Data Engineer

Short Description

Analytics Vidhya is seeking an experienced Big Data Engineer with vast experience in collecting, storing, processing and analyzing huge sets of data. The primary focus will be on creating ways to share this knowledge.

Job Description

Responsibilities:
Creating Tutorials, hackathons, challenges and open training for our community members.
 
Skills and Qualifications:
  • Proficient understanding of distributed computing principles.
  • Management of Hadoop cluster, with all included services.
  • Proficiency with Hadoop v2, MapReduce, HDFS.
  • Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming.
  • Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala.
  • Experience with Spark.
  • Experience with integration of data from multiple data sources.
  • Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.
  • Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O would be beneficial.
  • Good understanding of Lambda Architecture, along with its advantages and drawbacks.
  • Experience with Cloudera/MapR/Hortonworks.

Data Engineer
Mid-Senior-level Information | Technology | Information Technology Full-time Information Technology | Engineering | Other Data Engineer
Analytics Vidhya is a Passionate Community for Analytics / Data Science Professionals, and aims at Bringing Together Influencers and Learners to Augment Knowledge. People can freely share their thoughts, ideas and experiences.

This platform allows people to know more about analytics from its articles, Q&A forum, and learning paths. Also, we help professionals & amateurs to sharpen their skillsets by providing a platform to participate in Hackathons. Our viewers remain updated with the latest happenings around the world of analytics using our monthly newsletters. Stay in touch with us to be a perfect and informative data practitioner. www.analyticsvidhya.com