Senior Data Engineer

Card image cap
Senior Data Engineer

Analytics Vidhya

Gurgaon INR 11 - 20 LPA Experience : 5 - 10 YRS. Openings: 1

Details:

  • Person with 5+ years of experience in Big Data and Data Engineering in companies dealing with huge datasets.
  • Prior experience with training will be an advantage.
  • Having experience in Data Engineering technologies like Apache Spark, HBase, Hadoop, MapReduce, HDFS, Hive, YARN, Kafka, Zookeeper, Java, Python and Scala
  • Experience with setting up and maintaining Datawarehouse (RedShift) and DataLakes for an Organization
  • Having deep experience in one of the Cloud providers - Azure or AWS.
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra / MongoDB.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Having good understanding of machine learning landscape and concepts
  • Have Ability to quickly grasp new technologies and products and create training programs to increase adoption
  • Have ability to translate technical content into videos, tutorials, online courses
  • Strong problem solving and communication skills (English).

Min. Qualification:

  • Person with 5+ years of experience in Big Data and Data Engineering in companies dealing with huge datasets.
  • Prior experience with training will be an advantage.

Skills Required:

Spark, Kafka, Azure, Python, AWS

Roles:

  • Defining and leading our strategy in making data engineering skills accessible for our community members
  • Continuously learning new tools in Data Engineering and evangelizing them within our community
  • Delivering and creating content for offline and online workshops
  • Set up Data Engineering labs for Analytics Vidhya
  • Leading industry events, meetups and webinars
  • Develop custom data models and algorithms to apply to real life use cases

Recommended Jobs

Card image cap
Data Science Intern - Analytics Vidhya - Gurgaon

Analytics Vidhya

Gurugram INR 1 - 2 LPA

What is the hiring process? Because, we got more than 1000 application, a simple process would not work anymore. So, there is a new format of selection: The first round will be technical skill assessment – and what could be more appropriate than our DataHack platform. This round would includ

See More
Card image cap
Intern- Data Analytics- Gurgaon (2-6 Months)

A Client of Analytics Vidhya

Gurugram INR 0 - 1 LPA

  The intern will be expected to work on the following Building a data pipe line of extracting data from multiple sources, and organize the data into a relational data warehouse. Build fact tables with measures and dimensions from granular data. Build Vizualizations  on Tableau. Sen

See More
Card image cap
Software Engineer – Machine Learning- Bangalore (3+ Years of Experience)

A Client of Analytics Vidhya

Bengaluru INR 3 - 10 LPA

Job Responsibilities:•Design & build machine learning algorithms to solve business problems using different techniques like clustering, recommendation, classification.•Develop statistical or machine-assisted approaches to problems at massive scale.•Build models to solve business problems such as

See More