Data Engineer

Card image cap
Data Engineer

Precily R&D Private Limited

New Delhi INR 7 - 10 LPA Experience : 2 - 5 YRS. Openings: 1

Details:

  • Fluency in more than one programming language (Python, R, C++, Java, Scala).
  • Should be proficient in Data Cleaning, Bucketing, Blending and managing multiple phases of Unstructured to Structured Data development environment.
  • Experience with relational SQL and NoSQL databases, including Postgres and Cassandra, MongoDB, Redis
  • Production level experience of Elasticsearch / Solr / Lucene.
  • Working knowledge of message queuing, stream processing, and highly scalable big data' data stores.
  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with systems: Apache Storm, Spark-Streaming,Apache Gobblin, Apache NiFi.

Min. Qualification:

  • 2- 4 year professional working experience
  • Strong communication and interpersonal skills

Skills Required:

Mongodb, Apache Strom, Azkaban, Elasticsearch, Python

Roles:

  • Identify, analyze and interpret patterns from data sets.
  • Write efficient code to automate, analyze and structure data.
  • Analyzing results using statistical techniques.
  • Create and maintain optimal and robust data pipeline architecture.
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
  • Partner with Data Science and Engineering teams to solve problems and identify trends and opportunities.

Recommended Jobs

Card image cap
Data Science Intern - Analytics Vidhya - Gurgaon

Analytics Vidhya

Gurugram INR 1 - 2 LPA

What is the hiring process? Because, we got more than 1000 application, a simple process would not work anymore. So, there is a new format of selection: The first round will be technical skill assessment – and what could be more appropriate than our DataHack platform. This round would includ

See More
Card image cap
Intern- Data Analytics- Gurgaon (2-6 Months)

A Client of Analytics Vidhya

Gurugram INR 0 - 1 LPA

  The intern will be expected to work on the following Building a data pipe line of extracting data from multiple sources, and organize the data into a relational data warehouse. Build fact tables with measures and dimensions from granular data. Build Vizualizations  on Tableau. Sen

See More
Card image cap
Software Engineer – Machine Learning- Bangalore (3+ Years of Experience)

A Client of Analytics Vidhya

Bengaluru INR 3 - 10 LPA

Job Responsibilities:•Design & build machine learning algorithms to solve business problems using different techniques like clustering, recommendation, classification.•Develop statistical or machine-assisted approaches to problems at massive scale.•Build models to solve business problems such as

See More