Big Data Engineer- Bangalore (2 to 3 years of experience)

Card image cap
Big Data Engineer- Bangalore (2 to 3 years of experience)


Bengaluru INR 10 - 15 LPA Experience : 2 - 3 YRS. Openings: 1


Relevant Experience (In Years) :

1. Minimum 2 years of strong experience on Core Java, Hadoop ecosystem and any NoSQL Database.

2. Minimum 1.5 or 2 Years of strong experience on Spark/Storm/Cassandr/Kafka/Scala.

Technical/Functional Skills :

1. Core Java, Multi-Threading, OOPS, Writing Parsers

2. Hadoop/Hive/Pig/MapReduce

3. Spark/Storm/Kafka/Scala/Cassandra

4. SQL

5. Cloud Computing(AWS/Azure etc)

Roles & Responsibilities:

1. Strong on Core Java, Multi-Threading, OOPS Concept, writing parsers in Core Java

2. Should have strong knowledge on Hadoop ecosystem such as Hive/Pig/MapReduce

3. Strong in SQL, NoSQL, RDBMS and Data warehousing concepts

4. Writing complex MapReduce programs

5. Should have strong experience on pipeline building such Spark or Storm or Cassandra or Scala.

6. Designing efficient and robust ETL workflows

7. Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).

8. Tuning Hadoop solutions to improve performance and end-user experience;

9. Processing unstructured data into a form suitable for analysis - and then do the analysis.

10. Creating Big Data reference architecture deliverable

11. Performance optimization in a Big Data environment

Generic Leadership Skills:

1. Should have prior customer facing experience.

2. Ability to lead all requirement gathering sessions with the Customer

3. Strong co-ordination and interpersonal skills to handle complex projects.

Min. Qualification:


Skills Required:

bigdata, Cloud Computing, Data Warehouse, etl, hadoop, hive, java, mapreduce, pig, RDBMS, Scala, spark, sql, storm

Recommended Jobs

Card image cap
Data Science Intern - Analytics Vidhya - Gurgaon

Analytics Vidhya

Gurugram INR 1 - 2 LPA

What is the hiring process? Because, we got more than 1000 application, a simple process would not work anymore. So, there is a new format of selection: The first round will be technical skill assessment – and what could be more appropriate than our DataHack platform. This round would includ

See More
Card image cap
Intern- Data Analytics- Gurgaon (2-6 Months)

A Client of Analytics Vidhya

Gurugram INR 0 - 1 LPA

  The intern will be expected to work on the following Building a data pipe line of extracting data from multiple sources, and organize the data into a relational data warehouse. Build fact tables with measures and dimensions from granular data. Build Vizualizations  on Tableau. Sen

See More
Card image cap
Software Engineer – Machine Learning- Bangalore (3+ Years of Experience)

A Client of Analytics Vidhya

Bengaluru INR 3 - 10 LPA

Job Responsibilities:•Design & build machine learning algorithms to solve business problems using different techniques like clustering, recommendation, classification.•Develop statistical or machine-assisted approaches to problems at massive scale.•Build models to solve business problems such as

See More