Big Data Engineer

Card image cap
Big Data Engineer

LG Soft India

Bangalore INR 12 - 25 LPA Experience : 4 - 6 YRS. Openings: 2

Details:

 Skillsets required (Mandatory Skills):

  • Working knowledge in AWS platform and their key services, AWS Amplify, Lamda Functions, Dynamo DB, CF (Cloud Formation) templates, S3, Step Functions, Sagemaker, ECS (Elastic Container Service), EMR (Elastic Map Reduce),ECR, RDS (Relational Database Service), VPC (Virtual Private Cloud), Apache Airflow
  • Understand how to build scalable, real time, Big Data systems
  • Prior experience in understanding of Exploratory Big Data analysis, Big Data mining for inference and/or analytical algorithms
  • Experience with ETL (Extract, Transform, Load) , data warehousing and data mining.
  • Implement basic security and compliance aspects of the AWS platform and the shared security model & Define the billing, account management, and pricing models.
  • Working experience in Apache Spark, Hive
  • Programming: Python, Core Java, Boto3 Lib

Optional Skills:

  • Microsoft Azure, GCP (Google Cloud Platform) knowledge
  • AWS Certifications
  • Dockers, Kubernetics
  • Background and Experience in: Machine Learning, Data Mining, Mathematical and Statistical Modelling
  • React application knowledge

Min. Qualification:

Educational Qualifications: B.E/B.tech

Skills Required:

AWS Amplify, Lamda functions, Dynamo DB, AWS cerifications

Roles:

Skillsets required (Mandatory Skills):

  • Working knowledge in AWS platform and their key services, AWS Amplify, Lamda Functions, Dynamo DB, CF (Cloud Formation) templates, S3, Step Functions, Sagemaker, ECS (Elastic Container Service), EMR (Elastic Map Reduce),ECR, RDS (Relational Database Service), VPC (Virtual Private Cloud), Apache Airflow
  • Understand how to build scalable, real time, Big Data systems
  • Prior experience in understanding of Exploratory Big Data analysis, Big Data mining for inference and/or analytical algorithms
  • Experience with ETL (Extract, Transform, Load) , data warehousing and data mining.
  • Implement basic security and compliance aspects of the AWS platform and the shared security model & Define the billing, account management, and pricing models.
  • Working experience in Apache Spark, Hive
  • Programming: Python, Core Java, Boto3 Lib

Recommended Jobs

Card image cap
Data Science Intern - Analytics Vidhya - Gurgaon

Analytics Vidhya

Gurugram INR 1 - 2 LPA

What is the hiring process? Because, we got more than 1000 application, a simple process would not work anymore. So, there is a new format of selection: The first round will be technical skill assessment – and what could be more appropriate than our DataHack platform. This round would includ

See More
Card image cap
Intern- Data Analytics- Gurgaon (2-6 Months)

A Client of Analytics Vidhya

Gurugram INR 0 - 1 LPA

  The intern will be expected to work on the following Building a data pipe line of extracting data from multiple sources, and organize the data into a relational data warehouse. Build fact tables with measures and dimensions from granular data. Build Vizualizations  on Tableau. Sen

See More
Card image cap
Software Engineer – Machine Learning- Bangalore (3+ Years of Experience)

A Client of Analytics Vidhya

Bengaluru INR 3 - 10 LPA

Job Responsibilities:•Design & build machine learning algorithms to solve business problems using different techniques like clustering, recommendation, classification.•Develop statistical or machine-assisted approaches to problems at massive scale.•Build models to solve business problems such as

See More