Senior Python Engineer - PySpark Developer, Machine Learning

Card image cap
Senior Python Engineer - PySpark Developer, Machine Learning

Hexaconcepts (India) Pvt. Ltd.

Bangalore INR 10 - 15 LPA Experience : 4 - 8 YRS. Openings: 5


The Client
They are the first and currently the only player, in the predictive engine-based self-service analytics product space for end business users. They have created the world’s first virtual data scientist, a product capable of understanding plain English queries from user, and autonomously being able to take decisions ranging from data selection to algorithm selection and finally visualisation and narratives, without any human intervention. And now they are embarking on bringing explainable component to our AI based solutions, to make the business decisions simpler, easier and adaptable to larger stakeholders.

Position: Senior Python Engineer - PySpark Developer, Machine Learning
Relevant Experience: 4yr - 6yr
Location : Bangalore
Joining: Immediate to 30 days (If your time to join is >30 days, resume may not be considered)

Min. Qualification:

Key skills (Must Have): PySpark, DASK, NoSQL, Docker, Machine Learning, Neural Network

a) 4+ years of experience in Object Oriented Python programming, PySpark
b) Strong experience in Distributed Processing (Cluster experience and Spark Job Deployment on cloud)
c) Experience in SQL and at least one NoSQL data store Elasticsearch, MongoDB, Cassandra, HBase
d) Experience in data processing services, Data pipeline/Glue, Lambda, ADF, Airflow
e) Experience with containerizing applications using Docker
f) Good in data analysis libraries Pandas, Numpy, Dask
g) Experience in Machine Learning libraries Scikit-learn, StatsModels, Spark ML
h) Knowledge in Deep Learning and Neural Network frameworks like PyTorch, Keras, TensorFlow

Skills Required:

PySpark, DASK, NoSQL, Docker, Machine Learning


  • Build robust Machine Learning pipeline along with Data Engineer, Data Scientist
  • Integrate, optimize and maintain the machine learning models developed by the Data Scientist
  • Deployment, monitoring in staging, production pipelines
  • Apply generalization techniques for productization of the code to be used for different customers

Recommended Jobs

Card image cap
Data Science Intern - Analytics Vidhya - Gurgaon

Analytics Vidhya

Gurugram INR 1 - 2 LPA

What is the hiring process? Because, we got more than 1000 application, a simple process would not work anymore. So, there is a new format of selection: The first round will be technical skill assessment – and what could be more appropriate than our DataHack platform. This round would includ

See More
Card image cap
Intern- Data Analytics- Gurgaon (2-6 Months)

A Client of Analytics Vidhya

Gurugram INR 0 - 1 LPA

  The intern will be expected to work on the following Building a data pipe line of extracting data from multiple sources, and organize the data into a relational data warehouse. Build fact tables with measures and dimensions from granular data. Build Vizualizations  on Tableau. Sen

See More
Card image cap
Software Engineer – Machine Learning- Bangalore (3+ Years of Experience)

A Client of Analytics Vidhya

Bengaluru INR 3 - 10 LPA

Job Responsibilities:•Design & build machine learning algorithms to solve business problems using different techniques like clustering, recommendation, classification.•Develop statistical or machine-assisted approaches to problems at massive scale.•Build models to solve business problems such as

See More