Job Description

Role: AWS Senior Data Engineer

About the Role:

We are seeking a data engineer to join our dynamic team and play a vital role in leveraging the power of AWS to extract valuable insights from our data.

In this role, you will be responsible for utilizing your expertise and knowledge of AWS services to transform raw data and ingest it into data warehouses and data lakes. You will work closely with the development team and would be responsible for providing quality code.

You also need both theoretical and practical idea about basic data science algorithms of Regressing, Clustering, Classification. Also, must have a clear idea about the applicability of those

Responsibilities:

• Read data from sources, transform and ingest data into Redshift using Python and SQL
• Working with different business units to understand requirements and collaborating with them to deliver data pipelines. Expected to also be able to design a new pipeline based on the requirements.
• Maintaining and creating new data pipelines using AWS Step functions
• Must be able to offer support with Machine Learning algorithms and model fine tuning.

Must have:

• 6+ yrs experience as a python developer
• 5+ yrs experience working with AWS cloud.
• 4+ yrs experience working with SQL
• A good understanding of basic data science algorithms, using libraries like Scikit-Learn, XGBoost
• 1+ yr experience working with data processing tools like numpy, pandas, dask.
• GIT
• Understanding of CI-CD pipelines

Good to have:

• Prior experience with AWS Redshift, AWS Cloudformation
• Prior experience with Docker
• Prior experience with MLFlow
• AWS Certifications

Qualifications:

• Bachelors degree in Computer Science, Computer Engineering.
• Atleast 6 years of experience as a developer.
• Proven experience with SQL.
• Experience working with cloud-based data platforms (AWS preferred).
• Excellent communication and collaboration skills.
• Problem-solving skills and a strong analytical mind.

What We Offer:

• The opportunity to work with cutting-edge technology and a world-class cloud platform.
• Be part of a team that is passionate about data and its potential to drive innovation.
• Work on challenging and impactful projects that contribute to the success of the company.
• Competitive salary and benefits package.
• Opportunity to learn and grow in a fast-paced and dynamic environment