AWS Data Engineer- Job Description.

Requirement Name-Aws Data Engineer

Experience-7+ years

Location-Remote

Salary-50000/- Per month

Duration-3 months contract which could be extended

AWS Data Engineer

∙ Requirements

∙ Collaborate with business analysts to understand and gather requirements for existing or

new ETL pipelines.

∙ Connect with stakeholders daily to discuss project progress and updates.

∙ Work within an Agile process to deliver projects in a timely and efficient manner.

∙ Have worked extensively on Redshift and understands performance tuning techniques and management of Redshift data workloads.

∙ Design and develop Airflow DAGs to schedule and manage ETL workflows.

∙ Implement best practices for data engineering, including data modeling, data warehousing,

and data pipeline architecture.

∙ Monitor and troubleshoot ETL pipelines to ensure smooth operation. ∙ Custom Python functions to handle data quality and validation.

∙ Should have good understanding on S3,Cloud Formation, Cloud Watch, Service Catalog and IAM Roles

∙ Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes.

∙ Should have good knowledge about Tableau, with creating Tableau Published Datasets and managing access.

∙ Write PySpark scripts to process data and perform transformations.(Good to have) ∙ Run Spark jobs on AWS EMR cluster using Airflow DAGs.(Good to have)

∙ Min 7 + years of experience

Contact-9970820671

Please send cv on -hr@wehirectrecruitments.com

Please send cv on -hr@wehirectrecruitments.com