Data Engineering (Python)

Job Description:

We are seeking a highly skilled, detail-oriented, and motivated Python DQ Automation Developer to

join our team. The ideal candidate will be responsible for designing, developing, and maintaining data

quality automation solutions using Python. This role requires a deep understanding of data quality

principles, proficiency in Python, and experience with data processing and analysis.

Key Responsibilities:

 Design, develop, and implement data quality automation processes and solutions to identify,

measure, and improve data quality.

 Write and optimize Python scripts and applications to support data quality initiatives.

 Use Python libraries such as Pandas, NumPy, and PySpark for data manipulation and

processing.

 Develop and enhance ETL processes to ensure accurate and timely data integration and

transformation.

 Analyze data sets to identify data quality issues, trends, and anomalies, providing insights and

recommendations for improvement. Support manual DQ efforts as required.

 Develop and execute test plans to validate the effectiveness of data quality solutions.

 Maintain comprehensive documentation of data quality processes, procedures, and standards.

 Work closely with data analysts, data engineers, DQ testers and other team members and

stakeholders to understand data requirements and deliver high-quality data solutions.

Required Skills:

 Proficiency in Python and related libraries (Pandas, NumPy, PySpark, pyTest).

 Experience with data quality tools and frameworks.

 Strong understanding of ETL processes and data integration.

 Familiarity with data governance and data management principles.

 Excellent analytical and problem-solving skills with a keen attention to detail.

 Strong verbal and written communication skills, with the ability to explain technical concepts to

non-technical stakeholders.

 Ability to work effectively both independently and as part of a team.

Qualifications:

 Bachelor’s degree in computer science or Information Technology. Advanced degree is a plus.

 Minimum of 7 years of experience in data quality automation and Python Development.

 Proven experience with Python libraries for data processing and analysis