Data Engineering
Data Engineering 7
Applications
7
Applications
About the Job
Skills
Job Description:
We are seeking a highly skilled, detail-oriented, and motivated Python DQ Automation Developer to
join our team. The ideal candidate will be responsible for designing, developing, and maintaining data
quality automation solutions using Python. This role requires a deep understanding of data quality
principles, proficiency in Python, and experience with data processing and analysis.
Key Responsibilities:
Design, develop, and implement data quality automation processes and solutions to identify,
measure, and improve data quality.
Write and optimize Python scripts and applications to support data quality initiatives.
Use Python libraries such as Pandas, NumPy, and PySpark for data manipulation and
processing.
Develop and enhance ETL processes to ensure accurate and timely data integration and
transformation.
Analyze data sets to identify data quality issues, trends, and anomalies, providing insights and
recommendations for improvement. Support manual DQ efforts as required.
Develop and execute test plans to validate the effectiveness of data quality solutions.
Maintain comprehensive documentation of data quality processes, procedures, and standards.
Work closely with data analysts, data engineers, DQ testers and other team members and
stakeholders to understand data requirements and deliver high-quality data solutions.
Required Skills:
Proficiency in Python and related libraries (Pandas, NumPy, PySpark, pyTest).
Experience with data quality tools and frameworks.
Strong understanding of ETL processes and data integration.
Familiarity with data governance and data management principles.
Excellent analytical and problem-solving skills with a keen attention to detail.
Strong verbal and written communication skills, with the ability to explain technical concepts to
non-technical stakeholders.
Ability to work effectively both independently and as part of a team.
Qualifications:
Bachelor’s degree in computer science or Information Technology. Advanced degree is a plus.
Minimum of 7 years of experience in data quality automation and Python Development.
About the company
Industry
Management Consulting
Company Size
201-500 Employees
Headquarter
Chennai, Tamilnadu
Other open jobs from Covenant Consultants