company logo

Senior Data Engineer

Bangalore
Full-Time
Mid-Level: 5 to 8 years
Posted on Sep 20 2024

About the Job

Skills

IDQ Tool
Data Modeling
Data Warehousing
SQL
Python
Data Pipeline Development
Cloud Platforms
Extract, Transform, Load (ETL)

Roles and Responsibilities

  • Conduct data analysis and profiling using Informatica Data Quality (IDQ) tool to understand the structure, quality, and integrity of the data.
  • Collaborate with the data migration manager with project planning and status reporting on data profiling and cleansing activities. Overall adhere to the AX data clean up ways of working.
  • Collaborate with business stakeholders and data owners to interpret profiling results and understand data requirements and objectives.
  • Develop data quality rules & standards based on business requirements and industry best practices.
  • Document data quality processes, rules and standards for future reference and training purposes. Create and maintain source to target mappings.
  • Create DQ scorecard and reports to track and monitor data quality metrics over time.
  • Should have experience in Azure Synapse.


Create & Executing Data Cleansing Rules

  • Develop and maintain quality mappings, DQ rules, and workflow within informatica data quality environment.
  • Perform data profiling, cleansing, standardization, and matching using Informatica data quality transformations and functionalities.
  • Troubleshoot & resolve issues related to the tool.
  • Collaborate with Informatica SME to implement automated data quality checks and validations within data pipelines and workflows.


Testing

  • Develop and execute test plans and test cases to validate effectiveness of data quality rules and cleansing processes.
  • Conduct data validation and verification activities to ensure data quality improvements meet requirements.
  • Identify and address data quality issues and anomalies through root cause analysis and troubleshooting.
  • Prepare and present test results including defects and resolution status.


Rollout

  • Monitor data quality metrics and trends to identify areas for improvement and optimization.
  • Prepare weekly status reports on data quality activities status, continuously communicate with the data migration manager arising risks, issues, and contingency plan.
  • Work with the Informatica SME for troubleshooting technical issues related to using informatica data quality effectively for data profiling and cleansing purposes.


Desired Candidate Profile

Experience: 5 - 8 years

Location: Bangalore

Qualification: BE / M-Tech Engineering, BCA/ MCA, Any data related field

Schedule: Day Shift, Monday to Friday

Workplace Type: On-site (Work from Office)

Notice Period: Immediate

About the company

Nextbrain started its amazing journey in 2016 with a small team as an enterprise software development company. Since then, we have been offering end-to-end digital solutions across all business verticals worldwide. We have a great reputation of providing unique and customized business solutions tailored to meet the specific business needs. We have extended our remarkable services to more than 150 ...Show More

Industry

Information Technology & ...

Company Size

51-200 Employees

Headquarter

Bangalore

Other open jobs from Nextbrain Technologies Pvt Ltd