Job Title: Azure Data Factory (ADF) Developer

Job Summary:

We are seeking an Azure Data Factory Developer with 2+ years of experience in designing, developing, and deploying data integration and ETL solutions using Azure Data Factory. The ideal candidate will play a key role in implementing data pipelines, orchestrating data workflows, and transforming data across various sources and destinations within the Azure ecosystem.

Key Responsibilities:

• Data Integration and ETL Development: Design, develop, and deploy data integration solutions using Azure Data Factory pipelines to extract, transform, and load data from diverse sources into Azure services.
• Orchestration and Workflow Management: Create and manage data workflows, schedule data processing jobs, and monitor execution using Azure Data Factory monitoring tools.
• Data Transformation and Mapping: Implement data transformations, mappings, and data cleansing activities within Azure Data Factory using ADF Mapping Data Flows or other transformation tools.
• Integration with Azure Services: Integrate Azure Data Factory with other Azure services like Azure SQL Database, Azure Blob Storage, Azure Data Lake Storage, etc., to build comprehensive data solutions.
• Performance Optimization: Optimize data pipelines for performance, scalability, and reliability, ensuring efficient data processing and data quality.
• Troubleshooting and Maintenance: Identify and resolve issues, perform routine maintenance, and ensure the stability of Azure Data Factory environments.

Key Skills and Qualifications:

• Azure Data Factory (ADF): Hands-on experience in designing and developing data pipelines using Azure Data Factory v2 or later.
• ETL Concepts: Understanding of ETL principles, data integration, data transformation, and data movement methodologies.
• Azure Services: Familiarity with various Azure services like Azure SQL Database, Azure Blob Storage, Azure Data Lake Storage, etc., and their integration with Azure Data Factory.
• SQL and Data Querying: Proficiency in SQL querying and data manipulation to support data transformations and data processing tasks.
• Scripting and Automation: Knowledge of PowerShell, Python, or other scripting languages for automating ADF workflows or activities.
• Data Modeling (Optional): Understanding of data modeling concepts and practices to facilitate effective data transformations.
• Troubleshooting Skills: Ability to diagnose and resolve issues related to data pipelines, data transformations, and workflow orchestration within Azure Data Factory.

Preferred Qualifications:

• Microsoft Certifications: Azure Data Factory-related certifications like DP-203: Data Engineering on Microsoft Azure or DP-200: Implementing an Azure Data Solution.