Bangalore
Hyderabad
Pune
Hybrid
Full-Time
Mid-Level: 3 to 8 years
Posted on Mar 11 2025

Text Copied!

Share
Report
Website

About the Job

Skills

Python
SQL
aws
azure
PySpark
Data Structures

We are seeking a skilled and motivated Data Engineer with experience in Python, SQL, Azure, and cloud-based technologies to join our dynamic team. The ideal candidate will have a solid background in building and optimizing data pipelines, working with cloud platforms, and leveraging modern data engineering tools like Airflow, PySpark, and Azure Data Engineering. If you are passionate about data and looking for an opportunity to work on cutting-edge technologies, this role is for you


Key Responsibilities:

  • Design, develop, and optimize data pipelines using Python, SQL, and PySpark.
  • Collaborate with cross-functional teams to gather and understand data requirements.
  • Implement and maintain data workflows using Apache Airflow and Azure Data Factory.
  • Design and implement cloud-based data solutions in Microsoft Azure, ensuring scalability, performance, and security.
  • Write efficient, scalable, and reusable Python code for data processing tasks.
  • Work with large datasets, ensuring data is transformed, stored, and processed effectively.
  • Utilize Azure services such as Azure Data Lake, Azure SQL Database, Azure Synapse, and Azure Databricks to build robust data solutions.
  • Troubleshoot and resolve any issues with data pipelines and data flow across systems.
  • Ensure high-quality standards for data management, integrity, and security.
  • Stay up-to-date with the latest data engineering trends and technologies in the Azure cloud environment.


Key Skills & Qualifications:

  • Experience: 3-7 years of experience as a Data Engineer or related role.
  • Programming: Proficiency in Python for data processing and automation tasks.
  • SQL: Strong experience writing complex SQL queries for data manipulation and analysis.
  • Cloud Technologies: Experience with Azure Cloud and services like Azure Data Lake, Azure SQL Database, Azure Synapse, Azure Databricks.
  • Data Engineering Tools: Hands-on experience with Apache Airflow for orchestrating workflows and scheduling tasks.
  • Big Data: Familiarity with PySpark for distributed data processing.
  • Problem Solving: Strong analytical skills and the ability to troubleshoot data engineering challenges.
  • Collaboration: Excellent communication skills and ability to work effectively in a team-oriented environment.


About the company

Being one of the top staffing consultancy firms in Bangalore, VidPro provides manpower solutions to both IT and non-IT sectors. We have a track record of sourcing top talent for several startups PAN India and ensuring exceptional customer experience of all our clients. Our mission is to support our clients business objectives through continuous talent enhancement and skill augmentation. Our vision ...Show More

Industry

Human Resources Services

Company Size

11-50 Employees

Headquarter

Bengaluru

Other open jobs from VidPro Consultancy Services

Azure Data Engineer

VidPro Consultancy Services

Python
Airflow
Azure
ETL Tools

+4 More Skills

We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. You will be responsible for designing, implementing, and maintaining data pipelines to support our organization's data infrastructure and analytics initiatives. You will collaborate closely with data scientists, analysts, and other stakeholders to ensure the seamless flow of data across various systems and platforms.
Mandatory Skills: Python, Pyspark, SQL, Data Structures, A

Bangalore Urban
Full-Time
Junior: 3 to 5 years
₹ 8L - ₹ 25L (Per Year)

Posted on March 10 2025

Big Data Developer

VidPro Consultancy Services

Python
SQL
AWS
Django

+4 More Skills

Python, pyspark, SQL, DSA, AWS, Hadoop, Hive, Mapreduce and Spark

Bangalore Urban
Full-Time
Mid-Level: 4 to 6 years
₹ 17L - ₹ 20L (Per Year)

Posted on March 07 2025

Data Engineer (Azure + AWS)

VidPro Consultancy Services

SQL
Python
Databricks
Azure Data Factory

+4 More Skills

About the Role: SDE 1/SDE 2
We are seeking a highly skilled and motivated Data Engineer to join our dynamic team.

Bangalore Urban
Full-Time
Junior: 3 to 5 years
₹ 15L - ₹ 20L (Per Year)

Posted on March 11 2025

Data Engineer

VidPro Consultancy Services

Python
sql
PySpark
Azure Databricks

+4 More Skills

Required Skills:
● Proficiency in Python programming language for data manipulation and pipeline development.

Bangalore Urban
Full-Time
Junior: 3 to 5 years
₹ 15L - ₹ 20L (Per Year)

Posted on March 11 2025

Big Data Engineer (AWS)

VidPro Consultancy Services

Python
PySpark
databricks
Amazon Redshift

+4 More Skills

Role : Big Data Engineer
Location : Bangalore

Bangalore Urban
Full-Time
Junior: 3 to 5 years

Posted on March 10 2025

Powered By