Chennai
Bangalore
Hyderabad
Pune
Kolkata
Gurgaon
Delhi
Full-Time
Mid-Level: 3 to 14 years
Posted on Nov 09 2024

About the Job

Skills

Azure Datafactory
Snowflake
spark
Pyspark
Python
Sql

Company Overview

Hiring for a global analytics services and solutions company. We are one of the fastest growing private companies in the country for three straight years according to the Inc. 5000 and we continue to set ourselves apart from our competitors by attracting the greatest talent in the data analytics and data science space. Our capabilities range from Data Visualization, Data Management to Advanced analytics, Big Data and Machine Learning. Our uniqueness is in building Scalable Big Data Solutions on Onprem/GCP/Azure cloud in a very cost effective and easily scalable manner for our clients. We also come in with some strong IP and pre-built analytics solutions in data mining, BI and Big Data. 


Job Overview

We are seeking a mid-level Software Engineer for a full-time position located in Chennai, Bangalore, Hyderabad, Pune, Kolkata, Gurgaon, and Delhi. You will be integral to our client projects, leveraging advanced technical skills to drive innovation and solutions. The ideal candidate will have a strong background in Azure Datafactory and Snowflake, as well as proficiency in Spark, Pyspark, Python, and SQL.


Qualifications and Skills

  • Proficiency in Azure Datafactory (Mandatory skill) to design, deploy, and manage data flow efficiently.
  • Experience with Snowflake (Mandatory skill) for building scalable data solutions and managing large datasets.
  • Strong programming skills in Python with the ability to write efficient, scalable, and maintainable code.
  • Deep understanding of SQL for data extraction, analysis, and reporting across complex datasets.
  • Hands-on experience with Spark for processing large volumes of data quickly and effectively.
  • Knowledge of Pyspark to enhance the capabilities of Spark with easy integration and accessibility.
  • Solid problem-solving skills with the ability to troubleshoot and optimize data workflows and processes.
  • Excellent communication and teamwork abilities for collaborating with multi-disciplinary engineering teams.


Roles and Responsibilities

  • Design and implement data architectures and pipelines using Azure Datafactory to meet business requirements.
  • Develop robust data solutions on Snowflake ensuring data is accessible and consumable by data teams.
  • Collaborate with cross-functional teams to integrate data systems and support business intelligence initiatives.
  • Optimize data processing frameworks using Spark and Pyspark for performance and scalability.
  • Write efficient and maintainable Python scripts to automate data processing and transformation tasks.
  • Conduct comprehensive data validation and quality checks to ensure data integrity and accuracy.
  • Participate in code reviews to ensure code quality and adherence to best practices in data engineering.
  • Contribute to the continuous improvement of processes and methodologies within the engineering team.

About the company

Covenant is a premier Executive Search and Recruitment Firm with 350+ Full-Time Recruitment Specialists with a proven track record of strong delivery across the globe. We are specialists in the arena of Human Capital unmatched in all metrics Head Hunting, Turnaround Time, Unceasing Availability, Cost-Effectiveness, Steadfast Quality of Service - provided by a team of Principal Consultants and Ana ...Show More

Industry

Management Consulting

Company Size

201-500 Employees

Headquarter

Chennai, Tamilnadu

Other open jobs from Covenant Consultants