company logo

Data Engineer in Global Analytical Company

Bangalore
Chennai
Kolkata
Gurgaon
Pune
Full-Time
Mid-Level: 5 to 12 years
Posted on Nov 09 2024

About the Job

Skills

Snowflake
SQL
Azure Data Factory
Azure Databricks
azure
pyspark

Hiring Alert !! For the Global Analytical Company !!

Title : Data Engineer

Exp : 5+ Years

Location : Bangalore/Chennai/Pune/Kolkata/Gurgaon


Job Title: Data Engineer Primary Roles and Responsibilities:

  • Developing Modern Data Warehouse solutions using Snowflake, Databricks and ADF.
  • Ability to provide solutions that are forward-thinking in data engineering and analytics space
  • Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
  • Triage issues to find gaps in existing pipelines and fix the issues
  • Work with business to understand the need in the reporting layer and develop a data model to fulfill reporting needs
  • Help joiner team members to resolve issues and technical challenges.
  • Drive technical discussions with client architect and team members
  • Orchestrate the data pipelines in the scheduler via Airflow

Skills and Qualifications:

  • Bachelor's and/or master’s degree in computer science or equivalent experience.
  • Must have total 3+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
  • Expertise in Snowflake security, Snowflake SQL and designing/implementing other Snowflake objects.
  • Hands-on experience with Snowflake utilities, SnowSQL, Snowpipe, Snowsight and Snowflake connectors.
  • Deep understanding of Star and Snowflake dimensional modeling.
  • Strong knowledge of Data Management principles
  • Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
  • Should have hands-on experience in SQL and Spark (PySpark)
  • Experience in building ETL / data warehouse transformation processes
  • Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
  • Experience working with structured and unstructured data including imaging & geospatial data.
  • Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
  • Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning, troubleshooting and Query Optimization.
  • Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
  • Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
  • Should have experience working in Agile methodology
  • Strong verbal and written communication skills.
  • Strong analytical and problem-solving skills with a high attention to detail.

Mandatory Skills: Snowflake/Azure Data Factory/ PySpark / Databricks

About the company

Covenant is a premier Executive Search and Recruitment Firm with 350+ Full-Time Recruitment Specialists with a proven track record of strong delivery across the globe. We are specialists in the arena of Human Capital unmatched in all metrics Head Hunting, Turnaround Time, Unceasing Availability, Cost-Effectiveness, Steadfast Quality of Service - provided by a team of Principal Consultants and Ana ...Show More

Industry

Management Consulting

Company Size

201-500 Employees

Headquarter

Chennai, Tamilnadu

Other open jobs from Covenant Consultants