![company logo](/_next/image?url=https%3A%2F%2Fd1qx7guo221nxn.cloudfront.net%2Fkukulkan-in%2Flogo_XkMXauRk.png&w=128&q=75)
Big Data Engineer- Azure
![company logo](/_next/image?url=https%3A%2F%2Fd1qx7guo221nxn.cloudfront.net%2Fkukulkan-in%2Flogo_XkMXauRk.png&w=128&q=75)
Big Data Engineer- Azure25
Applications
25
Applications
Not Accepting Applications
About the Job
Skills
Skill Required
4 to 8 years of total IT experience with 2+ years in big data engineering and Microsoft Azure
• Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database
• A comprehensive foundation with working knowledge of Azure Full stack, Event Hub & Streaming Analytics.
• A passion for writing high-quality code and the code should be modular, scalable, and free of bugs (debugging skills in SQL, Python, or Scala/Java).
• Enthuse to collaborate with various stakeholders across the organization and take complete ownership of deliverables.
• Experience in using big data technologies like Hadoop, Spark, Databricks, Airflow, Kafka.
• Adept understanding of different file formats like Delta Lake, Avro, Parquet, JSON, and CSV. • Good knowledge of building and designing REST APIs with real-time experience working on Data Lake/Lakehouse projects.
• Experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner.
• Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE) are a valuable addition.
Responsibilities:
As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.
• Design and build scalable & metadata-driven data ingestion pipelines (For Batch and Streaming Datasets)
• Conceptualize and execute high-performance data processing for structured and unstructured data, and data harmonization.
• Schedule, orchestrate, and validate pipelines.
• Design exception handling and log monitoring for debugging
• Ideate with your peers to make tech stack and tools-related decisions.
• Interact and collaborate with multiple teams (Vendors/Consultants/Data Science & Dev team) and various stakeholders to meet deadlines, to bring Analytical Solutions to life.
• Should be able to understand complex architectures and be comfortable working with multiple teams.
• Delivery teams to build, automate, and deploy cloud solutions on Microsoft Azure • Monitor production, staging, test, and development environments for a myriad of applications in an agile and dynamic organization.
• Should be well-versed in Security Skills.
• Should have a Customer-Focused approach and understanding the problems.
• Proactiveness is must and self-driven.
Contact Details: 7094690436/hr2@kukulkan.in
About the company
Industry
Staffing and Recruiting
Company Size
2-10 Employees
Headquarter
Madurai
Other open jobs from Kukulkan Manpower Consultancy