Urgent Requirements - Big Data Engineers (6-nos).

Experience: 3 to 4 years

Job Type: Permanent Role

Job Location : Chennai / Remote

Note: immediate joiners will be preferred

If you interested Send CV to: itjobs@talentbrothers.com

Job Description:

We are Looking for Big Data Developers that will work on the collecting, storing, processing, and analyzing of huge sets of data. The Data Developers must also have exceptional analytical skills, showing fluency in the use of tools such as MySQL and strong Python, Shell, Java, PHP, and T-SQL programming skills. The candidate must also be technologically adept, demonstrating strong computer skills. Additionally, you must be capable of developing databases using SSIS packages, T-SQL, MSSQL, and MySQL scripts.

The candidate will also have an ability to design, build, and maintain the business’s ETL pipeline and data warehouse. The candidate will also demonstrate expertise in data modeling and query performance tuning on SQL Server, MySQL, Redshift, Postgres or similar platforms.

Key responsibilities will include:

Develop and maintain data pipelines

Design and implement ETL processes

Hands on experience on Data Modeling – Design conceptual, logical and physical data models with type 1 and type2 dimensions.

Knowledge to move the ETL code base from On-premise to Cloud Architecture

Understanding data lineage and governance for different data sources

Maintaining clean and consistent access to all our data sources

Hands on experience to deploy the code using CI/CD pipelines

Assemble large and complex data sets strategically to meet business requirements

Enable business users to bring data-driven insights into their business decisions through reports and dashboards

Required Qualifications:

Hands on experience in big data technologies including Scala or Spark (Azure Data bricks preferable), Hadoop, Hive, HDFS.

Python, Java & SQL

Knowledge of Microsoft’s Azure Cloud

Experience and commitment to development and testing best practices.

DevOps experience with continuous integration/delivery best-practices, technologies and tools.

Experienced deploying Azure SQL Database, Azure Data Factory and well-acquainted with other Azure services including Azure Data Lake and Azure ML

Experience implementing REST API calls and authentication

Experienced working with agile project management methodologies

Computer Science Degree/Diploma

Microsoft Certified: DP203 - Azure Data Engineer Associate.

#Spark #Scala # Python #AzureDataFactory #AzureSQLDatabase # Azuredatabricks