company logo

Big Data Engineer

Noida
Hybrid
Mid-Level: 5 to 10 years
Posted on Feb 14 2025

About the Job

Skills

python
spark
Apache Spark
Hadoop
NoSQL Databases
Python
Scala
MLOps pipeline

Basic Qualifications:

· Bachelor’s degree or higher in Computer Science, or equivalent degree and 3-10 years related working experience.

· In-depth experience with a big data cloud platform, preferably Azure.

· Strong grasp of programming languages (Python, PySpark, or equivalent) and a willingness to learn new ones.

· Experience writing database-heavy services or APIs.

· Experience building and optimizing data pipelines, architectures, and data sets. 

· Working knowledge of queueing, stream processing, and highly scalable data stores 

· Experience working with and supporting cross-functional teams.

· Strong understanding of structuring code for testability.

 

Preferred Qualifications:

· Professional experience implementing and maintaining MLOps pipelines in MLflow or AzureML.

· Professional experience implementing data ingestion pipelines using Data Factory.

· Professional experience with Databricks and coding with notebooks.

· Professional experience processing and manipulating data using SQL and Python code.

· Professional experience with user training, customer support, and coordination with cross-functional teams.


About the company

We are a staffing expert company with options to hire on C2H, Contract or Perm positions. We offer our clients to achieve their business goals with successfully outsourcing the business processes and functionalities. Our ability to offer high quality services in quick time makes us sustainable among the competitors. We believe in giving custom-fit, flexible and high quality solutions by deeply ...Show More

Industry

Staffing and Recruiting

Company Size

2-10 Employees

Headquarter

Bangalore

Other open jobs from Kiash Solutions LLP