company logo

senior data engineer

Hyderabad
Full-Time
Senior: 7 to 10 years
8L - 18L (Per Year)
Posted on Jan 18 2024

About the Job

Skills

Apache Spark:
python
Trino (formerly PrestoSQL
Trino architecture and optimization
Data Lakes
adf


1. Apache Spark:

 Extensive experience in designing, implementing, and optimizing Spark-based

data processing workflows.

 Strong knowledge of Spark's core concepts, RDDs, DataFrames, and Spark SQL.

 Ability to leverage Spark for large-scale data processing and analytics.

2. Python:

 Proficient in Python programming with a focus on data processing and

manipulation.

 Experience using Python libraries for data analysis, such as Pandas and NumPy.

 Familiarity with building and deploying Python-based data pipelines.

3. Trino:

 Hands-on experience with Trino (formerly PrestoSQL) for fast and scalable query

processing.

 Knowledge of Trino architecture and optimization techniques for efficient data

querying.

4. Presto:

 Previous exposure to Presto for distributed SQL queries on large datasets.

 Ability to design and implement Presto-based solutions for complex data access

requirements.

5. Data Lakes:

 Understanding of the principles and best practices for managing and utilizing

data lakes.

 Experience in working with data lakes for storing and retrieving diverse datasets.

About the company

Advitha Tech Solutions was established in 2018. Advitha Tech Solution is a leading global technology, Consulting companey. We enable clients in more than 5 countries to navigate their digital transformation. We are a team of professionals specialized in the fields of consulting, implementation and service delivery. Clients count on us to help them transform uncertainty to possibility.Advitha bring ...Show More

Industry

Staffing and Recruiting

Company Size

11-50 Employees

Headquarter

Hyderabad, Hyderabad

Other open jobs from Advitha Tech Solutions