Data Engineer - Python, PySpark, DBT @ Tata Consultancy

Home > Data Science & Machine Learning

Data Engineer - Python, PySpark, DBT

Tata Consultancy
5 - 10 years
Pune
6 days ago
Email to a friend
Report this job

Job Description

Role & responsibilities

Implementing data ingestion pipelines from different types of data sources i.e Databases, S3, Files etc..
Experience in building ETL/ Data Warehouse transformation process.
Experience working with structured and unstructured data.
Developing Big Data and non-Big Data cloud-based enterprise solutions in PySpark and SparkSQL and related frameworks/libraries,
Developing scalable and re-usable, self-service frameworks for data ingestion and processing,
Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data,
Processing performance analysis and optimization,
Bringing best practices in following areas: Design & Analysis, Automation (Pipelining, IaC), Testing, Monitoring, Documentation.

Good to have (Knowledge)1. Experience in cloud-based solutions,2. Knowledge of data management principles.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Data Science & Analytics
Role Category: Data Science & Machine Learning
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Tata Consultancy
Location(s): Pune

+ View Contact

Login

Candidates can login here to view contacts and apply.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach Resume Max 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Candidates are expected to provide most recent and accurate profile information, inappropriate content is strictly prohibited!

Keyskills: Data Build Tool Spark Python Pyspark SCALA SQL

Fraud Alert to job seekers!

₹ Not Disclosed

Job application

We will notify the employer with your details. You can also attach a resume or a cover letter.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach ResumeMax 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Similar positions

AI / ML Engineer

Accenture

7 - 12 years

Chennai

10 hours ago

₹ Not Disclosed

AI / ML Engineer

Accenture

2 - 5 years

Hyderabad

19 hours ago

₹ Not Disclosed

Data Science AIML & Gen AI

Cognizant

5 - 10 years

Bengaluru

20 hours ago

₹ Not Disclosed

Data Scientist-Advanced Analytics

IBM

3 - 7 years

Noida, Gurugram

21 hours ago

₹ Not Disclosed

Tata Consultancy

We are hiring Fulltime with TechMahindra for below mentioned Skills:\\\\n\\\\n1. Experience with Big Data Environment\\\\n\\\\n2. Hands on coding in Python, Spark, Hive\\\\n\\\\n3. Shell Scripting

Data Engineer - Python, PySpark, DBT @ Tata Consultancy

Home > Data Science & Machine Learning