Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Data Engineer - Python, PySpark, DBT @ Tata Consultancy

Home > Data Science & Machine Learning






Tata Consultancy  Data Engineer - Python, PySpark, DBT

Job Description

Role & responsibilities

  • Implementing data ingestion pipelines from different types of data sources i.e Databases, S3, Files etc..
  • Experience in building ETL/ Data Warehouse transformation process.
  • Experience working with structured and unstructured data.
  • Developing Big Data and non-Big Data cloud-based enterprise solutions in PySpark and SparkSQL and related frameworks/libraries,
  • Developing scalable and re-usable, self-service frameworks for data ingestion and processing,
  • Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data,
  • Processing performance analysis and optimization,
  • Bringing best practices in following areas: Design & Analysis, Automation (Pipelining, IaC), Testing, Monitoring, Documentation.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Data Science & Analytics
Role Category: Data Science & Machine Learning
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Tata Consultancy
Location(s): Pune

+ View Contactajax loader


Keyskills:   Pyspark Data Build Tool Python Data Engineering

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Data Scientist

  • Capgemini
  • 3 - 15 years
  • Hyderabad
  • 2 hours ago
₹ Not Disclosed

Data Scientist

  • HCLTech
  • 7 - 10 years
  • Hyderabad
  • 4 days ago
₹ Not Disclosed

Data Scientist-Artificial Intelligence

  • IBM
  • 3 - 7 years
  • Bengaluru
  • 4 days ago
₹ Not Disclosed

Data Scientist-Artificial Intelligence

  • IBM
  • 8 - 9 years
  • Pune
  • 13 days ago
₹ Not Disclosed

Tata Consultancy

Genus Healthcare Solution has been a part of the US & Indian healthcare industry circuit solidifying its position now for close to two decades.\n\nWe are emerging as a competent contender in (BPM) Business Process Management offering services in verticals like Medical Billing, Coding et al; desi...