Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Big Data Engineer (PySpark & Apache) @ Tummala Sai Venkata

Home >

 Big Data Engineer (PySpark & Apache)

Job Description

    As a Big Data Engineer specializing in PySpark and Apache Iceberg, your main responsibility will be designing and implementing scalable data pipelines. You will be tasked with handling large datasets, optimizing data workflows, and ensuring the quality and reliability of the data processed. Your key responsibilities will include designing, developing, and maintaining big data pipelines using PySpark and Apache Iceberg. Additionally, you will need to optimize data workflows for improved performance and scalability, implement data transformation, cleansing, and enrichment processes, collaborate with data scientists and analysts to deliver actionable insights, ensure data quality, consistency, and security across all pipelines, as well as monitor and troubleshoot data pipeline issues in production. To excel in this role, you should have a minimum of 8 years of experience working with PySpark and Apache Iceberg, proficiency in distributed data processing and big data technologies, knowledge of data modeling and schema design, familiarity with cloud platforms such as AWS, Azure, or GCP, and experience with version control tools like Git. Ideally, you should possess a Bachelor's degree or University degree in a relevant field, or equivalent experience. This job description covers a broad overview of your responsibilities, and additional duties related to the role may be assigned as necessary. Please note that this job falls under the Technology category within the Applications Development job family, and it is a full-time position. For further details on the most relevant skills required, refer to the requirements listed above. If you have any questions regarding complementary skills needed for this position, feel free to reach out to the recruiter. If you require a reasonable accommodation due to a disability when using our search tools or applying for a career opportunity, please review the Accessibility at Citi guidelines. Additionally, you can view Citi's EEO Policy Statement and the Know Your Rights poster for more information.,

Employement Category:

Employement Type: Full time
Industry: IT Services & Consulting
Role Category: Not Specified
Functional Area: Not Specified
Role/Responsibilies: Big Data Engineer (PySpark & Apache)

Contact Details:

Company: Early Career
Location(s): Chennai

+ View Contactajax loader


Keyskills:   data modeling AWS Azure GCP version control tools Git schema design

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Supply Chain Analytics & Planner

  • Dhanvantarilokasiri
  • 1 to 5 Yrs
  • All India
  • 6 days ago
₹ Not Disclosed

Food & Beverage Trainer

  • DMart
  • 1 to 5 Yrs
  • 6 days ago
₹ Not Disclosed

AI Engineer

  • The Professionals
  • 8 to 12 Yrs
  • Kolkata
  • 27 days ago
₹ Not Disclosed

Java Big Data Engineer

  • Capgemini
  • 4 to 8 Yrs
  • karnataka
  • 1 month ago
₹ Not Disclosed

Tummala Sai Venkata

We are AUROGYA - Andhra Urology and Gynecology Center. Founded by Dr. Manoj Tummala, a leading expert in urology and Robotic Uro-Oncology, and Dr. Sri Varshini Tummala, a skilled consultant in high-risk obstetrics and Laparoscopic Gynecology.