Big Data Engineer (PySpark & Apache)
- Tummala Sai Venkata
- 8 to 12 Yrs
- Chennai
- 4 months ago
- Email to a friend
- Report this job
Job Description
- As a Big Data Engineer specializing in PySpark and Apache Iceberg, your main responsibility will be designing and implementing scalable data pipelines. You will be tasked with handling large datasets, optimizing data workflows, and ensuring the quality and reliability of the data processed. Your key responsibilities will include designing, developing, and maintaining big data pipelines using PySpark and Apache Iceberg. Additionally, you will need to optimize data workflows for improved performance and scalability, implement data transformation, cleansing, and enrichment processes, collaborate with data scientists and analysts to deliver actionable insights, ensure data quality, consistency, and security across all pipelines, as well as monitor and troubleshoot data pipeline issues in production. To excel in this role, you should have a minimum of 8 years of experience working with PySpark and Apache Iceberg, proficiency in distributed data processing and big data technologies, knowledge of data modeling and schema design, familiarity with cloud platforms such as AWS, Azure, or GCP, and experience with version control tools like Git. Ideally, you should possess a Bachelor's degree or University degree in a relevant field, or equivalent experience. This job description covers a broad overview of your responsibilities, and additional duties related to the role may be assigned as necessary. Please note that this job falls under the Technology category within the Applications Development job family, and it is a full-time position. For further details on the most relevant skills required, refer to the requirements listed above. If you have any questions regarding complementary skills needed for this position, feel free to reach out to the recruiter. If you require a reasonable accommodation due to a disability when using our search tools or applying for a career opportunity, please review the Accessibility at Citi guidelines. Additionally, you can view Citi's EEO Policy Statement and the Know Your Rights poster for more information.,
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: Not SpecifiedFunctional Area: Not SpecifiedRole/Responsibilies: Big Data Engineer (PySpark & Apache)Contact Details:
Company: Early CareerLocation(s): Chennai+ View Contact
Keyskills: data modeling AWS Azure GCP version control tools Git schema design
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Tummala Sai Venkata
We are AUROGYA - Andhra Urology and Gynecology Center. Founded by Dr. Manoj Tummala, a leading expert in urology and Robotic Uro-Oncology, and Dr. Sri Varshini Tummala, a skilled consultant in high-risk obstetrics and Laparoscopic Gynecology.
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in