Design, develop, test, deploy and maintain large-scale data pipelines using Spark and Python.
Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time.
Develop complex SQL queries to extract insights from massive datasets.
Troubleshoot issues related to data processing, modeling, and visualization.
Job Requirements :
7-18 years of experience in Big Data engineering with expertise in Spark, Python, SQL, and data modeling.
Strong understanding of machine learning concepts and experience working with ML algorithms.
Proficiency in developing scalable data pipelines using Apache Spark framework.
Experience working with relational databases (SQL) for querying large datasets.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Analytics - OtherRole: Data Science & Analytics - OtherEmployement Type: Full time