Design, develop, and maintain large-scale data pipelines using Python and Spark to extract insights from various sources.
Collaborate with cross-functional teams to identify business requirements and design data models that meet those needs.
Develop complex SQL queries to optimize database performance and troubleshoot issues.
Ensure high-quality delivery of projects by mentoring junior team members and providing technical guidance.
Job Requirements :
7-10 years of experience in a similar role as Lead Data Engineer or equivalent position.
Strong proficiency in Python programming language with expertise in data modeling, machine learning algorithms, and natural language processing techniques.
Experience working with relational databases (e.g., MySQL) as well as NoSQL databases (e.g., MongoDB).
Proficiency in writing efficient SQL queries for querying large datasets.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Analytics - OtherRole: Data Science & Analytics - OtherEmployement Type: Full time