Design, develop, test, deploy and maintain large-scale data pipelines using Python on Azure Data Factory (ADF) to extract insights from various sources.
Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs through data analysis and visualization.
Develop complex SQL queries to optimize database performance and troubleshoot issues in Microsoft Azure databases.
Ensure high availability of ADF pipelines by monitoring their execution, identifying bottlenecks, and implementing improvements.
Job Requirements :
7-10 years of experience in IT Services & Consulting industry with expertise in big data analytics.
Strong proficiency in Python programming language with hands-on experience working with Azure Data Factory (ADF).
Experience working with Microsoft Azure cloud platform including Databricks, Synapse Analytics, Logic Apps etc. .
In-depth knowledge of SQL querying languages such as T-SQL.
Job Classification
Industry: InternetFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Machine Learning EngineerEmployement Type: Full time