Azure Data Engineer- GLN @ Puresoftware

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and architectures on Microsoft Azure.


• Implement and optimize ETL (Extract, Transform, Load) processes using tools such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.


• Work with Azure Data Lake Storage and Azure SQL Database to manage and store structured and unstructured data.


• Develop and maintain data models, databases, and large-scale data processing systems.


• Collaborate with Data Scientists, Analysts, and other engineers to build end-to-end data solutions for reporting and analytics.


• Write efficient, clean, and well-documented SQL queries for data extraction, manipulation, and analysis.


• Optimize performance of SQL-based queries, stored procedures, and jobs in Azure environments.


• Manage and monitor the data pipeline lifecycle, ensuring data quality, integrity, and timeliness.


• Implement data security best practices and ensure compliance with data privacy regulations (GDPR, etc.).


• Troubleshoot and resolve issues with data pipelines, databases, and integration points.


• Provide technical leadership and mentoring to junior engineers and team members.


• Stay current with emerging Azure technologies and trends, recommending improvements to existing systems and solutions.