5+ years of experience with Azure Data Factory and Databricks, including Big Data ecosystem tools (e.g., Hadoop, Hive).
Hands-on experience in data processing within Enterprise Data Lake (EDL) for big data pipelines, architectures, and datasets.
Strong knowledge of Python and/or C# is mandatory.
Ensure data is cleansed, mapped, transformed, and optimized for storage and usage per business and technical requirements.
Develop and maintain innovative Azure solutions for data integration and analytics.
Ability to automate tasks and deploy production-standard code (including unit testing, CI/CD, version control).
Load transformed data into data warehouses, high-speed indexes, real-time reporting systems, and analytics applications.
Build data pipelines to integrate and consolidate data from multiple sources.
Responsibilities include data extraction, troubleshooting, and maintenance of the data warehouse.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full time