Azure Data Engineer Job in ByVal Technologies
- Kpr sugar apperals
- 6 to 10 Yrs
- Other Haryana
- 11 months ago
- Email to a friend
- Report this job
Job Description
- Candidate Skills and Qualifications: Experience: 6 to 8+ years as an Azure Data Engineer, with a strong focus on Azure Databricks and PySpark. Data Pipeline Development: Proven expertise in designing, developing and maintaining complex data pipelines on Azure platforms. Data Migration: Experience in migrating data from on-premises and cloud-based systems to Azure, ensuring seamless data integration. Data Modeling: Proficient in dimensional data modeling and designing data warehouses for efficient data storage and retrieval. Azure Services Proficiency: Hands-on experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake and Azure SQL Database. Programming Skills: Strong proficiency in Python and SQL; familiarity with Scala is advantageous. Big Data Frameworks: Experience with big data frameworks, particularly Apache Spark, for large-scale data processing. Version Control and CI/CD: Familiarity with Azure DevOps, Git and implementing CI/CD pipelines for automated deployments. Security Practices: Knowledge of Azure security practices, including Azure Active Directory (AAD), Key Vault and Role-Based Access Control (RBAC). Role & Responsibilities: Data Pipeline Management: Design, develop and maintain complex data pipelines on Azure to support business requirements. Data Migration: Migrate data from on-premises and cloud-based systems to Azure platforms, ensuring data integrity and security. Data Modeling and Warehousing: Implement and optimize dimensional data models and data warehouses for scalable and efficient data processing. Azure Services Utilization: Work extensively with Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake and Azure SQL Database to manage and process large datasets. Programming: Write efficient and scalable code using Python and SQL to support data engineering workflows. ETL/ELT Processes: Develop and maintain ETL/ELT processes, leveraging big data frameworks such as Apache Spark for large-scale data processing. CI/CD Implementation: Set up and manage Azure DevOps pipelines, Git repositories and CI/CD processes for seamless deployment and automation. Security Compliance: Ensure compliance with Azure security best practices, including implementing AAD, Key Vault and RBAC for secure data access. Collaboration: Collaborate with cross-functional teams to identify, develop and implement data solutions to meet organizational needs. Monitoring and Troubleshooting: Monitor and troubleshoot data workflows, ensuring high performance and reliability. Preferred Candidate Profile: Experience: Minimum of 7 years as an Azure Data Engineer, Mandatory work experience with any Fortune 500 company. Certifications: At least one relevant certification, such as the Microsoft Certified: Azure Data Engineer Associate. Azure Data Services: In-depth knowledge of Azure data services, including Data Factory, Databricks, Synapse Analytics, Data Lake and SQL Database. Programming Skills: Strong programming skills in Python and SQL; familiarity with Scala is a plus. Data Modeling and ETL: Expertise in data modeling and ETL/ELT processes. Big Data Frameworks: Hands-on experience with big data frameworks, such as Apache Spark. Version Control and CI/CD: Familiarity with Azure DevOps, Git and CI/CD implementation. Security Practices: Understanding of Azure security practices, including Azure Active Directory (AAD), Key Vault and Role-Based Access Control (RBAC). Analytical Skills: Strong analytical and problem-solving abilities. Communication: Excellent communication and teamwork skills. Adaptability: Ability to adapt to changing business needs and work effectively in an offshore setup. Immediate Joiners (15 days or less) preferred.,
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: Not SpecifiedFunctional Area: Not SpecifiedRole/Responsibilies: Azure Data Engineer Job in ByVal TechnologiesContact Details:
Company: ByVal TechnologiesLocation(s): Other Haryana+ View Contact
Keyskills: Data Migration Data Modeling Python SQL Scala Apache Spark Version Control Azure DevOps Git Azure Data Factory
Fraud Alert to job seekers!
₹ Not Specified
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in