Principal Data Engineer (Logistics/Manufacturing)
- Dmi Innovations
- 11 - 21 years
- Hyderabad
- 4 months ago
- Email to a friend
- Report this job
Job Description
Job Title: Principal Data Engineer, Logistics
Employment Type: Full Time
Experience: 12+ Years
About the Role:
We are looking for a Principal Data Engineer to lead the design and delivery of scalable data solutions using Azure Data Factory and Azure Databricks. This is a consulting-focused role that requires strong technical expertise, stakeholder engagement, and architectural thinking.
You will work closely with business, functional, and technical teams to define data strategies, design robust pipelines, and ensure smooth delivery in an Agile environment.
Responsibilities
- Collaborate with business and technology stakeholders to gather and understand data needs
- Translate functional requirements into scalable and maintainable data architecture
- Design and implement robust data pipelines
- Lead data modeling, transformation, and performance optimization efforts
- Ensure data quality, validation, and consistency
- Participate in Agile ceremonies including sprint planning and backlog grooming
- Support CI/CD automation for data pipelines and integration workflows
- Mentor junior engineers and promote best practices in data engineering
Must Have
- 12+ years of IT experience, with at least 5 years in data architecture roles in modern metadata driven and cloud-based technologies, bringing a software engineering mindset
- Strong analytical and problem-solving skills - Ability to determine data patterns and perform root cause analysis to resolve production issues
- Excellent communication skills, with experience in leading client-facing discussion
- Strong hands-on experience with Azure Data Factory and Databricks, leveraging custom solutioning and design beyond drag-and-drop capabilities for big data workloads
- Demonstrated proficiency in SQL, Python, and Spark
- Experience with CI/CD pipelines, version control and DevOps tools
- Experience with applying dimensional and Data Vault methodologies
- Background in working with Agile methodologies and sprint-based delivery
- Ability to produce clear and comprehensive technical documentation
Nice to Have
- Experience with Azure Synapse and Power BI
- Experience with Microsoft Purview and/or Unity Catalog
- Understanding of Data Lakehouse and Data Mesh concepts
- Familiarity with enterprise data governance and quality frameworks
- Manufacturing experience within the operations domain
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Technical ArchitectEmployement Type: Full timeContact Details:
Company: Dmi Innovations now aLocation(s): Hyderabad
Keyskills: Data Engineering Data Pipeline Data Modeling Data Architecture Stakeholder Management Star Schema Pyspark python Spark Programming Metadata Azure Databricks sql Design Datafactory Snowflake Agile Data Lake Data Security Data Warehousing Delivery ERwin Data Governance
Similar positions
Dmi Innovations
\n\nhttps://linktr.ee/bangaloregastrocentre?fbclid=IwAR3n40eh5ckzDje29gUVge9NhS8XbbO8RjAH4D32gWTzCaZuq0zee0Mhz0Y
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in