Data Engineer
- Cybage
- 3 - 8 years
- Pune
- 13 days ago
- Email to a friend
- Report this job
Job Description
Role & responsibilities
- Ingest, warehouse, and store data at scale in the Azure cloud platform
- Work closely with colleagues in Operations, Architecture, Delivery, Product, and Software Engineering to collaboratively release platform increments
- Contribute toward solution level architecture and design
- Own your release from development to production following DevOps method.
- Continuously enhance your knowledge base and skillset
- Contribute towards ADF and Synapse pipeline design improvement and best practices and following design principles
- Understand data issues and able to analyse and work with Architects in addressing design challenges
- Able to migrate data from legacy databases and storage to Azure cloud-based lake and warehouse .
Mandatory skills:
- 3-8 years of experience in developing and debugging complex SQL statements, stored procedures, views, and functions in Microsoft SQL Server databases
- Experience in designing and developing complex ETL/ELT pipelines (Azure Data Factory and / or SSIS)
- Experience of preparing data mappings based on high level requirements and taking those to a solution level details
- Firm understanding of data warehousing concepts in the lake and traditional database with experience of working end-to-end in a ETL lifecycle from data acquisition to the consumption layer
- Knowledge and experience in value-added areas of automation, scripting
- Knowledgeable about the different types of cloud-based storage resources and distributed systems
- Relational databases (SQL Server, MySQL etc.), NoSQL and writing queries
- Hands-on analytical and data exploration skills
- Experience of working in Agile methodology
- Good knowledge of API-based Integration and Microservices architecture
- Practical experience of improving data quality and efficiency in data pipelines
- Solid understanding of DevOps and CI/CD
- Understanding of compliance and lifecycle of data management.
Desirable Skills
- Coding experience in .NET (C# or VB)
- Experience working with other Azure technologies such as Fabric, Databricks, Power Automate
- Experience of working with non-relational databases (CosmosDB, MongoDB, etc.) and handling unstructured data in ETL pipelines
- Experience of working in the Automotive industry
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: CybageLocation(s): Pune+ View Contact
Keyskills: ETL Azure Data Factory .Net MongoDB Spark Data Bricks Python SQL
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Cybage
About Cybage:Founded in 1995, Cybage Software Pvt. Ltd., a technology consulting organization is a leader in the hi-tech and outsourced product engineering space. We are a valued partner to technology startups, mid-size companies, and Fortune 500 corporations alike. Our solutions are focused on mode...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in