Hiring For Azure Databricks, Data Factory
- Coforge
- 4 - 15 years
- Hyderabad
- 3 months ago
- Email to a friend
- Report this job
Job Description
Job Responsibilities- Lead a team of Data Engineers and Senior Data Engineers, providing technical guidance and mentorship.
- Design, develop, and maintain scalable ETL pipelines using Azure Services.
- Process, transform, and load large datasets into AWS Datalake or other data stores.
- Collaborate with cross-functional teams including data architects, analysts, and business stakeholders to gather requirements and deliver efficient data solutions.
- Implement and maintain data pipelines for ingestion, processing, and transformation in Azure.
- Work closely with data scientists and analysts to understand data needs and create effective workflows.
- Create and manage data storage solutions such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
- Develop and maintain ETL operations using Azure Data Factory or similar technologies.
- Ensure data quality, integrity, and reliability through validation and cleansing procedures.
- Optimize data pipelines for scalability, efficiency, and cost-effectiveness.
- Monitor and troubleshoot data pipeline issues to ensure data consistency and availability.
- Proven experience in designing and developing cloud-based analytics solutions.
- Expert-level knowledge of:
- Azure Data Factory
- Azure Synapse
- Azure SQL
- Azure Data Lake
- Azure App Service
- Experience in building data pipelines using API and streaming ingestion methods.
- Familiarity with DevOps processes including CI/CD and Infrastructure as Code.
- Strong understanding of data warehouse modeling principles (Kimball, Inmon).
- Desirable knowledge of:
- Azure Databricks
- Azure IoT
- Azure HDInsight + Spark
- Azure Stream Analytics
- Power BI
- Working knowledge of Python is a plus.
- Experience in developing security models.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Analytics - OtherRole: Data Science & Analytics - OtherEmployement Type: Full timeContact Details:
Company: CoforgeLocation(s): Hyderabad+ View Contact
Keyskills: Azure Data Factory Azure Azure Databricks
Fraud Alert to job seekers!
₹ 10-30 Lacs P.A
Similar positions
Coforge
Coforge is a leading global IT solutions organization, enabling its clients to transform at the intersect of unparalleled domain expertise and emerging technologies to achieve real-world business impact. A focus on very select industries, a detailed understanding of the underlying processes of those...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in