Technical Lead
- Infinite Computer
- 5 - 14 years
- Bengaluru
- 9 months ago
- Email to a friend
- Report this job
Job Description
- Design, develop, and maintain efficient and reliable data pipelines to support business intelligence and analytics initiatives.
- Write optimized SQL queries for data extraction, transformation, and analysis.
- Design and implement robust data pipelines using Databricks and PySpark.
- Develop and maintain ETL processes to ensure data quality and integrity.
- Create comprehensive documentation for data flows, pipelines, and technical specifications.
- Troubleshoot and resolve data issues in a timely manner.
Required Qualifications
- Databricks PySpark Programming: Strong experience in developing and optimizing data pipelines using Databricks and PySpark.
- Databricks certified Spark Developer Associate or other spark certifications preferred.
- Strong understanding of data lakehouse design principles and implementation in Databricks.
- SQL: Strong proficiency required, including complex queries, stored procedures, query optimization and table design in SQL Server or any relational database systems.
- ETL / Data Pipeline Experience: Strong background in designing and implementing ETL processes and data pipelines.
- Azure Data Factory: Experience designing and implementing data pipelines in Azure Data Factory, including data transformations, scheduling, and error handling.
- Good understanding of Azure Data Lake Storage (ADLS).
- Good understanding of Azure DevOps and CI/CD process.
- Ability to understand business requirements and translate them into technical solutions.
- Overall Experience: 4-5 years of relevant experience in data engineering.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Technical LeadEmployement Type: Full timeContact Details:
Company: Infinite ComputerLocation(s): Bengaluru
Keyskills: SQL queries query optimization devops Technical Lead Scheduling Data quality Stored procedures Business intelligence SQL Data extraction
Similar positions
Infinite Computer
Infinite Computer Solutions India Ltd. Infinite Computer Solutions (India) Limited is a global service provider of Infrastructure Management, Intellectual Property (IP) leveraged solutions and IT services, with focus on Telecom, Media, Manufacturing and Healthcare Industries. Our services span f...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in