Data Engineer - Databricks
- KPI Partners
- 3 - 6 years
- Hyderabad
- 2 months ago
- Email to a friend
- Report this job
Job Description
About KPI Partners.
KPI Partners is a leading provider of data analytics solutions, dedicated to helping organizations transform data into actionable insights. Our innovative approach combines advanced technology with expert consulting, allowing businesses to leverage their data for improved performance and decision-making. Job Description.
We are seeking a skilled and motivated Data Engineer with experience in Databricks to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and data processing solutions that support our analytics initiatives. You will collaborate closely with data scientists, analysts, and other engineers to ensure the consistent flow of high-quality data across our platforms.
Key skills: Python, Pyspark, Databricks, ETL, Cloud (AWS, Azure, or GCP)
Key Responsibilities.
- Develop, construct, test, and maintain data architectures (e.g., large-scale data processing systems) in Databricks.
- Design and implement ETL (Extract, Transform, Load) processes to move and transform data from various sources to target systems.
- Collaborate with data scientists and analysts to understand data requirements and design appropriate data models and structures.
- Optimize data storage and retrieval for performance and efficiency.
- Monitor and troubleshoot data pipelines to ensure reliability and performance.
- Engage in data quality assessments, validation, and troubleshooting of data issues.
- Stay current with emerging technologies and best practices in data engineering and analytics. Qualifications.
- Bachelor's degree in Computer Science, Engineering, Information Technology, or related field.
- Proven experience as a Data Engineer or similar role, with hands-on experience in Databricks.
- Strong proficiency in SQL and programming languages such as Python or Scala.
- Experience with cloud platforms (AWS, Azure, or GCP) and related technologies.
- Familiarity with data warehousing concepts and data modeling techniques.
- Knowledge of data integration tools and ETL frameworks.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities. Why Join KPI Partners?
- Be part of a forward-thinking team that values innovation and collaboration.
- Opportunity to work on exciting projects across diverse industries.
- Continuous learning and professional development opportunities.
- Competitive salary and benefits package.
- Flexible work environment with hybrid work options. If you are passionate about data engineering and excited about using Databricks to drive impactful insights, we would love to hear from you! KPI Partners is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & Analytics
Role Category: Data Science & Machine Learning
Role: Data Engineer
Employement Type: Full time
Contact Details:
Company: KPI PartnersLocation(s): Hyderabad
Keyskills: python data analytics analytical scala pyspark microsoft azure data warehousing data pipeline data architecture data engineering sql data bricks cloud analytics data quality data modeling gcp teamwork integration aws etl programming communication skills etl scripts
Similar positions
KPI Partners
KPI Partners provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business intelligence, and data discovery.KPI works with both corporate technology departments and corpo...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in