Openings For Data Engineer with Relevantz
- Relevantz Technology
- 6 - 11 years
- Pune
- 6 months ago
- Email to a friend
- Report this job
Job Description
We are looking for a skilled DE to help build out our data analytics platform. This role will focus on designing and maintaining scalable ETL pipelines using Python, Kafka, and dbt, orchestrated with Apache Airflow. Data will be stored in Snowflake and leveraged for advanced analytics and reporting using ThoughtSpot or PowerBI.
Responsibilities:
- Design, build and maintain robust ETL/ELT pipelines using Python, Kafka and dbt to process data from various internal data sources
- Manage workflow orchestration with Apache Airflow to ensure timely and accurate data transformations
- Design data models for fast query times
- Optimize data models using Snowflake for high query performance and cost efficiency
- Implement real-time data streaming using Kafka
- Work closely with various application teams to identify, map and load data required for analysis and reporting
- Develop BI dashboards and self-service analytics using ThoughtSpot and/or PowerBI
- Adherence to data governance, enterprise security and compliance standards
- Monitor and optimize data pipelines for scalability and reliability
Preferred Skills:
- 6+ years of experience in data engineering preferably in a financial services or banking industry
- Proficient in python data processing and automation
- Hands-on experience with Kafka for real-time data streaming
- Strong SQL knowledge and prior experience with data lakes or warehouses
- Good knowledge of dbt for data transformations
- Experience with Airflow for orchestrating complex workflows
- Good understanding of Snowflake architecture with experience with using Snowflake tools for querying and loading data and optimizing query performance
- Exposure to cloud environments especially Azure and CI/CD best practices
Preferred candidate profile
- Candidates should be good in Data Engineering
- Candidates who have Strong experience in ETL Pipelines using Python, Airflow ,Kafka & dbt
- Work Experience: 5+ Yrs.
- Azure Cloud Preferable
Perks and benefits
- Best Salary in the Industry & Medical Insurance
Interested Candidate can share your profile to sr**************j@re******z.com
Contact HR : Sridhar S
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Analytics - OtherRole: Data Science & Analytics - OtherEmployement Type: Full timeContact Details:
Company: Relevantz TechnologyLocation(s): Pune
Keyskills: Etl Pipelines Airflow Data Engineering Kafka Python
Similar positions
Relevantz Technology
We are a software development services company with thought leadership in engineering digital solutions. We enable your enterprise to be more engaging, insightful, predictive, and efficient by adopting the technology advancements of the digital revolution and by supporting you from ideati...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in