Data Engineering Lead
- Persistent
- 8 - 12 years
- Pune
- 1 month ago
- Email to a friend
- Report this job
Job Description
About Position:
We at Persistent are looking for a Data Engineering lead with experience in MS Fabric, SQL, Python along with knowledge in Data Extraction and ETL Process.
- Role: Data Engineering Lead
- Location: Pune, Bangalore
- Experience: 8+ years
- Job Type: Full Time Employment
What You'll Do:
- Work with business to understand business requirements and translate into low level design
- Design and implement robust, fault tolerant, scalable, and secure data pipelines using pyspark, notebooks in MS Fabric
- Review code of peers and mentor junior team members
- Participate in sprint planning and other agile ceremonies
- Drive automation and efficiency in Data ingestion, data movement and data access workflow
- Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.
Expertise You'll Bring:
- Around 8 to 12 years of experience, at least 1 year in MS fabric and Azure cloud
- Leadership: Ability to lead and mentor junior data engineers, help with planning and estimations
- Data migration: Experience on migrating and re-modeling large enterprise data from legacy warehouse to Lakehouse (Delta lake) on MS Fabric or Databricks.
- Strong Data Engineering Skills: Proficiency in data extraction, transformation, and loading (ETL) processes, data modeling, and database management. Also experience around setting up pipelines using Notebooks and ADF, setting up monitoring and alert notifications.
- Experience with Data Lake Technologies: MS Fabric, Azure, Databricks, Python, Orchestration tool like Apache Airflow or Azure Data Factory, Azure Synapse along with stored procedures, Azure data lake storage.
- Data Integration Knowledge: Familiarity with data integration techniques, including batch processing, streaming, and real-time data ingestion, auto-loader, change data capture, creation of fact and dimension tables.
- Programming Skills: Proficiency in SQL, Python, Pyspark for data manipulation and transformation.
- DP-700 certification will be preferred
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Inclusive Environment:
Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We offer hybrid work options and flexible working hours to accommodate various needs and preferences.
- Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment. We are committed to creating an inclusive environment where all employees can thrive.
Our company fosters a values-driven and people-centric work environment that enables our employees to:
- Accelerate growth, both professionally and personally
- Impact the world in powerful, positive ways, using the latest technologies
- Enjoy collaborative innovation, with diversity and work-life wellbeing at the core
- Unlock global opportunities to work and learn with the industry's best
Let's unleash your full potential at Persistent
"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: IT & Information Security
Role Category: IT Infrastructure Services
Role: IT Infrastructure Services - Other
Employement Type: Full time
Contact Details:
Company: PersistentLocation(s): Pune
+ View Contact
Fraud Alert to job seekers!
₹ 19-30 Lacs P.A
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in