Senior Data Engineer
- Persistent
- 6 - 11 years
- Hyderabad
- 1 month ago
- Email to a friend
- Report this job
Job Description
About Position:
As a Data Engineer, you will have the opportunity to be a member of a focused team dedicated to helping to make the health care system work better for everyone. Here, you'll partner with some of the smartest people you've ever worked with to design solutions to meet a wide range of health consumer needs.
- Role: Senior Data Engineer
- Location: Pune, Mumbai, Bangalore, Hyderabad, Delhi
- Experience: 6 to 12 Years
- Job Type: Full Time Employment
What You'll Do:
- Design, build, and maintain DLT pipelines to process structured and unstructured data in Databricks.
- Implement ETL/ELT workflows using Delta Lake, Spark Streaming, and Auto Loader.
- Ensure data pipeline quality, reliability, observability, and performance using DLT expectations and monitoring tools.
- Develop and optimize batch and streaming data pipelines using PySpark or Scala.
- Work with data architects to define and enforce data modeling, governance, and lineage standards.
- Integrate data from multiple sources including relational databases, APIs, cloud services, and files.
- Optimize storage and compute usage using Delta Lake best practices.
- Collaborate with analytics and BI teams to ensure availability of trusted, production-grade datasets.
- Implement CI/CD and automation for pipeline deployment and versioning.
- Troubleshoot data quality issues, pipeline failures, and performance bottlenecks.
Expertise You'll Bring:
- Bachelors degree in Computer Science, Engineering, or related field.
- 3 to 7 years of experience as a Data Engineer.
- Hands-on experience with:
- Databricks (must-have)
- Delta Live Tables (DLT)
- PySpark / Spark SQL
- Delta Lake architecture
- Streaming frameworks (Structured Streaming)
- Strong knowledge of data modeling, ETL design, and distributed data processing.
- Experience with cloud platforms (Azure / AWS / GCP), preferably Azure Databricks.
- Proficiency in SQL for complex data transformations.
- Experience with Git, CI/CD pipelines, and DevOps practices.
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
Let's unleash your full potential at Persistent - persistent.com/careers
"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: IT & Information SecurityRole Category: IT Infrastructure ServicesRole: IT Infrastructure Services - OtherEmployement Type: Full timeContact Details:
Company: PersistentLocation(s): Hyderabad
Keyskills: Pytho Pyspark Azure Data Bricks DLT
Similar positions
Persistent
Persistent Systems builds software that drives our customers business, for enterprises and software product companies with software at the core of their digital transformation. For more information, please visit www.persistent.com
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in