AWS Data Engineer
- Careernet
- 4 - 9 years
- Hyderabad
- 7 months ago
- Email to a friend
- Report this job
Job Description
Interested can also apply with
Sanjeevan Natarajan
sa****************n@ca******t.in
Role & responsibilities
- Technical Leadership
Lead a team of data engineers and developers; define technical strategy, best practices, and architecture for data platforms.
- End-to-End Solution Ownership
Architect, develop, and manage scalable, secure, and high-performing data solutions on AWS and Databricks.
- Data Pipeline Strategy
Oversee the design and development of robust data pipelines for ingestion, transformation, and storage of large-scale datasets.
- Data Governance & Quality
Enforce data validation, lineage, and quality checks across the data lifecycle. Define standards for metadata, cataloging, and governance.
- Orchestration & Automation
Design automated workflows using Airflow, Databricks Jobs/APIs, and other orchestration tools for end-to-end data operations.
- Cloud Cost & Performance Optimization
Implement performance tuning strategies, cost optimization best practices, and efficient cluster configurations on AWS/Databricks.
- Security & Compliance
Define and enforce data security standards, IAM policies, and compliance with industry-specific regulatory frameworks.
- Collaboration & Stakeholder Engagement
Work closely with business users, analysts, and data scientists to translate requirements into scalable technical solutions.
- Migration Leadership
Drive strategic data migrations from on-prem/legacy systems to cloud-native platforms with minimal risk and downtime.
- Mentorship & Growth
Mentor junior engineers, contribute to talent development, and ensure continuous learning within the team.
Preferred candidate profile
- Python, SQL, PySpark, Databricks, AWS (Mandatory)
- Leadership Experience in Data Engineering/Architecture
- Added Advantage: Experience in Life Sciences / Pharma
Job Classification
Industry: Pharmaceutical & Life SciencesFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: "Empowering LifeLocation(s): Hyderabad
Keyskills: Pyspark python Data Bricks SQL AWS Airflow Design Patterns Big Data Aws Emr Life Sciences Healthcare Domain Amazon Redshift Pharmaceutical Domian Pharmacy Snowflake AWS S3 Data Modeling
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in