Data Engineer
- anblicks
- 5 - 10 years
- Hyderabad
- 4 months ago
- Email to a friend
- Report this job
Job Description
Role: Data Engineer ODS Platform
Location: [Onsite / Hybrid / Remote]
Type: [Full-Time / Contract]
Industry: Aviation, Retail, Finance, Healthcare
Job Overview
We are looking for an experienced Data Engineer with strong data modeling expertise, AWS Data Engineering certification, and hands-on experience across key AWS services used in building scalable Operational Data Store (ODS) platforms. The ideal candidate will bring a combination of backend engineering skills in Python or Java, a solid understanding of data pipelines and Lakehouse architectures, and a track record of delivering high-performance, SOX-compliant data systems in the cloud.
Key Responsibilities
Design and implement data ingestion pipelines, ETL/ELT workflows, and data transformation logic for ODS layers (Raw Curated Published).
Build scalable data models and schemas to support operational and analytical workloads with historical retention.
Leverage AWS-native services for data processing, storage, cataloging, and orchestration S3, Glue, Athena, Aurora, Redshift, DynamoDB, Step Functions, Lambda, Lake Formation
Ensure compliance with SOX, data governance, and access control standards.
Write reusable, well-tested code in Python and/or Java for custom data transformations and orchestration components.
Implement partitioning, compaction, and optimization techniques for performance and cost efficiency.
Monitor and troubleshoot data jobs using tools such as CloudWatch, Glue job metrics, and custom alerts.
Work closely with architects, analysts, and business stakeholders to understand data needs and deliver quality datasets.
Document technical designs, data flow diagrams, and data dictionaries.
Required Qualifications
5+ years of experience in data engineering with a strong focus on data modeling and cloud-based architecture.
AWS Certified Data Analytics Specialty or Big Data Specialty (or actively pursuing).
Solid hands-on experience with AWS Glue, S3, Athena, Aurora, Step Functions, Lambda, API Gateway, Lake Formation
Strong experience building and optimizing data models (3NF, star/snowflake, time-series) for ODS or EDW platforms.
Advanced proficiency in Python and/or Java, including experience building reusable frameworks or libraries.
Experience with data cataloging, schema evolution, and metadata management.
Familiarity with CI/CD, Git, and IaC tools like Terraform or CloudFormation.
Deep understanding of batch vs. streaming patterns, event-driven processing, and system decoupling.
Preferred Qualifications
Experience with Snowflake, Redshift Spectrum, or Databricks is a plus.
Knowledge of Kafka, Kinesis, or other streaming platforms.
Exposure to data quality, lineage, and governance frameworks.
Prior experience implementing SOX-compliant data architectures.
Familiarity with Airflow, dbt, or similar orchestration/transformation tools.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: anblicksLocation(s): Hyderabad+ View Contact
Keyskills: metadata Backend GIT Data modeling Analytical Schema Healthcare Data processing Data quality Python
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
anblicks
Anblicks, a team of specialists in strategic dUnlock the full potential of your data with Anblicks, a team of strategic data modernization experts. Our tailored services cover seamless data migration, robust re-architecture, and transformative solutions. The AIM Framework from Anblicks, encompassi...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in