Senior API Data Engineer
- Incedo
- 4 - 9 years
- Chennai
- 8 months ago
- Email to a friend
- Report this job
Job Description
Senior API Data Engineer:
Incedo is a US-based consulting, data science and technology services firm with over 2,000 people helping clients from our six offices across US and India. We help our clients achieve competitive advantage through end-to-end digital transformation. Our uniqueness lies in bringing together strong engineering, data science, and design capabilities coupled with deep domain understanding. We combine services and products to maximize business impact for our clients in telecom, financial services, product engineering and life science & healthcare industries.Working at Incedo will provide you an opportunity to work with industry leading client organizations, deep technology and domain experts, and global teams. Incedo University, our learning platform, provides ample learning opportunities starting with a structured onboarding program and carrying throughout various stages of your career. A variety of fun activities are also an integral part of our friendly work environment. Our flexible career paths allow you to grow into a program manager, a technical architect or a domain expert based on your skills and interests.
Role Description:
We are looking for an experienced API Data Engineer / Cloud Developer with strong expertise in building secure, scalable, and event-driven solutions on AWS. The ideal candidate will play a key role in transforming legacy on-prem systems to cloud-native, serverless architectures using services like AWS Glue, Lambda, Step Functions, RDS (Aurora), and API Gateway. This is a high-impact development role, not a maintenance or enhancement position.Key Responsibilities:
- Design and develop RESTful APIs using AWS Lambda and Python, including secure API-to-API and API-to-application communication.
- Build event-driven architectures that respond to file uploads in S3, triggering a pipeline of Glue jobs with quality checks and conditional processing.
- Translate complex SQL Server stored procedures into modular, reusable AWS Glue (PySpark) jobs with dependency chaining using Step Functions.
- Implement data quality checks and preprocessing logic directly in S3 using PySpark before triggering downstream processing.
- Ensure end-to-end data pipeline security through AWS services such as KMS, tokenization, and secure access control.
- Develop reusable libraries and components to streamline Glue development.
- Monitor and log job executions using CloudWatch, implement alerting for job failures or performance issues.
- Collaborate with cross-functional teams including architecture, DevOps, business analysts, and data consumers to deliver production-ready solutions.
- Drive infrastructure-as-code practices using Terraform to provision API and data services.
Required Skills and Experience:
- 5+ years of experience building enterprise-scale, cloud-native applications in AWS.
- Strong hands-on experience with AWS Glue, PySpark, Lambda, S3, Athena, and RDS (Aurora/Postgres).
- Proven experience in building secure REST APIs, including token-based security, API Gateway configuration, and monitoring.
- Experience working in event-driven and domain-driven architectures.
- Deep knowledge of SQL Server and experience translating complex stored procedures to AWS Glue.
- Expertise in designing modular, fault-tolerant Glue workflows using Step Functions.
- Proficient in Python and developing reusable code libraries for data processing tasks.
- Strong understanding of AWS security services (KMS, tokenization, IAM policies).
- Experience with CloudWatch, monitoring, alerting, and log tracing.
- Hands-on experience with Terraform for managing infrastructure as code.
- Experience with API documentation and lifecycle management.
Preferred Qualifications:
- Experience with data tokenization, PII masking, or secure data handling in financial services.
- Background in data engineering, especially in handling complex transformations and pipeline orchestration.
- Strong understanding of data governance, metadata management, and quality frameworks.
Location: ChennaiWe are an Equal Opportunity Employer:We value diversity at Incedo. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: IncedoLocation(s): Chennai
Keyskills: Restful API Api Documentation Aws Lambda Glue Python API-to-API API-to-application Amazon Cloudwatch Modular Step Functions Kms Tokenization Fault Tolerance
Similar positions
Incedo
If youre thinking scale, think bigger and dont stop there. At Walmart Global Tech India, we dont just innovate, we enable transformations across stores and different channels for the Walmart experience. \\\\\\\\r\\\\\\\\n \\\\\\\\r\\\\\\\\nA regular day at Walmart Global Tech India means using tech...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in