Aws Data Engineer
- Reveille Technologies
- 4 - 6 years
- Coimbatore
- 3 months ago
- Email to a friend
- Report this job
Job Description
Role: Data Engineer
Experience: 4 - 6 years
Location: Coimbatore
Job Type: Full Time
Mode of work: Hybrid (Weekly 2 days WFO)
Notice period: Immediate
Mandatory Skills Required: Python, PySpark, AWS, Data Bricks, SQL.
Job Description:
Roles and Responsibilities:
- Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift.
- Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability.
- Collaborate on the design of scalable and resilient data architectures in AWS.
- Develop and manage infrastructure as code using Terraform.
- Actively participate in code reviews and collaborative version control workflows using Git.
- Document technical solutions and promote best practices in data engineering.
- Ensure that data processing pipelines can handle large-scale datasets (Big Data). Who were looking for: Technical Requirements:
- Programming Languages: o Python 3+ years of experience (Intermediate to advanced level) o SQL 3+ years of experience, capable of working with complex data models
- Large-scale data processing: o Experience with PySpark or Big Data environments 12+ years (preferred) o Familiarity with distributed processing and performance optimization for high-volume data pipelines
- AWS Technologies: o Lambda, Glue, Redshift, S3 23 years of hands-on experience o Experience designing ETL workflows using native AWS services
- Infrastructure and DevOps: o Terraform 12 years of experience (Intermediate level) o Git Daily use in collaborative development environments
- Best Practices: o Well-structured project organization, error handling, logging, and automated testing within data pipelines Professional Profile:
- Proactive mindset with a drive to propose and implement improvements
- Analytical thinker with the ability to identify bottlenecks and performance issues Effective collaborator with both technical teams and non-technical stakeholders
- Strong documentation and technical communication skills Nice to have (not mandatory):
- Experience with monitoring and observability tools for data pipelines (CloudWatch, logging, alerting) Knowledge of event-driven architecture design
- Familiarity with orchestration tools like Apache
- Experience with automated testing for data pipelines
- Background in Fintech or experience handling financial datasets
- AWS certifications are a plus.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Analytics - OtherRole: Data Science & Analytics - OtherEmployement Type: Full timeContact Details:
Company: Reveille TechnologiesLocation(s): Coimbatore
Keyskills: Pyspark AWS Data Bricks Python SQL Data Engineering
Similar positions
Reveille Technologies
Datamatics is a Digital Technology & BPM company with over 10,000 employees and provides technology solutions to more than 200 customers worldwide. The company has a presence in 7 countries, including India, the Philippines, Switzerland, USA, UK, Netherlands, and UAE. Its global delivery centers...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in