Data Engineer
- Programming.Com
- 4 - 9 years
- Pune
- 5 months ago
- Email to a friend
- Report this job
Job Description
Locations: Pune, Gurgaon, Mohali, Bengaluru, Hyderabad
Experience: 4+ Years
Key Responsibilities
- Design and implement robust, scalable ETL/ELT pipelines using AWS-native tools
- Ingest and transform data from multiple sources into S3, applying schema discovery via AWS Glue Crawlers
- Develop and orchestrate workflows using Apache Airflow, AWS Step Functions, and Lambda functions
- Build and optimize data models in Amazon Redshift for analytics consumption
- Manage and enforce IAM-based access control, ensuring secure data practices
- Write clean, modular, and reusable code in PySpark and SQL for large-scale data processing
- Implement monitoring, alerting, and CI/CD pipelines to improve deployment efficiency and reliability
- Work closely with business stakeholders and analysts to understand data requirements and deliver meaningful insights
- Participate in code reviews and knowledge-sharing activities across teams.
- Understands scrum and comfortable working in an Agile environment.
Required Skills
- 4+ years of experience as a Data Engineer, with at least 3+ years working in cloud-native environments (preferably AWS)
- Hands-on experience with S3, Redshift, Glue (ETL & Crawlers), Lambda, Step Functions, and Airflow
- Strong programming skills in PySpark and SQL
- Experience designing and implementing data lakes, data warehouses, and real-time/near-real-time pipelines
- Familiarity with DevOps, CI/CD pipelines, and infrastructure as code tools (e.g., Git, CloudFormation, Terraform)
- Understanding of data governance, data security, and role-based access control in cloud environments
- Strong problem-solving skills and ability to work independently as well as collaboratively
- Excellent written and verbal communication skills
Nice to Have
- Experience working in domains such as nonprofit, healthcare, or campaign marketing
- Familiarity with AWS Notebooks, Athena, and CloudWatch
- Exposure to data observability tools, testing frameworks, or event-driven architectures
- Experience mentoring junior engineers or leading small teams
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Big Data EngineerEmployement Type: Full timeContact Details:
Company: Mobile ProgrammingLocation(s): Pune+ View Contact
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Programming.Com
Programming.com is a global technology services and software development company delivering high-quality digital solutions to enterprises and fast-growing businesses. We specialize in building scalable backend systems, modern web applications, and cloud-native platforms using cutting-edge technol...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in