Data Engineer
- Sourcefuse
- 4 - 5 years
- Noida, Gurugram
- 5 months ago
- Email to a friend
- Report this job
Job Description
Work Experience: 4-5 years
Industry: IT Services
Job Type: FULL TIME
Location: Noida, India
We are seeking a skilled Data Engineer with 4-5 years of experience to design, build, and maintain scalable data pipelines and analytics solutions within the AWS cloud environment. The ideal candidate will leverage AWS Glue, PySpark, and QuickSight to deliver robust data integration, transformation, and visualization capabilities. This role is critical in supporting business intelligence, analytics, and reporting needs across the organization.
Key Responsibilities:- Design, develop, and maintain data pipelines using AWS Glue, PySpark, and related AWS services to extract, transform, and load (ETL) data from diverse sources.
- Build and optimize data warehouse/data lake infrastructure on AWS, ensuring efficient data storage, processing, and retrieval.
- Develop and manage ETL processes to source data from various systems, including databases, APIs, and file storage, and create unified data models for analytics and reporting.
- Implement and maintain business intelligence dashboards using Amazon QuickSight, enabling stakeholders to derive actionable insights.
- Collaborate with cross-functional teams (business analysts, data scientists, product managers) to understand requirements and deliver scalable data solutions.
- Ensure data quality, integrity, and security throughout the data lifecycle, implementing best practices for governance and compliance.
- Support self-service analytics by empowering internal users to access and analyze data through QuickSight and other reporting tools.
- Troubleshoot and resolve data pipeline issues, optimizing performance and reliability as needed.
- Proficiency in AWS cloud services: AWS Glue, QuickSight, S3, Lambda, Athena, Redshift, EMR, and related technologies.
- Strong experience with PySpark for large-scale data processing and transformation.
- Expertise in SQL and data modeling for relational and non-relational databases.
- Experience building and optimizing ETL pipelines and data integration workflows.
- Familiarity with business intelligence and visualization tools, especially Amazon QuickSight.
- Knowledge of data governance, security, and compliance best practices.
- Strong programming skills in Python; experience with automation and scripting.
- Ability to work collaboratively in agile environments and manage multiple priorities effectively.
- Excellent problem-solving and communication skills.
- AWS certification (e. g. , AWS Certified Data Analytics Specialty, AWS Certified Developer).
Understanding of machine learning, deep learning and Generative AI concepts, Regression, Classification, Predictive modeling, Clustering, Deep Learning.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Data Science & Machine LearningRole: Data EngineerEmployement Type: Full timeContact Details:
Company: SourcefuseLocation(s): Noida, Gurugram
Keyskills: IT services Automation Data modeling Machine learning Agile Data quality Business intelligence Reporting tools SQL Python
Similar positions
Sourcefuse
Company ProfileSourceFuse Technologies (India) Pvt Ltd.SourceFuse Inc. is transforming the way today's most successful companies develop breakthrough roadmaps leveraging cloud-based technologies. A leading AWS Advanced Consulting Partner, SourceFuse has delivered over 600 AWS implementations that ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in