Aws Data Engineer
- Programming.Com
- 3 - 6 years
- Bengaluru
- 4 months ago
- Email to a friend
- Report this job
Job Description
Responsibilities
Create, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning.
Develop and maintain core data framework and key infrastructures
Create and support the ETL pipeline to get the data flowing correctly from the existing and new sources to our data warehouse.
Data Warehouse design and data modelling for efficient and cost effective reporting
Collaborate with data analysts, data scientists, and other data consumers within the business to manage the data warehouse table structure and optimize it for reporting.
Constantly striving to improve software development process and team productivity
Define and implement Data Governance processes related to data discovery, lineage, access control and quality assurance
Perform code reviews and QA data imported by various processes
Qualifications
3-5 years of experience.
At least 2+ years of experience in data engineering and data infrastructure space on any of the big data technologies: Hive, Spark, Pyspark(Batch and Streaming), Airflow, Redshift and Delta Lake.
Experience in product based companies or startups.
Strong understanding of data warehousing concepts and the data ecosystem.
Strong Design/Architecture experience architecting, developing, and maintaining solutions in AWS.
Experience building data pipelines and managing the pipelines after theyre deployed.
Experience with building data pipeline from business applications using APIs.
Previous experience in Databricks is a big plus.
Understanding of Dev Ops would be preferable though not a must
Working knowledge of BI Tools like Metabase, Power BI is plus
Experience of architecting systems for data access is a major plus.
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: Mobile ProgrammingLocation(s): Bengaluru
Keyskills: Pyspark Data Engineering AWS Data Bricks
Similar positions
Programming.Com
Programming.com is a global technology services and software development company delivering high-quality digital solutions to enterprises and fast-growing businesses. We specialize in building scalable backend systems, modern web applications, and cloud-native platforms using cutting-edge technol...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in