Data Engineer
- Programming.Com
- 3 - 7 years
- Bengaluru
- 4 months ago
- Email to a friend
- Report this job
Job Description
Location: Bangalore
Responsibilities:
- Create, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning.
- Develop and maintain core data framework and key infrastructures
- Create and support the ETL pipeline to get the data flowing correctly from the existing and new sources to our data warehouse.
- Data Warehouse design and data modelling for efficient and cost effective reporting
- Collaborate with data analysts, data scientists, and other data consumers within the business to manage the data warehouse table structure and optimize it for reporting.
- Constantly striving to improve software development process and team productivity
- Define and implement Data Governance processes related to data discovery, lineage, access control and quality assurance
- Perform code reviews and QA data imported by various processes
Qualifications
- 3-5 years of experience.
- At least 2+ years of experience in data engineering and data infrastructure space on any of the big data technologies: Hive, Spark, Pyspark(Batch and Streaming), Airflow, Redshift and Delta Lake.
- Experience in product based companies or startups.
- Strong understanding of data warehousing concepts and the data ecosystem.
- Strong Design/Architecture experience architecting, developing, and maintaining solutions in AWS.
- Experience building data pipelines and managing the pipelines after theyre deployed.
- Experience with building data pipeline from business applications using APIs.
- Previous experience in Databricks is a big plus.
- Understanding of Dev Ops would be preferable though not a must
- Working knowledge of BI Tools like Metabase, Power BI is plus
- Experience of architecting systems for data access is a major plus
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Big Data EngineerEmployement Type: Full timeContact Details:
Company: Mobile ProgrammingLocation(s): Bengaluru+ View Contact
Fraud Alert to job seekers!
₹ 4-8 Lacs P.A
Similar positions
Programming.Com
Programming.com is a global technology services and software development company delivering high-quality digital solutions to enterprises and fast-growing businesses. We specialize in building scalable backend systems, modern web applications, and cloud-native platforms using cutting-edge technol...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in