Lead Data Engineer (aws, Glue, Data Lake)
- DNEG
- 2 to 10 Yrs
- Other Maharashtra
- 10 months ago
- Email to a friend
- Report this job
Job Description
- Roles and Responsibilities: Architecture design and implementation of next generation data pipelines, analytics, and BI solutions Manage AWS resources including RDS, EMR, MWAA, Lambda etc. Build and deliver high quality data architecture and pipelines to support business analysts. and data scientists Interface with other technology teams to extract, transform, and load data from a wide variety of data sources Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers Requirement: 7-10 years of data engineering experience Experience with data modeling, warehousing and building ETL pipelines Experience programming with at least one modern language, preferably Python Experience working on and delivering end to end projects independently Knowledge of distributed systems as it pertains to data storage and computing 2+ years of analyzing and interpreting data with Postgres, NoSQL etc. experience 2+ Years of hands-on experience with big data framework and storage mechanisms like Apache Spark, EMR, Glue, Data Lake, and BI tools like Tableau Geospatial and time series data experience Desired Skills- Collaborate with Software Engineers, Product Managers, Data Scientists and Business Intelligence Engineers to design, plan and deliver on high priority data initiatives serving internal stakeholders. Build automated, fault tolerant and scalable data solutions leveraging state of the art technologies including but not limited to Spark, EMR, Python, AirFlow, Glue and S3. Look around corners and be creative - Continuously evaluate and improve our strategy, architecture, tooling and codebase to maximize performance, scalability and availability.,
Employement Category:
Employement Type: Full timeIndustry: IT Services & ConsultingRole Category: Not SpecifiedFunctional Area: Not SpecifiedRole/Responsibilies: Lead Data Engineer (aws, Glue, Data Lake) WithContact Details:
Company: Seventh Contact HiringLocation(s): Other Maharashtra
Keyskills: data engineering data modeling Python distributed systems Postgres NoSQL Apache Spark EMR Glue Tableau Geospatial data collaboration Spark AirFlow
Similar positions
DNEG
DNEG CREATIVE SERVICES PVT. LTD. We are DNEG We are one of the world's leading visual effects, animation and stereo conversion companies for feature film and television, with studios in London, Vancouver, Mumbai, Los Angeles, Chennai, Montréal, Chandigarh, Hyderabad and Goa. Since the o...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in