Data Engineer
- Orbis Hospitality
- 6 to 10 Yrs
- Bengaluru
- 4 years ago
- Email to a friend
- Report this job
Job Description
Business Title : Data Engineer
Role : Manager / AM
Job Overview
We are looking for a Manager, Data Engineering, who will be responsible for translating client requirements into design based on the big data solutions for clients. The role requires a hands-on technologist with expertise in Big Data solution architecture with excellent programming background in Java / Scala / Python, should have experience in setting up secure big data platform.
Job Responsibilities:
- Provide technical direction and hands-on implementation role in the areas of data engineering including data ingestion, data access, modeling, data processing, visualization, design and implementation.
- Help establish standard data practices like governance and address other non-functional issues like data security, privacy and quality
- Manage and provide technical direction to a data program implementation based on the requirement
- Work on Data Management Platforms
- Implement scalable architectural models for data processing and storage
- Build functionality for data ingestion from multiple heterogeneous sources in batch & real-time mode
- Build functionality for data analytics, search and aggregation
Requirements:
- Good in consulting with multiple stakeholders
- Overall 6+ years of IT experience with 3+ years in Data related technologies
- 1 2 years in data related Cloud services (AWS / Azure / GCP)
- Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of end to end Big data solutions either on premise or on Cloud.
- Experienced in Hadoop eco-system with one or more distribution like Cloudera and cloud specific distributions and in programming languages like Java/ Scala and good to have Python
- Experienced in one or more big data ingestion tools (Sqoop, Flume, NiFI etc), distributed messaging and ingestion frameworks (Kafka,Pulsar, Pub/Sub etc) and good to know traditional tools like Informatica, Talend etc.
- Experienced in at least one distributed data processing frameworks: like Spark (Core, Streaming , SQL), Storm or Flink etc.
- Should have worked on any of NoSQL and any of Orchestration tools (Oozie , Airflow, Ctr-M or similar).
- Should have good understanding of how to setup Big data cluster security Authorization/ Authentication, Security for data at rest, data in Transit.
- Should have basic understanding of how to manage and setup Monitoring and alerting for Big data cluster.
- Worked on Performance Tuning, Optimization and Data security and MPP style query engines like Impala , Presto, Athena etc
Employement Category:
Employement Type: Full timeIndustry: IT - SoftwareRole Category: DBA / DatawarehousingFunctional Area: Not ApplicableRole/Responsibilies: Data EngineerContact Details:
Company: Orbis HospitalityLocation(s): Bengaluru+ View Contact
Fraud Alert to job seekers!
₹ 18 - 20 Lakh/Yr
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in