Hadoop Big data engineer
- Tech Mahindra
- 7 - 10 years
- Pune
- 3 months ago
- Email to a friend
- Report this job
Job Description
Responsibilities:
- Onboarding and updating data deliveries on our Hadoop Datalake
Developing frameworks to process and deploy new data delivery methods or file formats (JSON, XML, CSV, ProtoBuf, Avro, Parquet, etc)
Creating views and tables for our users with optimal performance for their use case
Experience of connecting and interfacing with systems via APIs
Support both Development and Operations teams in quickly solving complex issues that are hindering the team and/or stakeholders
Coordinating with source teams producing data and also consumers using this data for their use cases
Supporting in the design, building, and testing of new services and extending existing services on our platform
Team collaboration on complex challenges, code reviews and testing new functionalities
Evaluating stakeholder requirements and guiding the innovation team towards the most suitable solution architecture
Identifying common development patterns and ensuring generic solutions and architecture are applied where possible
Take the design lead for complex requirements that go beyond the standard work done by the team
Continue to move the teams towards using more automation and efficient ways of working, to improve quality, eliminate manual mistakes and be more predictable with our deliveries
Education, Experience, and Licensing Requirements:
As an engineer, ideally you have the following qualifications or experience with:
Extensive knowledge of Data modelling Data Warehousing, Relational DBs and Hadoop BigData stores
Hadoop including specifically HDFS, Hive and SQL
Java/Scala, Spark with 5 years+ general software design/development experience
Shell scripting / Shell commands
Git and Confluence
Bachelors Degree in Computer Science, Information Systems or other area of academic study (IT experience can substitute for a Bachelors Degree)
DevOps mindset
Able to learn quickly in a complex multitool environment
Extra assets are:
Python, Groovy, Ansible
Hbase and Phoenix
Apache Nifi and Kafka
General hands-on experience with (Clouderas) Hadoop Suite
Domain
Telecom Domain knowledge - mainly Fault, Performance, Configuration and Capacity Management Data
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Data Science & AnalyticsRole Category: Business Intelligence & AnalyticsRole: Data AnalystEmployement Type: Full timeContact Details:
Company: Tech MahindraLocation(s): Pune
Similar positions
Tech Mahindra
Tech Mahindra Limited is an Indian multinational provider of information technology (IT), networking technology solutions and Business Process Outsourcing (BPO) to the telecommunications industry. Tech Mahindra is a US$4.2 billion company with over 117,000 employees across 90 countries. It provide...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in