Hadoop Admin Manager
- Smartavya Analytica
- 10 - 15 years
- Mumbai
- 1 month ago
- Email to a friend
- Report this job
Job Description
Years of Experience: 10-15 Yrs
Shifts: 24*7 (Rotational Shift)
Mode: Onsite
Experience: 10+ yrs of experience in IT, with At least 7+ years of experience with cloud and system administration. At least 5 years of experience with and strong understanding of 'big data' technologies in Hadoop ecosystem - Hive, HDFS, Map/Reduce, Flume, Pig, Cloudera, HBase Sqoop, Spark etc.
Job Overview: Smartavya Analytica Private Limited is seeking an experienced Hadoop Administrator to manage and support our Hadoop ecosystem. The ideal candidate will have strong expertise in Hadoop cluster administration, excellent troubleshooting skills, and a proven track record of maintaining and optimizing Hadoop environments. Key Responsibilities:
- Install, configure, and manage Hadoop clusters, including HDFS, YARN, Hive, HBase, and other ecosystem components.
- Monitor and manage Hadoop cluster performance, capacity, and security.
- Perform routine maintenance tasks such as upgrades, patching, and backups.
- Implement and maintain data ingestion processes using tools like Sqoop, Flume, and Kafka.
- Ensure high availability and disaster recovery of Hadoop clusters.
- Collaborate with development teams to understand requirements and provide appropriate Hadoop solutions.
- Troubleshoot and resolve issues related to the Hadoop ecosystem.
- Maintain documentation of Hadoop environment configurations, processes, and procedures.
Requirement:
- Experience in Installing, configuring and tuning Hadoop distributions.
- Hands on experience in Cloudera.
- Understanding of Hadoop design principals and factors that affect distributed system performance, including hardware and network considerations.
- Provide Infrastructure Recommendations, Capacity Planning, work load management.
- Develop utilities to monitor cluster better Ganglia, Nagios etc.
- Manage large clusters with huge volumes of data
- Perform Cluster maintenance tasks
- Create and removal of nodes, cluster monitoring and troubleshooting
- Manage and review Hadoop log files
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QA
Role Category: DBA / Data warehousing
Role: Database Administrator
Employement Type: Full time
Contact Details:
Company: Smartavya AnalyticaLocation(s): Mumbai
Keyskills: Hadoop Administration Hive Cloudera documentation troubleshooting big data HBase
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in