Hadoop Administrator Big Data Platform @ Visa Inc

Essential Functions

• Person will be responsible to Perform Big Data Administration and Engineering activities on multiple Hadoop, Kafka, Hbase and Spark clusters

• Work on Performance Tuning and Increase Operational efficiency on a continuous basis

• Monitor health of the platforms ,Generate Performance Reports and Monitor and provide continuous improvements

• Working closely with development, engineering and operation teams, jointly work on key deliverables ensuring production scalability and stability

• Develop and enhance platform best practices

• Ensure the Hadoop platform can effectively meet performance & SLA requirements

• Responsible for Big Data Production environment which includes Hadoop( HDFS and YARN), Hive, Spark, Livy, SOLR, Oozie, Kafka, Airflow,Nifi, Hbase etc .

• Perform optimization, debugging and capacity planning of a Big Data cluster

• Perform security remediation, automation and self heal as per the requirement

Basic Qualifications

8 years of work Big Data Engineer experience with a Bachelor s Degree or an Advanced Degree (e.g. Masters, MBA, JD, MD, or PhD)

Preferred Qualifications

• Minimum 3 years of work experience in maintaining, optimization, issue resolution of Big Data large scale clusters, supporting Business users and Batch process.

• Hands on Experience in Hadoop( HDFS and Yarn) , Hive ,Spark, Kafka is must.

• Handson Experience No SQL Databases HBASE is plus

• Prior Experience in Linux / Unix OS Services, Administration, Shell,awk scripting is a plus

• Excellent oral and written communication and presentation skills, analytical and problem solving skills

• Selfdriven, Ability to work independently and as part of a team with proven track record

• Minimum of four year technical degree required

• Experience on Hortonworks distribution or Open Source preferred