Bigdata/Hadoop Administrator with strong Linux and AWS experience
- Caspex Corp
- 6 - 10 years
- Hyderabad
- 1 month ago
- Email to a friend
- Report this job
Job Description
Bigdata Administrator with strong Linux and AWS experience
Experience 5+ years
Must Have skills:
- Deep understanding of Linux, networking and security fundamentals.
- Experience working with AWS cloud platform and infrastructure.
- Experience working with infrastructure as code with Terraform or Ansible tools.
- Experience managing large BigData clusters in production (at least one of -- Cloudera, Hortonworks, EMR).
- Excellent knowledge and solid work experience providing observability for BigData platforms using tools like Prometheus, InfluxDB, Dynatrace, Grafana, Splunk etc.
- Expert knowledge on Hadoop Distributed File System (HDFS) and Hadoop YARN.
- Decent knowledge of various Hadoop file formats like ORC, Parquet, Avro etc.
- Deep understanding of Hive (Tez), Hive LLAP, Presto and Spark compute engines.
- Ability to understand query plans and optimize performance for complex SQL queries on Hive and Spark.
- Experience supporting Spark with Python (PySpark) and R (SparklyR, SparkR) languages
- Solid professional coding experience with at least one scripting language - Shell, Python etc.
- Experience working with Data Analysts, Data Scientists and at least one of these related analytical applications like SAS, R-Studio, JupyterHub, H2O etc.
- Able to read and understand code (Java, Python, R, Scala), but expertise in at least one scripting languages like Python or Shell.
Nice to have skills:
- Experience with workflow management tools like Airflow, Oozie etc.
- Knowledge in analytical libraries like Pandas, Numpy, Scipy, PyTorch etc.
- Implementation history of Packer, Chef, Jenkins or any other similar tooling.
- Prior working knowledge of Active Directory and Windows OS based VDI platforms like Citrix, AWS Workspaces etc.
Job Classification
Industry: MiscellaneousFunctional Area / Department: IT & Information Security
Role Category: IT & Information Security - Other
Role: IT & Information Security - Other
Employement Type: Full time
Contact Details:
Company: Caspex CorpLocation(s): Hyderabad
+ View Contact
Keyskills: Hadoop Administration Linux Big Data Ci/Cd AWS
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in