Senior Big Data Developer - Hadoop/ Java @ Career Infosystem

Job Description

Professional Summary :

- Senior Big Data Developer with complete expertise in executing Data Engineering and Data Analytics projects from scratch.

- Around 8 years of experience in Software Development with strong focus on Big Data, Hadoop and Java.

- Strong expertise in Big Data ecosystem like Spark, Hive, Sqoop, HDFS, Map Reduce, Kafka, Oozie, Yarn, Hbase, Nifi.

- Strong expertise in building scalable applications using various programming languages (Java, Scala and Python).

- In depth Knowledge on Architecture of Distributed Systems and Parallel Computing.

- Experience implementing end to end data pipelines for serving reporting and data science capabilities.

- Experience in fine tuning applications written in Spark and Hive and to improve the overall performance of the pipelines.

- Developed production ready Spark applications using Spark RDD apis, Data frames, Datasets, Spark SQL and Spark Streaming.

- Strong experience working with various configurations of Spark like broadcast thresholds, increasing shuffle partitions, caching, repartitioning etc., to improve the performance of the jobs.

- In depth knowledge on import/export of data from Databases using Sqoop.

- Well versed in writing complex hive queries using analytical functions.

- Knowledge in writing custom UDF's in Hive to support custom business requirements.

- Solid experience in using the various file formats like CSV, TSV, Parquet, ORC, JSON and AVRO.

-Experience in using the compression techniques like Gzip, Snappy with in Hadoop.

- Strong knowledge of NoSQL databases and worked with HBase, Cassandra and Mongo DB.

- Experience in using the cloud services like Amazon EMR, S3, EC2, Red shift and Athena.

- Experience automating end-to-end data pipelines with strong resilience and recoverability.

- Worked on Spark Streaming and Structured Spark streaming including Kafka for real time data processing.

- Strong knowledge of version control systems like SVN and GITHUB.

- Involved in production monitoring using workflow monitor and experience in development and support environments.

- Experienced in using waterfall, Agile and Scrum models of software development process framework.

- Good level of experience in Core Java, J2EE technologies, JDBC, Servlets and JSP.

- Good knowledge in Oracle PL/SQL and shell scripting.

- Experience in design and development of Web forms using Spring MVC, Java Script, JSON and JQ plotter.

- Active team player with excellent interpersonal skills, keen learner with self-commitment& innovation.

- Ability to meet deadlines and handle pressure in coordinating multiple tasks in the work environment.

Technical Skills :

- Big Data Ecosystem: Spark, MapReduce, HDFS, HIVE, HBase, Pig, Sqoop, Flume, Oozie, Zookeeper, Spark, Hue, Cloudera (CDH), Hortonworks(HDP)

Cloud Services : EC2, EMR, S3, Redshift, Athena, AWS ECS, Terraform, AWS Cloud Formation, AWS Cloud Watch,

Relational Databases : Oracle 12c, MySQL, MS-SQL Server

NoSQL Databases : HBase, Cassandra and MongoDB

Version Control : GitHub, SVN

Programming Languages : Java, Scala, Python, SQL, PL/SQL, Shell Scripting.

Software Development : UML, Design Patterns (Core Java and J2EE), Software Development Lifecycle (SDLC), Waterfall Model and Agile, STLC

Web Technologies : JavaScript, CSS, HTML and JSP.

Operating Systems : Windows, UNIX/Linux, and Mac OS.

Build Management Tools : Maven, Ant.

IDE & Command line tools : Eclipse, IntelliJ, Toad and NetBeans.

Job Classification

Industry: IT Services & Consulting
Functional Area:
Role Category: Other
Role: Other
Employement Type: Full time

Education

Under Graduation: B.Tech/B.E. in Computers, BCA in Computers, B.Sc in Computers
Post Graduation: M.Tech in Computers, MCA in Computers, MS/M.Sc(Science) in Computers
Doctorate: Doctorate Not Required

Contact Details:

Company: Career Infosystem
Location(s): Bengaluru

+ View Contact

×

Login

Candidates can login here to view contacts and apply.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Sign In Close

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

0 - 1 Yrs 1 - 2 Yrs 2 - 3 Yrs 3 - 4 Yrs 4 - 5 Yrs 5 - 6 Yrs 6 - 7 Yrs 7 - 8 Yrs 8 - 9 Yrs 9 - 10 Yrs 10 - 11 Yrs 11 - 12 Yrs 12 - 13 Yrs 13 - 14 Yrs 14 - 15 Yrs 15 - 16 Yrs 16 - 17 Yrs 17 - 18 Yrs 18 - 19 Yrs 19 - 20 Yrs 20 - 21 Yrs 21 - 22 Yrs 22 - 23 Yrs 23 - 24 Yrs 24 - 25 Yrs 25 - 26 Yrs 26 - 27 Yrs 27 - 28 Yrs 28 - 29 Yrs 29 - 30 Yrs 30+ Yrs

Expected Salary (*)

Rs 0 - 50K PM Rs 50K - 1 LPA Rs 1.0 - 1.5 LPA Rs 1.5 - 2.0 LPA Rs 2.0 - 2.5 LPA Rs 2.5 - 3.0 LPA Rs 3.0 - 3.5 LPA Rs 3.5 - 4.0 LPA Rs 4.0 - 4.5 LPA Rs 4.5 - 5.0 LPA Rs 5 - 6 LPA Rs 6 - 7 LPA Rs 7 - 8 LPA Rs 8 - 9 LPA Rs 9 - 10 LPA Rs 10 - 12 LPA Rs 12 - 14 LPA Rs 14 - 16 LPA Rs 16 - 18 LPA Rs 18 - 20 LPA Rs 20 - 22 LPA Rs 22 - 24 LPA Rs 24 - 26 LPA Rs 26 - 28 LPA Rs 28 - 30 LPA Rs 30 - 32 LPA Rs 32 - 34 LPA Rs 34 - 36 LPA Rs 36 - 38 LPA Rs 38 - 40 LPA Rs 40 - 42 LPA Rs 42 - 44 LPA Rs 44 - 46 LPA Rs 46 - 48 LPA Rs 48 - 50 LPA Rs 50 - 75 LPA Rs 75 Lakh - 1C PA Rs 1 Crore+ PA

Desired Industry (*):

Accounting / Finance Advertising / MR / PR / Events Agriculture / Dairy Animation / Multimedia Architecture / Interior Design Astrology Automobile / Auto Ancillaries / Auto Components Aviation / Airline / Aerospace / Aeronautical Banking / Financial Services / Broking BPO / Call Center / ITeS Brewery / Distillery Broadcasting Cement / Building Material Chemical / Petro / Plastic / Rubber / Glass Consumer Electronics / Appliances / Durables Courier / Transportation / Freight Defence / Government Education / Teaching / Training Electricals / Switchgears Engineering / Construction / Cement / Metals Environment / Waste Management Export / Import / Trading Facility Management Fertilizers / Pesticides FMCG / Foods / Beverage Food Processing Furnishings / Ceramics / Sanitaryware / Electricals Gems / Jewellery Gifts / Toys / Stationary Government / Departmental Heat Ventilation / Air Conditioning Hotel / Restaurant Industrial Design Industrial Products / Heavy Machinery Insurance Internet / E-Commerce IT - Hardware / Networking IT - Software / Services KPO / Research / Analytics Leather / Leather Products Legal / Courts Logistics / Courier / Transportation Management Consulting / Strategy Manufacturing / Production Matrimony / Matchmaking Media / Entertainment Medical / Healthcare / Hospital Merchant Navy Metal / Iron / Steel MFI - Micro Finance Military / Police / Arms Ammunition Mining / Quarrying NBFC-Non Banking Financial Services NGO / Social Work Office Equipment / Automation Not Mentioned Paint / Art / Sculpture / Craft Paper / Wood Personal Care / Beauty Pharma / Biotech / Clinical Research Politics Power / Energy / Oil / Gas / Petroleum Printing / Publishing / Packaging Quality Certification Real Estate / Property Recruitment Services / RPO Religion / Spirituality Retail Security / Detective Services Semiconductors / Electronics Shipping / Marine Telecom / ISP Textile / Garments / Fashion Travel / Tourism / Hotels / Airlines / Railways Unskilled Labor / Domestic Help Veterinary Science / Pet Care Sports / Fitness / Beauty

Functional area / Department (*):

Accounts / Finance / Tax / CS / Audit Agent / Agency Analytics & Business Intelligence Architecture / Interior Design Banking / Insurance Beauty / Fitness / Spa Services Content / Journalism Corporate Planning / Consulting CSR & Sustainability Engineering Design / R&D Export / Import / Merchandising Fashion / Garments / Merchandising Guards / Security Services Hotels / Restaurants HR / Administration / IR IT- Hardware / Telecom / Technical Staff / Support IT Software - Application Programming / Maintenance IT Software - Client Server IT Software - DBA / Datawarehousing IT Software - E-Commerce / Internet Technologies IT Software - Embedded /EDA /VLSI /ASIC /Chip Des. IT Software - ERP / CRM IT Software - Mainframe IT Software - Middleware IT Software - Mobile IT Software - Network Administration / Security IT Software - Other IT Software - QA & Testing IT Software - System Programming IT Software - Systems / EDP / MIS IT Software - Telecom Software ITES / BPO / KPO / Customer Service / Operations Legal Marketing / Advertising / MR / PR Pharma / Biotech / Healthcare / Medical / R&D Packaging Production / Maintenance / Quality Purchase / Logistics / Supply Chain Sales / BD Secretary / Front Office / Data Entry Self Employed / Consultants Shipping Site Engineering / Project Management Teaching / Education Top Management Ticketing / Travel / Airlines TV / Films / Production Web / Graphic Design / Visualiser Other Areas

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach Resume  Max 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Sign Up Close

Candidates are expected to provide most recent and accurate profile information, inappropriate content is strictly prohibited!

Keyskills:   Java RDBMS Hadoop Big Data HDFS J2EE Data Analytics Distributed Systems Performance Tuning Spark Streaming MapReduce