Big Data Engineer (2-6 Yrs)
- B3 Digital Solution
- 2 - 6 years
- Delhi, NCR
- 4 years ago
- Email to a friend
- Report this job
Job Description
We are currently looking for BID DATA administrators, DevOps engineers and developers to work from Hyderabad/Noida office on Contract to hire role. The job would need you to join initially on contract for minimum 4 months. Upon confirmation based on employee performance, the employement would be made permanent.
Job Summary:
Big Data specialist who has experience in setting up and engineering BIG DATA clusters or building real time analytical pipelines with the latest Big Data Technologies and DevOps tools.
You will lead the administration or development of data collection, data streaming, data processing and rules engine framework.
The ideal candidate will be passionate about Big Data and stay up-to-date with the latest developments in the field.
Job Responsibilities/ Accountabilities:
- Develop a plan and brief for IT Governance assessment as per COBIT 5 guidelines
- Proficient in designing, developing and delivering Big Data solutions on a Hadoop platform.
- Expertise & Experience of Hadoop based platform and associated technology; Spark, Kafka, Hive, HBase, Yarn, Python, Flink, Java and Scala
- Experience in building web applications with Java Frameworks
- Strong knowledge in MongoDB, Redis and optimizations of NoSQL database
- Develop and maintain scalable data pipelines and build out new integrations to support continuing increases in data volume and complexity.
- Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Ensure End to end delivery from PoC through to Production service for projects related to data and engineering
- Strong developer / coding skills that encompass:
- Provide design and support for Architecture and solution design
- Design and engineering decisions that cater for both functional and non-functional requirements
- Give insight and Knowledge of industry and technology trends around Big Data and Data Science
- Enterprise solutions support on data management and analysis.
Key Critical Competencies
- Excellent Java and Python knowledge
- Proficiency in Spark, Flink and Kafka
- Object oriented programming
- Strong knowledge of web application framework; Java Spring
- Strong grasp on SQL/NoSQL
- Git / version control culture
- Good knowledge of Linux, bash
- Ability to work with containerised solutions: Docker/Compose/Swarm/Kubernetes
- Unit testing, Test driven development practice
- DevOps, Continuous integration/ continuous deployment experience
- Agile development environment experience, familiarity with SCRUM
Knowledge Sharing and Mentoring Requirements:
- A University degree in Computer Science, Information Technology, and/or related field. Preferred Minimum 2 years of experience in Information Technology in the field of data science and data analytics.
- Analysis: Identify and understand issues, problems and opportunities; compare data from different sources to draw conclusions
- Demonstrated ability to effectively balance multiple responsibilities which may frequently change
- Ability to learn information quickly and apply risk/control considerations which impact downstream decisions
- High degree of professionalism and personal integrity
- Ability to work with a high degree of independence
- Excellent analytical skills.
- Able to record information accurately
- Able to remain calm under pressure
Job Classification
Industry: IT-Software, Software ServicesFunctional Area: IT Software - Application Programming, Maintenance,
Role Category: Programming & Design
Role: Programming & Design
Employement Type: Contract
Education
Under Graduation: B.Tech/B.E. in Any Specialization, B.Sc in Any SpecializationPost Graduation: MCA in Computers, MBA/PGDM in Any Specialization, Information Technology, Systems, MS/M.Sc(Science) in Any Specialization, Post Graduation Not Required, M.Tech in Any Specialization
Doctorate: Doctorate Not Required, Any Doctorate in Any Specialization
Contact Details:
Company: B3 Digital Solution pvt ltdLocation(s): Delhi, NCR
Keyskills: Java BIG DATA Administrator Hadoop Big Data Kafka SQL HBase Big Data Architect Hive NoSQL Devops Engineer Spark Python
B3 Digital Solution
B3 Digital Solutions is an information technology and research & development company, providing application development and support service in next generation emerging technology. Company primarily deal in enterprise applications for data management, analytics and visualization. Head quartered i...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in
