Data Engineer Big Data
- Best infosystems
- 4 - 9 Years
- Delhi, NCR
- 4 years ago
- Email to a friend
- Report this job
Job Description
Data Engineer: Big DataYour Role and Responsibilities
As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the design of data solutions. You will manage the implementing and managing large scale cluster for streaming using technologies like kafka, flink, Druid, NoSQL DB etc.
Responsibilities:
Responsible for full operational lifecycle of streaming platform including cluster sizing, technology selection, deployment, monitoring, scaling & helping with kafka apps development
Responsible for ensuring platform availability and zero downtime
Implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Apache Spark, Kafka, any Cloud computing etc.
If you thrive in a dynamic, collaborative workplace, IBM provides an environment where you will be challenged and inspired every single day. And if you relish the freedom to bring creative, thoughtful solutions to the table, there's no limit to what you can accomplish here.
Posting Country
India
State / Province
KARNATAKA
City / Township / Village
Bangalore
Travel Required
Up to 10% or 1 day a week
Position Type
Professional
Required Education
Bachelor's Degree
Required Technical and Professional Expertise
Minimum 4+ years of experience in Big Data technologies
Experience of implementing and managing large scale cluster for streaming kafka, flink, Druid, NoSQL DB etc
Expertise in Contenerizing cluster services using Docker and Kubernetes (preferably using Openshift)
Solid practical experience of Cluster Administration and Monitoring using Grafana, Prometheus, ElasticSearch, Kibana or similar technologies
Hands on experience on securing clusters - Kerberos, LDAP, TLS, RBAC
Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers
Eligibility Requirements
NA
Preferred Technical and Professional Experience
Experience in Python programming is desirable
You love collaborative environments that use agile methodologies to encourage creative design thinking and find innovative ways to develop with cutting edge technologies
Ambitious individual who can work under their own direction towards agreed targets/goals and with creative approach to work
Intuitive individual with an ability to manage change and proven time management
Proven interpersonal skills while contributing to team effort by accomplishing related results as needed
Up-to-date technical knowledge by attending educational workshops, reviewing publications
Preferred Education
Master's Degree
Experience :- 4 + year
Responsible for full operational lifecycle of streaming platform including cluster sizing, technology selection, deployment, monitoring, scaling & helping with kafka apps development
Responsible for ensuring platform availability and zero downtime
Implement scalable solutions to meet the ever-increasing data volumes, using big data/cloud technologies Apache Spark, Kafka, any Cloud computing etc.
If you thrive in a dynamic, collaborative workplace, IBM provides an environment where you will be challenged and inspired every single day. And if you relish the freedom to bring creative, thoughtful solutions to the table, there's no limit to what you can accomplish here.
Posting Country
India
State / Province
KARNATAKA
City / Township / Village
Bangalore
Travel Required
Up to 10% or 1 day a week
Position Type
Professional
Required Education
Bachelor's Degree
Required Technical and Professional Expertise
Minimum 4+ years of experience in Big Data technologies
Experience of implementing and managing large scale cluster for streaming kafka, flink, Druid, NoSQL DB etc
Expertise in Contenerizing cluster services using Docker and Kubernetes (preferably using Openshift)
Solid practical experience of Cluster Administration and Monitoring using Grafana, Prometheus, ElasticSearch, Kibana or similar technologies
Hands on experience on securing clusters - Kerberos, LDAP, TLS, RBAC
Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers
Eligibility Requirements
NA
Preferred Technical and Professional Experience
Experience in Python programming is desirable
You love collaborative environments that use agile methodologies to encourage creative design thinking and find innovative ways to develop with cutting edge technologies
Ambitious individual who can work under their own direction towards agreed targets/goals and with creative approach to work
Intuitive individual with an ability to manage change and proven time management
Proven interpersonal skills while contributing to team effort by accomplishing related results as needed
Up-to-date technical knowledge by attending educational workshops, reviewing publications
Preferred Education
Master's Degree
Experience :- 4 + year
Employement Category:
Employement Type: Full timeIndustry: ITFunctional Area: ITRole Category: Data AnalystRole/Responsibilies: Data Engineer Big DataContact Details:
Company: Best infosystemsLocation(s): Delhi, NCR+ View Contact
Fraud Alert to job seekers!
₹ Not Specified
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in