Cyber Data Pipeline Engineer
- Dexian India
- 7 - 12 years
- Bengaluru
- 4 months ago
- Email to a friend
- Report this job
Job Description
Role & responsibilities
Title: Cyber Data Pipeline Engineer
Location: Bengaluru
Experience: 7 to 14 years
Role Profile
A successful applicant will contribute to several important initiatives including:
- Collaborate with Cyber teams to identify, onboard, and integrate new data sources into the platform.
- Design and implement data mapping, transformation, and routing processes to meet analytics and monitoring requirements.
- Developing automation tools that integrate with in-house developed configuration management frameworks and APIs
- Monitor the health and performance of the data pipeline infrastructure.
- Working as a top-level escalation point to perform complex troubleshoots, working with other infrastructure teams to resolve issues
- Create and maintain detailed documentation for pipeline architecture, processes, and integrations.
Required Skills
- Hands-on experience deploying and managing large-scale dataflow products like Cribl, Logstash or Apache NiFi.
- Hands-on experience integrating data pipelines with cloud platforms (e.g., AWS, Azure, Google Cloud) and on-premises systems.
- Hands-on experience in developing and validating field extraction using regular expressions.
- A solid understanding of Operating Systems and Networking concepts: Linux/Unix system administration, HTTP and encryption.
- Good understanding of software version control, deployment & build tools using DevOps SDLC practices (Git, Jenkins, Jira)
- Strong analytical and troubleshooting skills
- Excellent verbal & written communication skills
- Appreciation of Agile methodologies, specifically Kanban
Desired Skills
- Enterprise experience with a distributed event streaming platform like Apache Kafka, AWS Kinesis, Google Pub/Sub, MQ
- Infrastructure automation and integration experience, ideally using Python and Ansible
- Familiarity with cybersecurity concepts, event types, and monitoring requirements.
- Experience in Parsing and Normalizing data in Elasticsearch using Elastic Common Schema (ECS)
Preferred candidate profile
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: IT & Information SecurityRole Category: IT SecurityRole: Cyber SecurityEmployement Type: Full timeContact Details:
Company: Dexian IndiaLocation(s): Bengaluru
Keyskills: Logstash Linux Devops Tools Splunk Elastic Search Kibana Cribl Elk Kafka Devops Apache Nifi Cloud Platforms Data Pipeline
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in