Senior Data Engineer
- Infoblox
- 8 - 13 years
- Bengaluru
- 4 months ago
- Email to a friend
- Report this job
Job Description
- Curate large-scale data from a multitude of sources into appropriate sets for research and development for the data scientists, threat analysts, and developers across the company
- Design, test, and implement storage solutions for various consumers of the data. Especially data warehouses like ClickHouse and OpenSearch.
- Design and implement mechanisms to monitor data sources over time for changes using summarization, monitoring, and statistical methods
- Design, develop, and maintain APIs that enable seamless data integration and retrieval processes for internal and external applications, and ensure these APIs are scalable, secure, and efficient to support high-volume data interactions
- Leverage computer science algorithms and constructs, including probabilistic data structures, to distill large data into sources of insight and enable future analytics
- Convert prototypes into production data engineering solutions through disciplined software engineering practices, Spark optimizations, and modern deployment pipelines
- Collaborate on design, implementation, and deployment of applications with the rest of software engineering
- Support data scientists and Product teams in building, debugging, and deploying Spark applications that best leverage data
- Build and maintain tools for automation, deployment, monitoring, and operations
- Create test plans, test cases, and run tests with automated tools
- 8+ years of experience in software development with programming languages such as Golang, Python, C, C++, C#, or Java,
- Expertise in Big Data MapReduce, Spark Streaming, Kafka, Pub-Sub, In-memory Database
- Experience with technologies such as OpenSearch/ElasticSearch
- Experience in Data lake technologies like Clickhouse
- Good exposure in application performance tuning, memory management, scalability
- Ability to design highly scalable distributed systems using different open-source technologies
- Experience in microservices development and container-based software using Docker/Kubernetes and other container technologies is a plus
- Experience with AWS, GCP or Azure is a plus.
- Experience building high-performance algorithms
- Bachelor s degree in Computer Science, Computer Engineering, or Electrical Engineering is required, master s degree preferred
Job Classification
Industry: TV / RadioFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data EngineerEmployement Type: Full timeContact Details:
Company: InfobloxLocation(s): Bengaluru
Keyskills: Performance tuning C++ Automation Networking Debugging Data structures Test cases Open source Analytics Python
Similar positions
Infoblox
Infoblox delivers Actionable Network Intelligence to enterprise, government, and service provider customers around the world. We are the industry leader in DNS, DHCP, and IP address management, the category known as DDI. We empower thousands of organizations to control and secure their networks from...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in