Data Processing Engineer (Java, Apache Flink/Storm/Beam)
- Synechron
- 4 - 9 years
- Chennai
- 6 months ago
- Email to a friend
- Report this job
Job Description
Job SummarySynechron is seeking an experienced Data Processing Engineer to lead the development of large-scale data processing solutions using Java, Apache Flink/Storm/Beam, and Google Cloud Platform (GCP). In this role, you will collaborate across teams to design, develop, and optimize data-intensive applications that support strategic business objectives. Your expertise will help evolve our data architecture, improve processing efficiency, and ensure the delivery of reliable, scalable solutions in an Agile environment.Software RequirementsRequired:
Java (version 8 or higher)
Apache Flink, Storm, or Beam for streaming data processing
Google Cloud Platform (GCP) services, especially BigQuery and related data tools
Experience with databases such as BigQuery, Oracle, or equivalent
Familiarity with version control tools such as Git
Preferred:
Cloud deployment experience with GCP in particular
Additional familiarity with containerization (Docker/Kubernetes)
Knowledge of CI/CD pipelines and DevOps practicesOverall ResponsibilitiesCollaborate closely with cross-functional teams to understand data and system requirements, then design scalable solutions aligned with business needs.
Develop detailed technical specifications, implementation plans, and documentation for new features and enhancements.
Implement, test, and deploy data processing applications using Java and Apache Flink/Storm/Beam within GCP environments.
Conduct code reviews to ensure quality, security, and maintainability, supporting team members' growth and best practices.
Troubleshoot technical issues, resolve bottlenecks, and optimize application performance and resource utilization.
Stay current with advancements in data processing, cloud technology, and Java development to continuously improve solutions.
Support testing teams to verify data workflows and validation processes, ensuring reliability and accuracy.
Participate in Agile ceremonies, including sprint planning, stand-ups, and retrospectives to ensure continuous delivery and process improvement.Technical Skills (By Category)Programming Languages:
Required: Java (8+)
Preferred: Python, Scala, or Node.js for scripting or auxiliary processing
Databases/Data Management:
Experience with BigQuery, Oracle, or similar relational data stores
Cloud Technologies:
GCP (BigQuery, Cloud Storage, Dataflow etc.) with hands-on experience in cloud data solutions
Frameworks and Libraries:
Apache Flink, Storm, or Beam for stream processing
Java SDKs, APIs, and data integration libraries
Development Tools and Methodologies:
Git, Jenkins, JIRA, and Agile/Scrum practices
Familiarity with containerization (Docker, Kubernetes) is a plus
Security and Compliance:
Understanding of data security principles in cloud environmentsExperience Requirements4+ years of experience in software development, with a focus on data processing and Java-based backend development
Proven experience working with Apache Flink, Storm, or Beam in production environments
Strong background in managing large data workflows and pipeline optimization
Experience with GCP data services and cloud-native development
Demonstrated success in Agile projects, including collaboration with cross-functional teams
Previous leadership or mentorship experience is a plusDay-to-Day ActivitiesDesign, develop, and deploy scalable data processing applications in Java using Flink/Storm/Beam on GCP
Collaborate with data engineers, analysts, and architects to translate business needs into technical solutions
Conduct code reviews, optimize data pipelines, and troubleshoot system issues swiftly
Document technical specifications, data schemas, and process workflows
Participate actively in Agile ceremonies, provide updates on task progress, and suggest process improvements
Support continuous integration and deployment of data applications
Mentor junior team members, sharing best practices and technical insightsQualificationsBachelors or Masters degree in Computer Science, Information Technology, or equivalent
Relevant certifications in cloud technologies or data processing (preferred)
Evidence of continuous professional development and staying current with industry trendsProfessional CompetenciesStrong analytical and problem-solving skills focused on data processing challenges
Leadership abilities to guide, mentor, and develop team members
Excellent communication skills for technical documentation and stakeholder engagement
Adaptability to rapidly changing technologies and project priorities
Capacity to prioritize tasks and manage time efficiently under tight deadlines
Innovative mindset to leverage new tools and techniques for performance improvements
Job Classification
Industry: IT Services & ConsultingFunctional Area / Department: Engineering - Software & QARole Category: Software DevelopmentRole: Data Platform EngineerEmployement Type: Full timeContact Details:
Company: SynechronLocation(s): Chennai+ View Contact
Keyskills: java python software development agile model pipeline continuous integration kubernetes scala ci/cd cloud deployment docker git gcp devops jenkins bigquery api jira oracle apache flink node.js cloud storage scrum agile data flow data integration
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in