Lead Data Engineer-Spark, Scala & Hadoop
- G. Pulla Reddy Sweets
- 6 to 13 Yrs
- All India
- 17 days ago
- Email to a friend
- Report this job
Job Description
- Company Description Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa. Job Description Visa is inviting passionate and highly energetic technology enthusiast to join our Data & AI Platform Org. Have you developed applications handling data ranging in hundreds of million records, processing them in near real-time and batch Are you keen to understand how it moves the needle for the business Our Data organization develops and manages end-to-end technology solutions that create value from our enterprise data through Internal and client-focused information-based services. This role will participate in design discussions, create solutions, develop programs and ensure successful delivery of business capabilities. This role will assume technical ownership of multiple applications and create robust and scalable solutions. The successful candidate will be a Lead Data Engineer as part of Data as a Service in Data & AI Platform Organization. Visa provides a challenging environment of volume, velocity and variety that is rarely matched. Candidates looking forward to thrive in such environment are encouraged to apply. Translate business requirements and source system understanding into technical solutions using open source tech stack, Big Data, Java etc. Work directly with business partners to seek clarity on requirements. Define solutions in terms of components, modules, and algorithms. Design, develop, document, and implement new programs and subprograms, including enhancements, modifications, and corrections to existing software. Create technical documentation and procedures for installation and maintenance. Write unit tests covering known use cases using appropriate tools. Integrate test frameworks into the development process. Refactor existing solutions to make them reusable and scalable. Collaborate with operations to deploy solutions. Take ownership of the production deployment of code. Collaborate with cross functional teams to build and launch applications, for either revenue generating or operational purposes. Develop coding and design best practices. Adapt quickly to new application knowledge and changes. This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs. Qualifications Basic Qualifications 10+ years of relevant work experience with a Bachelors Degree or at least 7 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 4 years of work experience with a PhD, OR 13+ years of relevant work experience. Preferred Qualifications Masters or bachelor degree in computer science or another technical discipline. At least 12 plus years of software development experience, particularly in data centric initiatives, with demonstrated expertise in standard development best practices. Minimum 6 plus years of experience with Hadoop, including Spark, Scala, Hive, Kafka, GO Lang. Need exposure to Real Time data processing. Good to have hands on experience in Cloud tech stack GCP, AWS or Azure. Expertise in object-oriented programming languages such as Java and Python. Experience with CI CD processes, version control and bug tracking tools. Experience handling very large data volumes in both low latency and batch modes. Experience with the automation of job execution, validation, and comparison of data files at the field level in a Hadoop environment. Experience leading a small team and being a team player. Strong communication skills with the ability to present complex ideas clearly and concisely. Quick learner, self starter with attention to detail and depth. Additional Information ,
Employement Category:
Employement Type: Full timeIndustry: IT Services & Consulting
Role Category: Not Specified
Functional Area: Not Specified
Role/Responsibilies: Lead Data Engineer-Spark, Scala & Hadoop
Contact Details:
Company: VisaLocation(s): All India
+ View Contact
Keyskills: Big Data Java Hadoop Spark Scala Hive Kafka GCP AWS Azure Python Version control Bug tracking Data processing Automation Team leadership Communication skills GO Lang
Fraud Alert to job seekers!
₹ Not Disclosed
Similar positions
G. Pulla Reddy Sweets
G. Pulla Reddy Sweets is a legendary Indian confectionery brand, celebrated for its authentic pure ghee sweets and savory snacks. Established in 1948 by the visionary entrepreneur and philanthropist Sri G. Pulla Reddy, the brand began its journey from a modest sweet cart in Kurnool, Andhra Prades...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in