Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior Data Engineer - Pyspark, Azure Databricks, Scala @ Optum

Home > Software Development

 Senior Data Engineer - Pyspark, Azure Databricks, Scala

Job Description


Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health equity on a global scale. Join us to start  Caring. Connecting. Growing together.
  •   Positions in this function are responsible for the management and manipulation of mostly structured data, with a focus on building business intelligence tools, conducting analysis to distinguish patterns and recognize trends, performing normalization operations and assuring data quality. Depending on the specific role and business line, example responsibilities in this function could include creating specifications to bring data into a common structure, creating product specifications and models, developing data solutions to support analyses, performing analysis, interpreting results, developing actionable insights and presenting recommendations for use across the company. Roles in this function could partner with stakeholders to understand data requirements and develop tools and models such as segmentation, dashboards, data visualizations, decision aids and business case analysis to support the organization. Other roles involved could include producing and managing the delivery of activity and value analytics to external stakeholders and clients. Team members will typically use business intelligence, data visualization, query, analytic and statistical software to build solutions, perform analysis and interpret data. Positions in this function work on predominately descriptive and regression-based analytics and tend to leverage subject matter expert views in the design of their analytics and algorithms. This function is not intended for employees performing the following workproduction of standard or self-service operational reporting, casual inference led (healthcare analytics) or data pattern recognition (data science) analysis; and/or image or unstructured data analysis using sophisticated theoretical frameworks. Generally work is self-directed and not prescribed.
  •  Primary Responsibilities
  •  
  • Analyze business requirements & functional specifications
  • Be able to determine the impact of changes in current functionality of the system
  • Be able to handle SAS Algo dev assignments independently, end-to-end SDLC
  • Interaction with diverse Business Partners and Technical Workgroups
  • Drive Algo optimization and innovation in the team
  • Be able to be flexible to collaborate with onshore business, during US business hours
  • Be able to be flexible to support project releases, during US business hours
  • Adherence to the defined delivery process/guidelines
  • Drive project quality process compliance
  • Works with less structured, more complex issues
  • Serves as a resource to others
  • Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
  •  Required Qualifications
  •  
  • Bachelors degree or equivalent experience
  • 7+ years of working experience in Python, Pyspark, Scala
  • 5+ years working experience in Azure Databricks
  • 3+ years of experience working on MS SQL Server and NoSQL DBs like Cassandra, etc.
  • Hands-on experience in the Streaming application (Kafka, Spark Streaming, etc.)
  • Solid healthcare domain knowledge
  • Exposure to following DevOps methodology and creating CI/CD deployment pipeline
  • Exposure to following Agile methodology specifically using tools like Rally
  • Proven ability to understand the existing application codebase, perform impact analysis and update the code when required based on the business logic or for optimization
  • Proven excellent analytical and communication skills (Both Verbal and Written)

  • Job Classification

    Industry: Retail
    Functional Area / Department: Engineering - Software & QA
    Role Category: Software Development
    Role: Data Engineer
    Employement Type: Full time

    Contact Details:

    Company: Optum
    Location(s): Hyderabad

    + View Contact

    Keyskills:   scala pyspark azure databricks python nosql hive continuous integration ci/cd azure data factory sql spark devops ssrs hadoop big data etl rally msbi data analysis azure data lake ssas microsoft azure sql server cassandra kafka agile sqoop ssis

     Fraud Alert to job seekers!

    ₹ Not Disclosed

    Similar positions

    Software Development Engineer 2

    • Flipkart
    • 2 - 5 years
    • Bengaluru
    • 23 hours ago
    ₹ 15-27.5 Lacs P.A.

    Senior Software Engineer_Embedded C Developer

    • Capgemini
    • 4 - 7 years
    • Chennai
    • 23 hours ago
    ₹ Not Disclosed

    Software Development Engineer

    • Accenture
    • 2 - 7 years
    • Mumbai
    • 1 day ago
    ₹ Not Disclosed

    Software Engineer Iii - React / Ui

    • JPMorgan Chase Bank
    • 0 - 6 years
    • Bengaluru
    • 1 day ago
    ₹ Not Disclosed

    Optum

    About: OptumInsight India Pvt Ltd, a UnitedHealth group company is a leading health services and innovation company dedicated to help make the health system work better for everyone. With more than 115,000 people worldwide, Optum combines technology, data and expertise to improve the delivery, ...

    IndigoJobs © 2025

    For enquiries: contact(at)indigojobs.in

    We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in