Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Senior Data Engineer/Python Developer @ Luxoft

Home > DBA / Data warehousing

 Senior Data Engineer/Python Developer

Job Description

  • Project description Luxoft has been asked to contract a Developer in support of a number of customer initiatives. The primary objective is to develop based on client requirements in the Telecom/network work environment
  • Responsibilities
  • A Data Engineer with experience in the following techologies
  • Databricks and Azure
  • Apache Spark-based, hands on Python, SQL, Apache Airflow.
  • Databricks clusters for ETL processes.
  • Integration with ADLS, Blob Storage.
  • Efficiently ingest data from various sources, including on-premises databases, cloud storage, APIs, and streaming data.
  • Use Azure Key Vault for managing secrets.
  • Hands on experience working with API's
  • Kafka/Azure EventHub streaming hands on experience
  • Hands on experience with data bricks delta API's and UC catalog Hands on experience working with version control tools Github
  • Data Analytics
  • Supports various ML frameworks.
  • Integration with Databricks for model training.
  • OnPrem
  • Exposure on Linux based systems
  • Unix scripting
  • Skills Must have
  • Python, Apache Airflow, Microsoft Azure and Databricks, SQL, databricks clusters for ETL, ADLS, Blob storage, ingestion from various sources including databases and cloud storage, APIs and streaming data, Kafka/Azure EventHub, databricks delta APIs and UC catalog.
  • EducationTypically, a Bachelor's degree in Computer Science (preferably M.Sc. in Computer Science), Software Engineering, or a related field is required.
  • Experience7+ years of experience in development or related fields.
  • Problem-Solving Skills:
  • Ability to troubleshoot and resolve issues related to application development and deployment.
  • Communication Skills:
  • Ability to effectively communicate technical concepts to team members and stakeholders. This includes written and verbal communication.
  • TeamworkAbility to work effectively in teams with diverse individuals and skill sets.
  • Continuous LearningGiven the rapidly evolving nature of web technologies, a commitment to learning and adapting to new technologies and methodologies is crucial. Nice to have
  • Snowflake, PostGre, Redis exposure
  • GenAI exposure
  • Good understanding of RBAC
  • Job Classification

    Industry: Legal
    Functional Area / Department: Engineering - Software & QA
    Role Category: DBA / Data warehousing
    Role: Data warehouse Developer
    Employement Type: Full time

    Contact Details:

    Company: Luxoft
    Location(s): Bengaluru

    + View Contactajax loader


    Keyskills:   python airflow microsoft azure sql data bricks snowflake github azure data lake data analytics continuous development rbac python development redis apache postgresql spark linux kafka web technologies api etl azure event hub unix ml

     Fraud Alert to job seekers!

    ₹ Not Disclosed

    Similar positions

    SAP Data and AI Architect

    • Capgemini
    • 20 - 25 years
    • Mumbai
    • 3 days ago
    ₹ Not Disclosed

    Job Opening | Data Engineer- Python And Pyspark | Hcl Tech |

    • HCLTech
    • 5 - 10 years
    • Hyderabad
    • 3 days ago
    ₹ .75-8.75 Lacs P.A.

    Data Engineer II

    • Amazon
    • 1 - 6 years
    • Hyderabad
    • 3 days ago
    ₹ Not Disclosed

    Data Architect

    • Mphasis
    • 8 - 10 years
    • Bengaluru
    • 3 days ago
    ₹ Not Disclosed

    Luxoft

    Luxoft India LLP