Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Data Engineer @ Vigoursoft Global

Home > Software Development

 Data Engineer

Job Description

  • Expert in building and scaling data pipelines for ML/GenAI using Spark, Airflow, PostgreSQL, and cloud-native practices.
  • Must have experience to handle end-to-end GenAI projects: NLP model usage, embeddings, pipelines
  • Hands on experience with LLMs with Spark/Airflow ETL
  • Hands-on experience with tool stack: GitHub, Docker, FastAPI, Redis, Ray Serve, Kubernetes and GitHub Actions.
  • Should have experience in tokenization and embedding generation work using Hugging Face.
  • Should be able to generate prompts for the GPT and Should be able to fine-tune GPT for a classification task.
  • Should have experience in building a RAG pipeline using LangChain + FAISS
  • Should be able to integrate FastAPI with OpenAI function-calling
  • Should have knowledge of Slackbot agent and its modules, Tool-Calling Agent, Multi-Agent System, License Optimizer Bot etc.
  • Should be able to design a resilient Spark pipeline to process SFDC PostgreSQL data for NLP.
  • Candidate must have a deep understanding of Postgres and DB design practices.
  • Candidate must have experience with CI/CD pipeline to deploy and monitor an LLM service. 
  • Candidate should take initiative and ownership of cross-functional projects and run projects with limited supervision
  • Candidate should be innovative, able to scale ideas, and should have vision in the latest in GenAI/ML/Data Engineering.

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Data Engineer
Employement Type: Full time

Contact Details:

Company: Vigoursoft Global
Location(s): Bengaluru

+ View Contactajax loader


Keyskills:   Airflow Generative Ai Spark Python SQL

 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Engineer /senior Engineer - (mcu Rtos)

  • Einfochips
  • 5 - 10 years
  • Hyderabad
  • 20 hours ago
₹ Not Disclosed

QA Automation & Infrastructure Engineer

  • FCS Software Solutions
  • 10 - 20 years
  • Noida, Gurugram
  • 3 days ago
₹ Not Disclosed

Senior CPaaS Engineer

  • FCS Software Solutions
  • 8 - 13 years
  • Noida, Gurugram
  • 3 days ago
₹ Not Disclosed

Sr. Software Engineer

  • Orange Business
  • 6 - 11 years
  • Noida, Gurugram
  • 4 days ago
₹ Not Disclosed

Vigoursoft Global

Founded in 2016, VigourSoft Global Solutions is a Big data analytics based software product engineering services firm specializing in Customer Data Platforms, MarTech, AdTech, Infrastructure, Healthcare and Business Analytics. We help develop cloud based products and platforms that improve market sh...