Your browser does not support javascript! Please enable it, otherwise web will not work for you.

Lead Software Engineer (Generative AI Java) @ Epam Systems

Home > Software Development

 Lead Software Engineer (Generative AI Java)

Job Description

We are seeking a hands-on and forward-thinkingPrincipal or Lead Engineerwith deep expertise inJava-based backend developmentand a strong grasp ofGenerative AI technologies. You will lead the design, development, and deployment of Gen AI-based solutions, working across data, ML engineering, and software engineering teams to integrate AI capabilities into our core platforms and client-facing products.


Responsibilities

  • Lead end-to-end architecture and implementation of Generative AI solutions integrated with Java-based applications
  • Evaluate, fine-tune, and deploy foundational and LLM models (e.g., GPT, LLaMA, Claude, Gemini) for use cases such as code generation, summarization, intelligent assistants, etc.
  • Collaborate with engineers and practice leads to identify and scope high-impact Gen AI use cases
  • Build solutions based on AI models with engineers. Mentor and guide junior engineers and set technical direction across AI initiatives
  • Build scalable APIs and microservices in Java/Spring Boot that interact with AI models
  • Optimize performance and cost of AI solutions in production using prompt engineering, retrieval-augmented generation (RAG), caching, and model selection
  • Contribute to AI model experimentation and evaluation pipelines (OpenAI, Hugging Face, LangChain, etc.)
  • Drive adoption of Gen AI best practices (e.g., guardrails, ethical AI, observability, and feedback loops)

Requirements

  • Bachelors or Masters degree in Computer Science, Engineering, or related field
  • 10+ years of experience in Java/J2EE/Spring Boot and backend architecture
  • 3+ years of experience working on ML/AI/Gen AI systems, including hands-on work with LLM APIs or open-source models
  • Strong knowledge of modern Gen AI frameworks likeLangChain, LlamaIndex, andVector DBs (e.g., FAISS, Pinecone, Chroma)
  • Experience integrating with LLMs via APIs (OpenAI, Azure OpenAI, Hugging Face) or self-hosted models
  • Working knowledge of Python for AI model orchestration and prototyping
  • Solid understanding of data pipelines, REST APIs, containerization (Docker, Kubernetes), and CI/CD workflows
  • Experience with AWS, GCP, or Azure AI/ML services

Nice to have

  • Familiarity with prompt engineering and fine-tuning LLMs using techniques like LoRA or PEFT
  • Experience building RAG-based chatbots, copilots, or AI-powered developer tools
  • Contributions to AI communities, research, or open-source Gen AI projects
  • Strong communication and stakeholder management skills

Job Classification

Industry: IT Services & Consulting
Functional Area / Department: Engineering - Software & QA
Role Category: Software Development
Role: Search Engineer
Employement Type: Full time

Contact Details:

Company: Epam Systems
Location(s): Hyderabad

+ View Contactajax loader


Keyskills:   fundamentals lora continuous integration kubernetes ci/cd data pipeline artificial intelligence docker cloud containerization gen java gcp devops j2ee vector backend architecture communication skills ml rest cd python large spring boot framework stakeholder management aws

 Job seems aged, it may have been expired!
 Fraud Alert to job seekers!

₹ Not Disclosed

Similar positions

Engineer /senior Engineer - (mcu Rtos)

  • Einfochips
  • 5 - 10 years
  • Hyderabad
  • 21 hours ago
₹ Not Disclosed

SDET Technical Lead

  • Wipro HR Soniya
  • 5 - 8 years
  • Hyderabad
  • 2 days ago
₹ Not Disclosed

Application Lead

  • Accenture
  • 15 - 20 years
  • Bengaluru
  • 3 days ago
₹ Not Disclosed

Application Lead

  • Accenture
  • 5 - 8 years
  • Bengaluru
  • 3 days ago
₹ Not Disclosed

Epam Systems

About us:EPAM Systems