Senior Java Backend Engineer - Generative AI Platform @ Grid Dynamics

Essential functions

• Develop and maintain scalable backend services for generative AI applications using Java and Spring Boot

• Design and implement APIs for LLM integration and AI agent orchestration

• Build robust microservices architecture to support RAG systems and LLM-powered applications

• Implement caching strategies and optimization for vector database operations

• Integrate with multiple LLM providers and manage API rate limiting and failover mechanisms

• Develop real-time streaming capabilities for conversational AI applications

• Ensure system observability and implement comprehensive logging and monitoring

Qualifications

Backend Development:

• 3+ years of experience with Java and Spring Boot framework

• Strong understanding of RESTful API design and microservices architecture

• Experience with Spring Security, Spring Data JPA, and Spring Cloud

• Proficiency with database technologies (PostgreSQL, MongoDB, Redis)

• Knowledge of message queuing systems (RabbitMQ, Apache Kafka)

• Experience with caching mechanisms and performance optimization

Generative AI Integration:

• Experience integrating LLM APIs (OpenAI, Gemini, Anthropic) into backend systems

• Knowledge of vector database integration and semantic search implementations

• Experience with AI agent frameworks and orchestration (LangGraph, etc.)

• Understanding of RAG architecture and implementation patterns

• Experience with streaming responses and WebSocket connections for real-time AI interactions

• Knowledge of prompt management and template systems

Would be a plus

Good to Have:

• Experience with fine-tuning workflows and model deployment pipelines

• Knowledge of self-hosted LLM integration and management

• Experience with observability tools (LangSmith, custom monitoring solutions)

• Understanding of natural language to SQL query systems

• Experience with containerization (Docker) and orchestration (Kubernetes)

• Knowledge of CI/CD pipelines and DevOps practices

• Cloud platform experience with certifications preferred (AWS, GCP, Azure)

• Understanding of authentication and authorization patterns

• Experience with testing frameworks (JUnit, Mockito, TestContainers)

• Knowledge of system design and scalability patterns

• Familiarity with Elasticsearch or similar search technologies

We offer

• Opportunity to work on bleeding-edge projects


• Work with a highly motivated and dedicated team


• Competitive salary


• Flexible schedule


• Benefits package - medical insurance, sports


• Corporate social events


• Professional development opportunities


• Well-equipped office