Overview

We are seeking a skilled Generative AI Platforms Architect to lead and define the architecture for our enterprise GenAI platform.

The role involves creating reference architectures, guardrails, and roadmaps to deliver scalable and secure AI solutions—including LLMs, agentic applications, and tool integrations—across multiple clouds. By collaborating with engineering, security, data governance, and product teams, the Architect will translate business goals into platform designs and actionable delivery plans, while mentoring engineers and advocating for best practices in LLMOps/ModelOps.

Responsibilities

  • Design enterprise generative AI reference architectures, blueprints, and reusable patterns
  • Define multi-cloud platform foundations addressing networking, identity, and secrets management
  • Lead efforts in LLMOps/ModelOps, focusing on model evaluation, safety, observability, and rollout strategies
  • Create frameworks and governance for agentic systems, including tool governance and the Model Context Protocol (MCP)
  • Ensure systems comply with security, risk, and compliance standards, with Responsible AI principles and PII controls applied
  • Establish strategies for cost efficiency, reliability, and performance using capacity planning and FinOps techniques
  • Improve developer experience through CI/CD pipelines, golden paths, templates, and Infrastructure as Code (IaC) techniques
  • Collaborate with cross-functional teams to align system requirements with strategic objectives

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience
  • Proven experience in architecture roles involving cloud, data, or production Generative AI/LLM systems
  • Strong knowledge of cloud platforms (either Azure, AWS or GCP) and Infrastructure as Code tools like Terraform, Bicep, CDK, CloudFormation
  • Proficiency with containerization, orchestration, and API management (Docker, Kubernetes, API gateways/service meshes)
  • Experience with CI/CD and release management for ML/LLM workloads (Jenkins, GitHub Actions, GitLab CI, Azure DevOps)
  • Comprehensive expertise with LLM-based solutions, including deploying and operating LLM inference (e.g., vLLM, Triton, TGI, Ray Serve, KServe/Seldon), LLM/app tracing and metrics (e.g., OpenTelemetry, Langfuse, Arize Phoenix, WhyLabs), and building evaluation pipelines (offline/online, regression suites)
  • Ability to design and oversee data and retrieval pipelines (embedding generation, indexing/refresh strategies, vector DBs such as Pinecone, Weaviate, Milvus, FAISS, and relevance monitoring)
  • Experience architecting secure, scalable agentic systems, including multi-agent workflows (LangGraph, CrewAI, AutoGen-like), state management, retries, rate limits, tool-failure handling, step-level auditing, and integration with external tools via Model Context Protocol (MCP) or similar standards
  • Proven track record implementing security and compliance guardrails: secrets isolation, tool/API permissions, prompt-injection defenses, data leakage prevention, PII redaction, policy enforcement, and operating tool registries
  • Advanced proficiency in English (B2+/C1)

Georgia (Production)

We connect like-minded people

  • Delivering innovative solutions to industry leaders, making a global impact 
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home 
  • Opportunity to work abroad for up to two months per year 
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events   

We invest in your growth

  • Leadership development, career advising, soft skills and well-being programs 
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to LinkedIn Learning and Udemy
  • Free English classes with certified teachers 

We cover it all

  • Participation in the Employee Stock Purchase Plan 
  • Monetary bonuses for engaging in the referral program 
  • Comprehensive medical & family care package   
  • Five trust days per year (sick leave without a medical certificate)   
  • Benefits package (sports activities, a variety of stores and services)

Armenia (Prod)

We connect like-minded people

  • Delivering innovative solutions to industry leaders, making a global impact  
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your home 
  • Opportunity to work abroad for up to two months per year 
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events   

We invest in your growth

  • Leadership development, career advising, soft skills and well-being programs 
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to LinkedIn Learning and Udemy
  • Free English classes with certified teachers    

We cover it all

  • Participation in the Employee Stock Purchase Plan 
  • Monetary bonuses for engaging in the referral program 
  • Comprehensive medical & family care package   
  • Four trust days per year for personal needs
  • Discounts for fitness clubs
  • Benefits package (hotels, restaurants, stores and services)

Kazakhstan (Prod)

We connect like-minded people:

  • Delivering innovative solutions to industry leaders, making a global impact 
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home 
  • Opportunity to work abroad for up to two months per year 
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events   

We invest in your growth: 

  • Leadership development, career advising, soft skills and well-being programs 
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to LinkedIn Learning and Udemy
  • Free English classes with certified teachers 
  • Discounts in local language schools, including online courses for the Kazakh language

We cover it all:

  • Participation in the Employee Stock Purchase Plan 
  • Monetary bonuses for engaging in the referral program 
  • Medical & family care package   
  • Six trust days per year (sick leave without a medical certificate)   
  • Coverage of psychology sessions of your choice
  • Benefits package (sports activities, a variety of stores and services)

Kyrgyzstan (Prod)

We connect like-minded people:

  • Delivering innovative solutions to industry leaders, making a global impact 
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home 
  • Opportunity to work abroad for up to two months per year 
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events 

We invest in your growth: 

  • Leadership development, career advising, soft skills and well-being programs 
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to LinkedIn Learning and Udemy
  • Free English classes with certified teachers

We cover it all:

  • Monetary bonuses for engaging in the referral program 
  • Medical & family care package   
  • Six trust days per year (sick leave without a medical certificate)   
  • Coverage of psychology sessions of your choice
  • Discounts for fitness clubs and sports programs
  • Benefits package (sports activities, a variety of stores and services)

Uzbekistan (Prod)

We connect like-minded people:

  • Delivering innovative solutions to industry leaders, making a global impact 
  • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home 
  • Opportunity to work abroad for up to two months per year 
  • Relocation opportunities within our offices in 55+ countries
  • Corporate and social events  

We invest in your growth: 

  • Leadership development, career advising, soft skills and well-being programs 
  • Certifications, including GCP, Azure and AWS
  • Unlimited access to LinkedIn Learning and Udemy
  • Free English classes with certified teachers 

  • Discounts in local language schools, including offline courses for the Uzbek language

We cover it all:

  • Monetary bonuses for engaging in the referral program 
  • Medical & family care package   
  • Four trust days per year (sick leave without a medical certificate)   
  • Discounts for fitness clubs, dance schools and sports programs
  • Benefits package (sports activities, a variety of stores and services)

[epamgdo] Georgia (Hybrid)

This position offers remote setup with the flexibility to work from any location in Georgia, whether it's your home, well-equipped offices in Tbilisi and Batumi or a coworking space in Kutaisi.

[epamgdo] Armenia (Hybrid)

This is a fully remote position that offers you the flexibility to work from any location in Armenia, whether it's your home or well-equipped offices in Yerevan or Gyumri.

[epamgdo] Kazakhstan (Hybrid)

This position offers remote setup with the flexibility to work from any location in Kazakhstan, whether it's your home or well-equipped offices in Astana, Almaty or Karaganda.

[epamgdo] Kyrgyzstan (Hybrid)

Unlock the potential of remote work in Kyrgyzstan, giving you the flexibility to work from home or access our office in Bishkek.

[epamgdo] Uzbekistan (Hybrid)

Unlock the potential of remote work in Uzbekistan, giving you the flexibility to work from home or access our office in Tashkent.

[epamgdo] Georgia (About EPAM)

EPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, clients, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow.

[epamgdo] Armenia (About EPAM)

EPAM Armenia is a team of talented innovators united by a passion for technology. In 2014, we opened our first office in Yerevan, and now we have a second engineering hub in Gyumri. We've built a continuously learning organization that helps its employees rapidly advance their careers. Here you will work with the world's industry leaders, support impactful projects using the latest technologies, collaborate with multi-national teams, and have access to a wide variety of development opportunities.

[epamgdo] Kazakhstan (About EPAM)

EPAM is a team of technologists and innovators united by a passion for technology. In Kazakhstan, we operate across all cities with offices in Astana, Almaty, and Karaganda and work with the world's leading companies from different industries. In 2023, EPAM received the Export Excellence Award at the esteemed Digital Bridge Awards, showcasing our commitment to excellence and innovation.

[epamgdo] Kyrgyzstan (About EPAM)

EPAM Kyrgyzstan is a team of technologists and innovators united by a passion for technology. In 2022, we opened our first office in Bishkek that works with the world's leading companies across many different industries. EPAM builds a continuously learning organization and helps its employees reach their full potential and achieve their professional goals through learning. Our agile methodologies, client collaboration frameworks, engineering excellence programs, and hybrid teams offer many career paths and development opportunities.

[epamgdo] Uzbekistan (About EPAM)

EPAM Uzbekistan is a team of technologists and innovators united by technology. In 2019, we opened our first office in Tashkent. Since then, we’ve built a continuously learning organization that helps its employees reach their full potential and achieve professional goals through learning. Our agile methodologies, client collaboration frameworks, engineering excellence programs, and hybrid teams offer many career paths and development opportunities.