Overview

Join EPAM Malaysia as a Senior AI Engineer and lead the charge in creating cutting-edge AI solutions that solve complex, real-world problems. You’ll design and deploy scalable ML pipelines using ML frameworks and data platforms while harnessing the power of cloud platforms. Collaborate with cross-functional teams to transform business challenges into innovative data-driven solutions, leveraging your expertise in Python, SQL and MLOps frameworks.

Responsibilities

  • Design and implement end-to-end AI systems including inference pipelines, agent workflows and tool-calling architectures
  • Build and manage context orchestration for LLMs, covering system prompts, memory, retrieval and structured inputs
  • Engineer latency-aware and cost-efficient fallback strategies across models and providers
  • Develop backend services for prompt routing, response handling and tool execution using Python or Node.js
  • Implement observability for AI systems including logging, metrics, tracing and quality monitoring
  • Maintain CI/CD pipelines for safe, repeatable deployments of AI services
  • Integrate and deploy AI-powered software solutions into scalable enterprise environments, translating business requirements into robust system designs
  • Collaborate with cross-functional teams, ensure compliance with data protection and AI governance and document architectures and implementation decisions

Requirements

  • Solid software engineering experience with hands-on work with AI/ML or LLM systems, and a Bachelor’s or Master’s degree in Computer Science, Data Science or a related field
  • Proficient in Python, with experience in SQL or NoSQL databases, REST APIs and backend integration
  • Demonstrated expertise in LLM-based solution development, prompt engineering, NLP, semantic models and agent-style architectures
  • Skilled in fine-tuning and evaluating LLMs, building automated AI pipelines for training, testing, deployment and monitoring
  • Experience with the Spark or Apache ecosystem, scalable data and AI architectures and cloud computing platforms
  • Proficient in containerization technologies such as Docker and Kubernetes with experience in GPU orchestration and cost optimization
  • Familiarity with CI/CD pipelines, DevOps tooling and enterprise-scale architectures
  • Strong analytical thinker and communicator, results-driven, customer-focused and actively following new AI advancements and industry best practices

Nice to have

  • Experience integrating with LLM APIs from providers like OpenAI, Claude, or comparable platforms
  • Direct involvement in building or maintaining Retrieval-Augmented Generation (RAG) systems, including work with vector databases and embedding pipelines
  • Familiarity with model safety measures, implementation of AI guardrails or responsible AI best practices

Malaysia

  • By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.

  • Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters

  • You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices

  • We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey

  • At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us

[epamgdo] Malaysia (About EPAM)

Life at EPAM

  • EPAM is a leader in the fastest-growing segment (product development/digital platform engineering) of the IT industry. We acquired Just-BI in 2021 to reinforce our leading position as a global Business Intelligence services provider and have been growing rapidly. With a talented multinational team, we provide data and analytics expertise
  • We are currently involved in end-to-end BI design and implementation projects in major national and international companies. We are proud of our entrepreneurial start-up culture and are focused on investing in people by creating continuous learning and development opportunities for our employees who deliver engineering excellence for our clients