EKS GenAI Platform

containersai-mleks

Overview

Democratizing LLMs and Agents via Bedrock, AgentCore, and Strands on EKS.

Key Concepts

  • Platform Engineering approach to GenAI
  • Self-service developer experience
  • Multi-tenant inference endpoints on EKS
  • Cost optimization with Karpenter + spot instances

References