Skip to main content

AI/Run CodeMie Deployment Architecture

The diagram below depicts the AI/Run CodeMie infrastructure deployment in one region (AZ) of the AWS public cloud environment.

AI/Run CodeMie Architecture on AWS

Container Resources Requirements

ComponentPodsRAMvCPUStorage
CodeMie API28Gi4.0
CodeMie UI1128Mi0.1
Elasticsearch216Gi4.0100-200 Gb per pod
Kibana11Gi1.0
Mermaid-server1512Mi1.0
PostgreSQLManaged service in cloud30-50 Gb
Keycloak + DB1 + 14Gi2.01 Gb
Oauth2-proxy1128Mi0.1
NATS + Auth Callout1 + 1512Mi1.0
MCP Connect11Gi0.5
Fluent Bitdaemonset128Mi0.1
LLM Proxy*11Gi1.0

*Depends on the exact LLM proxy type

Infrastructure Components

The AI/Run CodeMie deployment on AWS includes the following main infrastructure components:

Compute

  • Amazon EKS Cluster: Managed Kubernetes service for running containerized applications
  • Auto Scaling Groups (ASG): Automatically adjusts compute capacity for the EKS cluster

Networking

  • VPC: Isolated network environment
  • Application Load Balancer (ALB): Distributes incoming HTTPS traffic to application services
  • Network Load Balancer (NLB): Handles TCP traffic for NATS messaging system
  • NAT Gateway: Provides outbound internet connectivity for private subnets
  • Route 53: DNS service with automatically provisioned records

Storage

  • Amazon RDS PostgreSQL: Managed relational database service
  • Amazon S3: Object storage for application data and artifacts
  • EBS Volumes: Persistent block storage for Kubernetes pods

Security

  • AWS KMS: Key Management Service for encrypting and decrypting sensitive data
  • IAM Roles: Granular permissions for services and components
  • AWS Certificate Manager: Automated SSL/TLS certificate management for ALB and NLB
  • Security Groups: Network-level access control

Optional Features

  • Internal ALB: For private network communication when enabled
  • Private DNS Hosted Zone: For internal service discovery