Kubernetes Infrastructure

Cluster Architecture

graph TB HOST["Host network<br/>YOUR_SERVER_IP"] subgraph CLUSTER["k3s cluster (single-node, embedded etcd)"] subgraph KS[kube-system] COREDNS[coredns] METRICS[metrics-server] LPP[local-path-provisioner] end subgraph PLATFORM_NS[Cairn namespaces] CAPS[caps] CM[cert-manager] ING[ingress-nginx] MON["monitoring<br/>grafana + prometheus"] LOKI[loki] MINIO[minio] ARGO[argocd] PORT[portainer] MONGO[mongo] REDIS[redis] PG[postgres] end end HOST --> ING

Namespace Layout

Namespace Purpose Services Ingress
caps Cairn control plane api-service, portal-service /, /api
cert-manager SSL certificate management cert-manager, cert-manager-webhook, cert-manager-cainjector None
ingress-nginx Ingress controller ingress-nginx-controller (host network) All inbound traffic
monitoring Observability stack grafana, prometheus, kube-state-metrics /grafana
loki Log aggregation loki, loki-canary None (API forwards directly)
minio Object storage minio None (internal)
argocd GitOps continuous delivery argocd-server, argocd-repo-server, argocd-redis, argocd-application-controller /argocd
portainer Container management UI portainer /portainer
mongo MongoDB (logs/metrics) mongodb None (internal)
redis Cache (available, not actively used) redis None (internal)
postgres PostgreSQL (primary data store) postgres None (internal)

Helm Chart Versions

Component Chart Version (as deployed) Source
cert-manager jetstack/cert-manager v1.15.0 artifacthub.io
ingress-nginx ingress-nginx/ingress-nginx 4.11.0 artifacthub.io
Grafana grafana/grafana 8.3.0 artifacthub.io
Prometheus prometheus-community/kube-prometheus-stack 62.0.0 artifacthub.io
Loki grafana/loki 6.10.0 artifacthub.io
ArgoCD argo/argo-cd 7.3.0 artifacthub.io
MinIO bitnami/minio 14.6.0 artifacthub.io
Portainer portainer/portainer 1.0.65 artifacthub.io
MongoDB bitnami/mongodb 15.6.0 artifacthub.io
Redis bitnami/redis 20.6.0 artifacthub.io
PostgreSQL bitnami/postgresql 15.5.0 artifacthub.io

Ingress Routing Table

graph TB NGINX["nginx-ingress-controller<br/>LoadBalancer / HostNetwork<br/>YOUR_SERVER_IP :443"] ING_CAPS["ingress-caps<br/>host: *.sslip.io"] ING_ARGO["ingress-argocd<br/>host: *.sslip.io"] ING_PORT["ingress-portainer<br/>host: *.sslip.io"] PORTAL["portal-service :80"] API["api-service :3000"] ARGO_SRV["argocd-server :443<br/>path /argocd"] PORT_SRV["portainer-service :9000<br/>path /portainer"] NGINX --> ING_CAPS NGINX --> ING_ARGO NGINX --> ING_PORT ING_CAPS --> PORTAL ING_CAPS --> API ING_ARGO --> ARGO_SRV ING_PORT --> PORT_SRV

Ingress Configuration (Cairn)

# D:\SERVER-automation\platform\templates\k8s\ingress.yaml
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
  name: caps-ingress
  namespace: caps
  annotations:
    kubernetes.io/ingress.class: nginx
    cert-manager.io/cluster-issuer: letsencrypt-prod
spec:
  tls:
  - hosts:
    - YOUR_SERVER_IP.sslip.io
    secretName: caps-tls
  rules:
  - host: YOUR_SERVER_IP.sslip.io
    http:
      paths:
      - path: /api
        pathType: Prefix
        backend:
          service:
            name: api-service
            port:
              number: 3000
      - path: /
        pathType: Prefix
        backend:
          service:
            name: portal-service
            port:
              number: 80

Complete Subpath Mapping

Subpath Target Service Namespace Port Notes
/ portal-service caps 80 Angular SPA — serves index.html, try_files $uri /index.html
/api api-service caps 3000 Express REST API
/grafana grafana monitoring 3000 Grafana — subpath configured via GF_SERVER_ROOT_URL
/argocd argocd-server argocd 443 ArgoCD — subpath via argocd-server ingress annotation
/portainer portainer portainer 9000 Portainer UI
/oauth2 oauth2-proxy caps 4180 OAuth2 proxy (Grafana/Portainer SSO)

Resource Limits per Namespace

# ResourceQuota per critical namespace
apiVersion: v1
kind: ResourceQuota
metadata:
  name: caps-quota
  namespace: caps
spec:
  hard:
    requests.cpu: "1"
    requests.memory: "1Gi"
    limits.cpu: "2"
    limits.memory: "2Gi"
Namespace CPU Request CPU Limit Memory Request Memory Limit
caps 1.0 2.0 1Gi 2Gi
monitoring 1.0 2.0 2Gi 4Gi
argocd 0.5 1.0 512Mi 1Gi
loki 0.5 1.0 1Gi 2Gi
minio 0.5 1.0 1Gi 2Gi
mongo 0.5 1.0 1Gi 2Gi
postgres 0.5 1.0 512Mi 1Gi
redis 0.2 0.5 256Mi 512Mi
ingress-nginx 0.2 0.5 256Mi 512Mi
cert-manager 0.1 0.2 128Mi 256Mi
portainer 0.2 0.5 256Mi 512Mi

Storage Classes and PVCs

Default Storage Class

# k3s local-path-provisioner (default)
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  name: local-path
provisioner: rancher.io/local-path
volumeBindingMode: WaitForFirstConsumer
reclaimPolicy: Delete

Persistent Volume Claims

PVC Name Namespace Size Access Mode Storage Class Mount Path Used By
data-postgres-0 postgres 8Gi ReadWriteOnce local-path /var/lib/postgresql/data PostgreSQL
mongodb-data-0 mongo 8Gi ReadWriteOnce local-path /data/db MongoDB
minio-data-0 minio 10Gi ReadWriteOnce local-path /data MinIO
prometheus-data-0 monitoring 8Gi ReadWriteOnce local-path /prometheus Prometheus
loki-data-0 loki 10Gi ReadWriteOnce local-path /var/loki Loki
grafana-data-0 monitoring 1Gi ReadWriteOnce local-path /var/lib/grafana Grafana
redis-data-0 redis 1Gi ReadWriteOnce local-path /data Redis (optional)

Example PVC

apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: data-postgres-0
  namespace: postgres
spec:
  accessModes:
    - ReadWriteOnce
  resources:
    requests:
      storage: 8Gi
  storageClassName: local-path

Deployment Template

# D:\SERVER-automation\platform\templates\k8s\deployment.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
  name: app-service
  labels:
    app: app-service
spec:
  replicas: 2
  selector:
    matchLabels:
      app: app-service
  template:
    metadata:
      labels:
        app: app-service
    spec:
      containers:
      - name: app-service
        image: app/my-service:latest
        ports:
        - containerPort: 3000
        livenessProbe:
          httpGet:
            path: /health
            port: 3000
        readinessProbe:
          httpGet:
            path: /health
            port: 3000
        resources:
          limits:
            cpu: 500m
            memory: 512Mi
          requests:
            cpu: 100m
            memory: 128Mi

Service Template

# D:\SERVER-automation\platform\templates\k8s\service.yaml
apiVersion: v1
kind: Service
metadata:
  name: app-service
spec:
  selector:
    app: app-service
  ports:
  - port: 3000
    targetPort: 3000
  type: ClusterIP

Key Configuration Notes

cert-manager ClusterIssuer

apiVersion: cert-manager.io/v1
kind: ClusterIssuer
metadata:
  name: letsencrypt-prod
spec:
  acme:
    server: https://acme-v02.api.letsencrypt.org/directory
    email: [email protected]
    privateKeySecretRef:
      name: letsencrypt-prod-private-key
    solvers:
    - http01:
        ingress:
          class: nginx

Note: The wildcard domain sslip.io uses self-signed certs (cert-manager skips because the domain includes IP digits). Only real domains (non-sslip, non-IP) trigger Let's Encrypt provisioning (see src/routes/sdk.ts:221 — isRealDomain check).

Grafana Subpath Configuration

# Configured via Helm values or env vars:
GF_SERVER_ROOT_URL=https://YOUR_SERVER_IP.sslip.io/grafana
GF_SERVER_SERVE_FROM_SUB_PATH=true

ArgoCD Subpath Configuration

# argocd-server ingress annotation
nginx.ingress.kubernetes.io/rewrite-target: /argocd
nginx.ingress.kubernetes.io/ssl-passthrough: "true"

See Network Topology for DNS and ingress controller details, and Overview for the high-level system architecture.