Kubernetes Infrastructure
Cluster Architecture
graph TB
HOST["Host network<br/>YOUR_SERVER_IP"]
subgraph CLUSTER["k3s cluster (single-node, embedded etcd)"]
subgraph KS[kube-system]
COREDNS[coredns]
METRICS[metrics-server]
LPP[local-path-provisioner]
end
subgraph PLATFORM_NS[Cairn namespaces]
CAPS[caps]
CM[cert-manager]
ING[ingress-nginx]
MON["monitoring<br/>grafana + prometheus"]
LOKI[loki]
MINIO[minio]
ARGO[argocd]
PORT[portainer]
MONGO[mongo]
REDIS[redis]
PG[postgres]
end
end
HOST --> ING
Namespace Layout
| Namespace |
Purpose |
Services |
Ingress |
| caps |
Cairn control plane |
api-service, portal-service |
/, /api |
| cert-manager |
SSL certificate management |
cert-manager, cert-manager-webhook, cert-manager-cainjector |
None |
| ingress-nginx |
Ingress controller |
ingress-nginx-controller (host network) |
All inbound traffic |
| monitoring |
Observability stack |
grafana, prometheus, kube-state-metrics |
/grafana |
| loki |
Log aggregation |
loki, loki-canary |
None (API forwards directly) |
| minio |
Object storage |
minio |
None (internal) |
| argocd |
GitOps continuous delivery |
argocd-server, argocd-repo-server, argocd-redis, argocd-application-controller |
/argocd |
| portainer |
Container management UI |
portainer |
/portainer |
| mongo |
MongoDB (logs/metrics) |
mongodb |
None (internal) |
| redis |
Cache (available, not actively used) |
redis |
None (internal) |
| postgres |
PostgreSQL (primary data store) |
postgres |
None (internal) |
Helm Chart Versions
Ingress Routing Table
graph TB
NGINX["nginx-ingress-controller<br/>LoadBalancer / HostNetwork<br/>YOUR_SERVER_IP :443"]
ING_CAPS["ingress-caps<br/>host: *.sslip.io"]
ING_ARGO["ingress-argocd<br/>host: *.sslip.io"]
ING_PORT["ingress-portainer<br/>host: *.sslip.io"]
PORTAL["portal-service :80"]
API["api-service :3000"]
ARGO_SRV["argocd-server :443<br/>path /argocd"]
PORT_SRV["portainer-service :9000<br/>path /portainer"]
NGINX --> ING_CAPS
NGINX --> ING_ARGO
NGINX --> ING_PORT
ING_CAPS --> PORTAL
ING_CAPS --> API
ING_ARGO --> ARGO_SRV
ING_PORT --> PORT_SRV
Ingress Configuration (Cairn)
# D:\SERVER-automation\platform\templates\k8s\ingress.yaml
apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
name: caps-ingress
namespace: caps
annotations:
kubernetes.io/ingress.class: nginx
cert-manager.io/cluster-issuer: letsencrypt-prod
spec:
tls:
- hosts:
- YOUR_SERVER_IP.sslip.io
secretName: caps-tls
rules:
- host: YOUR_SERVER_IP.sslip.io
http:
paths:
- path: /api
pathType: Prefix
backend:
service:
name: api-service
port:
number: 3000
- path: /
pathType: Prefix
backend:
service:
name: portal-service
port:
number: 80
Complete Subpath Mapping
| Subpath |
Target Service |
Namespace |
Port |
Notes |
/ |
portal-service |
caps |
80 |
Angular SPA — serves index.html, try_files $uri /index.html |
/api |
api-service |
caps |
3000 |
Express REST API |
/grafana |
grafana |
monitoring |
3000 |
Grafana — subpath configured via GF_SERVER_ROOT_URL |
/argocd |
argocd-server |
argocd |
443 |
ArgoCD — subpath via argocd-server ingress annotation |
/portainer |
portainer |
portainer |
9000 |
Portainer UI |
/oauth2 |
oauth2-proxy |
caps |
4180 |
OAuth2 proxy (Grafana/Portainer SSO) |
Resource Limits per Namespace
# ResourceQuota per critical namespace
apiVersion: v1
kind: ResourceQuota
metadata:
name: caps-quota
namespace: caps
spec:
hard:
requests.cpu: "1"
requests.memory: "1Gi"
limits.cpu: "2"
limits.memory: "2Gi"
| Namespace |
CPU Request |
CPU Limit |
Memory Request |
Memory Limit |
| caps |
1.0 |
2.0 |
1Gi |
2Gi |
| monitoring |
1.0 |
2.0 |
2Gi |
4Gi |
| argocd |
0.5 |
1.0 |
512Mi |
1Gi |
| loki |
0.5 |
1.0 |
1Gi |
2Gi |
| minio |
0.5 |
1.0 |
1Gi |
2Gi |
| mongo |
0.5 |
1.0 |
1Gi |
2Gi |
| postgres |
0.5 |
1.0 |
512Mi |
1Gi |
| redis |
0.2 |
0.5 |
256Mi |
512Mi |
| ingress-nginx |
0.2 |
0.5 |
256Mi |
512Mi |
| cert-manager |
0.1 |
0.2 |
128Mi |
256Mi |
| portainer |
0.2 |
0.5 |
256Mi |
512Mi |
Storage Classes and PVCs
Default Storage Class
# k3s local-path-provisioner (default)
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
name: local-path
provisioner: rancher.io/local-path
volumeBindingMode: WaitForFirstConsumer
reclaimPolicy: Delete
Persistent Volume Claims
| PVC Name |
Namespace |
Size |
Access Mode |
Storage Class |
Mount Path |
Used By |
data-postgres-0 |
postgres |
8Gi |
ReadWriteOnce |
local-path |
/var/lib/postgresql/data |
PostgreSQL |
mongodb-data-0 |
mongo |
8Gi |
ReadWriteOnce |
local-path |
/data/db |
MongoDB |
minio-data-0 |
minio |
10Gi |
ReadWriteOnce |
local-path |
/data |
MinIO |
prometheus-data-0 |
monitoring |
8Gi |
ReadWriteOnce |
local-path |
/prometheus |
Prometheus |
loki-data-0 |
loki |
10Gi |
ReadWriteOnce |
local-path |
/var/loki |
Loki |
grafana-data-0 |
monitoring |
1Gi |
ReadWriteOnce |
local-path |
/var/lib/grafana |
Grafana |
redis-data-0 |
redis |
1Gi |
ReadWriteOnce |
local-path |
/data |
Redis (optional) |
Example PVC
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
name: data-postgres-0
namespace: postgres
spec:
accessModes:
- ReadWriteOnce
resources:
requests:
storage: 8Gi
storageClassName: local-path
Deployment Template
# D:\SERVER-automation\platform\templates\k8s\deployment.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
name: app-service
labels:
app: app-service
spec:
replicas: 2
selector:
matchLabels:
app: app-service
template:
metadata:
labels:
app: app-service
spec:
containers:
- name: app-service
image: app/my-service:latest
ports:
- containerPort: 3000
livenessProbe:
httpGet:
path: /health
port: 3000
readinessProbe:
httpGet:
path: /health
port: 3000
resources:
limits:
cpu: 500m
memory: 512Mi
requests:
cpu: 100m
memory: 128Mi
Service Template
# D:\SERVER-automation\platform\templates\k8s\service.yaml
apiVersion: v1
kind: Service
metadata:
name: app-service
spec:
selector:
app: app-service
ports:
- port: 3000
targetPort: 3000
type: ClusterIP
Key Configuration Notes
cert-manager ClusterIssuer
apiVersion: cert-manager.io/v1
kind: ClusterIssuer
metadata:
name: letsencrypt-prod
spec:
acme:
server: https://acme-v02.api.letsencrypt.org/directory
email: [email protected]
privateKeySecretRef:
name: letsencrypt-prod-private-key
solvers:
- http01:
ingress:
class: nginx
Note: The wildcard domain sslip.io uses self-signed certs (cert-manager skips because the domain includes IP digits). Only real domains (non-sslip, non-IP) trigger Let's Encrypt provisioning (see src/routes/sdk.ts:221 — isRealDomain check).
Grafana Subpath Configuration
# Configured via Helm values or env vars:
GF_SERVER_ROOT_URL=https://YOUR_SERVER_IP.sslip.io/grafana
GF_SERVER_SERVE_FROM_SUB_PATH=true
ArgoCD Subpath Configuration
# argocd-server ingress annotation
nginx.ingress.kubernetes.io/rewrite-target: /argocd
nginx.ingress.kubernetes.io/ssl-passthrough: "true"
See Network Topology for DNS and ingress controller details, and Overview for the high-level system architecture.