jakman85andClaude Opus 4.8
7a3da96d9f
The UniFi Block import got past the device-permission fix but then failed ReplicaSchedulingFailure / "insufficient storage": CDI sizes scratch ~= the disk virtual size and, on the default 3-replica `longhorn` class, the ~60Gi scratch x3 (189G) on top of the disk's x3 (180G) overflowed the Longhorn tier (~125G/node). - platform/longhorn/storageclasses.yaml: NEW `longhorn-scratch` StorageClass (numberOfReplicas: 1) — CDI scratch is ephemeral/throwaway, replicating it 3x is waste; if a node dies mid-import CDI just retries. - platform/kubevirt/cdi-cr.yaml: spec.config.scratchSpaceStorageClass -> longhorn-scratch. - apps/vms/unifi/20-datavolume.yaml: boot disk 60Gi -> 40Gi (UOS min is 25Gi; 40Gi is comfortable for a home site and lighter on the replicated tier). Co-Authored-By: Claude Opus 4.8 <[email protected]>
50 lines
2.5 KiB
YAML
50 lines
2.5 KiB
YAML
---
|
|
# STAGING / DRAFT — see namespace.yaml header.
|
|
#
|
|
# CDI DataVolume — the UniFi VM boot disk. This is the FIRST real CDI *http* import on
|
|
# this cluster (the vm-demo/conformance path imports a containerdisk from a *registry*;
|
|
# this pulls the official Ubuntu 24.04 LTS server cloud image (qcow2) over https and CDI
|
|
# converts it onto the PVC).
|
|
#
|
|
# STANDALONE DataVolume (NOT a dataVolumeTemplate) so the disk OUTLIVES `kubectl delete vm`
|
|
# and survives destroy/rebuild (R-STATE-01) — same durability contract as vm-demo.
|
|
#
|
|
# STORAGE = longhorn-vm (the RWX/migratable StorageClass the storage workstream is adding):
|
|
# - accessModes: ReadWriteMany + volumeMode: Block => REQUIRED for KubeVirt LIVE MIGRATION
|
|
# (evictionStrategy: LiveMigrate in the VM). A ReadWriteOnce disk cannot live-migrate.
|
|
# - 40Gi: the Ubuntu cloud image virtual size is ~3.5Gi; cloud-init growpart/growroot
|
|
# expands the root fs to fill the disk on first boot. 40Gi (UOS min is 25Gi) leaves room for the
|
|
# UniFi datastore + OS + podman images + updates.
|
|
#
|
|
# GOTCHA / FLAG: a Block RWX DataVolume import needs CDI scratch space and the importer pod
|
|
# needs egress to cloud-images.ubuntu.com (see the CDI-import allow in 40-networkpolicy.yaml —
|
|
# the importer runs in THIS default-deny namespace, unlike the conformance test whose ephemeral
|
|
# ns has no baseline). No checksum is verified on an http source; pin a dated build for full
|
|
# reproducibility if drift matters (see README "Open questions").
|
|
#
|
|
# NODE PREREQ (Block-mode CDI): the non-root importer opens the raw block device, which k8s
|
|
# never chowns for it. The k3s nodes set `nonroot-devices: true`
|
|
# (infra/ansible/roles/k3s_server) so containerd hands the device to the pod's UID/GID —
|
|
# without it the import dies with `blockdev: cannot open /dev/cdi-block-volume: Permission denied`.
|
|
apiVersion: cdi.kubevirt.io/v1beta1
|
|
kind: DataVolume
|
|
metadata:
|
|
name: unifi-rootdisk
|
|
namespace: unifi
|
|
labels:
|
|
app.kubernetes.io/name: unifi
|
|
spec:
|
|
source:
|
|
http:
|
|
# Ubuntu 24.04 LTS (noble) server cloud image, amd64, qcow2. "releases/.../release/"
|
|
# tracks the latest 24.04 point release. Pin to a dated build dir for reproducibility.
|
|
url: "https://cloud-images.ubuntu.com/releases/noble/release/ubuntu-24.04-server-cloudimg-amd64.img"
|
|
storage:
|
|
accessModes:
|
|
- ReadWriteMany # RWX => migratable (paired with evictionStrategy: LiveMigrate)
|
|
volumeMode: Block # block mode is the migratable/perf default for VM disks
|
|
storageClassName: longhorn-vm
|
|
resources:
|
|
requests:
|
|
storage: 40Gi
|