diff --git a/infra/PROD-PROVISIONING.md b/infra/PROD-PROVISIONING.md index 295a536..30714f1 100644 --- a/infra/PROD-PROVISIONING.md +++ b/infra/PROD-PROVISIONING.md @@ -25,13 +25,20 @@ Fill a row per node as it lands. Node 1 is as-found on 2026-08-31. |---|---|---|---| | Hostname | `k3s-prod-1` | `k3s-prod-2` | `k3s-prod-3` | | LAN IP | `192.168.2.10` | `192.168.2.11` | `192.168.2.12` | -| Model | HP EliteDesk 800 G5 Desktop Mini | | | -| CPU | i7-9700T, 8c/8t, VT-x | | | -| RAM | 31 GiB | | | -| Disks | 1× 477 GB SATA SSD (`C400-MTFDDAC512M`) | | | -| OS | Debian 13 (trixie), kernel 6.12 | | | -| Firmware | HP R21 Ver. 02.26.00 | | | -| `/dev/kvm` | present | | | +| Model | HP EliteDesk 800 G5 Desktop Mini | HP EliteDesk 800 G5 Desktop Mini | | +| CPU | i7-9700T, 8c/8t, VT-x | i7-9700T, 8c/8t, VT-x | | +| RAM | 31 GiB (2×16 GB Micron) | **2.6 GiB usable of 16 GB — see §0b** | | +| Disks | 1× 477 GB SATA SSD (`C400-MTFDDAC512M`, ~2011) | 1× 477 GB **NVMe** (`PM9A1 Samsung`) | | +| Drive health | 69% life, 15 grown bad blocks, 187 erase fails | **96% life**, 2142 h, PASSED | | +| OS | Debian 13 (trixie), kernel 6.12 | Debian 13 (trixie), kernel 6.12 | | +| Firmware | HP R21 Ver. 02.26.00 | HP R21 Ver. 02.26.00 | | +| `/dev/kvm` | present | present | | +| Serial | MXL1052NGN | MXL0073949 | | + +**The nodes are NOT hardware-symmetric.** Node 1 has a ~2011 SATA SSD with real wear; node 2 has a +healthy modern NVMe. §2 requires an identical disk layout across all three because Longhorn replica +placement assumes symmetry — so this is a live input to the disk decision, not a footnote. Node 2's +NVMe is the drive node 1 should have had. Dev nodes for comparison: 8 vCPU / 24 GiB / Debian 13, **two** dedicated data disks (Longhorn + etcd). @@ -108,9 +115,6 @@ To investigate, cheapest first: - [ ] **Set `After Power Loss=Power On`** regardless of the memory question — §1 requires it and node 2 currently violates it. - [ ] Clear CMOS / load setup defaults on node 2 to force a full memory retrain, then re-check. -- [ ] Compare node 2's BIOS settings against node 1 directly. Look for a memory remap / "Above 4G - decoding" style option, and for any memory-limit or 32-bit-addressing setting. -- [ ] Clear CMOS / load setup defaults on node 2, then re-check `MemTotal`. - [ ] Reseat the DIMM; try it in DIMM3; try it in node 1 (swap test) — that isolates DIMM vs slot vs board in one move. - [ ] `memtest86+` if the above do not resolve it.