Extends the SSO work to the two remaining `auth: oidc` apps still on local-admin
logins, each as a native confidential client of the Keycloak `homelab` realm with
its local admin kept as break-glass (docs/15 availability caveat; R-IDP-02/06).
Realm (source of truth): add the `nextcloud` and `semaphore` confidential clients
to platform/keycloak/keycloak-realm-import.yaml (modeled on grafana/gitea) + their
NEXTCLOUD_CLIENT_SECRET / SEMAPHORE_CLIENT_SECRET placeholders. As before, a
KeycloakRealmImport no-ops on an already-existing realm, so both live clients were
ALSO created via kcadm (nextcloud e95049ed-ca10-4085-97d9-4bbef495fe61, semaphore
1835bfe9-b125-4026-8f69-33557519cf4a); the YAML keeps git authoritative.
Secrets (SOPS/age): add nextcloud-client-secret + semaphore-client-secret to
keycloak-realm-clients.sops.yaml (keycloak ns). Mirror the nextcloud secret as
oidc-client-secret into nextcloud-bootstrap (nextcloud ns). For semaphore, the
whole SEMAPHORE_OIDC_PROVIDERS JSON (which embeds the client secret) is held
encrypted as oidc-providers-json in semaphore-bootstrap (semaphore ns). All values
verified == the live clients; existing keys untouched; no plaintext in git.
App config (catalog source + re-render):
- nextcloud: add NEXTCLOUD_OIDC_CLIENT_SECRET env + an idempotent postStart hook
that installs/enables user_oidc and runs `occ user_oidc:provider keycloak`
(create-or-update; secret via --clientsecret-env so it never hits argv; occ as
www-data; group provisioning on the `groups` claim). Syntax verified against the
running user_oidc 8.11.0 on Nextcloud 31.0.14; su-to-www-data env passthrough
verified. Missing-secret/not-installed guards prevent crashloops.
- semaphore: add SEMAPHORE_OIDC_PROVIDERS env sourced from the encrypted
oidc-providers-json (provider_url=realm issuer/auto-discovery, redirect
/api/auth/oidc/keycloak/redirect). Mechanism verified against semaphore v2.19.10
source (util ConfigType oidc_providers env tag + OidcProvider struct + router
redirect path); no kubelet service-link env collision.
apps/wave-1/{nextcloud,semaphore}.yaml re-rendered via
`render.py --no-image-automation` (diffs are env/lifecycle-only).
Verified: realm import Done=True/HasErrors=False and platform-config
Ready=True/Healthy=True (unchanged); edited realm YAML passes server dry-run; live
homelab clients now include gitea/nextcloud/semaphore; static gate (lint/l0/l1)
green. Browser SSO login for each still needs a human check.
Co-Authored-By: Claude Opus 4.8 <[email protected]>
135 lines
7.7 KiB
YAML
135 lines
7.7 KiB
YAML
# ServiceDefinition: semaphore
|
|
# Source of truth: spec docs/13-service-catalog.md row 10; docs/15-identity-and-access.md; docs/04.
|
|
# internal Ansible UI | egress internet | config on Longhorn + external PostgreSQL | auth oidc.
|
|
#
|
|
# Semaphore (semaphoreui/semaphore) is a web UI for running Ansible/Terraform. It is a stateless
|
|
# app over (a) its /etc/semaphore config PVC on Longhorn and (b) an external PostgreSQL — the
|
|
# SECOND CNPG-DB app, reusing the pattern nextcloud established (apps/nextcloud-db.yaml). Its DB is
|
|
# a CloudNativePG Cluster in a dedicated namespace (apps/semaphore-db.yaml).
|
|
#
|
|
# DB WIRING (schema >=1.2.0 env): the app reaches its PostgreSQL cross-namespace at
|
|
# semaphore-db-rw.semaphore-db:5432 (the CNPG read-write Service). Its owner credentials are the
|
|
# SAME password held in two SOPS secrets — semaphore-db-app (basic-auth, ns semaphore-db; consumed
|
|
# by the CNPG Cluster's initdb) and semaphore-bootstrap (ns semaphore; consumed here as db-password).
|
|
# A Pod can only read Secrets in its OWN namespace, so the shared password is duplicated across the
|
|
# two encrypted files rather than replicated cross-namespace (documented in apps/semaphore-db.yaml).
|
|
#
|
|
# PERSISTENT ENCRYPTION KEY: SEMAPHORE_ACCESS_KEY_ENCRYPTION is a base64 32-byte AES key Semaphore
|
|
# uses to encrypt the SSH keys / access credentials it stores in the DB. It MUST be FIXED and stable
|
|
# across restarts — if it changes, every stored credential becomes undecryptable. It is pinned via
|
|
# the semaphore-bootstrap SOPS secret (like gitea's SECRET_KEY), never regenerated per boot.
|
|
# Validates against schemas/servicedefinition.schema.json.
|
|
name: semaphore
|
|
kind: container
|
|
source:
|
|
image: semaphoreui/semaphore:v2.19.10 # pinned recent stable tag (R-UPD-01); update.range governs advancement
|
|
env:
|
|
# --- PostgreSQL connection (the CNPG-DB pattern). DIALECT/HOST/PORT/DB/USER are literals; PASS is
|
|
# sourced from the in-namespace SOPS secret (the CNPG -app secret lives in ns semaphore-db,
|
|
# unreachable by a Pod secretKeyRef, so the same value is mirrored into semaphore-bootstrap). ---
|
|
- name: SEMAPHORE_DB_DIALECT
|
|
value: postgres
|
|
- name: SEMAPHORE_DB_HOST
|
|
value: semaphore-db-rw.semaphore-db.svc.cluster.local
|
|
- name: SEMAPHORE_DB_PORT
|
|
value: "5432"
|
|
- name: SEMAPHORE_DB
|
|
value: semaphore
|
|
- name: SEMAPHORE_DB_USER
|
|
value: semaphore
|
|
- name: SEMAPHORE_DB_PASS
|
|
valueFrom:
|
|
secretKeyRef:
|
|
name: semaphore-bootstrap
|
|
key: db-password
|
|
# --- Break-glass local admin (docs/15 availability caveat): created on first-boot so the operator
|
|
# is never locked out by an IdP outage. Username/password sourced from the SOPS secret; the
|
|
# display name + email are non-sensitive literals. ---
|
|
- name: SEMAPHORE_ADMIN
|
|
valueFrom:
|
|
secretKeyRef:
|
|
name: semaphore-bootstrap
|
|
key: admin-username
|
|
- name: SEMAPHORE_ADMIN_PASSWORD
|
|
valueFrom:
|
|
secretKeyRef:
|
|
name: semaphore-bootstrap
|
|
key: admin-password
|
|
- name: SEMAPHORE_ADMIN_NAME
|
|
value: Semaphore Admin
|
|
- name: SEMAPHORE_ADMIN_EMAIL
|
|
value: [email protected]
|
|
# --- Persistent access-key encryption key (see header): FIXED base64 32-byte key from SOPS so the
|
|
# SSH keys / credentials Semaphore stores in the DB stay decryptable across restarts. ---
|
|
- name: SEMAPHORE_ACCESS_KEY_ENCRYPTION
|
|
valueFrom:
|
|
secretKeyRef:
|
|
name: semaphore-bootstrap
|
|
key: access-key-encryption
|
|
# Because the Service is named `semaphore`, the kubelet injects a Docker-link-style
|
|
# SEMAPHORE_PORT=tcp://<svcIP>:3000 env var, which COLLIDES with Semaphore's OWN SEMAPHORE_PORT
|
|
# (its HTTP listen port) and crashes config validation ("field 'Port' is not valid: tcp://..."). An
|
|
# explicit env entry shadows the injected one (the kubelet gives user-defined env precedence over
|
|
# service links), pinning the listen port back to :3000 (matches containerPort/Service).
|
|
- name: SEMAPHORE_PORT
|
|
value: ":3000"
|
|
# --- Keycloak native OIDC SSO (auth.mode oidc; docs/15 "Native OIDC"; R-IDP-02/06). Semaphore
|
|
# v2.19.10 reads its OIDC providers from the SEMAPHORE_OIDC_PROVIDERS env as a JSON map
|
|
# (util ConfigType `oidc_providers`, env-tagged SEMAPHORE_OIDC_PROVIDERS). The value is a single
|
|
# JSON blob for the `keycloak` provider — provider_url is the homelab realm issuer (auto-discovery),
|
|
# client_id=semaphore, redirect_url=/api/auth/oidc/keycloak/redirect, claims map to the realm's
|
|
# token. It CONTAINS the confidential client secret, so the whole blob is held SOPS-encrypted in the
|
|
# semaphore-bootstrap Secret (key oidc-providers-json; same secret value SOPS-held in
|
|
# keycloak-realm-clients) and injected here by reference — never in cleartext. The name is NOT a
|
|
# kubelet service-link var (those are SEMAPHORE_SERVICE_HOST / SEMAPHORE_PORT_*), so no collision.
|
|
# The LOCAL SEMAPHORE_ADMIN above stays as the break-glass path (docs/15). ---
|
|
- name: SEMAPHORE_OIDC_PROVIDERS
|
|
valueFrom:
|
|
secretKeyRef:
|
|
name: semaphore-bootstrap
|
|
key: oidc-providers-json
|
|
# The semaphoreui/semaphore image runs as the non-root user UID 1001 / GID 0 (tini -> server-wrapper),
|
|
# and on boot the wrapper writes its generated config.json into the config dir. A mounted Longhorn PVC
|
|
# is root:root, so UID 1001 cannot write it -> the pod panics ("permission denied"). fsGroup=1001 makes
|
|
# the kubelet group-own the mounted PVC to 1001 and add it as a supplemental group so the process can
|
|
# write; runAsUser/runAsGroup pin the image's own identity, runAsNonRoot asserts it (R-STATE-01/02).
|
|
podSecurityContext:
|
|
runAsUser: 1001
|
|
runAsGroup: 0
|
|
runAsNonRoot: true
|
|
fsGroup: 1001
|
|
exposure: internal # LAN-only (internal DNS + Gateway on LAN); not edge-forwarded (docs/09; R-DNS/R-NET)
|
|
egress: internet # normal WAN egress (docs/03; R-NET-05) — clones repos, installs Galaxy roles
|
|
storage:
|
|
- name: config
|
|
size: 1Gi
|
|
class: longhorn # config (generated config.json, tmp inventories) on the 3-replica tier
|
|
mountPath: /etc/semaphore # Semaphore reads/writes its config under /etc/semaphore (R-STATE-02)
|
|
dependencies:
|
|
- to: semaphore-db # explicit allow: Semaphore -> its PostgreSQL (docs/13 graph; R-NET-02).
|
|
port: 5432 # Renders the egress half; the DB namespace mirrors keycloak-db (no
|
|
protocol: tcp # default-deny), so Cilium's default-allow accepts the reciprocal ingress.
|
|
ingressRoutes:
|
|
- host: semaphore.home.keithjackson.dev
|
|
port: 3000 # Semaphore HTTP web/API; wildcard TLS terminates at the shared Gateway (docs/08/09)
|
|
auth:
|
|
mode: oidc # native Keycloak OIDC client (docs/13 SSO row, docs/15 "Native OIDC"; R-IDP-02)
|
|
groups:
|
|
- platform-admins # access scoped to an authorized group (R-IDP-06)
|
|
# WIRED (native OIDC): the Keycloak `semaphore` confidential client (platform/keycloak/keycloak-realm-
|
|
# import.yaml + live kcadm) is consumed via the SEMAPHORE_OIDC_PROVIDERS env (JSON blob held encrypted
|
|
# in the semaphore-bootstrap Secret, oidc-providers-json). The `groups` claim is exposed for
|
|
# authorization (R-IDP-06). Semaphore KEEPS its LOCAL admin as the break-glass path so an IdP outage
|
|
# never locks the operator out (docs/15 "Availability caveat"). No secret is embedded here.
|
|
update:
|
|
channel: stable # R-UPD-01
|
|
range: ">=2.19.0 <3.0.0" # stay on the 2.x stable line
|
|
cadence: "0 4 * * *"
|
|
autoRollbackOnFailedHealth: true # R-UPD-03
|
|
observability:
|
|
metrics: true
|
|
slis:
|
|
- up # automation UI down is a critical alert (docs/10; R-OBS-01)
|
|
backup:
|
|
policy: daily-offcluster # DR-critical: its DB holds automation credentials, backed up off-cluster (docs/13, docs/04; R-STATE-03)
|