Documentation
¶
Overview ¶
Package gpugen is the shared Go exec wrapper for every LOCAL GPU generation runner (image / video / audio). It shells out to a render/*.mjs (or a python TTS worker) that takes the single-slot GPU lock + drives ComfyUI/Chatterbox, and wraps that child with the hard-won lifecycle guards the bare runners lack:
- killTree on timeout/cancel — on Windows a bare node-kill ORPHANS the spawned ComfyUI python grandchild (pinning ~8GB VRAM) and skips node's JS finally (leaking the GPU lock); we taskkill the WHOLE process tree.
- WaitDelay — a short grace window after Cancel before the pipe is force-closed.
- defer freeComfyVRAM — belt-and-suspenders: however the child ended (clean exit, error, or a timeout-kill that skipped its finally), force-drop any ComfyUI VRAM so a render never leaves the GPU pinned (zero-always-warm; protects the load-bearing CPU memory stack).
This was extracted from internal/imagegen.Generate so video + audio get the SAME process-tree-kill (they previously had no Go wrapper → no kill on timeout). Pure os/exec + net/http, no deps. The output-file stat is the success gate (a child can exit 0 yet produce nothing). Behavior for the image path is preserved byte-for-byte.
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func ClassifyErr ¶
ClassifyErr maps a gen failure to a coarse class (oom|timeout|conn_refused|other) for the ledger's ErrClass. Mirrors pipeline.classifyErr; nil => "".
Types ¶
type Spec ¶
type Spec struct {
// Exe is the executable ("" => "node"). Script is its first argument (the
// render/*.mjs path, or for `node -e` the verb). Args are the remaining argv.
Exe string
Script string
Args []string
// Env are extra "K=V" entries appended to the current environment (e.g.
// COMFY_DIR, MEMORY_STACK, GPU_LOCK_WAIT_MS). nil = inherit only.
Env []string
// Out is the file the runner must produce; a missing/empty Out after a clean
// exit is treated as failure (the caller defers). Required.
Out string
// Timeout bounds the whole invocation (cold-start + render + margin).
Timeout time.Duration
// ComfyAPI is the ComfyUI endpoint freeComfyVRAM hits after the run. "" =>
// the COMFY_API env or the 127.0.0.1:8188 default. Set "" to inherit; a runner
// with no ComfyUI (TTS) can leave it — /free on a dead endpoint is a no-op.
ComfyAPI string
// SkipFreeComfy, when true, suppresses the post-run ComfyUI /free (the TTS/voice
// path never starts ComfyUI, so there is nothing to free). The killTree + output
// stat still apply — the python worker still gets process-tree-killed on timeout.
SkipFreeComfy bool
}
Spec describes one GPU-gen invocation. The caller assembles Args (the runner's CLI flags) — gpugen owns only the cross-cutting lifecycle, not the per-task arg shape.
Source Files