Run Cuda

Standalone CUDA greedy-decode driver for the qwen35 forward pass.

Loads the GGUF onto the GPU via loader_cuda, builds the forward state in src/compute/forward_cuda.zig, and runs a single greedy decode step for a fixed token, printing the predicted token id, a hidden-state sanity dump, and the top-5 logits. Independent of the gpu/ dispatch interface so the CUDA forward pass can be brought up incrementally.

Rooted at src/ (module path) so it reaches both model/* and cuda/* and compute/* — exactly like src/main.zig. The whole thing is one Zig module so the loader's and forward pass's internal `../cuda/*` imports resolve.

Build + run (on the box): cd ~/zinc5090 && CUDA_HOME=/usr/local/cuda \ ~/zig-0.15.2/zig build cuda-run -Dbackend=cuda -- [token] [milestone] [model.gguf] milestone: v0 (tail only), v1 (one attn L3 + one ssm L0 + ffn), v2 (full 32 layers)

1 exports 0 methods src/run_cuda.zig

1 exports shown

function

main

pub fn main() !void

No public doc comment yet.

src/run_cuda.zig:27