Serve the home! Inference stack for your Nvidia DGX / RTX Spark (128GB ram) aka the Grace Blackwell AI supercomputer on your desk. Mostly vLLM based for now and single-spark. For the not-so-rich people. Updated once a month. Hobby project
Terminal score: 0–1000 raw, weighted across 4 dimensions. Public score: 0–10 normalized (shown in the 30-day stars chart above).