Skip to main content
Download one archive and run the probe on the host. Use this on a machine with GPUs that you manage yourself — bare metal or a VM.

Before you start

Beyond the requirements, this mode needs:
  • Root access on the host. The probe loads eBPF programs and reads GPU state.
  • /sys/fs/bpf and /sys/kernel/tracing mounted.

Install the probe

1

Download the release

The probe and the CLI ship in one archive.
2

Check the download

Expect OK. This confirms the archive arrived intact — it catches a corrupt or truncated transfer, not a tampered one.
3

Extract and install

Configure and start it

The probe requires two settings: your API address and your API key. See the Quickstart.
The probe logs one JSON object per line. Expect a startup line naming the version and pid file, then one line per GPU it finds:
Press Ctrl+C to stop.

Verify it’s working

The socket should exist — that is what the CLI and the vLLM plugin connect to.

Upgrade

Stop the probe, repeat the install steps with the new version, and start it again. If you have also installed the CLI, replace both from the same release — do not upgrade one on its own. Let any in-flight runs finish first — stopping the probe mid-run loses that run’s telemetry.

Uninstall

Stop the probe, then remove the binary and its state:

Troubleshooting

The host’s glibc is older than the version the probe is built against. Check with ldd --version. Ubuntu 20.04, Debian 11, and RHEL 9 or newer all satisfy the 2.31 floor.
--api-address and --api-token are both required. The error names the one that is missing.
The probe cannot reach the NVIDIA driver. Confirm nvidia-smi works as root on the same host, and that the driver is installed rather than only the CUDA toolkit.
Confirm /sys/fs/bpf and /sys/kernel/tracing are mounted and the kernel has BTF enabled (ls /sys/kernel/btf/vmlinux).

Next steps

Install the CLI

Wrap training commands. The binary is in the archive you just downloaded.

Install the vLLM plugin

Report inference telemetry from your vLLM server.