feed/tags/determinism

determinism

One reading ordered as a path, each with one line on why it earns your time.

advanced/ 1 entry

Current work, at the depth practitioners actually argue about.

articleDefeating Nondeterminism in LLM Inference
Temperature zero is not determinism. A thousand identical requests gave eighty different completions, because kernel output depends on batch size, and batch size depends on who else is on the server.
Horace HeSept 2025#determinism#kernels#batching

Related topics