David Samuel — Blog https://davidsamuel.no/ 2026-08-14T00:00:00Z David Samuel Stop using greedy decoding for LLM inference https://davidsamuel.no/blog/greedy-decoding/ 2026-08-14T00:00:00Z 2026-08-14T00:00:00Z Greedy decoding is not deterministic in practice, it is heavily biased, and its target is degenerate – why temperature=0 is a poor default for LLM inference.