AI Tool Labs

Builds about llama.cpp

  1. Does temperature break JSON output? Small LLMs, measured

    3 small local LLMs, 20 emails to JSON at temperature 0, 0.8 and 1.5. With llama.cpp's default samplers, JSON stayed valid. Without them, 1.5 broke it.

    Shipped

  2. Small LLM JSON output: the grammar fixes syntax, not answers

    6 small local LLMs, 20 emails to JSON, with and without llama.cpp's json_schema grammar. Valid JSON went to 100%; right answers did not move.

    Shipped

  3. Best small LLM for a CPU-only laptop: 10 models measured

    10 small LLMs on a 2-core laptop CPU: speed, RAM, first-token time and a 20-question check. Gemma 4 E2B was the best trade-off.

    Shipped

  4. Ollama vs llama.cpp on CPU: same speed, different defaults

    I benchmarked Ollama and llama.cpp on a 2-core laptop CPU with the same GGUF files. With equal settings the speed matched. The defaults did not.

    Shipped