Llama Guard vs ShieldGemma vs Granite Guardian on Ollama
450 XSTest prompts on a laptop CPU: Granite Guardian 2B flagged 40% of safe prompts, ShieldGemma 2B missed every privacy one, Llama Guard 1B did best.
450 XSTest prompts on a laptop CPU: Granite Guardian 2B flagged 40% of safe prompts, ShieldGemma 2B missed every privacy one, Llama Guard 1B did best.
372 Claude Code runs: Read(./.env) blocked cat and the Read tool, but grep -r, a glob, bash -c, source, Python and Node still read the key.