Local LLM / Local LLM model selection
Local LLM: Small model escalation
Use a small model for measured easy cases and escalate uncertain or failed cases.
Environment and inputs: Local model selection across Ollama, llama.cpp and Transformers; capabilities depend on model revision and runtime.
When to use it
A model that looks strong on general conversation may fail a specific extraction, language or tool-use requirement. Compare approved artifacts using the same task fixtures and include memory, latency and licensing information in the selection record.
Check the result
Measure total success and escalation frequency on a mixed-difficulty set.
Save and compare results
Save the test input, configuration and result. Fix the failing boundary, repeat the same test and compare it with the saved working configuration.
Scope and limits
These exercises have not been tested on your systems. Check feature support and configuration names against the installed release and linked documentation.