Local LLM / Local inference setup and APIs
Local LLM: API compatibility fixtures
Test the exact fields used by your client rather than assuming endpoint compatibility.
Environment and inputs: Local inference APIs; Ollama examples require a running local service and a compatible installed model.
When to use it
Make one small request work end to end before adding streaming, tools or batching. Capture the effective model identity and configuration so failures can be reproduced against the server actually used by the application.
Check the result
Exercise tool calls, streaming and structured output against each runtime adapter.
Save and compare results
Save the test input, configuration and result. Fix the failing boundary, repeat the same test and compare it with the saved working configuration.
Scope and limits
These exercises have not been tested on your systems. Check feature support and configuration names against the installed release and linked documentation.