Local LLM / Local inference setup and APIs
Local LLM: Container network addressing
Use the correct host or service address from inside the application container.
Environment and inputs: Local inference APIs; Ollama examples require a running local service and a compatible installed model.
When to use it
Make one small request work end to end before adding streaming, tools or batching. Capture the effective model identity and configuration so failures can be reproduced against the server actually used by the application.
Check the result
Test connectivity from the application container rather than only from the host shell.
Save and compare results
Save the test input, configuration and result. Fix the failing boundary, repeat the same test and compare it with the saved working configuration.
Scope and limits
These exercises have not been tested on your systems. Check feature support and configuration names against the installed release and linked documentation.