Merry Christmas & Happy 2027! Less downtime. More good times. Celebrating 13 years of sorlavit.com
Skip to content
Sorlavit KimIT Support, Network & Infrastructure Services Let’s talk

ปุ่มแปลไทยจะเปิดบทความผ่าน Google Translate เพื่อแปลอัตโนมัติ โดยคงโค้ดและคำสั่งไว้ตามต้นฉบับ

Local LLM / Local prompting and model adaptation

Local LLM: Extraction null semantics

Define when an absent field should be null, omitted or explicitly unknown.

Compiled for Sorlavit Kim · Published · Updated · 1 min read

Environment and inputs: Local chat models and optional PEFT/LoRA adaptation; templates and adapter compatibility depend on the base model.

When to use it

Version prompts, templates and decoding settings alongside the model artifact. Test a change on unseen examples before adopting it, and keep domain improvements separate from regressions in capabilities that the application still requires.

Practical example

Illustrative extraction schema. Null records missing evidence; it is not a fabricated invoice number.

{
  "type": "object",
  "properties": {
    "invoice_number": {
      "type": [
        "string",
        "null"
      ]
    }
  },
  "required": [
    "invoice_number"
  ],
  "additionalProperties": false
}

Check the result

Use documents with missing values and verify the model does not invent replacements.

Save and compare results

Save the test input, configuration and result. Fix the failing boundary, repeat the same test and compare it with the saved working configuration.

Scope and limits

These exercises have not been tested on your systems. Check feature support and configuration names against the installed release and linked documentation.

Share this article

Back to all articles