Repository navigation

llama-server : make chat logprobs response OpenAI-compatible - #113

Open

Json288 wants to merge 8 commits into

gfx11from

jamesong.aiesw-41278-logprobs-tools-stream

Open

llama-server : make chat logprobs response OpenAI-compatible#113
Json288 wants to merge 8 commits into
gfx11from
jamesong.aiesw-41278-logprobs-tools-stream

Commits on Sep 22, 2026
- server : remove a throw for stream + tool + logprobs and add a unit test; remove the OAI incompatible comment
  Json288
  committed
  5692fb5
Commits on Oct 14, 2026
- requested fixes: queue+flush logprobs across chunks so none are silently dropped when a chat-msg diff is empty
  Json288
  committed
  53d3cd3
Commits on Oct 15, 2026
- trim comments
  Json288
  committed
  0cd46de
Commits on Oct 19, 2026
- server : add stream/non-stream x 5/100 top_logprobs test matrix for tool calls
  Json288
  committed
  2deb95b
Commits on Oct 20, 2026
- server : fix discarded logprobs for UTF-8 multi-token characters
  Json288
  committed
  59366e6
Commits on Oct 21, 2026
- server : apply stricter bytes check in tool-call logprobs tests
  Json288
  committed
  1675ff1
Commits on Oct 26, 2026
- server : fix dropping stored contents logprobs in stop string partial match branch and add unit test
  Json288
  committed
  e1812a3
Commits on Oct 27, 2026
- server : fix logprobs containing matched stop string's text and add unit test
  Json288
  committed
  e47a754