ollama_ollama

Files

T

Jesse Gross 505e35f2b9 mlxrunner: choose the speculative draft length to maximize throughput

The heuristic schedule grew the draft toward a fixed cap on acceptance alone,
maximizing accepted-tokens-per-step rather than throughput, and on a
steep-forward target it regressed below no speculation. Replace it with an
engine-level controller that drafts the depth maximizing
committed-tokens-per-wallclock from live per-position acceptance and persisted
per-width forward cost, with no draft-length cap; the heuristic schedule and
the OLLAMA_MLX_MTP_* env vars go with it.

2026-06-22 15:25:45 -07:00

agent

x/cmd: enable web search and web fetch with flag (#13690 )

2026-01-12 13:59:40 -08:00

cmd

Reapply "don't require pulling stubs for cloud models" again (#14608 )

2026-03-06 14:27:47 -08:00

create

models: add cohere2_moe (Command A / North) to the MLX engine (#16670 )

2026-06-16 23:15:21 -07:00

imagegen

llama-server followups (#16353 )