Backfill issue -329 — The AI Toolchain

EDITIONS tail grep head diff uniq

The daily firehose — everything the toolchain shipped today, already filtered.

// HOW THIS ISSUE IS MADE

We read every release from the 174 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.

VIEW

ISSUE VIEW full issue

Do you prefer this view?

$ tct list   # 2 tools matched

AI & LLM Tooling

◆ Local LLM Runtimes

KoboldCpp

v1.99.4 NOTES

KoboldCpp v1.99.4 adds llama.cpp flag aliases, per-IP rate limiting, a new audio voices endpoint, and a UI design overhaul.

└──▷ GET THIS VERSION

$ git clone --branch v1.99.4 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.99.4

└──▷ TRY IT

Drop-in replacement for a llama.cpp launch command when switching to KoboldCpp, reusing familiar flags without rewriting your script.

$ koboldcpp -m ./model.gguf -c 8192 -ngl 35 --flash-attn -fa --override-tensor -ot some_tensor=CPU

Limit how aggressively public users can hammer a shared KoboldCpp instance by enabling per-IP rate limiting.

$ koboldcpp --model ./model.gguf --ratelimit 10

Retrieve available TTS voices from a running KoboldCpp instance via the new audio voices endpoint.

$ curl http://localhost:5001/v1/audio/voices

›Adds aliases for llama.cpp command-line flags so llama.cpp users can pass familiar arguments directly: -m, -t, --ctx-size, -c, --gpu-layers, --n-gpu-layers, -ngl, --tensor-split, -ts, --main-gpu, -mg, --batch-size, -b, --threads-batch, --no-context-shift, --mlock, -p, --no-mmproj-offload, --model-draft, -md, --draft-max, --draft-n, --gpu-layers-draft, --n-gpu-layers-draft, -ngld, --flash-attn, -fa, --n-cpu-moe, -ncmoe, --override-kv, --override-tensor, -ot, --no-mmap.
›Adds new --ratelimit flag for per-IP rate limiting to help prevent abuse of public instances.
›Adds /v1/audio/voices API endpoint for listing available TTS voices.
›Renames --promptlimit to --genlimit; the renamed flag now also applies to API requests and is configurable in the UI launcher.
›Adds a KoboldAI Lite UI design overhaul with a new default color scheme; the previous scheme remains available as 'Nostalgia' in advanced settings, and several new custom color schemes have been added.

+4 moreshow less

›Adds a popup in Kobold Lite to enable TTS or image generation when those features are available but currently disabled.
›Adds Think/NoThink instruct tags to the best-practices recommendation in Kobold Lite, providing per-instruct-sequence reasoning control instead of relying on <think> prefill injection.
›Adds new 'Aletheia' scenario to Kobold Lite.
›Smarter automatic 'Enter Sends' default detection based on platform in Kobold Lite; the toggle is now located in advanced settings.

└──▷ BREAKING ON UPGRADE

!The --promptlimit flag has been renamed to --genlimit; any scripts or configs using --promptlimit must be updated.

Was this useful?

◆ AI Model & Data Infrastructure

Ollama

v0.12.1 NOTES

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Ollama v0.12.1 adds Qwen3 Embedding model support and tool calling for Qwen3-Coder.

└──▷ GET THIS VERSION

$ git clone --branch v0.12.1 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.12.1

└──▷ TRY IT

Generate embeddings locally with the new state-of-the-art Qwen3 Embedding model for use in RAG pipelines or semantic search.

$ ollama pull qwen3-embedding

›Adds Qwen3 Embedding, a state-of-the-art open embedding model from the Qwen team, available via ollama pull qwen3-embedding.
›Enables tool calling support for Qwen3-Coder models.

Was this useful?

// END OF TRANSMISSION

The AI Toolchain · curated daily · September 21, 2025
Releases & features from the open-source and commercial AI tools that practitioners actually run.

The AI Toolchain — issue -329, September 21, 2025

KoboldCpp

Ollama