Backfill issue -253 — The AI Toolchain

EDITIONS tail grep head diff uniq

The daily firehose — everything the toolchain shipped today, already filtered.

// HOW THIS ISSUE IS MADE

We read every release from the 174 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.

VIEW

ISSUE VIEW full issue

Do you prefer this view?

$ tct list   # 2 tools matched

AI & LLM Tooling

◆ Local LLM Runtimes

llama.cpp

b7315 2 RELEASES · 2025-12-07 NOTES STABLE

llama.cpp b7315 adds Llama 4 scaling support for Mistral-Large (DeepSeek architecture).

└──▷ GET THIS VERSION

$ git clone --branch b7315 https://github.com/ggml-org/llama.cpp.git
# already have the repo? check out this version:
$ git checkout b7315

›Adds Llama 4 scaling support for Mistral-Large models using the DeepSeek architecture.

└──▷ BREAKING ON UPGRADE

!Linux releases will switch from .zip archives to .tar.gz archives — update any deployment scripts that reference the .zip format.

1 more release in this issue · 2025-12-07

b7312 NOTES STABLE

llama.cpp b7312: --color gains on/off/auto modes, defaulting to auto; Linux releases switching to .tar.gz.

└──▷ GET THIS VERSION

$ git clone --branch b7312 https://github.com/ggml-org/llama.cpp.git
# already have the repo? check out this version:
$ git checkout b7312

└──▷ TRY IT

Force colorized output on even when piping llama.cpp output to a file or downstream tool.

$ llama-cli --color on -m model.gguf -p "Explain buffer overflows"

›Changes --color flag to accept explicit values on, off, or auto (default: auto), replacing the previous boolean toggle.

└──▷ BREAKING ON UPGRADE

!Linux releases will use .tar.gz archives instead of .zip — deployment scripts that unzip Linux builds must be updated.

Was this useful?

oobabooga's Text Generation WebUI (textgen)

v3.20 NOTES

oobabooga textgen v3.20 adds a full image generation tab with diffusers models, quantization, and an OpenAI-compatible image API.

└──▷ GET THIS VERSION

$ git clone --branch v3.20 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v3.20

└──▷ HOW TO FIND IT

Access the new image generation UI to generate images with a diffusers model, enable quantization, and browse past generations in the gallery.

📍1. Launch textgen as usual and open the web UI. 2. Click the 'Image AI' tab. 3. Select a diffusers model (e.g. Z-Image-Turbo) and choose 4-bit or 8-bit quantization. 4. Enter a prompt and click Generate; past generations appear in the gallery below.

›New 'Image AI' tab supports image generation via diffusers models (e.g. Z-Image-Turbo) with 4-bit/8-bit quantization, torch.compile support, PNG metadata embedding, a gallery of past generations, and a progress bar.
›Adds an OpenAI-compatible API endpoint for image generation.
›Passes bos_token and eos_token to jinja2 templates, enabling template support for Seed-OSS-36B-Instruct and similar models.
›Enables flash_attention_2 by default for Transformers models.
›Adds LLM-generated prompt variations as an image generation feature within the new 'Image AI' tab.

Was this useful?

// END OF TRANSMISSION

The AI Toolchain · curated daily · December 7, 2025
Releases & features from the open-source and commercial AI tools that practitioners actually run.

The AI Toolchain — issue -253, December 7, 2025

llama.cpp

oobabooga's Text Generation WebUI (textgen)