Backfill issue -211 — The AI Toolchain

EDITIONS tail grep head diff uniq

The daily firehose — everything the toolchain shipped today, already filtered.

// HOW THIS ISSUE IS MADE

We read every release from the 174 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.

VIEW

ISSUE VIEW full issue

Do you prefer this view?

$ tct list   # 3 tools matched

AI & LLM Tooling

◆ Local LLM Runtimes

LocalAI

v3.10.0 NOTES

LocalAI v3.10.0 adds Anthropic /v1/messages API, Open Responses API, video generation UI, Moonshine STT, and Pocket-TTS with voice cloning.

└──▷ GET THIS VERSION

$ git clone --branch v3.10.0 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v3.10.0

└──▷ TRY IT

Fetch in-memory request/response traces after an agent run to diagnose unexpected tool calls or context drift.

$ curl http://localhost:8080/api/v1/trace

Use LocalAI as a drop-in Claude replacement by pointing the Anthropic SDK at the local /v1/messages endpoint.

$ curl -X POST http://localhost:8080/v1/messages \
  -H 'Content-Type: application/json' \
  -d '{"model": "claude-3-opus-20240229", "max_tokens": 1024, "messages": [{"role": "user", "content": "Summarise this document."}]}'

›Adds GET /api/v1/responses/{response_id} and GET /api/v1/trace endpoints as part of new Open Responses API support, enabling stateful agent sessions with response_id, background: true async mode, and stream: true streaming of tool calls, images, and audio.
›Adds GET /api/v1/trace endpoint for in-memory request/response tracing; logs are capped by max size and exportable to JSON for agent debugging and fine-tuning analysis.
›Adds native Anthropic messages API support at /v1/messages, providing a drop-in replacement for Claude with full tool/function calling, streaming, and compatibility with anthropic-sdk-go and LangChain.
›Adds new /video page in the web UI for text-to-video and image-to-video generation, supporting LTX-2 and diffusers with adjustable fps, num_frames, and guidance_scale parameters.
›Adds Moonshine backend — an ONNX-based, ultra-fast speech-to-text engine optimised for low-end devices (Raspberry Pi, older laptops) with live transcription support.

+6 moreshow less

›Adds Pocket-TTS backend for lightweight, high-fidelity text-to-speech with voice cloning support (requires HF authentication and a registered voice model).
›Adds streaming tool call support (input_json_delta) and XML-style tool call parsing (<function>...</function>) across all backends (llama.cpp, vLLM, diffusers, etc.).
›Adds a new 'Reasoning' field that automatically detects and extracts thinking tags from model output, surfacing reasoning steps in a dedicated 'Thinking' tab in the chat UI in both SSE and non-SSE modes.
›Unified GPU backend packaging: CUDA, ROCm, and Vulkan GPU libraries are now bundled inside backend containers, so any latest/master image works on Nvidia, AMD, and ARM64 (Vulkan, experimental) without manual driver configuration.
›Adds Vulkan arm64 backend builds, extending GPU-accelerated inference to ARM64 platforms.
›System-aware backend gallery now auto-detects CPU/GPU capabilities and hides incompatible backends (e.g., MLX on Linux, CUDA on AMD), showing only runnable options alongside detected capabilities.

Was this useful?

◆ AI Coding Agents

Earendil Works Pi

v0.49.1 NOTES

AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

Pi v0.49.1 adds undo in interactive mode, richer session management, shell-command API key retrieval, and Azure Responses pairing support.

└──▷ GET THIS VERSION

$ git clone --branch v0.49.1 https://github.com/earendil-works/pi.git
# already have the repo? check out this version:
$ git checkout v0.49.1

└──▷ USE IT

Pull an API key from macOS Keychain instead of storing it in plaintext in models.json.

json

"apiKey": "!security find-generic-password -ws 'anthropic'"

Undo the last action while working in interactive mode without leaving the session.

📍Ctrl+-

While reviewing past sessions in /resume, toggle full path display or delete a session without leaving the selector.

$ Ctrl+P   # toggle path display
Ctrl+D   # delete selected session (with inline confirmation)

›Adds strictResponsesPairing compat option for custom OpenAI Responses models on Azure.
›Session selector (/resume) gains path display toggle (Ctrl+P) and inline session deletion (Ctrl+D).
›Adds undo support in interactive mode via Ctrl+- hotkey.
›API keys in models.json can now be sourced from shell commands using the ! prefix, enabling integration with system keychains (e.g., macOS Keychain).
›Share URLs now use hash fragments (#) instead of query strings, keeping session IDs out of server logs.

Was this useful?

Alibaba Qwen Code

v0.7.1-nightly.20260118.0681c718 NOTES

Qwen Code v0.7.1-nightly adds settings support for experimental skills in the CLI.

└──▷ GET THIS VERSION

$ git clone --branch v0.7.1-nightly.20260118.0681c718 https://github.com/QwenLM/qwen-code.git
# already have the repo? check out this version:
$ git checkout v0.7.1-nightly.20260118.0681c718

›Adds settings support for experimental skills via the CLI, enabling configuration of opt-in skill features.

Was this useful?

// END OF TRANSMISSION

The AI Toolchain · curated daily · January 18, 2026
Releases & features from the open-source and commercial AI tools that practitioners actually run.

The AI Toolchain — issue -211, January 18, 2026

LocalAI

Earendil Works Pi

Alibaba Qwen Code