Heads up This site is currently under heavy development.
Subscribe Get it delivered — the daily firehose, filtered to the tools you run, plus the documentation changes vendors never announce. Compare plans →

The AI Toolchain — issue -082, May 29, 2026

THE AI TOOLCHAIN NO. -082
Tail
THE DAILY RELEASE FIREHOSE
PUBLISHED MAY 29, 2026 · EVERY WEEKDAY
EDITIONS tail grep head diff uniq

The daily firehose — everything the toolchain shipped today, already filtered.

// HOW THIS ISSUE IS MADE

We read every release from the 174 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.

VIEW
ISSUE VIEW full issue
Do you prefer this view?
$ tct list   # 13 tools matched
AI & LLM Tooling
◆  AI Coding Agents

Anthropic Claude Code

Sources Release notes → v2.1.157 NOTES

Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflows - all through natural language commands.

Claude Code v2.1.157 adds auto-loaded plugins, plugin scaffolding, richer telemetry, and smarter agents dispatch.

└──▷ GET THIS VERSION
$ git clone --branch v2.1.157 https://github.com/anthropics/claude-code.git
# already have the repo? check out this version:
$ git checkout v2.1.157
└──▷ TRY IT
Bootstrap a new plugin without touching any marketplace — scaffold it locally and it loads automatically on next launch.
$ claude plugin init my-recon-tool
Capture detailed tool parameters (bash commands, MCP/skill names) in OTEL traces for audit or pipeline debugging.
$ OTEL_LOG_TOOL_DETAILS=1 claude --print 'Run nmap on 10.0.0.0/24 and summarize open ports'
  • Adds automatic loading of plugins from .claude/skills directories — no marketplace required.
  • New claude plugin init <name> command scaffolds a new plugin directly into .claude/skills.
  • Adds autocomplete for /plugin arguments: subcommands, installed plugin names, and plugins from known marketplaces.
  • Honors the agent field in settings.json for dispatched sessions, with --agent <name> to override per-run.
  • EnterWorktree can now switch between Claude-managed worktrees mid-session.
+5 moreshow less
  • tool_decision telemetry events now include tool_parameters (bash commands, MCP/skill names) when OTEL_LOG_TOOL_DETAILS=1 is set.
  • Claude-managed worktrees are left unlocked after an agent finishes, enabling clean git worktree remove/prune workflows.
  • Adds a 'Workflow keyword trigger' setting in /config to prevent the word 'workflow' in a prompt from triggering a dynamic workflow.
  • Slash-command autocomplete in the claude agents dispatch input now matches substrings.
  • Pressing backspace immediately after a workflow trigger keyword dismisses the workflow request instead of deleting a character.
Was this useful?

Cline

Sources Release notes → cli-v3.0.15 NOTES

Autonomous coding agent as an SDK, IDE extension, or CLI assistant.

Cline CLI v3.0.15 adds Cline Hub web monitoring, global AGENTS rules, Discord mute controls, and three new models.

└──▷ GET THIS VERSION
$ git clone --branch cli-v3.0.15 https://github.com/cline/cline.git
# already have the repo? check out this version:
$ git checkout cli-v3.0.15
  • Adds Cline Hub, a web app for monitoring connected clients, viewing and driving sessions, streaming assistant output, and restarting the local hub — with local, LAN, and tunnel access gated by a room secret.
  • Supports global AGENTS rules so agent rules apply across all sessions, not just per-project.
  • Lets plugins contribute static or dynamic rule content when installed in the sandbox.
  • Binds Discord sessions to individual message authors so different Discord users no longer share chat state in a thread.
  • Supports /mute and /unmute commands in Discord, resolved from user mentions or raw user IDs to mute a specific participant in a thread.
+3 moreshow less
  • Makes OAuth URLs clickable in the TUI.
  • Discovers SDK skill directories that are symlinked, including handling circular symlinks.
  • Steers active connector sessions across turn keys by matching on session ID so replies continue the existing session instead of starting a duplicate.
Was this useful?

GitHub Copilot CLI

Sources Release notes → v1.0.56 NOTES

GitHub Copilot CLI v1.0.56 adds rubber duck agent config, MCP structured content surfacing, and smarter token-reduction defaults.

└──▷ GET THIS VERSION
$ git clone --branch v1.0.56 https://github.com/github/copilot-cli.git
# already have the repo? check out this version:
$ git checkout v1.0.56
└──▷ TRY IT
Enable or disable the rubber duck agent without editing config files manually.
$ copilot config set builtInAgents.rubberDuck true
  • Adds builtInAgents.rubberDuck setting to enable or disable the rubber duck agent via copilot config.
  • MCP tools that return both content text and a structuredContent payload now surface both to the agent; literal JSON serialization (per MCP spec §5.2.6) is deduplicated, otherwise the two are concatenated.
  • When gh CLI is on PATH, the GitHub MCP server now omits redundant gh-replaceable tools by default, reducing token usage.
  • Free and Student users can select models other than Auto in the model picker.
  • Reasoning effort picker respects model capabilities, hiding options unsupported by the current model.
+3 moreshow less
  • Diff view uses a continuous scroll layout with sticky file and hunk headers, full terminal width, and theme-aware colors.
  • web_fetch tool prefers markdown content when available, using HTTP content negotiation for cleaner results from documentation sites.
  • Context window tier selection now persists durably in session events and survives SDK-only resume paths, reapplying tier-derived limits to request, compaction, and truncation logic.
Was this useful?

Earendil Works Pi

Sources Release notes → v0.78.0 NOTES

AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

Pi v0.78.0 adds named sessions, clickable file paths, custom Bedrock headers, and new extension APIs.

└──▷ GET THIS VERSION
$ git clone --branch v0.78.0 https://github.com/earendil-works/pi.git
# already have the repo? check out this version:
$ git checkout v0.78.0
└──▷ TRY IT
Label a session so it's identifiable by name in session listings or logs from the moment it starts.
$ pi --name incident-triage-2025
Start a non-interactive print-mode session with a meaningful name for audit trail purposes.
$ pi -n vuln-scan-run --print 'Scan the repo for hardcoded secrets'
  • Adds --name / -n flag to set a session display name at startup across interactive, print, JSON, and RPC modes.
  • Adds OSC 8 file:// hyperlinks to file paths in built-in file tool titles, including tmux clients that support them.
  • Adds custom Amazon Bedrock request header support.
  • Exports convertToPng for extension authors.
  • Exports parseArgs and type Args for extension authors.
+1 moreshow less
  • Shows a resume command hint when exiting interactive sessions.
Was this useful?

Alibaba Qwen Code

Sources Release notes → v0.17.0 NOTES

Qwen Code v0.17.0 adds a Feishu/Lark channel adapter, zero-config computer-use via MCP, and PermissionDenied hooks for AUTO classifier blocks.

└──▷ GET THIS VERSION
$ git clone --branch v0.17.0 https://github.com/QwenLM/qwen-code.git
# already have the repo? check out this version:
$ git checkout v0.17.0
  • Emits PermissionDenied hooks when the AUTO classifier blocks a tool, enabling downstream integrations to react to permission decisions.
  • Adds a Feishu (Lark) channel adapter for routing Qwen Code interactions through Feishu/Lark.
  • Enables zero-config computer-use capability built in via the open-computer-use MCP — no manual setup required.
  • Lays telemetry foundation for skill-based real-time optimization (P0+P1 priority tiers).
└──▷ BREAKING ON UPGRADE
  • !Context compaction strategy replaced: tail-preservation compaction is removed and replaced with summary + restoration attachments, which may change how long conversation contexts are truncated on upgrade.
Was this useful?
◆  AI Agent Frameworks

Nous Research Hermes

Sources Release notes → v2026.5.29 NOTES

The agent that grows with you

Hermes v2026.5.29 adds explicit Docker insecure opt-in, full 19,932-entry skills catalog, and memory providers now receive completed-turn context.

└──▷ GET THIS VERSION
$ git clone --branch v2026.5.29 https://github.com/NousResearch/hermes-agent.git
# already have the repo? check out this version:
$ git checkout v2026.5.29
└──▷ TRY IT
Run Hermes in Docker with LAN access while explicitly opting into insecure dashboard mode — required after the bind-host inference removal.
$ docker run -e HERMES_DASHBOARD_INSECURE=1 -p 0.0.0.0:8080:8080 nous-research/hermes-agent
  • Adds HERMES_DASHBOARD_INSECURE=1 env var as an explicit opt-in to disable the dashboard's loopback auth guard in Docker, replacing silent bind-host inference.
  • Expands the skills.sh catalog from 858 to 19,932 entries by walking the full sitemap instead of a single paginated page.
  • Memory providers now receive completed-turn message context, enabling richer recall across sessions.
  • Narrows hindsight recall_types default to observation-only, giving more targeted hindsight behavior out of the box.
└──▷ BREAKING ON UPGRADE
  • !Docker setups that previously relied on bind-host inference to enable --insecure must now explicitly set HERMES_DASHBOARD_INSECURE=1 or the dashboard's same-origin guard will remain active.
Was this useful?

PydanticAI

Sources Release notes → v1.104.0 NOTES

PydanticAI v1.104.0 adds Claude Opus 4.8 model support.

└──▷ GET THIS VERSION
$ git clone --branch v1.104.0 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:
$ git checkout v1.104.0
  • Adds support for Claude Opus 4.8 as a usable model.
Was this useful?

Hugging Face smolagents

Sources Release notes → v1.26.0 NOTES

smolagents v1.26.0 adds Exa as a search engine option in WebSearchTool and removes the remote WasmExecutor.

└──▷ GET THIS VERSION
$ git clone --branch v1.26.0 https://github.com/huggingface/smolagents.git
# already have the repo? check out this version:
$ git checkout v1.26.0
  • Adds Exa as a supported search engine option in WebSearchTool.
└──▷ BREAKING ON UPGRADE
  • !The remote WasmExecutor has been removed; any setup relying on it will break on upgrade.
Was this useful?
◆  Local LLM Runtimes

Jan AI Jan

Sources Release notes → v0.8.1 NOTES

Jan v0.8.1 adds Italian localization to the desktop UI.

└──▷ GET THIS VERSION
$ git clone --branch v0.8.1 https://github.com/janhq/jan.git
# already have the repo? check out this version:
$ git checkout v0.8.1
  • Adds Italian language translation to the Jan desktop interface.
Was this useful?

LocalAI

Sources Release notes → v4.3.5 NOTES

LocalAI v4.3.5 adds per-request reasoning_effort control on chat completions.

└──▷ GET THIS VERSION
$ git clone --branch v4.3.5 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v4.3.5
  • Supports reasoning_effort as a per-request parameter on chat completions, letting callers tune reasoning depth without changing model config.
Was this useful?

llama.cpp

Sources Release notes → b9415 6 RELEASES · 2026-05-29 NOTES STABLE

llama.cpp b9415 adds a skip_download option to prevent automatic model downloads.

└──▷ GET THIS VERSION
$ git clone --branch b9415 https://github.com/ggml-org/llama.cpp.git
# already have the repo? check out this version:
$ git checkout b9415
  • Adds skip_download flag to the download subsystem, allowing operators to prevent automatic model fetching — including when the target file does not exist locally.
5 more releases in this issue · 2026-05-29
b9414 NOTES STABLE

llama.cpp b9414 adds DeepSeek-OCR 2 support with multi-tile dynamic resolution in the mtmd subsystem.

└──▷ GET THIS VERSION
$ git clone --branch b9414 https://github.com/ggml-org/llama.cpp.git
# already have the repo? check out this version:
$ git checkout b9414
  • Adds DeepSeek-OCR 2 model support in mtmd with multi-tile dynamic resolution via tools/mtmd/models/deepseekocr2.cpp.
b9411 NOTES STABLE

llama.cpp b9411 adds DeepSeek V3.2 model support with sparse attention and NVFP4 quantization.

└──▷ GET THIS VERSION
$ git clone --branch b9411 https://github.com/ggml-org/llama.cpp.git
# already have the repo? check out this version:
$ git checkout b9411
  • Adds support for the DeepseekV32ForCausalLM architecture (LLM_ARCH_DEEPSEEK32) with a generic DeepSeek Sparse Attention (DSA) implementation including a lightning indexer cache.
  • Adds convert tooling support for the DeepseekV32ForCausalLM architecture to enable GGUF conversion of DeepSeek V3.2 model weights.
  • Adds NVFP4 quantization support for DeepSeek V3.2 models.
  • Adds llama_kv_cache_dsa memory type combining KV cache with a lightning indexer cache to accelerate DSA inference.
  • Adds f16 support for the GGML_OP_FILL operation in the ggml backend.
b9391 NOTES STABLE

llama.cpp b9391 adds LLAMA_ARG_API_KEY_FILE env var to supply API keys via file instead of inline flag.

└──▷ GET THIS VERSION
$ git clone --branch b9391 https://github.com/ggml-org/llama.cpp.git
# already have the repo? check out this version:
$ git checkout b9391
└──▷ TRY IT
Keep API keys out of shell history or process lists by pointing the server at a key file through the environment.
$ export LLAMA_ARG_API_KEY_FILE=/etc/llama/api_keys.txt
llama-server --model /models/my-model.gguf
  • Adds LLAMA_ARG_API_KEY_FILE environment variable as an alternative to passing --api-key-file directly, letting operators supply API keys via file path through the environment.
b9389 NOTES STABLE

llama.cpp b9389 automatically applies the iGPU flag for integrated CUDA/HIP devices

└──▷ GET THIS VERSION
$ git clone --branch b9389 https://github.com/ggml-org/llama.cpp.git
# already have the repo? check out this version:
$ git checkout b9389
  • Automatically applies the integrated GPU (iGPU) flag for CUDA and HIP backends when an integrated device is detected, removing the need for manual configuration.
b9387 NOTES STABLE

llama.cpp b9387 adds per-quantization MMQ dispatch thresholds on AMD MFMA hardware, yielding up to +76% prompt throughput.

└──▷ GET THIS VERSION
$ git clone --branch b9387 https://github.com/ggml-org/llama.cpp.git
# already have the repo? check out this version:
$ git checkout b9387
  • Introduces ggml_cuda_should_use_mmvq(type, cc, ne11) to apply per-quantization MMVQ/MMQ batch thresholds on AMD CDNA (MFMA) hardware, replacing the single global MMVQ_MAX_BATCH_SIZE = 8 cutoff: K-quants Q3_K/Q4_K/Q5_K switch to MMQ at batch≥4, Q2_K/Q6_K at batch≥6, legacy and IQ quants retain the original threshold — delivering up to +76% pp512 throughput on MI250X.
  • Non-AMD-MFMA paths (NVIDIA, RDNA, CDNA1 without MFMA) are unchanged by this dispatch logic update.
Was this useful?

vLLM

Sources Release notes → v0.22.0 NOTES

vLLM v0.22.0 adds a Rust frontend, multi-tier KV cache offloading, batch-invariant FP8/NVFP4 paths, and broad new model/hardware support.

└──▷ GET THIS VERSION
$ git clone --branch v0.22.0 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.22.0
└──▷ TRY IT
Limit reasoning token budget per request to control cost when using thinking-capable models.
$ curl http://localhost:8000/v1/completions -H 'Content-Type: application/json' -d '{"model": "deepseek-ai/DeepSeek-R1", "prompt": "Explain quantum entanglement.", "thinking_token_budget": 512}'
  • Adds --cpu-distributed-timeout-seconds CLI flag for CPU-distributed deployments.
  • Adds thinking_token_budget parameter support to the Completions API.
  • Adds reasoning_effort mapping to enable_thinking in the Completions API.
  • Adds chat_template_kwargs support to the Responses API.
  • Adds reset_cache() method to the KV offloading framework.
+53 moreshow less
  • Adds update_config support to Model Runner V2.
  • Adds logprob_token_ids field support in Model Runner V2.
  • Adds X-data-parallel-rank header forwarding for data-parallel serving.
  • Adds API-key authorization for /v2 endpoints.
  • Adds AuthenticationMiddleware path extraction simplification and utility call-ID newtype to the Rust frontend.
  • Adds PoolingOfflineMixin split for the pooling offline API.
  • Adds QuantKey with activation override, reworking quantization_config in the quantization framework.
  • Adds ExpertMapManager as part of the MoE refactor, with experts moved to the experts/ directory and a RoutedExperts alias for FusedMoE.
  • Adds truncation-side control for OpenAI-compatible endpoints.
  • Adds reasoning_contentreasoning normalization in the frontend.
  • Adds consolidated Speech-to-Text entrypoints.
  • Adds beam-search consolidation via BeamSearchMixin.
  • Adds score/rerank chat-template instructions to the frontend.
  • Introduces experimental Rust frontend integration with in-tree code, a DP Supervisor for data-parallel serving.
  • Introduces multi-tier KV cache offloading framework with a Python filesystem secondary tier, DSv4 support, and Mooncake disk offloading via MooncakeStoreConnector.
  • Adds DeepSeek V4 model package reorganized into dedicated vllm/models/deepseek_v4/ package with NVFP4 fused MoE, full and piecewise CUDA graph, and MTP speculative decoding.
  • Model Runner V2 (MRv2) is now default for Qwen3 dense models, with automatic fallback to MRv1 for unsupported features.
  • Adds batch-invariant inference with Cutlass FP8 support for a 28.9% end-to-end latency improvement and an NVFP4 Cutlass linear path.
  • Adds CutlassFP8 padding pre-processing yielding a 13.5% TTFT improvement.
  • Adds padded NVFP4 quantization kernel yielding 2.4–5.7% end-to-end improvement.
  • Adds fused RoPE+KVCache+q_concat kernel for MLA decoding.
  • Adds FULL CUDA graph capture for TRITON_MLA decode.
  • Adds breakable CUDA graph (experimental).
  • Adds RISC-V Vector Extension (RVV) optimized attention kernels with VLEN=256 support.
  • Adds fused GDN for AMX CPU and experimental Triton + MRv2 on CPU.
  • Adds MXFP4 linear layers with compressed-tensors integration.
  • Adds MXFP4 CPU W4A16 MoE and XPU mxfp8 MoE support.
  • Adds AutoRound W4A16 quantization support.
  • Adds ability to load Quark NVFP4 checkpoints.
  • Adds ModelOpt Qwen3.5/3.6 VLM quantized prefix mapping.
  • Adds GPTQ consolidation, migrating gptq_marlinauto_gptq.
  • Adds support for new model architectures: MiniCPM-V 4.6, InternS2 Preview, OpenVLA, and EXAONE-4.5.
  • Adds custom callable proposer backend for speculative decoding.
  • Adds post-norm EAGLE-3 and peagle speculative decoding backends.
  • Adds non-MTP speculation support for NemotronH.
  • Adds Apertus tool parser.
  • Adds anyOf/oneOf/$ref resolution for Qwen3Coder tool calling.
  • Adds one-shot Triton kernel for MoE LoRA and simultaneous 2D & 3D MoE LoRA adapters.
  • Adds per-tensor FP8 CUTLASS on SM12.1 and FlashInfer b12x MoE + FP4 GEMM for SM120/121 (NVIDIA Blackwell).
  • Adds RMSNorm+Quant fusion for AMD gfx950 and XGMI backend for MoRI connector.
  • Adds Intel XPU GPTQ int4 support and FP8 block-scaled quantization.
  • Adds head_dim=512 for FlashInfer TRTLLM attention.
  • Adds manual cumem allocator enable and stream-aware free callback to the allocator.
  • Adds KV cache event metadata emission.
  • Adds penalties Triton kernel.
  • Adds Mamba2 SSD kernel warmup, bf16 SSM cache, and GPU-side state postprocessing fused kernel.
  • Adds lease-renewal TTL for KV blocks and handshake-failure policy for disaggregated serving (NIXL).
  • Adds Mooncake operation metrics and HMA support for DSV4.
  • Adds DP Supervisor and publishes request counts at engine-step start for data-parallel serving.
  • Adds non-root vllm-openai Docker target.
  • Adds setuptools-rust dependency for Rust frontend builds.
  • Adds cohere MoE and pipeline parallelism for Cohere vision models.
  • Adds runai-streamer weight loading for Qwen3.5/MTP/Qwen3-VL.
└──▷ BREAKING ON UPGRADE
  • !Removed old locations of get_tokenizer and resolve_hf_chat_template; callers must update their import paths.
  • !Removed deprecated MLA prefill arguments; existing code using those arguments will break.
  • !Marked environment variables now covered by --moe-backend / --linear-backend as deprecated.
Was this useful?
◆  AI Model & Data Infrastructure

Microsoft ONNX Runtime

Sources Release notes → plugin-ep-webgpu/v0.1.0 NOTES

ONNX Runtime ships the WebGPU Execution Provider as a standalone plugin (onnxruntime_providers_webgpu) compatible with ORT 1.24.4+.

└──▷ GET THIS VERSION
$ git clone --branch plugin-ep-webgpu/v0.1.0 https://github.com/microsoft/onnxruntime.git
# already have the repo? check out this version:
$ git checkout plugin-ep-webgpu/v0.1.0
  • Introduces the onnxruntime_providers_webgpu plugin EP, registered into an existing ONNX Runtime 1.24.4+ installation at runtime via onnxruntime.register_execution_provider_library(...) (Python) or OrtEnv.RegisterExecutionProviderLibrary(...) (.NET) — no core ORT package swap required.
  • Adds the onnxruntime-ep-webgpu Python wheel (PyPI: onnxruntime-ep-webgpu) for installing the WebGPU EP alongside the onnxruntime package.
  • Adds the Microsoft.ML.OnnxRuntime.EP.WebGpu NuGet package for .NET, referenced alongside Microsoft.ML.OnnxRuntime.
  • Ships cross-platform native binaries for Windows x64/arm64 (bundled with dxil.dll and dxcompiler.dll), Linux x64, and macOS arm64.
  • Provides WebGPU kernels for transformer and LLM contrib ops: Attention, MultiHeadAttention, GroupQueryAttention, RotaryEmbedding, SkipLayerNormalization, SkipSimplifiedLayerNormalization, SimplifiedLayerNormalization, BiasAdd, BiasGelu, BiasSplitGelu, FastGelu, Gelu, QuickGelu, CausalConvWithState, and LinearAttention.
+4 moreshow less
  • Supports quantized inference via MatMulNBits (with DP4A and subgroup-matrix acceleration paths), DequantizeLinear, GatherBlockQuantized, and QMoE (quantized Mixture-of-Experts) on WebGPU.
  • Includes a FlashAttention kernel and Intel-optimized MatMul/Gemm code paths for improved throughput on Intel GPUs.
  • Adds program caching to amortize WebGPU shader compilation costs across inference runs.
  • Adds optional PIX frame capture and WebGPU profiler integration for GPU performance investigation.
Was this useful?
my-toolchain — 0 tools
paste an install list to detect your tools

A brew list, a Brewfile, requirements.txt, a Dockerfile — or just the product names, free-form. Nothing leaves your browser.

    browse all tools →