Heads up This site is currently under heavy development.
Subscribe Get it delivered — the daily firehose, filtered to the tools you run, plus the documentation changes vendors never announce. Compare plans →

The AI Toolchain — issue 019, September 7, 2026

THE AI TOOLCHAIN NO. 019
Tail
THE DAILY RELEASE FIREHOSE
PUBLISHED SEPTEMBER 7, 2026 · EVERY WEEKDAY
EDITIONS tail grep head diff uniq

The daily firehose — everything the toolchain shipped today, already filtered.

// HOW THIS ISSUE IS MADE

We read every release from the 193 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.

VIEW
ISSUE VIEW full issue
Do you prefer full issue?
$ tct list   # 18 tools matched
Same issue, same prompt, two writers:

A read across the whole issue before you read any of it: what stands out in today's releases, grouped by what it lets you do. Every tool named links to its entry below.

Three unrelated things stand out. Anthropic's Claude Fable 5.1 and Mythos 5.1 land with 1M-token context and always-on adaptive thinking, plus ant apply for declaring agent deployments as code. Helicone open-sourced a Rust AI gateway you can self-host with docker compose. Braintrust's Patterns clusters failures across traces so you stop reading them one at a time.

  • build

    Declare an agent deployment in config instead of clicking it into existence

    Anthropic's ant apply brings infrastructure-as-code semantics to agent deployment, and its Admin API now reaches the CLI and SDKs, so provisioning stops being a console task. Cursor pairs this with self-hosted execution for Cloud Agents, meaning agent runs can sit inside your own network boundary rather than a vendor's.

    Anthropic · Cursor

  • evaluate

    Find the failure mode across a thousand traces without reading them

    Braintrust's Patterns does automated cross-trace analysis to surface recurring failure shapes, with Debugger for drilling into a single bad run — the manual step that goes away is eyeballing traces hoping a theme emerges. LangSmith adds pre-save testing for thread evaluators, so you learn an evaluator is broken before it starts scoring production threads.

    Braintrust · LangSmith

  • operate

    Route every model call through a gateway you actually run yourself

    Helicone's AI Gateway is open source, written in Rust, and self-hostable via docker compose, so the single choke point where fallbacks, cost attribution and logging happen no longer has to be someone else's cloud. Cost tracking and context-window data now cover GPT-5, GPT-OSS, Claude and Grok, which is what makes per-team spend legible rather than a monthly surprise.

    Helicone

  • build

    Give an agent Datadog or Power BI without writing the auth plumbing

    Arcade added ten third-party toolkits including Power BI, Postman, OneDrive, Vercel and Datadog, plus stateless MCP support — each one is an integration you would otherwise build and hold OAuth OAuth An open authorization protocol that lets a user grant a third-party application access to their account on another service without sharing their password, using scoped tokens instead of credentials. tokens for. Docker Sandboxes adds scoped MCP OAuth authorization, so a sandboxed agent gets exactly the permissions the task needs instead of whatever the token already carried.

    Arcade

Does Opus 5 read better?
DEPTH
Build
◆  AI Coding Agents

Replit Agent

Sources Release page → 1 RELEASE · seen 2026-09-07 NOTES also Why this rank top features scored 55 — 55 How ranking works →

Replit Agent added a machine-readable documentation index endpoint for programmatic discovery of its docs.

Replit Agent is an AI coding agent that builds, tests, and deploys applications in Replit.

Replit Agent added a machine-readable documentation index endpoint for programmatic discovery of its docs.

└──▷ WHAT SHIPPED · 1 FEATURE 1 OF 1 FEATURE most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Documentation index endpoint at /llms.txt NEW 55

Adds a /llms.txt endpoint to fetch the complete documentation index, enabling programmatic discovery of all available pages.

— Names exact endpoint but no further mechanism detail snapshot-20260907
Was this useful?

Augment Code

Sources Release page → 1 RELEASE · seen 2026-09-07 NOTES also Why this rank top features scored 56/54/45, +15 breaking change, +10 product media — 76.67 How ranking works →

Augment Code's Cosmos platform gained a set of Template Experts led by a Feedback Triager and a Ticket Manager, alongside a CLI flag for model reasoning effort and the removal of the secret get --reveal flag.

Your engineers have agents. Your organization doesn't.

Augment Code's Cosmos platform gained a set of Template Experts led by a Feedback Triager and a Ticket Manager, alongside a CLI flag for model reasoning effort and the removal of the secret get --reveal flag.

└──▷ WHAT SHIPPED · 5 FEATURES 5 OF 5 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Ticket Manager Expert for delegated tickets NEW 56

A Ticket Manager Expert converts delegated Linear, Jira, or GitHub tickets into implementation-ready work and tracks them through closure.

— Names integrations but no invocation surface given. product docs
02 02
Feedback Triager Expert for Slack reports NEW 54

A Feedback Triager Expert classifies Slack feedback, investigates technical reports, and creates tickets or launches fixes automatically.

— Explains behaviour but no command or config to invoke it. product docs
03 03
`secret get --reveal` flag removed BREAKING 45

The secret get --reveal flag has been removed.

— Names exact removed flag but no migration guidance. snapshot-20260907
04 04
CLI flag for model reasoning effort NEW 35

Adds a flag to control the model's reasoning effort from the CLI.

— Exact flag name not given, only its purpose. snapshot-20260907
05 05
Additional Template Experts for PR review and incident response NEW 25

Augment Code also adds Template Experts for PR authoring and repair, code review, incident response, and project building, alongside the Feedback Triager and Ticket Manager experts.

— Only named in a list, no mechanism described. product docs
└──▷ ALSO FROM THESE RELEASES
Cosmos Week 33 Release NotesCosmos Week 32 Release Notes
└──▷ BREAKING ON UPGRADE
  • !The secret get --reveal flag has been removed.
Was this useful?

StackBlitz bolt.new

Sources Release page → 1 RELEASE · seen 2026-09-07 NOTES lead Why this rank top features scored 91/84/79, +6 runnable example — 90.67 How ranking works →

Bolt.new is an AI-powered web development platform that builds websites and applications from prompts.

Bolt.new shipped a full visual editing mode for prompt-free UI tweaks, in-chat AI image generation, MCP MCP Model Context Protocol, an open standard from Anthropic that lets an AI model call external tools and data sources through a uniform interface, so cyber tools can expose capabilities directly to LLM-based agents. server connectors for external tools, a new Claude Sonnet 4.6 model, team-scoped project templates, and direct file editing from folder view in Code view.

└──▷ WHAT SHIPPED · 6 FEATURES 5 OF 6 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Visual editing mode in preview NEW 91

Adds a Select tool in the chatbox that lets you click any preview element and edit text, colors, font size, alignment, opacity, object fit, alt text, links, and list formatting directly in the UI without writing prompts. Edits are batched above the chatbox and only consume tokens when you click Save changes; CMD+click (Mac) or CTRL+click (Windows) selects a child element inside a selected parent, with arrow-key navigation between nested elements. An optional batch note field lets you type cross-page instructions (e.g. apply a style change to matching elements on other pages) before saving, and a saved batch of visual edits can be rolled back via the project's version history when individual undo isn't available.

Restyle a heading across multiple pages without writing code — batch the change and use a note to propagate it site-wide.
📍1. In your Bolt project, click 'Select' in the chatbox. 2. Click the section heading in the preview. 3. In the toolbar, change font size and type color, then click 'Add changes'. 4. In the chatbox, type: Apply these changes to the section headings on the other pages too. 5. Click 'Save changes' next to the batch.
Select a deeply nested child element (e.g. a button label inside a card) without accidentally editing the container.
📍1. Click 'Select' in the chatbox. 2. Click the card element in the preview. 3. Use CMD+click (Mac) or CTRL+click (Windows) to target the button label inside the card. 4. Double-click the text and type your changes, then click 'Add changes'.
— Names exact UI controls, click modifiers, and save/rollback mechanics product docs
02 02
MCP server connectors for external tools NEW 84

Adds MCP (Model Context Protocol) server connectors, letting Bolt integrate with external tools like Notion, Linear, and GitHub via built-in connectors or a custom MCP server URL, accessible via the plus icon in the chatbox under Connectors > Manage connectors.

Connect a GitHub MCP server so Bolt can read issues and pull requests without leaving the chat.
📍In the Bolt chatbox, click the plus icon › Connectors › Manage connectors, then add GitHub from the built-in connectors list or paste a custom MCP server URL.
— Exact navigation path and named integrations given snapshot-20260907
03 03
AI image generation in chatbox NEW 79

Adds AI image generation directly in the Bolt chatbox, with transparent background support and automatic WebP conversion; requires enabling Image Generation under Personal Settings > Add-on features.

Enable AI image generation so you can describe and create ready-to-use WebP images with transparent backgrounds from the chatbox.
📍Go to Personal Settings › Add-on features and turn on 'Image Generation', then return to the chatbox and describe the image you want to generate.
— Names exact settings toggle and output format snapshot-20260907
thinner coverage below
04 04
Team-scoped reusable project templates NEW 49

Adds team-scoped reusable project templates (Teams plan only), allowing organizations to create standardized starter projects from existing projects without modifying the original.

— Describes scope and behavior but no UI path given snapshot-20260907
05 05
Claude Sonnet 4.6 model option NEW 45

Adds Claude Sonnet 4.6 as a selectable model in the agent selector, balancing speed, cost, and reasoning for planning, coding, debugging, and iterative development.

— Names the model and selector but no further detail snapshot-20260907
06 00
Direct file editing in Code view folders IMPROVED 30

Enables direct file editing from folder view in Code view.

— Single-line description with no mechanism or scope product docs
Was this useful?

Vercel v0

Sources Release page → 1 RELEASE · seen 2026-09-07 NOTES also Why this rank top features scored 85/70/65, +6 runnable example — 79.33 How ranking works →

v0 shipped a unified GitHub Publish flow with a full branch menu, zero-config AI Gateway authentication for generated apps, a new GPT-5.6 Sol model tier, and in-preview Vercel sign-in, alongside a long tail of editor, mobile, and billing improvements.

The v0 generative UI platform builds web applications from natural-language prompts.

v0 shipped a unified GitHub Publish flow with a full branch menu, zero-config AI Gateway authentication for generated apps, a new GPT-5.6 Sol model tier, and in-preview Vercel sign-in, alongside a long tail of editor, mobile, and billing improvements.

└──▷ WHAT SHIPPED · 18 FEATURES 9 OF 18 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Publish flow with branch menu for GitHub projects NEW 85

A new branch menu gives access to the latest preview deployment, a code diff against the base branch, PR creation/open/merge, CI check and repository-rule status, pulling the base branch, and in-chat fix requests for preview, CI, or merge issues. The unified Publish action lets v0 create or reuse a pull request, wait for required checks and reviews, merge into the base branch, and deploy to production, pausing to link directly to the PR if a branch protection rule needs human action.

Publish a GitHub-backed project to production without leaving v0 — useful when you want branch protections and CI checks to run before merge but don't want to context-switch to GitHub.
📍In v0, open your GitHub-backed project, make your changes, then select Publish. v0 creates or reuses the pull request, waits for required checks and reviews, merges into the base branch, and deploys to production. If a branch protection rule needs human action, v0 pauses and links you directly to the pull request.
— Full workflow described with concrete steps. snapshot-20260907
02 00
MCP server limit raised to 100 per scope IMPROVED 70

Raises the maximum number of MCP servers per scope from 10 to 100; in v0 settings, navigate to MCP Servers for your scope to add up to 100 servers.

Increase the MCP server limit for a scope that integrates more than 10 tools — the new ceiling of 100 lets large teams connect many MCP providers without hitting the old cap.
📍In v0 settings, navigate to MCP Servers for your scope and add up to 100 servers. The previous limit of 10 no longer applies.
— Exact old/new limits and navigation path given. snapshot-20260907
03 02
Team or password visibility for published apps NEW 65

Adds a 'Team or password' visibility option for published apps, requiring Vercel team sign-in while still allowing password-based access for others. Set via Share/Publish settings by choosing this visibility option and saving.

Set a published app to require Vercel team sign-in while still allowing external reviewers in via a shared password — useful for staging apps shared with contractors.
📍In your project, open Share / Publish settings and set visibility to 'Team or password', then save. Team members sign in with Vercel; others use the password you supply.
— Exact settings path given for enabling. snapshot-20260907
04 03
Zero-config AI Gateway authentication for generated apps NEW 60

Generated apps get zero-config authentication to the AI Gateway covering text, structured output, embeddings, reranking, images, video, speech, and transcription — no provider or Gateway API keys required.

— Names capabilities covered but no setup steps given. snapshot-20260907
thinner coverage below
05 04
GPT-5.6 Sol and Sol Fast model tier NEW 55

Adds GPT-5.6 Sol and a Sol Fast tier to the model picker, routed through OpenAI on Vercel AI Gateway, priced at 50% off through September 18.

— Names model, tier, and discount window; no usage steps. snapshot-20260907
06 05
Inline error bar for failed VM dev servers NEW 55

A compact error bar appears beneath the preview when a VM dev server fails to boot or install, and clicking it opens the console log to the exact error.

— Describes trigger and click-through behavior. snapshot-20260907
07 06
Sign-in with Vercel inside VM preview NEW 50

Sign-in with Vercel now works from inside a VM preview: the preview and app share an origin so the session persists, and sign-in opens in a new top-level window when the preview is embedded.

— Explains mechanism but no config steps. snapshot-20260907
08 00
Project-scoped chat starting source IMPROVED 50

New chats started inside a project now begin from that project's own source — GitHub branch, managed repository, or production deployment — so v0 has the code from the first message.

— Describes behavior change, no config surface. snapshot-20260907
09 00
Automatic VM tier upgrade on resource exhaustion IMPROVED 45

Paid chats whose sandbox runs out of CPU or memory are automatically moved up a VM size tier and restarted in the background instead of timing out.

— Explains before/after behavior, no manual action needed. snapshot-20260907
10 00
Inline environment variable requests above composer IMPROVED 45

Environment variable requests now appear above the composer like questions and approvals, with collapse and reopen that preserve entered values.

— Describes UI placement and state preservation. snapshot-20260907
11 00
Native mobile app messaging and history improvements IMPROVED 40

The native mobile app adds message queuing, tappable links, shared-chat author avatars, and chat-history and image-caching improvements.

— Lists several additions with no mechanism depth. snapshot-20260907
12 00
Direct-to-chat Git repository imports IMPROVED 40

Git repository imports go directly to chat, skipping the detection step and requirements modal.

— Names skipped steps but limited further detail. snapshot-20260907
13 00
Token billing default for paid Enterprise teams IMPROVED 40

Paid Enterprise teams default to token billing, enabling teams with a shared credit pool but no seat credits to spend it.

— States billing change and who benefits. snapshot-20260907
14 07
Revision history for custom skills NEW 35

Custom skills now show revision history, including file paths, authors, timestamps, and text diffs.

— Names fields shown but no usage steps. snapshot-20260907
15 08
Native Save As dialog for ZIP downloads NEW 35

Adds a native Save As dialog to the Download ZIP action where the browser supports it.

— Names exact action, minimal further detail. snapshot-20260907
16 09
Drag-to-Favorites for sidebar chats NEW 30

Adds drag-to-Favorites for chats in the sidebar.

— Bare feature name, no further detail. snapshot-20260907
17 00
Web-based VM code editor for all users IMPROVED 30

Makes the web-based code editor in the VM panel available to all users.

— States rollout only, no mechanism. snapshot-20260907
18 00
Illustrated tooltips for editor modes IMPROVED 30

Editor modes — Preview, Design, Code, and Database — now have illustrated tooltips.

— Names the four modes, no other mechanism. snapshot-20260907
Was this useful?

Anysphere Cursor

Sources Release page → 1 RELEASE · seen 2026-09-07 NOTES lead Why this rank top features scored 85/80/75, +10 product media, +6 runnable example — 96 How ranking works →

Built to make you extraordinarily productive, agents turn ideas into code. Accelerate development by handing off tasks to Cursor.

Cursor's biggest shipment in this window opens Cloud Agents to self-hosted execution infrastructure and introduces Origin, a built-in code hosting service, alongside 3x-faster agent starts via Builds, persistent /goal objectives, subscriptions, custom modes, and new team controls over skill sharing.

└──▷ WHAT SHIPPED · 10 FEATURES 9 OF 10 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Origin code hosting for Cloud Agents NEW 85

Introduces Origin, a built-in code hosting service with repos, pull requests, code browsing, and GitHub sync, available in early beta on all paid plans. Adds a Codebase tab as the home for Origin repos with a +New button to create repos whose names become part of every repo URL at cursor.com/codebase/<name>, and lets Cloud Agents start without a connected GitHub or third-party SCM provider via 'Start from scratch' in the repo picker, saving work to a Cursor Origin repo. Adds pull request sync between Origin and GitHub so comments, reactions, and replies made in either surface appear in the other within seconds, app extensions (Vercel, Depot, Buildkite) to Origin repos via a per-repo Apps tab enabling preview deployments and CI on every PR, and per-repo Settings for managing GitHub sync status, access control, and connected apps.

Start from scratch in the repo pickerVercel, Depot, and Buildkite apps connected to an Origin repo
— Names URL scheme, tabs, and specific app integrations snapshot-20260907
02 02
Self-hosted machines and execution infrastructure NEW 80

Introduces self-hosted machines so tool execution, codebase, build outputs, and secrets stay entirely within your own network. Adds dynamic pool scheduling via My Machines (single laptop/VM) and Team Pools (named queues of workers) that auto-scale and hibernate idle machines, plus support for running cloud agents on pre-existing sandbox infrastructure including AWS Lambda, Coder, Cloudflare, Daytona, Modal, Namespace, Vercel, and E2B. Also enables computer use (click, type, screenshot, browser control) on Linux and Mac for self-hosted workers, with live desktop viewing and takeover from Cursor.

Run on menu showing Remote Machines with self-hosted options lambda-test, cloud-demo, and jacks-desktopCloud Agents dashboard listing Self-hosted Machines pools with active and idle worker counts
— Many named integrations and mechanisms, no exact commands snapshot-20260907
03 03
Skill sync and team marketplace for Cloud Agents NEW 75

Adds a Sync Skills for Cloud Agents toggle under Settings → Agents → Context and Tools that lets individuals enable their personal skills for use in Cloud Agents, and a team admin control under Team Settings → Security & Identity to disable this org-wide for Teams and Enterprise plans. Also adds a team skill marketplace where members publish personal skills from ~/.cursor/skills/ to a shared Default marketplace via Customize → SkillsPublish, an Allow Members to Publish toggle in Dashboard → Plugins that restricts who can publish, and the ability for admins to mark a published plugin 'Default On' or 'Required' to control installation across the team.

Enable your local personal skills for use in Cloud Agents without sharing them with your team.
📍Settings → Agents → Context and Tools → turn on 'Sync Skills for Cloud Agents' → Confirm
As a Teams or Enterprise admin, prevent all members from syncing personal skills to Cloud Agents.
📍Team Settings → Security & Identity → turn off 'Sync Skills for Cloud Agents'
Share a personal skill with your team so teammates can discover and install it from the team marketplace.
📍Go to Customize → Skills, open the personal skill you want to share from ~/.cursor/skills/, choose Publish, and confirm. The skill becomes available in your team's Default marketplace.
Restrict skill publishing to admins only, so members cannot add unapproved skills to the team marketplace.
📍Go to Dashboard → Plugins, open the team marketplace, and turn Allow Members to Publish off.
— Names exact UI paths and toggles, no API surface product docs
04 04
Long-lived goals via /goal command NEW 70

Adds /goal command to give a cloud agent a long-lived objective that it pursues until fully complete — pair with a custom mode or /loop for recurring check-ins.

Give a cloud agent a persistent, long-running objective — such as eliminating all flaky tests — so it keeps working toward the goal across sessions without you re-prompting.
📍In a new chat, type: /goal fix all flaky tests and make CI green
— Exact runnable command with pairing options named snapshot-20260907
05 05
Custom Modes pin skills as always-on NEW 65

Adds Custom Modes, which pin any skill as an always-on mode in chat, activated via ⌥⏎ (Mac) or Alt+Enter (Windows) from the skill picker.

Pin a skill as a Custom Mode so every new chat automatically follows a specific playbook — useful for always enforcing a code-review or security-audit workflow.
📍In the chat panel, open the skill picker with / , select the skill you want to pin, then press Alt+Enter (Windows) or Option+Return (Mac) to activate it as a Custom Mode.
— Exact activation shortcut given snapshot-20260907
06 06
Builds for faster Cloud Agent starts NEW 65

Introduces Builds for Cloud Agents: pre-prepared environment snapshots (repos cloned, dependencies installed) that make agents start 3x faster, with a Builds tab in the Cloud Agents dashboard for inspecting build status, logs, and commit SHAs.

— Concrete speedup and dashboard location, no command snapshot-20260907
07 00
Non-interrupting steering messages IMPROVED 60

Adds steering improvements allowing mid-run follow-up messages that wait for the next tool call rather than interrupting the agent — send via 'Send now' or by pressing twice.

— Exact send mechanism named snapshot-20260907
thinner coverage below
08 07
Subscriptions for event-driven cloud agents NEW 50

Adds Subscriptions for cloud agents to monitor PRs, watch Slack threads, or run scheduled tasks — agents wake on events without manual intervention.

— Describes triggers but no setup steps snapshot-20260907
09 08
Isolated-VM subagents NEW 45

Enables subagents to run on their own isolated virtual machines, each with a clean copy of the project and an independent cloud environment.

Spin up a swarm of subagents to independently test a parent agent's changes in fresh, isolated environments — useful for parallel regression or security smoke-testing without environment collisions.
📍In the chat panel, prompt: run a swarm of subagents to test my app for bugs, each in its own environment
— Describes mechanism but no config or limits snapshot-20260907
10 09
Live preview and publishing for Cloud Agents NEW 45

Adds in-browser live port-forwarding of a cloud agent's environment for real-time preview and design mode tooling, plus a Publish feature that connects a Vercel account and produces a live URL from a built project.

— Two thin additions with no exact steps snapshot-20260907
Was this useful?

Diagram Design

Sources Commits → changes since 2026-08-12 CODE

Diagram Design is a Claude Code skill that generates editorial HTML and SVG diagrams and imports draw.io or Mermaid sources.

Diagram Design 2.6 ships ten new diagram types, native Droid packaging, named client profiles, animated semantic patterns, and a live gallery.

└──▷ GET THIS VERSION
$ git clone --branch commits-2026-08-12 https://github.com/cathrynlavery/diagram-design.git
# already have the repo? check out this version:
$ git checkout commits-2026-08-12
└──▷ TRY IT
Run the new rendered-lint pass against all examples to catch SVG clipping and runtime errors that source-level linting cannot see.
$ python3 scripts/lint-render.py
Verify beeswarm geometric invariants (value-axis accuracy, no overprint) after editing or generating a beeswarm example.
$ python3 scripts/verify-beeswarm.py
Run adversarial Sankey contract tests to confirm the checker fires on known mutations and stays quiet on clean files.
$ python3 scripts/test-verify-sankey.py
  • Adds role="img", aria-labelledby, and first-child <title> / <desc> slots to template.html, template-dark.html, template-full.html, and template-terminal.html, and adds an a11y category to scripts/lint-skin.py that rejects a diagram SVG without a resolvable accessible name.
  • Adds scripts/test-lint-a11y.py covering nine rejection and seven acceptance cases for the accessible-SVG contract.
  • Adds scripts/verify-beeswarm.py to enforce nine geometric invariants — shared value scale, no overprint, and others — that lint-skin.py and verify-geometry.py cannot catch.
  • Adds scripts/lint-render.py to lint diagram examples as rendered in headless Chromium, catching clipped SVG viewports, collapsed SVGs, page overflow, and runtime errors that source-level linting misses.
  • Adds scripts/test-verify-sankey.py with adversarial fixtures testing both passing and failing polarities of the Sankey geometric contract.
+13 more show less
  • Adds treemap diagram type for part-of-whole by area (feat #87).
  • Ships ten editorial diagram types in a single release (feat #118).
  • Adds dumbbell as a Bar variant (feat #107).
  • Adds slopegraph variant to the line diagram type for showing change between two states (feat #106).
  • Adds example-queue-animated.html for Semantic Pattern #1 (Fan-in Queue / Bottleneck) and example-paved-road-animated.html for Semantic Pattern #5 (Secure Paved Road).
  • Adds native Droid plugin packaging via scripts/factory (feat #120).
  • Adds named client profiles (#61).
  • Adds a GitHub Actions CI workflow (.github/workflows/ci.yml) running lint-skin.py --all --baseline, verify-sequence-oauth.py, verify-drawio-import.py, and build-icons.py on push and pull request to main.
  • Adds multi-OS CI testing matrix for Linux, Windows, and macOS with OS-aware Playwright browser provisioning and a GitHub Step Summary table for matrix run results.
  • Adds automated visual artifact packaging and upload on linter failures.
  • Deploys a live gallery to GitHub Pages.
  • Adds automatic plugin updates via native marketplaces and a version gate.
  • Emits aria-hidden="true" from scripts/build-icons.py so decorative specimen icons remain exempt through regeneration.
  • Adds role="img", aria-labelledby, and first-child <title> / <desc> slots to template.html, template-dark.html, template-full.html, and template-terminal.html, and adds an a11y category to scripts/lint-skin.py that rejects a diagram SVG without a resolvable accessible name.
  • Adds scripts/test-lint-a11y.py covering nine rejection and seven acceptance cases for the accessible-SVG contract.
  • Adds scripts/verify-beeswarm.py to enforce nine geometric invariants — shared value scale, no overprint, and others — that lint-skin.py and verify-geometry.py cannot catch.
  • Adds scripts/lint-render.py to lint diagram examples as rendered in headless Chromium, catching clipped SVG viewports, collapsed SVGs, page overflow, and runtime errors that source-level linting misses.
  • Adds scripts/test-verify-sankey.py with adversarial fixtures testing both passing and failing polarities of the Sankey geometric contract.
+12 more show less
  • Adds treemap diagram type for part-of-whole by area (feat #87).
  • Ships ten editorial diagram types in a single release (feat #118).
  • Adds dumbbell as a Bar variant (feat #107).
  • Adds slopegraph variant to the line diagram type for showing change between two states (feat #106).
  • Adds example-queue-animated.html for Semantic Pattern #1 (Fan-in Queue / Bottleneck) and example-paved-road-animated.html for Semantic Pattern #5 (Secure Paved Road).
  • Adds native Droid plugin packaging via scripts/factory (feat #120).
  • Adds named client profiles (#61).
  • Adds a GitHub Actions CI workflow (.github/workflows/ci.yml) running lint-skin.py --all --baseline, verify-sequence-oauth.py, verify-drawio-import.py, and build-icons.py on push and pull request to main.
  • Adds multi-OS CI testing matrix for Linux, Windows, and macOS with OS-aware Playwright browser provisioning and a GitHub Step Summary table for matrix run results.
  • Adds automated visual artifact packaging and upload on linter failures.
  • Deploys a live gallery to GitHub Pages.
  • Adds automatic plugin updates via native marketplaces and a version gate.

1 more in Everything

Was this useful?
Agent
◆  AI Agent Frameworks

Arcade

Sources Release page → 1 RELEASE · seen 2026-09-07 NOTES also Why this rank top features scored 83/68/63, +6 runnable example — 77.33 How ranking works →

Arcade's biggest release in this window adds ten new third-party toolkits (Power BI, Postman, Insightly, Fireflies.ai, OneDrive, Freshdesk, Ashby, Vercel, Datadog, and Nimble) alongside stateless MCP MCP Model Context Protocol, an open standard from Anthropic that lets an AI model call external tools and data sources through a uniform interface, so cyber tools can expose capabilities directly to LLM-based agents. protocol support, new platform RBAC RBAC Role-Based Access Control, a permissions model where rights are assigned to roles rather than individuals, letting tools enforce least-privilege by granting users only the access their role requires. /org APIs, and a wide set of additions to existing Google Workspace, Linear, Telegram, X and Google Slides toolkits.

Arcade provides an actions runtime that lets AI agents securely call external services with authorization and governance controls.

Arcade's biggest release in this window adds ten new third-party toolkits (Power BI, Postman, Insightly, Fireflies.ai, OneDrive, Freshdesk, Ashby, Vercel, Datadog, and Nimble) alongside stateless MCP MCP Model Context Protocol, an open standard from Anthropic that lets an AI model call external tools and data sources through a uniform interface, so cyber tools can expose capabilities directly to LLM-based agents. protocol support, new platform RBAC RBAC Role-Based Access Control, a permissions model where rights are assigned to roles rather than individuals, letting tools enforce least-privilege by granting users only the access their role requires. /org APIs, and a wide set of additions to existing Google Workspace, Linear, Telegram, X and Google Slides toolkits.

└──▷ WHAT SHIPPED · 12 FEATURES 7 OF 12 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Stateless MCP protocol support NEW 83

Arcade's /mcp path now supports per-request protocol-version dispatch and a stateless server/discover endpoint, plus stateless tools/list and tools/call against the real catalog. The MCP /list page size is now configurable, and MRTR url-mode elicitation was added for tool OAuth challenges on the stateless MCP path.

Discover the stateless MCP server catalog without establishing a session, useful for lightweight integrations.
$ curl -X GET 'https://api.arcade.dev/mcp/server/discover' \
  -H 'Authorization: Bearer <token>'
— Named endpoints with a runnable curl example against server/discover. snapshot-20260907
02 02
Ten new toolkits for third-party services NEW 68

Arcade adds the microsoft_powerbi toolkit for Power BI integrations, a Postman API toolkit with 30 tools and API-key authentication, an Insightly CRM toolkit with 29 tools for sales and account management, a Fireflies.ai meeting-intelligence toolkit with 17 functionalities, a Microsoft OneDrive toolkit with 16 tools for file management, a Freshdesk customer-support toolkit with API-key authentication, an Ashby recruiting/ATS toolkit for core recruiting operations (including a pipeline exit tool to archive applications), a Vercel toolkit for managing accounts via the REST API, a Datadog observability toolkit for log management, and Nimble as a Partner MCP Server for real-time web data in the search integrations catalog.

— Names ten toolkits with counts and auth types but no invocation examples. snapshot-20260907
03 03
Google Workspace toolkit tool additions NEW 63

Google Workspace toolkits gain new tools: GetSpreadsheetEditHistory in the google_sheets toolkit, a secure Gmail unsubscribe tool with multiple flow outcomes and enhanced validation, new Gmail tools for label lifecycle management and conversation trash status handling, a search_directory_people tool for resolving coworkers' emails, a search_drive tool to search the user's entire Google Drive, and a check_file_access pre-flight probe plus a file_types picker filter for Drive access.

— Names every new tool across Sheets, Gmail and Drive without usage examples. snapshot-20260907
thinner coverage below
04 04
Builtin agent tooling and model selection NEW 57

Adds an Arcade.ListApps builtin that prefixes apps into the MCP prompt, MCP behavior annotations on Arcade builtin tools, an Agent Capability Gap self-report MCP builtin tool with a master switch and LLM instruction integration, a configurable chat-model selector for choosing from a curated catalog, and VS Code chat host support in agent mode for attachment capabilities.

— Named builtins and features, but no configuration details shown. snapshot-20260907
05 05
RBAC and org management APIs NEW 55

New platform APIs add a project-scoped tool execution list and detail endpoint for tool-execution history, surface can_invite on org endpoints for RBAC-aware UI, add a CLI command for operator authorization, enable default RBAC for new Cloud signups, and let project members leave projects voluntarily.

— Names endpoints and a field but no exact CLI syntax or paths. snapshot-20260907
06 00
Dashboard UI for MCP gateways and Tools page IMPROVED 53

The dashboard gains dedicated create/edit pages for MCP gateways with new routing and tool selection, a catalog-driven server-side search with lazy loading on the Tools page, and an undo toast notification for destructive picker edits.

— Describes UI changes with clear navigation targets but no exact paths. snapshot-20260907
07 06
Linear toolkit new tools NEW 45

The Linear toolkit adds a resolve_comment tool for managing comment resolution state and a read tool to retrieve project status updates with pagination.

— Names two tools but gives no invocation details. snapshot-20260907
08 00
OIDC issuer validation and coordinator errors IMPROVED 35

Adds deep validation for OIDC user source issuers and improves coordinator error detail visibility.

— Names the auth area but no configuration or error format detail. snapshot-20260907
09 07
Interactive messaging in Telegram toolkit NEW 30

The Telegram worker toolkit gains interactive messaging with buttons and response handling.

— Brief description with no mechanism or usage detail. snapshot-20260907
10 00
Complex schema support across surfaces IMPROVED 23

Complex tool input/output schemas are now supported across all surfaces.

— Generic claim with no named surface or example. snapshot-20260907
11 00
Google Slides integration overhaul IMPROVED 15

Arcade performed a comprehensive overhaul of the Google Slides integration.

— One-line claim with no specifics of what changed. snapshot-20260907
12 00
X toolkit rebuild IMPROVED 15

Arcade did a ground-up rebuild of the X toolkit.

— No details on scope or changed behavior given. snapshot-20260907
Was this useful?

CopilotKit OpenBot

Sources Release notes → 1 RELEASE · 2026-09-06 NOTES lead Why this rank top features scored 80/75/75, +15 breaking change, +6 runnable example — 97.67 How ranking works →

OpenBot runs self-hosted AI coworkers that each get their own browser, files, and gated tools, with every action decided and recorded.

OpenBot v0.0.8 ships a cross-platform desktop shell and a production serve script, alongside a new computer.action_stopped audit event and a broad pass of startup and input validation hardening across config variables, the audit endpoint, and the component catalogue.

└──▷ WHAT SHIPPED · 8 FEATURES 5 OF 8 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Startup configuration validation hardening BREAKING 80

Validates SERVER_INTERNAL_URL at worker startup and requires an http or https URL, refusing to start and naming the variable when wrong. Validates HostPort with digit and range checks, refusing supervisor startup on an invalid port. Treats an empty PORT value on agent-bot and agent-langgraph as the shipped default rather than parsing it as NaN and binding an ephemeral port. Refuses malformed IPv6 entries in AGENT_ENDPOINT_ALLOWED_HOSTS at boot instead of silently accepting entries that never match. Reads durationMs units case-insensitively, accepting 30S alongside 30s.

— Names every affected variable and its exact validation rule v0.0.8
02 00
`DATABASE_URL` password and parse validation IMPROVED 75

Reports a malformed DATABASE_URL password containing a bare % with a structured error naming the variable and the required %25 encoding, instead of crashing with URIError: URI error, and refuses any DATABASE_URL value that cannot be parsed without echoing the password into the log.

— Gives exact before/after error behaviour and the fix v0.0.8
03 02
`COMPUTER_MEMORY_BYTES` validation BREAKING 75

Validates COMPUTER_MEMORY_BYTES at supervisor startup and refuses non-integer values, preventing a misconfigured cap such as 512m — previously parsed via parseInt into 512 bytes — from ever reaching a container.

— Concrete before/after example of the bug it fixes v0.0.8
04 00
Strict audit endpoint parameter validation IMPROVED 75

Validates from, to, and limit parameters on the audit endpoint strictly, returning HTTP 400 for an unparseable date or non-integer limit instead of coercing and querying.

Query the audit log for a specific time window when building a dashboard that needs to distinguish deliberate stops from real outages — filter by the new computer.action_stopped type.
$ curl -G 'https://<openbot-host>/audit' \
  --data-urlencode 'from=2024-06-01T00:00:00Z' \
  --data-urlencode 'to=2024-06-30T23:59:59Z' \
  --data-urlencode 'limit=100' \
  -H 'Authorization: Bearer <token>'
— Names endpoint params, status code, and includes a runnable query v0.0.8
05 03
`serve` script for production deployment NEW 65

Adds a serve script that builds the app once and serves the bundle, replacing the dev-only dev script as the path to a production deployment.

— Names the exact script and what it replaces v0.0.8
06 04
`computer.action_stopped` audit event type BREAKING 65

Adds the computer.action_stopped audit event type to distinguish a user-initiated Stop from a genuine computer-unreachable failure, enabling accurate outage monitoring by type. Previously all stops were recorded under computer.action_failed, so monitoring that counts failures by that type will no longer count deliberate stops after upgrading.

— Names the event type and the migration impact clearly v0.0.8
07 00
Whitespace sanitization in component catalogue IMPROVED 65

Refuses titles, slugs, and IDs that are entirely whitespace in sandboxed components, skills, custom servers, and the component catalogue, and trims name, title, kind, and description fields before storing them in the catalogue, so a component with a stray space in its name is treated as the same component rather than creating a duplicate row.

— Names affected areas and fields but no direct command v0.0.8
thinner coverage below
08 05
Cross-platform desktop shell NEW 50

Introduces a desktop shell for macOS, Windows, and Linux that fetches, pins, and raises the full OpenBot stack in a single window, no browser tab required.

— Describes mechanism but no install command or config path given v0.0.8
└──▷ BREAKING ON UPGRADE
  • !The audit event type for a user-initiated Stop is now computer.action_stopped; anything counting failures by type using computer.action_failed will no longer count deliberate stops.
  • !SERVER_INTERNAL_URL must be a valid http or https URL; the worker refuses to start if the value is any other string.
  • !COMPUTER_MEMORY_BYTES must be a whole number of bytes; values like 512m that previously parsed silently via parseInt now cause the supervisor to refuse to start.
  • !IPv6 entries in AGENT_ENDPOINT_ALLOWED_HOSTS that are not parseable as a valid address are refused at boot; previously malformed entries were accepted and silently never matched.
Was this useful?
Deploy
◆  AI Model & Data Infrastructure

Perplexity API

Sources Release page → 1 RELEASE · seen 2026-09-07 NOTES also Why this rank top features scored 75/68/55, +6 runnable example — 72 How ranking works →

Perplexity enriched its gateway chat completions responses with moderation results and deeper usage/audio metadata, and shipped a standalone Search API alongside an API key rotation mechanism.

Perplexity API Platform - build with the Router, Agent, Search, and Embeddings APIs. Real-time, web-wide research and Q&A capabilities for your products.

Perplexity enriched its gateway chat completions responses with moderation results and deeper usage/audio metadata, and shipped a standalone Search API alongside an API key rotation mechanism.

└──▷ WHAT SHIPPED · 4 FEATURES 3 OF 4 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Moderation results in chat completions NEW 75

Adds a moderation object to POST /router/v1/chat/completions responses, with input and output sub-objects each carrying type, model, flagged, categories, category_scores, and category_applied_input_types fields for content moderation results.

Check whether the model flagged your prompt or its own output for policy violations, using the new moderation fields in the gateway response.
$ curl --request POST \
  --url https://api.perplexity.ai/router/v1/chat/completions \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{"model": "<model>", "messages": [{"role": "user", "content": "<prompt>"}]}' \
  | jq '{input_flagged: .moderation.input.results[0].flagged, output_flagged: .moderation.output.results[0].flagged, categories: .moderation.output.results[0].categories}'
— Names endpoint and every field, runnable curl example given product docs
02 00
Expanded chat completion response metadata IMPROVED 68

The POST /router/v1/chat/completions response gains reasoning_content on message for chain-of-thought exposure, an annotations array with url_citation entries (start_index, end_index, url, title) for inline source attribution, and an audio object (id, expires_at, data, transcript). usage gains completion_tokens_details (accepted_prediction_tokens, audio_tokens, reasoning_tokens, rejected_prediction_tokens) and prompt_tokens_details (audio_tokens, cached_tokens, cache_write_tokens), plus top-level service_tier and system_fingerprint fields.

Inspect token-level cost breakdown — including cached, reasoning, and audio tokens — to optimise latency and billing for high-volume pipelines.
$ curl --request POST \
  --url https://api.perplexity.ai/router/v1/chat/completions \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{"model": "<model>", "messages": [{"role": "user", "content": "<prompt>"}]}' \
  | jq '.usage | {prompt_tokens, completion_tokens, total_tokens, reasoning_tokens: .completion_tokens_details.reasoning_tokens, cached_tokens: .prompt_tokens_details.cached_tokens}'
— Every added field named; example queries usage breakdown product docs
thinner coverage below
03 02
Standalone Search API NEW 55

A standalone Search API endpoint returns raw, ranked search results from Perplexity's index without any LLM processing, supporting all existing filters including domain, date range, and academic sources.

— Explains behaviour and filters but no endpoint path or example snapshot-20260907
04 03
API key rotation mechanism NEW 35

Introduces an API key rotation mechanism allowing seamless replacement of API keys without service interruption, and supports automated rotation workflows.

— No named endpoint, flag, or example to act on snapshot-20260907
Was this useful?

Eigen Labs Darkbloom

Sources Release notes →Source code → 1 RELEASE · 2026-09-07 NOTES CODE also Why this rank top features scored 86/83/41, +6 runnable example — 76 How ranking works →

Darkbloom's v0.9.0 release adds an operator-controlled idle-memory policy for provider nodes, per-model hardware eligibility checks in the model catalog, international payout support for providers, and a round of inference performance and UI improvements.

Private Inference Network on Idle Macs

Darkbloom's v0.9.0 release adds an operator-controlled idle-memory policy for provider nodes, per-model hardware eligibility checks in the model catalog, international payout support for providers, and a round of inference performance and UI improvements.

└──▷ WHAT SHIPPED · 6 FEATURES 3 OF 6 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Idle-memory policy for provider nodes NEW 86

Operators choosely how models are kept in memory at darkbloom start: 'Always ready' keeps models loaded, 'Free when idle' unloads them after 60 minutes (the default), or 'Custom' lets the user define their own idle window.

Start a provider node interactively to be prompted for your idle-memory policy — choose between 'Always ready', 'Free when idle', or 'Custom' timeout.
$ darkbloom start
— Names exact command, all three modes, and the default timeout. v0.9.0
02 02
Hardware eligibility verdicts in model catalog NEW 83

darkbloom models catalog now surfaces required_provider_capabilities per model and prints eligibility verdicts based on detected hardware, e.g. requires: Apple M5, NAX runtime or 'not eligible on this machine (missing: apple_m5, mlx_nax)'.

Check which catalog models your Apple Silicon Mac is eligible to serve before downloading, including any M5/NAX-gated models.
$ darkbloom models catalog
— Names the command, field, and sample verdict text verbatim. v0.9.0
thinner coverage below
03 03
International bank withdrawals for providers NEW 41

Providers can now withdraw earnings via international bank transfer using Stripe Global Payouts.

— Names the payout mechanism but no UI path or limits given. v0.9.0
04 00
Pinned model downloads with R2 fallback IMPROVED 41

Model fetching now prefers pinned Hugging Face artifact downloads, falling back to a verified R2 mirror when needed.

— Names the mechanism but no command or config surface given. v0.9.0
05 00
Inference performance improvements IMPROVED 38

Adds paged attention and SSD caching for Qwen models, and accelerates GPT-OSS prefill and decode performance with measured controls.

— Names techniques and target models but no benchmarks or mechanism detail. v0.9.0
06 00
Console, onboarding, and stats dashboard redesign IMPROVED 27

Redesigns the console entry point, the provider onboarding flow, and the network stats dashboard.

— Names three UI areas but gives no detail on the changes. v0.9.0
Was this useful?
◆  Local LLM Runtimes

vMLX

Sources Release notes → 1 RELEASE · 2026-09-06 NOTES also Why this rank top features scored 55/40/35 — 43.33 How ranking works →

vMLX 1.6.55 sharpened tool-call validation and warning surfacing across API lanes, refined native MTP sampling-policy adoption, and added ordered replay of tool-step reasoning in chat history.

The vMLX server runs compressed MLX models on Apple Silicon with disk caching, paged memory, continuous batching, and hybrid SSM scheduling.

vMLX 1.6.55 sharpened tool-call validation and warning surfacing across API lanes, refined native MTP sampling-policy adoption, and added ordered replay of tool-step reasoning in chat history.

└──▷ WHAT SHIPPED · 3 FEATURES 1 OF 3 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 00
Tool-call validation and warnings across API lanes IMPROVED 55

Surfaces tool-call drop and schema warnings on every API lane (OpenAI, Anthropic, Ollama), and separates tool-call presence validation and schema validation into independent checks rather than one combined check.

— Names the three API lanes but no config or flag to act on. v1.6.55
02 00
MTP sampling-policy adoption IMPROVED 40

Native MTP adoption now keeps the live engine's sampling policy and depth, governed by one sidecar evidence rule.

— Mechanism named but no exposed setting or command. v1.6.55
03 01
Ordered tool-step reasoning replay in chat history NEW 35

Chat history now replays persisted tool-step reasoning ordered by step rank.

— Behavior described but no interface or command shown. v1.6.55
Was this useful?
Data
◆  Vector DBs & RAG

Pinecone

Sources Changelog → 1 RELEASE · 2026-09-07 CHANGELOG lead Why this rank top features scored 95/70/45, +15 breaking change, +6 runnable example — 91 How ranking works →

Pinecone is a managed vector database that stores and queries embeddings for AI applications.

Pinecone shipped a GA schema-based Documents API combining BM25 full-text, dense-vector, and sparse-vector search, introduced egress metering on read operations across all plans, and moved BYOC BYOC Bring Your Own Cloud — a deployment model where the end user supplies the cloud infrastructure and the software runs inside it, letting vendors avoid touching customer data. cluster metadata storage in-cluster via FoundationDB FoundationDB A distributed key-value store maintained by Apple, offering ACID transactions across a cluster. Cyber tools use it as a reliable, scalable backend when they need consistent storage under high concurrency. .

└──▷ WHAT SHIPPED · 3 FEATURES 2 OF 3 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Schema-based Documents API with BM25 and metadata operations BREAKING 95

On API version 2026-07, POST /indexes now creates schema-based document indexes: a schema object combines BM25 full-text, dense-vector, and sparse-vector ranking fields in a single index, replacing the previous top-level dimension, metric, vector_type, and spec fields (which will break existing index-creation code on 2026-07). The Documents API supports BM25 token matching, Lucene query syntax, and vector similarity queries with metadata and text-match filters, and adds fetch, update, and delete of documents by metadata filter in addition to by ID.

Create a document index combining BM25 full-text and dense-vector fields in a single index using the new 2026-07 API version.
$ curl -X POST https://api.pinecone.io/indexes \
  -H 'Api-Key: <your-api-key>' \
  -H 'X-Pinecone-API-Version: 2026-07' \
  -H 'Content-Type: application/json' \
  -d '{
    "name": "my-doc-index",
    "schema": {
      "fields": [
        {"name": "body", "type": "text", "ranking": "bm25"},
        {"name": "embedding", "type": "dense_vector", "dimension": 1536, "metric": "cosine"}
      ]
    }
  }'
— Names endpoint, API version, schema fields, and includes a runnable example changelog-20260907-be541c1b
02 02
Egress metering on read operations NEW 70

Reads via query, fetch, list, and search are now metered for egress, with monthly allowances of 1 GB (Starter), 10 GB (Builder), and 100 GB (Standard and Enterprise). Standard and Enterprise plans continue serving reads beyond the allowance at an overage rate, while Starter and Builder reads are blocked until the next billing period.

— Concrete limits and plan behavior given, but no config or command to act on changelog-20260907-be541c1b
thinner coverage below
03 00
In-cluster metadata storage for BYOC IMPROVED 45

BYOC deployments now run FoundationDB inside the customer's Kubernetes cluster to store cluster metadata, eliminating the need for a separately managed database.

— Describes the architectural change but gives no configuration or migration steps changelog-20260907-be541c1b
└──▷ BREAKING ON UPGRADE
  • !On API version 2026-07, POST /indexes is schema-only: the top-level dimension, metric, vector_type, and spec fields are replaced by a schema field. Code that passes those top-level fields when creating indexes on 2026-07 will break.
Was this useful?
Evaluate
◆  AI Observability & Evals

Helicone

Sources Release page → 1 RELEASE · seen 2026-09-07 NOTES lead Why this rank top features scored 95/88/75, +6 runnable example — 92 How ranking works →

Routing and monitoring for reliable AI apps - the LLMOps platform behind the fastest-growing AI companies.

Helicone's biggest release this window is the open-source Rust-based AI Gateway (with self-hosting via docker compose), alongside Prompt Management V2, a new Go SDK, and broad cost-tracking and context-window expansions across GPT-5, GPT-OSS, Claude and Grok models.

└──▷ WHAT SHIPPED · 11 FEATURES 9 OF 11 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Open-source AI Gateway proxy launch NEW 95

Helicone AI Gateway is a new open-source Rust-based proxy available via docker run -p 8080:8080 helicone/ai-gateway at github.com/helicone/ai-gateway, supporting smart load balancing, semantic caching, automatic failover, and rate limiting across OpenAI, Anthropic, Azure, and more providers.

Spin up the self-hosted Helicone AI Gateway locally to proxy LLM traffic without sending data to third-party servers.
$ docker run -p 8080:8080 helicone/ai-gateway
— Runnable docker command and repo link included snapshot-20260907
02 02
Prompt Management V2 with AI Gateway references NEW 88

Prompt Management V2 adds version control, typed variables in system prompts, messages, and tool schemas, and instant deployment through the AI Gateway. AI Gateway API calls now accept prompt_id and inputs fields, enabling prompt references by ID with runtime variable substitution (e.g., {{hc:customer_name:string}}) so prompts can be updated in the dashboard without code changes.

— Named fields and variable syntax, but no full endpoint spec snapshot-20260907
03 03
Go SDK for Helicone Helpers NEW 75

Introduces a Go SDK for the Helicone Helpers Package, installable via go get github.com/helicone/go-helicone-helpers, enabling custom LLM integration with the Go Manual Logger.

Install the Go Helicone Helpers Package to instrument a custom LLM with the Manual Logger in a Go service.
$ go get github.com/helicone/go-helicone-helpers
— Runnable install command names package and use snapshot-20260907
04 04
One-command self-hosting deployment NEW 75

Adds self-hosting support via a single docker compose up -d command from the github.com/Helicone/helicone repository, keeping all LLM interactions and analytics within your own infrastructure.

— Runnable docker compose command and repo named snapshot-20260907
05 05
Cost tracking for new LLM models NEW 70

Adds cost tracking for GPT-5, GPT-5-Mini, GPT-5-Nano, and GPT-5-Chat-Latest models across multiple providers with Playground support; for GPT-OSS models (accounts/fireworks/models/gpt-oss-20b, accounts/fireworks/models/gpt-oss-120b, openai/gpt-oss-20b, openai/gpt-oss-120b) across Fireworks, Groq, and OpenRouter; for Claude Opus 4.1 (claude-opus-4-1-20250805, anthropic/claude-opus-4.1 on OpenRouter) and grok-4 / x-ai/grok-4; and for gpt-4o-search with automatic pricing detection.

— Every model id named verbatim, tracking mechanism itself thin snapshot-20260907
06 06
Country-based request filtering NEW 65

Adds a country_code:<ISO> filter (e.g., country_code:US) to the requests dashboard advanced filters section for geographic analytics on LLM usage.

— Exact filter syntax given, mechanism otherwise thin snapshot-20260907
07 00
1M token context for Claude Sonnet on AI Gateway IMPROVED 60

Extends Claude Sonnet 4 and Sonnet 4.5 on the AI Gateway to support a 1M token context window by default across Anthropic API, AWS Bedrock, and Google Vertex AI.

— Specific limit and providers named, no config steps snapshot-20260907
thinner coverage below
08 07
Reasoning effort control in Playground NEW 55

Adds reasoning effort control in the Playground with minimal, low, medium, and high reasoning levels for supported thinking models.

— Named levels and UI location as starting point snapshot-20260907
09 00
Redesigned Sessions view with metrics IMPROVED 50

Introduces a redesigned Sessions view with session-level metrics including average latency, total cost, and improved time filtering.

— Names metrics shown, no config or API detail snapshot-20260907
10 08
OpenAI Responses API monitoring NEW 40

Adds OpenAI Responses API support to Helicone for monitoring and analyzing text and image input/output responses.

— No config or endpoint named beyond API name snapshot-20260907
11 09
Automatic local timezone detection NEW 25

Adds automatic local timezone detection and clear timezone indicators for all timestamp displays in the dashboard.

— Thin description, no mechanism or config named snapshot-20260907
Was this useful?

LangChain LangSmith

Sources Release page → 1 RELEASE · 2026-08-10 NOTES also Why this rank top features scored 90/60/35, +15 breaking change, +6 runnable example — 82.67 How ranking works →

LangSmith's latest release changes bulk export compression defaults, adds pre-save testing for thread evaluators, reworks trace sharing to operate at the trace root, and ships several breaking API and logging changes.

LangSmith provides tracing, evaluation, and deployment tools for LLM applications.

LangSmith's latest release changes bulk export compression defaults, adds pre-save testing for thread evaluators, reworks trace sharing to operate at the trace root, and ships several breaking API and logging changes.

└──▷ WHAT SHIPPED · 5 FEATURES 4 OF 5 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Thread evaluator pre-save testing and turn-count filter NEW 90

The thread evaluator config now shows a locked 'Trace count >= 2' filter for managed thread evaluators, making explicit that they only run on threads with multiple turns. Evaluators can be validated against a real conversation before saving via POST /runs/rules/validate with test_thread_id, session_id, and rule parameters, catching misconfiguration early.

Test a multi-turn thread evaluator against a real conversation before saving it to catch misconfiguration early.
$ curl -X POST 'https://api.smith.langchain.com/runs/rules/validate' \
  -H 'X-Api-Key: <your-api-key>' \
  -H 'Content-Type: application/json' \
  -d '{"test_thread_id": "<thread-uuid>", "session_id": "<session-uuid>", "rule": { ... }}'
— Names endpoint, method, and parameters with a runnable curl example. snapshot-20260907
02 02
Dataset comparison helpers removed from public API BREAKING 60

Legacy dataset comparison helpers are removed from the public OpenAPI spec and generated SDKs; existing HTTP routes continue to work only for LangSmith UI clients, so integrations relying on the SDK methods must migrate.

— Names the removed surface and migration constraint clearly. snapshot-20260907
thinner coverage below
03 03
Trace-root scoped sharing BREAKING 35

Sharing, viewing, or unsharing any run in a trace now operates on the trace root, meaning every run in a shared trace becomes publicly viewable rather than just the individual run that was shared.

— Explains behavior change but no config or opt-out named. snapshot-20260907
04 04
Dataset split chips in Examples table NEW 35

Each example's dataset splits now render as chips in the dataset Examples table, with a clickable +N overflow menu for examples belonging to many splits.

— UI change described but no exact navigation path given. snapshot-20260907
05 00
ABAC-aware access denial messaging IMPROVED 30

Thread pages now show an explicit access-control message when trace loading is denied by ABAC, instead of a generic retrieval error.

— Describes the change but no mechanism or navigation detail. snapshot-20260907
└──▷ BREAKING ON UPGRADE
  • !Legacy dataset comparison helpers are removed from the public OpenAPI spec and generated SDKs; existing HTTP routes continue to work only for LangSmith UI clients.
  • !The batched-run ingestion log now emits run_verbs as a list of run_id and verbs objects instead of a map keyed by run UUID, which will break any structured-log aggregators that parse the old map format.
Was this useful?

Braintrust

Sources Release page → 1 RELEASE · 2026-09-01 NOTES lead Why this rank top features scored 90/85/80, +6 runnable example — 91 How ranking works →

Braintrust provides evaluation, tracing, and improvement workflows for AI applications.

Braintrust's biggest additions this window are two new investigation tools—Patterns for automated cross-trace analysis and Debugger for single-trace failure diagnosis—plus an upgraded Loop agent with a managed runtime, project-wide write access, and built-in GPT-5.6 models. Smaller additions cover a new gateway model, OpenAI Batch API tracing, GitHub eval action filtering, Pydantic AI Pydantic AI A Python library that wraps Pydantic's data-validation models around LLM interactions, giving developers structured, type-safe inputs and outputs when building AI-powered agents or pipelines. span metadata, blind human reviews, and Agno auto-instrumentation.

└──▷ WHAT SHIPPED · 7 FEATURES 5 OF 7 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Tracing for OpenAI Batch API requests NEW 90

TypeScript SDK v3.30.0 adds openaiFilesCreateTraced, openaiBatchesRetrieveTraced, and completeOpenAIBatchTrace to trace asynchronous OpenAI Batch API requests end-to-end, so batch inference jobs appear as spans in Braintrust experiments.

Trace async OpenAI Batch requests end-to-end so batch inference jobs appear as first-class spans in your Braintrust experiments.
typescript
import { openaiFilesCreateTraced, openaiBatchesRetrieveTraced, completeOpenAIBatchTrace } from 'braintrust';

const file = await openaiFilesCreateTraced(openai, {
  file: fs.createReadStream('requests.jsonl'),
  purpose: 'batch'
});
const batch = await openai.batches.create({
  input_file_id: file.id,
  endpoint: '/v1/chat/completions',
  completion_window: '24h'
});
await openaiBatchesRetrieveTraced(openai, batch.id);
await completeOpenAIBatchTrace(openai, batch.id);
— Named functions plus runnable example snapshot-20260907
02 00
Loop managed runtime and built-in models IMPROVED 85

Loop now runs in a Braintrust-managed runtime, persists threads, and operates across logs, experiments, and datasets project-wide. It can create and edit prompts, scorers, datasets, facets, custom views, dashboards, and automations, with a per-write approval step unless auto-accept is enabled. Loop also runs built-in on GPT-5.6 Sol, GPT-5.6 Terra, and GPT-5.6 Luna models with no AI provider configuration required.

— Describes mechanism, objects, and built-in models snapshot-20260907
03 02
Auto-instrumentation for Agno eval types NEW 80

Calling auto_instrument() automatically instruments all Agno eval types (AccuracyEval, AgentAsJudgeEval, ReliabilityEval, PerformanceEval) so their runs appear as Braintrust experiments without manual tracing setup.

Automatically instrument all Agno eval types so their runs appear as Braintrust experiments without manual tracing setup.
python
from braintrust import auto_instrument
from agno.evals import AccuracyEval, AgentAsJudgeEval, ReliabilityEval, PerformanceEval

auto_instrument()

eval_suite = [
    AccuracyEval(agent=my_agent, questions=questions),
    AgentAsJudgeEval(agent=my_agent, rubric=rubric),
    ReliabilityEval(agent=my_agent, scenarios=scenarios),
    PerformanceEval(agent=my_agent, tasks=tasks),
]
for e in eval_suite:
    e.run()
— Runnable example, not mentioned in changelog prose snapshot-20260907
04 03
PR comment filtering in GitHub eval action NEW 75

GitHub eval action v2.1.0 adds report_scores and report_metrics inputs, each accepting a comma- or newline-separated list of names to filter what appears in the PR comment.

— Named inputs and version, no full workflow example snapshot-20260907
05 04
Patterns automated trace investigation NEW 70

Patterns is a scheduled automated investigation of traces that surfaces recurring failure modes, cost trends, and cohort-level problems. Each finding includes supporting traces and a suggested fix, and can be used to create a scorer, continue in Loop, or copy as a prompt.

— Explains mechanism and outputs, no exact command snapshot-20260907
06 05
Debugger trace failure analysis NEW 65

Debugger reports likely failure modes for a single trace, citing spans, tool calls, and model outputs, and groups a run into 'Work' sections via 'Analyze trace' to explain what the agent did.

— Names UI action, lacks deeper mechanism snapshot-20260907
07 00
Invocation parameters in Pydantic AI span metadata IMPROVED 60

Python SDK v0.37.0 adds invocation parameters (temperature, max_tokens, and similar model settings) to Pydantic AI LLM span metadata when model settings are provided.

— Names fields, lacks usage example snapshot-20260907
Was this useful?
Govern
◆  AI/LLM Security

Promptfoo

Sources Release page → 1 RELEASE · seen 2026-09-07 NOTES also Why this rank top features scored 65/55/55, +10 product media — 68.33 How ranking works →

Promptfoo expanded its provider ecosystem with new integrations for Docker Model Runner, MCP MCP Model Context Protocol, an open standard from Anthropic that lets an AI model call external tools and data sources through a uniform interface, so cyber tools can expose capabilities directly to LLM-based agents. servers, and several models and vision providers, while also adding enterprise-grade mutual TLS support for the HTTP provider.

Promptfoo tests, evaluates, and red-teams LLM applications to detect vulnerabilities and compare model outputs.

Promptfoo expanded its provider ecosystem with new integrations for Docker Model Runner, MCP MCP Model Context Protocol, an open standard from Anthropic that lets an AI model call external tools and data sources through a uniform interface, so cyber tools can expose capabilities directly to LLM-based agents. servers, and several models and vision providers, while also adding enterprise-grade mutual TLS support for the HTTP provider.

└──▷ WHAT SHIPPED · 5 FEATURES 4 OF 5 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
MCP provider and red-team agent example NEW 65

Adds an MCP (Model Context Protocol) provider to connect Promptfoo evals to MCP servers, plus an MCP Agent example for red team testing that demonstrates how to test AI systems using tool call results via MCP.

— Names provider and example but no exact config shown snapshot-20260907
thinner coverage below
02 02
JKS and PFX client certificates for HTTP provider NEW 55

The HTTP provider now supports JKS and PFX client certificate formats, enabling mutual TLS authentication against enterprise endpoints.

— Names cert formats but no config key or flag shown snapshot-20260907
03 03
New model and provider integrations NEW 55

Adds the Google Imagen provider for generating images in multimodal testing scenarios, the AIMLAPI provider for unified access to various AI models, support for OpenAI's o3-deep-research and o4-mini-deep-research models, Grok-4 model support via the xAI provider, LiteLLM embeddings support for similarity testing and semantic search evaluations, and a Google Vision provider for image understanding in multimodal evaluations.

— Six providers named but each described in one line only snapshot-20260907
04 04
Docker Model Runner provider NEW 50

Adds a Docker Model Runner provider to run models in isolated Docker containers for improved security and reproducibility.

— Names the provider but no setup command or config given snapshot-20260907
05 00
System prompt support in Azure provider IMPROVED 25

The Azure provider now supports system prompts for better control over model behavior.

— Thin description with no mechanism or config detail snapshot-20260907
└──▷ ALSO FROM THESE RELEASES
Tracing and OpenTelemetry Support
Was this useful?

Docker Sandboxes

Sources Release notes → 1 RELEASE · 2026-09-07 NOTES lead Why this rank top features scored 95/85/80, +15 breaking change, +6 runnable example — 107.67 How ranking works →

Docker Sandboxes runs AI agents in isolated Docker environments with controlled filesystem, network, and tool access.

Docker Sandboxes v0.42.0 adds machine-readable JSON output across read-only commands, scoped MCP MCP Model Context Protocol, an open standard from Anthropic that lets an AI model call external tools and data sources through a uniform interface, so cyber tools can expose capabilities directly to LLM-based agents. OAuth authorization, Git-based skills, a full argument system for kits and environment files, and a Windows MSI installer — alongside several breaking changes to port defaults, built-in agents, and environment-file semantics.

└──▷ WHAT SHIPPED · 23 FEATURES 16 OF 23 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Kit arguments (`--kit-arg`, `args:` block) NEW 95

Kits can now declare arguments in an args: block and receive values with --kit-arg name=value or --kit-arg kit.name=value to target a specific kit; a kits: entry in sbxenv.yaml can carry per-kit arguments under kits[].args.

Pass parameterized values into a kit at launch time — useful when a kit exposes configurable targets or modes.
$ sbx run docker.io/myorg/pentest-kit:latest --kit-arg target=192.168.1.0/24 --kit-arg mode=aggressive
Pin per-kit arguments in an environment file so the same values are applied every time the environment is started.
yaml
sandbox:
  name: pentest-env
kits:
  - ref: docker.io/myorg/pentest-kit:latest
    args:
      target: 192.168.1.0/24
      mode: aggressive
— Full flag and config key with runnable examples v0.42.0
02 02
JSON output for read-only commands NEW 85

Adds a --json flag to sbx secret ls, sbx version, sbx mcp ls, sbx skills ls, sbx policy inspect, and the sbx kit verification commands for machine-readable output; sbx version --json also reports a server.state field (running or unavailable) so scripts can check daemon reachability without parsing error text.

Check daemon reachability in CI scripts without parsing human-readable error text.
$ sbx version --json | jq '.server.state'
— Names every affected command and field, with a runnable jq example v0.42.0
03 03
Default TCP4 port publishing BREAKING 80

sbx ports --publish and kit-declared ports now default to tcp4 instead of dual-stack tcp, so published ports no longer listen on ::1; pass the protocol explicitly (e.g. --publish 8080:3000/tcp) to restore dual-stack behavior.

— Exact flag and migration example provided v0.42.0
04 00
Scoped MCP OAuth authorization IMPROVED 75

sbx mcp auth now requests only the chosen scopes (or those the resource requires) instead of a broad default set, accepts a new --no-scope flag to suppress server-required scopes, explains refused scopes with a narrower retry command, and reports granted/requested/supported scope sets in sbx mcp auth status.

— Mechanism and flag named but no runnable example given v0.42.0
05 04
Optional workspace bind mounts BREAKING 75

sbx create can now omit the workspace path to create a sandbox with no workspace bind mount; correspondingly, an environment file that declares no workspace: now creates a sandbox with no bind mount instead of mounting the directory holding the file — add workspace: . to restore the previous behavior.

— Behavior change and explicit migration note included v0.42.0
06 05
Environment-file arguments (`args:` block) BREAKING 75

Environment files (sbxenv.yaml) can now declare their own arguments in an args: block, referenced as ${{ env.args.NAME }} and supplied with sbx env --env-arg; this replaces the previous ${VAR} interpolation syntax, which is no longer expanded.

— Config syntax and breaking migration named, no example v0.42.0
07 06
Built-in agents removed in favor of community kits BREAKING 75

The built-in droid, copilot, and kiro agents are removed and must now be run as community kits, e.g. sbx run docker.io/sbx/droid-kit:latest, sbx run docker.io/sbx/copilot-kit:latest, or sbx run docker.io/sbx/kiro-kit:latest.

— Exact migration commands given for each removed agent v0.42.0
08 07
sbx env plan-and-confirm workflow NEW 70

sbx env now shows a plan of all changes an environment file will make to the host (lifecycle commands, credentials, bindings, MCP servers, workspaces, kits, ports) and prompts for approval unless env.rememberHostCommands is set.

— Names the config key and scope of the plan, no example v0.42.0
09 08
Sandbox default disk size reduced BREAKING 70

Sandbox default Docker volume size is reduced to 10 GB (from 50 GB); configurable via the sandbox.disk.dockerVolume setting or the DOCKER_SANDBOXES_DOCKER_SIZE environment variable.

— Exact size numbers and config keys named v0.42.0
10 00
sbx mcp add flag rename and address flexibility IMPROVED 65

sbx mcp add gains a --skip-auth flag (replacing --skip_auth) and now allows --url values pointing at private, loopback, or cloud-metadata addresses, printing a warning instead of refusing.

— Flag rename and behavior change named, no example command v0.42.0
11 00
Kit reference as positional run argument IMPROVED 60

Adds an sbx run <sandbox-kit-ref> positional form so kit references can be passed directly as the agent argument; the --kit flag is now reserved for mixins.

— Names the new syntax and repurposed flag, no example v0.42.0
thinner coverage below
12 00
Environment file resolution and defaults IMPROVED 55

sbx env now reads a non-hidden sbxenv.yaml in preference to .sbxenv.yaml when both exist in a directory, and merges a sbxenv.yaml from the home directory as project-wide defaults.

— File precedence and merge behavior named clearly v0.42.0
13 09
CPU and memory limits via kit spec NEW 55

Kits can now set a sandbox's CPU and memory limits via the sandbox.resources block in their spec.

— Config block named, no example of values v0.42.0
14 00
Registry mirror applied inside sandboxes IMPROVED 55

A registry mirror configured with platform.images.registryMirror is now also applied to Docker running inside a sandbox when the value is a bare host.

— Config key and condition named, no example v0.42.0
15 10
Audit records for declined MCP approval prompts NEW 55

Declined @requireApproval prompts on a local MCP server now produce their own audit record with policy attribution and a context digest.

— Mechanism named but no command to inspect the record v0.42.0
16 11
Cloud sandbox port publishing NEW 55

sbx --cloud run and sbx --cloud create now publish a kit's declared TCP ports and print their public URLs.

— Commands and behavior named, no worked example v0.42.0
17 12
Git-based sandbox skills management NEW 45

Adds an sbx skills subcommand to add, update, list, and remove sandbox skills directly from Git repositories.

— Names the subcommand but no flags or example shown v0.42.0
18 00
Governance resolution visibility IMPROVED 45

Governance resolution issues are now shown in sbx policy output and the dashboard.

— Names the command surface but not the mechanism v0.42.0
19 00
Terminal display fixes IMPROVED 45

sbx terminal output now adapts colours for light terminal backgrounds and uses a distinct pink spinner glyph; CJK and combining-mark column widths in table output are now measured correctly.

— Cosmetic fixes described, no config surface involved v0.42.0
20 13
Relative kit path resolution changed BREAKING 45

Relative kit paths in an environment file now resolve against the file's directory instead of the directory sbx was run from.

— Behavior change named, no example or migration command v0.42.0
21 14
sbx env create display, GPU, and USB options NEW 40

sbx env create now accepts display, GPU, and USB options in sbxenv.yaml and shares imported skills by default.

— Options named generically, no exact keys given v0.42.0
22 15
Automatic diagnostics bundle upload NEW 35

Docker Sandboxes can now upload a diagnostics bundle automatically when the daemon hits an error, after opt-in.

— No detail on the opt-in mechanism or command v0.42.0
23 16
Windows MSI installer NEW 30

Provides a machine-wide Windows MSI installer for administrator-managed installations.

— Bare description with no options or install steps v0.42.0
└──▷ BREAKING ON UPGRADE
  • !sbx ports --publish and kit-declared ports now default to tcp4 instead of dual-stack tcp, so published ports no longer listen on ::1; pass the protocol explicitly (e.g. --publish 8080:3000/tcp) to restore dual-stack behavior.
  • !The built-in droid, copilot, and kiro agents are removed; existing workflows that invoke them directly must be updated to sbx run docker.io/sbx/droid-kit:latest, sbx run docker.io/sbx/copilot-kit:latest, or sbx run docker.io/sbx/kiro-kit:latest.
  • !${VAR} interpolation in .sbxenv.yaml is no longer expanded; use the new ${{ env.args.NAME }} syntax with an args: block instead.
  • !An environment file that declares no workspace: now creates a sandbox with no workspace bind mount instead of mounting the directory holding the file; add workspace: . to restore the previous behavior.
  • !Relative kit paths in an environment file now resolve against the file's directory instead of the directory sbx was run from.
Was this useful?
AI Models
◆  Frontier Models

Anthropic

Sources Release page → 1 RELEASE · seen 2026-09-07 NOTES lead Why this rank top features scored 95/90/90, +15 breaking change — 106.67 How ranking works →

Anthropic provides Claude AI models and APIs for building applications that generate, analyze, and automate work.

Anthropic shipped Claude Fable 5.1 and Claude Mythos 5.1 with 1M-token context and always-on adaptive thinking, alongside an ant apply subcommand for infrastructure-as-code agent deployments, a full Admin API in the CLI and SDKs, expanded Compliance API coverage, and several breaking changes to tool_choice, thinking-block replay, and beta SDK clients.

└──▷ WHAT SHIPPED · 15 FEATURES 13 OF 15 FEATURES most completely described first
what's the number?

Each feature carries 0–100 for how completely the vendor documented it — not how big or important the work is. A major capability described in eight words scores low, and that is the finding.

  • depth0–40 what it does and how it works or what changed
  • specificity0–30 names real surfaces — APIs, flags, formats, limits, numbers
  • actionability0–30 enough to go use it — a named endpoint, flag, or config key tops this; a UI path is a starting point

Code and config rank first by construction: a documented endpoint, flag or config key scores at the top of specificity and actionability, so it sorts above a feature described only in prose. Under 60 the notes go thin — everything below the “thinner coverage” line is thinner documentation, not smaller work. Hover any meter for that feature's three sub-scores.

01 01
Admin API in CLI and SDKs NEW 95

The Admin API is now available in the ant CLI and Python, TypeScript, C#, Go, Java, PHP, and Ruby SDKs under client.beta.organization, covering organization info, members, invites, workspaces, API keys, rate limits, service accounts, workload identity federation issuers and rules, and customer-managed encryption keys; it reads credentials from ANTHROPIC_API_KEY or ANTHROPIC_AUTH_TOKEN.

— Names the client path, env vars, and every covered resource. snapshot-20260907
02 02
Mid-conversation effort control beta NEW 90

With the mid-conversation-output-config-2026-07-01 beta header, a role: "system" message inside messages can include output_config.effort to change effort mid-conversation on Claude Fable 5.1, Claude Mythos 5.1, and Claude Opus 5 while preserving the prompt cache.

— Exact header and JSON field make this runnable as described. snapshot-20260907
03 03
Turn-scoped system messages beta NEW 90

The mid-conversation-system-clear-at-2026-08-21 beta header lets a mid-conversation role: "system" message set clear_at: "next_user_message" so it applies only to the current turn and remains in history at no token cost.

— Exact header and field value give a runnable configuration. snapshot-20260907
04 04
`ant apply` subcommand for agent infrastructure-as-code NEW 85

The ant CLI (v1.30.0) adds ant apply to create and update agents, environments, skills, memory stores, and deployments directly from repository files, writing a claude-lock.json lockfile to keep CI runs reproducible.

— Names exact subcommand, CLI version, and lockfile file. snapshot-20260907
05 05
Thinking block binding controls beta header NEW 85

The thinking-binding-controls-2026-08-01 beta header reports dropped thinking blocks in an input_transformations response field and adds thinking.block_binding.prefix_mismatch_behavior to choose between rejecting or dropping blocks whose conversation history changed.

— Named header, response field, and config key are directly usable. snapshot-20260907
06 00
Compliance API session coverage expands and exits beta for Cowork/Code IMPROVED 85

The Compliance API's local session endpoints (beta, Claude Enterprise) now return transcripts for Claude Science sessions (product_surface value claude_science) and Claude for Microsoft 365 sessions in Excel, PowerPoint, Word, and Outlook (product_surface values beginning with office_agents), using the existing Compliance Access Key and read:compliance_user_data scope; the same session endpoints for Cowork and Claude Code sessions are promoted out of beta.

— Names product_surface values, scope, and beta status change. snapshot-20260907
07 06
Beta files/skills SDK client changes BREAKING 85

In Python SDK 1.2.0, TypeScript SDK 0.122.0, Go SDK 1.68.0, Java SDK 2.59.0, Ruby SDK 1.67.0, and C# SDK 12.44.0, client.beta.files and client.beta.skills no longer send the files-api-2025-04-14 and skills-2025-10-02 beta headers and return the same response shapes as client.files and client.skills; client.beta.skills.delete() now deletes a Skill together with all of its versions, and the beta Messages type BetaSkill is renamed BetaContainerSkill.

— Names exact SDK versions, headers, methods, and type rename. snapshot-20260907
08 07
Claude Fable 5.1 and Claude Mythos 5.1 launch with 1M context NEW 80

claude-fable-5-1 launches with a 1M token context window, 128k max output tokens, always-on adaptive thinking, priced at $10/$50 per MTok input/output with prompt cache reads at $0.25 per MTok (0.025x base input price); claude-mythos-5-1 ships the same context, output, thinking, and pricing for Project Glasswing participants.

— Concrete specs and pricing but only a model id to call. snapshot-20260907
09 08
`thinking.display` "updates" mode beta NEW 80

With the thinking-display-updates-2026-08-18 beta header, thinking.display accepts the value "updates", returning short progress updates Claude writes between tool calls as text, with at most one thinking block before each tool call.

— Named header and field value with a stated behavioural limit. snapshot-20260907
10 00
Computer and browser use toolsets on Google Cloud IMPROVED 70

The computer_toolset_20260801 and browser_toolset_20260801 toolsets are now available on Google Cloud for Claude Fable 5, Claude Mythos 5, Claude Opus 5, Claude Sonnet 5, and Claude Opus 4.8.

— Names exact toolsets and model availability, no mechanism detail. snapshot-20260907
11 09
`tool_choice` restrictions on Fable/Mythos 5.1 BREAKING 65

On Claude Fable 5.1 and Claude Mythos 5.1, tool_choice types any and tool are not supported and return a 400 error; only auto and none are accepted.

— Clear before/after but no migration guidance. snapshot-20260907
12 10
Thinking block replay restrictions BREAKING 65

For accounts created on or after August 31, 2026, replaying a thinking block on Claude Fable 5.1 after the system prompt, tools, or an earlier message has changed now returns a 400 error, and thinking blocks produced by Claude Fable 5.1 and Claude Mythos 5.1 are dropped by the API if replayed to an earlier model.

— Names exact conditions but no remediation steps. snapshot-20260907
thinner coverage below
13 11
`anthropic-version` header now required for Enterprise APIs BREAKING 55

The Claude Enterprise Admin API endpoints, Claude Enterprise Analytics API, and Compliance API now require the anthropic-version header on every request.

— Exact header and affected APIs named, minimal further detail. snapshot-20260907
14 12
Automatic content watermarking NEW 50

Text output from Claude Fable 5.1 and Claude Mythos 5.1 automatically carries Anthropic's text watermark; image, video, and audio files produced via the code execution tool carry C2PA Content Credentials when retrieved through the Files API, with no request or response changes required.

— Automatic behaviour with nothing for a reader to configure. snapshot-20260907
15 13
Personal and service account API keys in Console NEW 40

The Console adds personal keys and service account keys that can be scoped to a specific workspace or made active across any workspace or admin endpoints the linked account can access.

— Describes scope options but only a UI starting point. snapshot-20260907
└──▷ BREAKING ON UPGRADE
  • !On Claude Fable 5.1 and Claude Mythos 5.1, tool_choice types any and tool are not supported and return a 400 error; only auto and none are accepted.
  • !For accounts created on or after August 31, 2026, replaying a thinking block on Claude Fable 5.1 after the system prompt, tools, or an earlier message has changed returns a 400 error.
  • !Thinking blocks produced by Claude Fable 5.1 and Claude Mythos 5.1 are dropped by the API if replayed to an earlier model.
  • !In Python SDK 1.2.0, TypeScript SDK 0.122.0, Go SDK 1.68.0, Java SDK 2.59.0, Ruby SDK 1.67.0, and C# SDK 12.44.0, client.beta.files and client.beta.skills no longer send the files-api-2025-04-14 and skills-2025-10-02 beta headers and return the same response shapes as client.files and client.skills.
  • !In the SDK versions above, client.beta.skills.delete() now deletes a Skill together with all of its versions, and the beta Messages type BetaSkill (the container Skill reference) is renamed BetaContainerSkill.
  • !The Claude Enterprise Admin API endpoints, Claude Enterprise Analytics API, and Compliance API now require the anthropic-version header on every request.
Was this useful?
my-toolchain — 0 tools
paste an install list to detect your tools

A brew list, a Brewfile, requirements.txt, a Dockerfile — or just the product names, free-form. Nothing leaves your browser.

    browse all tools →