Heads up This site is currently under heavy development.
Subscribe Get it delivered — the daily firehose, filtered to the tools you run, plus the documentation changes vendors never announce. Compare plans →

The AI Toolchain — issue -371, December 31, 2024

THE AI TOOLCHAIN NO. -371
Tail
THE DAILY RELEASE FIREHOSE
PUBLISHED DECEMBER 31, 2024 · EVERY WEEKDAY
EDITIONS tail grep head diff uniq

The daily firehose — everything the toolchain shipped today, already filtered.

// HOW THIS ISSUE IS MADE

We read every release from the 174 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.

VIEW
ISSUE VIEW full issue
Do you prefer this view?
$ tct list   # 34 tools matched
AI & LLM Tooling
◆  AI Coding Agents

Aider

Sources Release notes → v0.70.0 5 RELEASES · 2024-12-01 → 2024-12-26 NOTES STABLE

Aider v0.70.0 adds full o1 model support, OpenRouter DeepSeek integration, git-free operation, and subtree-scoped file watching.

└──▷ GET THIS VERSION
$ git clone --branch v0.70.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.70.0
└──▷ TRY IT
Use the DeepSeek Chat model via OpenRouter without managing API keys directly.
$ aider --model openrouter/deepseek/deepseek-chat
  • Adds full support for o1 models.
  • Supports openrouter/deepseek/deepseek-chat as a selectable model.
  • Enables running Aider without git installed.
  • Watch files now respects --subtree-only, limiting file watching to that subtree.
  • New install methods via uv, including one-liner invocations.
+1 moreshow less
  • Shows hints about AI! and AI? syntax when user makes AI comments in watched files.
4 more releases in this issue · 2024-12-01 → 2024-12-26
v0.69.0 NOTES STABLE

Aider v0.69.0 adds watch-all-files AI comments, multiline input mode, Gemini Flash 2.0 Exp support, and richer copy-context.

└──▷ GET THIS VERSION
$ git clone --branch v0.69.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.69.0
└──▷ TRY IT
Trigger Aider from inside any source file to ask a question without switching to the terminal.
$ # ... AI? Why does this function return None instead of raising an exception?
Enable multiline input so you can compose multi-paragraph prompts without accidentally sending early.
$ aider --multiline
Copy code context with custom instructions to paste into a web UI like ChatGPT or Claude.
$ /copy-context Focus on security vulnerabilities in the authentication flow
  • Supports # ... AI? comments in any file to trigger Aider and ask inline questions about code.
  • Watch mode now monitors all files (not just selected source types), with AI comment support via # AI, // AI, or -- AI syntax.
  • Adds --multiline flag and /multiline-mode command to make ENTER a soft newline and META-ENTER send the message.
  • Full support for Gemini Flash 2.0 Exp via --model flash or --model gemini/gemini-2.0-flash-exp.
  • /copy-context now accepts optional instructions to include when copying code context to the clipboard.
+1 moreshow less
  • /voice now lets you edit the transcribed text before sending.
v0.68.0 NOTES STABLE

Aider v0.68.0 adds copy-paste mode for LLM web UIs, CLI API key management, and bash/zsh watch-file support.

└──▷ GET THIS VERSION
$ git clone --branch v0.68.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.68.0
└──▷ TRY IT
Use Aider with a web-based LLM UI (e.g., Claude.ai) when you have no direct API access.
$ aider --copy-paste
Supply your Anthropic API key directly on the command line without setting environment variables.
$ aider --api-key anthropic=sk-ant-<your-key>
  • New --copy-paste mode enables Aider to work with LLM web chat UIs (e.g., ChatGPT, Claude.ai) instead of requiring a direct API connection.
  • New /copy-context command copies the current context to the clipboard for pasting into an LLM web chat UI.
  • New --api-key provider=key setting lets you supply API keys for any provider directly from the command line or a YAML config file.
  • New --set-env VAR=value setting lets you configure arbitrary environment variables for LLM providers from the command line or YAML config.
  • Adds bash and zsh support to --watch-files, enabling auto-detection of AI coding comments in shell scripts.
+1 moreshow less
  • Adds experimental Gemini models.
v0.67.0 NOTES STABLE

Aider v0.67.0 adds in-editor AI comment instructions, Amazon Bedrock Nova support, and smarter /diff and /run workflows.

└──▷ GET THIS VERSION
$ git clone --branch v0.67.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.67.0
└──▷ TRY IT
Run aider in watch mode so you can drop AI instructions directly in your source files without switching to a terminal.
$ aider --watch-files
  • New --watch-files mode lets aider watch source files for inline AI instructions — trigger execution by ending a comment with AI!.
  • Supports new Amazon Bedrock Nova models.
  • The /diff command now invokes git diff, honouring your configured diff tool.
  • Adds Ctrl-Z support for process suspension.
v0.66.0 NOTES STABLE

Aider v0.66.0 adds PDF support for Sonnet/Gemini, voice device selection, API timeout control, and improved /drop matching.

└──▷ GET THIS VERSION
$ git clone --branch v0.66.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.66.0
└──▷ TRY IT
Select a specific microphone when your system default isn't the one you want for voice input.
$ aider --voice-input-device 2
Set a longer API timeout to avoid premature failures when working with slow or large model responses.
$ aider --timeout 120
  • Adds PDF support for Sonnet and Gemini models, enabling document context in chats.
  • New --voice-input-device flag lets you select the audio input device for voice recording.
  • New --timeout option configures API call timeouts.
  • Sets working directory to repo root when running shell commands.
  • Adds Ctrl-Up/Down keyboard shortcuts for per-message history navigation.
+1 moreshow less
  • Improves /drop command to support substring matching for non-glob patterns.
└──▷ BREAKING ON UPGRADE
  • !Dart support has been removed.
Was this useful?

Cline

Sources Release notes → v3.0.0 2 RELEASES · 2024-12-12 → 2024-12-18 NOTES STABLE

Autonomous coding agent as an SDK, IDE extension, or CLI assistant.

Cline v3.0.0 adds auto-approve controls, diff editing for large files, and per-project .clinerules instruction files.

└──▷ GET THIS VERSION
$ git clone --branch v3.0.0 https://github.com/cline/cline.git
# already have the repo? check out this version:
$ git checkout v3.0.0
└──▷ TRY IT
Enforce project-specific coding conventions and architecture context so Cline follows team standards without repeated prompting.
$ # In the root of your repo:
cat > .clinerules <<'EOF'
# Project conventions
- Use ES modules (import/export), never CommonJS require()
- All API routes live under src/routes/
- Refer to docs/architecture.md before modifying the auth layer
EOF
  • New Auto-approve menu lets practitioners selectively allow Cline to read files, edit files, run terminal commands, use the browser, and invoke MCP servers without per-action confirmation.
  • Configurable API-request limit triggers a pause-and-approve checkpoint before Cline continues autonomous work.
  • Background system notifications alert the user when Cline needs approval, has a question, or has completed a task.
  • Diff editing for large files: Cline now uses a search-and-replace diff format for targeted edits, outputting only the changed content rather than the entire file, with automatic fallback to whole-file editing when appropriate.
  • New .clinerules project-level file supports custom instructions, conventions, documentation pointers, and architecture context scoped to a repository.
1 more release in this issue · 2024-12-12 → 2024-12-18
v2.2.0 NOTES STABLE

Cline v2.2.0 adds Model Context Protocol (MCP) support, letting you plug in or auto-generate custom tools on demand.

└──▷ GET THIS VERSION
$ git clone --branch v2.2.0 https://github.com/cline/cline.git
# already have the repo? check out this version:
$ git checkout v2.2.0
└──▷ TRY IT
Instantly scaffold and install a custom MCP tool tailored to your workflow without writing any server code.
$ add a tool that manages AWS EC2s
  • Supports Model Context Protocol (MCP), enabling plug-and-play integration of external tool servers (e.g. web search, GitHub) via a new server icon in the menu bar.
  • Enables Cline to autonomously create and install new MCP server tools from a natural-language prompt (e.g. 'add a tool that fetches Jira tickets').
  • Saves auto-generated MCP servers to ~/Documents/Cline/MCP for easy reuse and sharing across workflows.
Was this useful?

All Hands AI OpenHands

Sources Release notes → 0.17.0 7 RELEASES · 2024-12-04 → 2024-12-26 NOTES STABLE

OpenHands: AI-Driven Development

OpenHands 0.17 adds custom PR titles, per-conversation URLs, and a homepage recent-conversation view.

└──▷ GET THIS VERSION
$ git clone --branch 0.17.0 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.17.0
  • Supports custom pull request titles when using the GitHub issue resolver.
  • Each conversation now gets its own unique URL, enabling direct linking and bookmarking.
  • Shows the most recent conversation on the homepage for quick resumption.
  • Adds TheAgentCompany evaluation harness for benchmarking agent performance.
  • Settings store type is now defined in openhands_config instead of the main config.
└──▷ BREAKING ON UPGRADE
  • !Settings store type is now defined in openhands_config rather than the main config — configurations relying on the main config for this setting will need to be updated.
6 more releases in this issue · 2024-12-04 → 2024-12-26
0.16.1 NOTES STABLE

OpenHands 0.16.1 adds file-by-file download with progress and backend config saving infrastructure.

└──▷ GET THIS VERSION
$ git clone --branch 0.16.1 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.16.1
  • Adds file-by-file download with progress tracking for workspace files.
  • Introduces infrastructure for saving configuration on the backend rather than the frontend.
0.16.0 NOTES STABLE

OpenHands 0.16.0 updates GitHub Authentication flow.

└──▷ GET THIS VERSION
$ git clone --branch 0.16.0 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.16.0
  • Updates GitHub Authentication integration.
0.15.3 NOTES STABLE

OpenHands 0.15.3 raises default max_iterations to 500 and resets turn budget per user interaction

└──▷ GET THIS VERSION
$ git clone --branch 0.15.3 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.15.3
  • Adds color coding to the 'Ran a Command' UI indicator based on command return value, making pass/fail status immediately visible.
  • Increases default max_iterations to 500, enabling agents to tackle longer, more complex tasks before hitting the iteration limit.
  • Measures the turn limit from the last user interaction rather than session start, giving agents a full budget after each user message.
  • Persists jwt_secret in the config file so the secret survives service restarts without manual reconfiguration.
0.15.2 NOTES STABLE

OpenHands 0.15.2 adds workspace-level custom MicroAgents, resolver code-review requests, and browser observations in chat.

└──▷ GET THIS VERSION
$ git clone --branch 0.15.2 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.15.2
  • Adds support for Custom MicroAgents placed directly in the connected workspace, enabling project-specific agent behavior without global configuration.
  • Enables the resolver to automatically request a code review from the person who initiated it after completing a PR.
  • Surfaces browser observations (what the agent sees while web browsing) directly in the chat interface for real-time visibility.
0.15.1 NOTES STABLE

OpenHands 0.15.1 adds command-run notifications and multiline message support in headless mode.

└──▷ GET THIS VERSION
$ git clone --branch 0.15.1 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.15.1
  • Shows a status message in the UI each time the agent executes a command, giving real-time visibility into agent actions.
  • Supports multiline user messages, and provides a default user message when running in headless mode.
0.15.0 NOTES STABLE

OpenHands 0.15.0 adds SocketIO comms, BrowseURLAction in CodeAct, custom resolver sandboxes, and multi-tab session sharing.

└──▷ GET THIS VERSION
$ git clone --branch 0.15.0 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.15.0
  • Switches underlying client-server communication to SocketIO for more robust real-time messaging.
  • Adds BrowseURLAction to the CodeAct agent, enabling it to navigate URLs as part of agentic workflows.
  • Adds an alignment checker for the browsing agent to verify page-interaction accuracy.
  • Supports custom sandbox images for the GitHub issue resolver.
  • Adds a microagent to automatically handle npm timeout issues during code execution.
+2 moreshow less
  • Allows multiple browser tabs to connect to and share the same agent session simultaneously.
  • Runtimes are no longer kept alive by default, reducing idle resource consumption.
└──▷ BREAKING ON UPGRADE
  • !Runtimes are no longer kept alive by default — existing deployments that relied on persistent runtimes between sessions will need to reconfigure this behavior explicitly.
Was this useful?

Zed

Sources Release notes → v0.166.1 3 RELEASES · 2024-12-04 → 2024-12-18 NOTES STABLE

Zed v0.166.1 adds image viewing, UUID insertion actions, per-language completion settings, and expanded Vim navigation.

└──▷ GET THIS VERSION
$ git clone --branch v0.166.1 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.166.1
└──▷ USE IT
Activate the left adjacent tab instead of the right one when closing a tab — useful when working through files left-to-right.
json
{
  "tabs": {
    "activate_on_close": "left_neighbour"
  }
}
Disable completion popups while typing in prose-heavy languages like Markdown, without affecting code languages.
json
{
  "languages": {
    "Markdown": {
      "show_completions_on_input": false,
      "show_completion_documentation": false
    }
  }
}
Always show error and warning indicators on file tabs so you can spot problems at a glance without opening the diagnostics panel.
json
{
  "project_panel": {
    "show": "always"
  }
}
  • Adds left_neighbour option to the tabs.activate_on_close setting to activate the left adjacent tab when a tab is closed.
  • Adds show_completions_on_input and show_completion_documentation as per-language configurable settings (previously only global).
  • Adds "project_panel": {"show": "always"} setting to display error and warning indicators in tabs.
  • Adds editor: insert uuid v4 and editor: insert uuid v7 actions for inserting generated UUIDs at the cursor.
  • Adds editor::OpenContextMenu action to open the context menu at the current cursor position.
+11 moreshow less
  • Adds Vim [ c / ] c bindings to select the previous/next git-modified file in the project panel.
  • Adds Vim [ d / ] d bindings to select the previous/next file with LSP diagnostics in the project panel.
  • Adds Vim { / } bindings to select the previous/next directory in the project panel.
  • Adds support for opening images by dropping them onto a pane or opening them via the command line.
  • Adds language server action execution on file rename.
  • Adds YAML and TOML frontmatter syntax highlighting for Markdown files.
  • Adds JavaScript runnable detection for context and suite methods in the Mocha.js framework.
  • Recognizes *.C and *.H (uppercase) file extensions as C++.
  • Adds delete action to Helix Normal mode.
  • Linux: Adds preliminary support for voice chat and viewing screenshares.
  • Makes the include-warnings toggle in the diagnostics tab global for the entire Zed session.
└──▷ BREAKING ON UPGRADE
  • !editor::ShowInlineCompletion keybinding changed to option-tab on macOS (was option-/); editor::NextCompletion and editor::PreviousCompletion are now option-tab and option-shift-tab (were option-[ and option-]).
  • !In keymap.json, "use_layout_keys": true is now the default; to restore the previous behaviour, explicitly set "use_key_equivalents": true.
  • !The completion_documentation_secondary_query_debounce setting is deprecated and no longer has effect.
2 more releases in this issue · 2024-12-04 → 2024-12-18
v0.165.4 NOTES STABLE

Zed v0.165.4 adds terminal panel splitting, zed --uninstall, new Vim motions/text objects, and a show_user_picture setting.

└──▷ GET THIS VERSION
$ git clone --branch v0.165.4 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.165.4
└──▷ TRY IT
Uninstall Zed cleanly from the command line without hunting for files manually.
$ zed --uninstall
Hide your profile picture from the Zed titlebar in a shared or screen-recorded session.
json
{
  "show_user_picture": false
}
Control whether yanked text is highlighted in Vim mode.
json
{
  "vim": {
    "highlight_on_yank": true,
    "highlight_on_copy": false
  }
}
  • Adds zed --uninstall CLI flag to cleanly uninstall Zed.
  • Adds autoscroll_on_clicks setting to configure whether the editor scrolls when clicking near the edges of the visible text area.
  • Adds show_user_picture setting (default: true) to hide the user profile picture in the titlebar.
  • Adds editor::FoldFunctionBodies action to fold all function bodies in textobject-supported languages.
  • Adds Vim settings highlight_on_yank and highlight_on_copy to control highlight behavior on yank/copy.
+14 moreshow less
  • Adds terminal panel splitting support.
  • Adds Vim section-navigation motions [[, [], ]], ][, method-navigation motions [m, ]m, [M, ]M, and comment-navigation motions [*, ]*, [/, ]/ (tree-sitter–powered, built-in languages only).
  • Adds Vim text objects ic/ac (inside/around class), if/af (inside/around function/method), and g c (comment) (tree-sitter–powered, built-in languages only).
  • Adds textobject support for Erlang, Haskell, Lua, PHP, Prisma, Proto, TOML, and Zig.
  • Publishes updated JSON Schema for themes at zed.dev/schema/themes/v0.2.0.json.
  • Adds 'Copy Extension ID' option to the extension details context menu.
  • Adds Vim == indent-line operator.
  • GIF images now animate when opened in the editor.
  • Enables clangd's dot-to-arrow automatic correction feature for C/C++.
  • Adds support for running Rust examples as tasks.
  • Recognizes .pcss files as CSS.
  • Enables toolchain virtual environment activation in newly opened terminals.
  • Improves runnable detection for JavaScript/TypeScript files.
  • Adds Python syntax highlighting for forward references.
└──▷ BREAKING ON UPGRADE
  • !Linux users with an existing installation must re-run install.sh or manually edit their zed.desktop file to fix the issue where files would not open from the file explorer (the fix only applies automatically to new installs).
v0.164.2 NOTES STABLE

Zed v0.164.2 adds file_scan_inclusions, task output controls, image rendering in Markdown preview, and expanded Vim motions.

└──▷ GET THIS VERSION
$ git clone --branch v0.164.2 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.164.2
└──▷ USE IT
Force Zed to index gitignored files (e.g., vendored or generated directories) so they appear in search and the file finder.
json
"file_scan_inclusions": ["vendor/**", "generated/**", ".env*"]
Keep task output clean by hiding the summary header and the command line that was run.
json
"show_summary": false,
"show_command": false
  • Adds file_scan_inclusions setting to force Zed to index files matching provided globs even when they are gitignored.
  • Adds show_summary and show_command task settings to suppress the summary and command line from task output.
  • Adds image rendering to the Markdown preview.
  • Adds support for extension languages on the remote server (SSH Remoting).
  • Adds support for ctrl-k / ctrl-y alternate cut/yank buffer on macOS.
+8 moreshow less
  • Adds the = operator for auto-indent in Vim mode.
  • Adds support for ctrl-w _ and ctrl-w = in Vim mode.
  • Adds ctrl-w {+,-,>,<} for resizing the current pane in Vim mode.
  • Adds Vim 'unmatched' motions: ]}, ]), [{, and [( for jumping to surrounding brackets.
  • Adds vii, vai, and vaI for selecting the indent text object in Vim mode.
  • Adds JSON language server configuration via settings for json-language-server.
  • Python: pylsp now uses the version installed in the user's venv when one is available.
  • Python: Adds string.doc syntax highlighting for class and module-level docstrings.
└──▷ BREAKING ON UPGRADE
  • !Zed no longer provides universal binaries for macOS releases.
Was this useful?
◆  AI Agent Frameworks

AutoGPT

Sources Release notes → autogpt-platform-beta-v0.4.0 2 RELEASES · 2024-12-02 → 2024-12-20 NOTES STABLE

AutoGPT Platform beta v0.4.0 launches Marketplace V2 with agent ratings, AI-generated listing images, API key rate limiting, LaunchDarkly feature flags, and manual webhook setup.

└──▷ GET THIS VERSION
$ git clone --branch autogpt-platform-beta-v0.4.0 https://github.com/Significant-Gravitas/AutoGPT.git
# already have the repo? check out this version:
$ git checkout autogpt-platform-beta-v0.4.0
  • Adds API key rate limit middleware to the platform backend, enabling per-key request throttling.
  • Adds LaunchDarkly feature flagging UI, allowing operators to gate platform features via LaunchDarkly toggles.
  • Supports manually setting up webhooks, giving users direct control over webhook configuration without relying on automatic provisioning.
  • Adds field extraction handle for blocks with object output, enabling downstream blocks to consume individual fields from structured block results.
  • Strips credentials from agent export and import, preventing accidental credential leakage when sharing agent definitions.
+7 moreshow less
  • Introduces Marketplace V2 (Agent Store V2) with media-rich listings — icons, images, and YouTube video embeds — for richer agent discovery.
  • Generates AI images automatically for store submissions, providing default listing artwork without manual uploads.
  • Auto-populates the agent submission form when publishing to the store, reducing manual data entry.
  • Adds a featured-creators schema, allowing specific creator profiles to be highlighted in the marketplace.
  • Adds a personal agent library, letting users save and organize agents from the marketplace.
  • Adds a reset password page to the platform UI.
  • Adds a Jina fact-checker block for use in agent workflows.
1 more release in this issue · 2024-12-02 → 2024-12-20
autogpt-platform-beta-v0.3.4 NOTES STABLE

AutoGPT Platform v0.3.4 adds webhook-triggered blocks, AI video generation, HubSpot integration, and searchable block descriptions.

└──▷ GET THIS VERSION
$ git clone --branch autogpt-platform-beta-v0.3.4 https://github.com/Significant-Gravitas/AutoGPT.git
# already have the repo? check out this version:
$ git checkout autogpt-platform-beta-v0.3.4
  • Adds webhook-triggered blocks, enabling agent workflows to be initiated by incoming webhooks.
  • Introduces feature flagging to the platform, allowing controlled rollout of capabilities.
  • Adds an AI video generation block powered by Fal txt2vid for generating video from text inside agent flows.
  • Enables search over Block descriptions in the Block list palette, making it faster to discover the right block.
  • Adds new HubSpot integration blocks for connecting agent workflows to HubSpot.
+1 moreshow less
  • Adds a Word Character Count block for counting words and characters within a flow.
Was this useful?

CrewAI

Sources Release notes → 0.86.0 2 RELEASES · 2024-12-04 → 2024-12-05 NOTES STABLE

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

CrewAI 0.86.0 adds multi-round Human-in-the-Loop follow-up and expanded knowledge tooling

└──▷ GET THIS VERSION
$ git clone --branch 0.86.0 https://github.com/crewAIInc/crewAI.git
# already have the repo? check out this version:
$ git checkout 0.86.0
  • Supports multiple rounds of Human-in-the-Loop (HITL) follow-up, enabling iterative human feedback within a crew's execution flow.
  • Adds Nvidia NIM as a supported provider for custom LLM configuration.
  • Introduces a knowledge demo and improved knowledge documentation to help practitioners integrate knowledge sources into crews.
└──▷ BREAKING ON UPGRADE
  • !All references to Pipeline and PipelineRouter have been removed; any working setup that uses these constructs will break on upgrade.
1 more release in this issue · 2024-12-04 → 2024-12-05
0.85.0 NOTES STABLE

CrewAI 0.85.0 adds agent-level knowledge, removes LangChain dependency, and improves typed task outputs.

└──▷ GET THIS VERSION
$ git clone --branch 0.85.0 https://github.com/crewAIInc/crewAI.git
# already have the repo? check out this version:
$ git checkout 0.85.0
  • Adds knowledge support at the individual agent level, enabling per-agent knowledge bases alongside crew-level knowledge.
  • Removes LangChain as a dependency, reducing the library's footprint and eliminating LangChain version conflicts.
  • Improves typed task outputs for stronger, more predictable structured results from tasks.
  • Adds Tool Repository authentication via crewai login, enabling access to hosted tools.
└──▷ BREAKING ON UPGRADE
  • !LangChain has been removed as a dependency; any code or configuration that imports or relies on LangChain internals through CrewAI will break on upgrade.
Was this useful?

Stanford NLP DSPy

Sources Release notes → 2.6.0rc6 5 RELEASES · 2024-12-10 → 2024-12-22 NOTES STABLE

DSPy 2.6.0rc6 adds response_model key to LM history entries.

└──▷ GET THIS VERSION
$ git clone --branch 2.6.0rc6 https://github.com/stanfordnlp/dspy.git
# already have the repo? check out this version:
$ git checkout 2.6.0rc6
  • Adds response_model key to LM history entries, exposing the structured output model used for each language model call.
4 more releases in this issue · 2024-12-10 → 2024-12-22
2.6.0rc4 NOTES STABLE

DSPy 2.6.0rc4 adds streaming support for language model calls.

└──▷ GET THIS VERSION
$ git clone --branch 2.6.0rc4 https://github.com/stanfordnlp/dspy.git
# already have the repo? check out this version:
$ git checkout 2.6.0rc4
  • Adds streaming support for language model outputs.
2.6.0rc3 NOTES STABLE

DSPy 2.6.0rc3 adds LiteLLM RetryPolicy support and thread-safe Settings semantics.

└──▷ GET THIS VERSION
$ git clone --branch 2.6.0rc3 https://github.com/stanfordnlp/dspy.git
# already have the repo? check out this version:
$ git checkout 2.6.0rc3
  • Supports automatic retries for LM calls via LiteLLM RetryPolicy integration.
  • Refines thread-safety semantics for Settings to make concurrent DSPy usage more reliable.
2.5.43 NOTES STABLE

DSPy 2.5.43 adds logprob support in Predictor and a new docs_uri_column_name field for DatabricksRM.

└──▷ GET THIS VERSION
$ git clone --branch 2.5.43 https://github.com/stanfordnlp/dspy.git
# already have the repo? check out this version:
$ git checkout 2.5.43
└──▷ USE IT
Retrieve documents from Databricks Vector Search and map a custom URI column to results.
python
retriever = DatabricksRM(
    databricks_index_name='my_index',
    docs_uri_column_name='source_url',
    text_column_name='content',
    k=5
)
  • Adds docs_uri_column_name parameter to DatabricksRM to specify which column holds document URIs when retrieving results.
  • Enables returning log probabilities from Predictor, exposing token-level confidence scores for model outputs.
  • Improves DSPy module saving fidelity.
2.5.42 NOTES STABLE

DSPy 2.5.42 adds tool callbacks, in-memory LM caching, structured output support, and broader type coverage.

└──▷ GET THIS VERSION
$ git clone --branch 2.5.42 https://github.com/stanfordnlp/dspy.git
# already have the repo? check out this version:
$ git checkout 2.5.42
  • Adds on_tool_start and on_tool_end callbacks for observability hooks around tool execution.
  • Integrates cachetools for in-memory LM caching, with support for unhashable types and Pydantic models.
  • Supports structured outputs response format derived from the signature in the JSON adapter.
  • Expands supported types for DSPy signatures via broader type annotation handling.
  • Makes DatabricksRM compatible with the Mosaic agent framework.
Was this useful?

deepset Haystack

Sources Release notes → v2.8.0 NOTES

Haystack v2.8.0 adds DALLEImageGenerator, MetaFieldGroupingRanker, TTFT support, and new converter path controls.

└──▷ GET THIS VERSION
$ git clone --branch v2.8.0 https://github.com/deepset-ai/haystack.git
# already have the repo? check out this version:
$ git checkout v2.8.0
└──▷ USE IT
Generate an image from a text prompt using the new DALLEImageGenerator component.
python
from haystack.components.generators import DALLEImageGenerator

image_generator = DALLEImageGenerator()
response = image_generator.run("Show me a picture of a black cat.")
print(response)
Enforce that every variable in a prompt template must be supplied at pipeline run time.
python
from haystack.components.builders import PromptBuilder

builder = PromptBuilder(
    template="Summarize the following: {{ text }} in {{ language }}",
    required_variables="*"
)
  • Adds store_full_path parameter to __init__ of JSONConverter, CSVToDocument, DOCXToDocument, HTMLToDocument, MarkdownToDocument, PDFMinerToDocument, PPTXToDocument, TikaDocumentConverter, PyPDFToDocument, AzureOCRDocumentConverter, and TextFileToDocument; set to False to store only the file name instead of the full path in document metadata (defaults to True).
  • Adds required_variables='*' option to PromptBuilder and ChatPromptBuilder to automatically mark all prompt template variables as required.
  • Adds optional parameters to ConditionalRouter enabling default/fallback routing when certain inputs are absent at runtime.
  • New DALLEImageGenerator component brings OpenAI DALL-E image generation into Haystack pipelines.
  • New MetaFieldGroupingRanker component reorders documents by grouping them on metadata keys, useful for pre-processing before LLM ingestion.
+6 moreshow less
  • Adds TTFT (Time-to-First-Token) support for OpenAI generators, capturing latency of first-token generation.
  • Adds Maximum Margin Relevance (MMR) strategy to SentenceTransformersDiversityRanker for query-relevance and diversity-balanced document selection.
  • Adds split-by-line support to DocumentSplitter.
  • Adds new initialization parameters to PyPDFToDocument for customizing text extraction from PDF files.
  • Adds SSL verification toggle and custom certificate authority support when making function calls via OpenAPI.
  • OpenAIDocumentEmbedder now continues processing remaining batches when a single batch fails embedding instead of stopping.
└──▷ BREAKING ON UPGRADE
  • !The is_greedy argument has been removed from the @component decorator; replace Variadic inputs with GreedyVariadic in custom components.
Was this useful?

LangChain

Sources Release notes → langchain-community==0.3.13 11 RELEASES · 2024-12-02 → 2024-12-19 NOTES STABLE

langchain-community 0.3.13 adds Cosmos DB semantic cache, FalkorDB vector store, FewShotSQLTool, full-text/hybrid search, and a wave of new model and integration support.

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.3.13 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.3.13
└──▷ USE IT
Reuse an existing DocumentLoader as a blob parser inside an ingestion pipeline without writing a custom parser class.
python
from langchain_community.document_loaders.parsers import DocumentLoaderAsParser
from langchain_community.document_loaders import PyPDFLoader

parser = DocumentLoaderAsParser(PyPDFLoader)
blobs = [blob]  # your Blob objects
docs = list(parser.lazy_parse(blobs[0]))
Scrape pages from a site that sits behind a corporate proxy by honouring the HTTP_PROXY / HTTPS_PROXY environment variables.
python
from langchain_community.document_loaders import WebBaseLoader

loader = WebBaseLoader("https://internal.example.com/docs", trust_env=True)
docs = loader.load()
Narrow Azure AI image analysis to only the features you need, reducing latency and cost.
python
from langchain_community.tools.azure_ai_services import AzureAiServicesImageAnalysisTool
from azure.ai.vision.imageanalysis.models import VisualFeatures

tool = AzureAiServicesImageAnalysisTool(
    visual_features=[VisualFeatures.CAPTION, VisualFeatures.OBJECTS]
)
result = tool.run("https://example.com/image.png")
  • Adds DocumentLoaderAsParser wrapper, enabling any DocumentLoader to be used as a BaseBlobParser in pipelines.
  • Adds default_headers parameter to allow custom HTTP headers to be injected at the community client level.
  • Adds trust_env parameter to WebBaseLoader to control whether environment-level proxy settings are respected.
  • Adds VisualFeatures as a configurable parameter on AzureAiServicesImageAnalysisTool to select which vision features are requested.
  • Adds FewShotSQLTool for few-shot prompting workflows targeting SQL generation.
+17 moreshow less
  • Adds bind_tools support to ChatMLX.
  • Adds tool-calling and structured output support to SambaStudio.
  • Adds with_structured_output support to ChatSambaNovaCloud.
  • Adds Cosmos DB NoSQL Semantic Cache integration (with tests and a Jupyter notebook).
  • Adds full-text and hybrid search support to the Azure CosmosDB NoSQL vector store.
  • Adds FalkorDB vector store implementation.
  • Adds OpenAI prompt caching and reasoning token tracking callbacks.
  • Adds Haiku 3.5 and Opus token-tracking callbacks.
  • Adds OCI Generative AI new model support and structured output.
  • Adds Hunyuan Embedding support.
  • Adds cookie-based authentication support for the Confluence document loader.
  • Adds kwargs support to VectorStore base class.
  • Updates DynamoDB chat history to use update-in-place instead of full overwrite.
  • Refactors OpenSearch query constructor to use wildcard instead of match in the contain comparator.
  • Updates OpenLLM integration to support v0.6.
  • Ensures node uniqueness by ID in the Apache AGE graph wrapper.
  • Makes DocumentAttributeValue class properties default to None, broadening compatibility.
10 more releases in this issue · 2024-12-02 → 2024-12-19
langchain-mistralai==0.2.4 NOTES STABLE

langchain-mistralai 0.2.4 adds automatic retry logic to MistralAIEmbeddings on rate-limit errors.

└──▷ GET THIS VERSION
$ git clone --branch langchain-mistralai==0.2.4 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-mistralai==0.2.4
  • Adds a retrying mechanism to MistralAIEmbeddings that automatically retries requests when a rate-limit error is encountered.
langchain-ollama==0.2.2 NOTES STABLE

langchain-ollama 0.2.2 adds structured output support to Ollama-backed LLM calls.

└──▷ GET THIS VERSION
$ git clone --branch langchain-ollama==0.2.2 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-ollama==0.2.2
  • Adds structured output support for Ollama models, enabling schema-constrained response generation.
langchain-core==0.3.26 NOTES STABLE

LangChain core 0.3.26 exports InjectedToolCallId and adds kwargs support to VectorStore

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.3.26 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.3.26
└──▷ USE IT
Annotate a tool parameter so the framework automatically injects the tool call ID rather than requiring the LLM to supply it.
python
from langchain_core.tools import InjectedToolCallId
from langchain_core.tools import tool
from typing import Annotated

@tool
def my_tool(query: str, tool_call_id: Annotated[str, InjectedToolCallId()]) -> str:
    return f'Handling call {tool_call_id} for query: {query}'
  • Exports InjectedToolCallId from langchain_core, making it part of the public API and importable for annotating tool call ID injection in tool functions.
  • Adds **kwargs support to VectorStore, allowing subclasses and callers to pass arbitrary keyword arguments through vector store methods.
langchain-community==0.3.12 NOTES STABLE

LangChain Community 0.3.12 adds OpenSearch hybrid search, FAISS advanced query operators, Tablestore vector store, Azure Cosmos DB DiskANN, and more integrations.

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.3.12 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.3.12
└──▷ USE IT
Filter O365 emails or files to only those modified after a given date, reducing load time in incremental ingestion pipelines.
python
loader = O365BaseLoader(..., modified_since='2024-12-01T00:00:00Z')
docs = loader.load()
Control OpenSearch bulk indexing batch size when ingesting large document collections to tune throughput.
python
from langchain_community.vectorstores import OpenSearchVectorSearch

vs = OpenSearchVectorSearch(
    index_name='my-index',
    embedding_function=embeddings,
    opensearch_url='https://localhost:9200',
    bulk_size=500,
)
  • Adds modified_since argument to O365BaseLoader to filter loaded documents by modification date.
  • Adds bulk_size as a settable parameter for OpenSearchVectorSearch to control indexing batch size.
  • Adds FAISS filter function enhancement with advanced query operators for more expressive vector search filtering.
  • Adds OpenSearch hybrid search implementation combining dense and sparse retrieval.
  • Adds TablestoreVectorStore integration for Alibaba Cloud Tablestore as a vector store backend.
+5 moreshow less
  • Adds Azure Cosmos DB Mongo vCore vector store support with DiskANN indexing.
  • Adds methods to create a branch and list files for the GitLab tool integration.
  • Adds streaming functionality to ChatSnowflakeCortex.
  • Adds support for cross-region inference profile IDs in Bedrock Anthropic Claude token cost calculation.
  • Adds Graphviz document rendering capability for visualizing document graphs.
langchain-core==0.3.25 NOTES STABLE

LangChain Core 0.3.25 adds a new scoped_full clean-up strategy to the indexing API.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.3.25 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.3.25
  • Adds scoped_full as a new clean-up strategy option in the indexing API, giving practitioners a scoped variant of full deletion during index runs.
langchain-community==0.3.11 NOTES STABLE

LangChain Community 0.3.11 adds model2vec embeddings, Confluence label filtering, Memgraph updates, and KuzuGraph dangerous-request gating.

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.3.11 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.3.11
└──▷ USE IT
Filter Confluence pages by label so only relevant docs are loaded into your RAG pipeline.
python
from langchain_community.document_loaders import ConfluenceLoader

loader = ConfluenceLoader(
    url="https://your-org.atlassian.net/wiki",
    username="[email protected]",
    api_key="<api_key>",
    space_key="ENG",
    include_labels=["approved", "public"]
)
docs = loader.load()
Generate and persist graph documents from an LLM into KuzuGraph with the new dangerous-request gate.
python
from langchain_community.graphs import KuzuGraph
from langchain_experimental.graph_transformers import LLMGraphTransformer
from langchain_openai import ChatOpenAI

graph = KuzuGraph(database=db, allow_dangerous_requests=True)
llm = ChatOpenAI(model="gpt-4o")
transformer = LLMGraphTransformer(llm=llm)
graph_docs = transformer.convert_to_graph_documents(docs)
graph.add_graph_documents(graph_docs)
  • Adds include_labels option to ConfluenceLoader to filter loaded content by Confluence labels.
  • Adds support for model2vec embeddings via a new integration in the community package.
  • Adds allow_dangerous_requests parameter to KuzuGraph and enables adding graph documents via LLMGraphTransformer.
  • Adds Pebblo support for the new Pinecone class PineconeVectorStore.
  • Retains Azure Document Intelligence API metadata in the Document parser output.
+1 moreshow less
  • Updates the Memgraph integration with new capabilities.
langchain-community==0.3.10 NOTES STABLE

langchain-community 0.3.10 adds Needle retriever/loader, SAP HANA HNSW index support, PubMed API key auth, and BM25 document ID preservation.

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.3.10 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.3.10
  • Adds Needle retriever and document loader integration, enabling retrieval workflows backed by the Needle service.
  • Adds HNSW index creation support for SAP HANA Vector Store, unlocking approximate nearest-neighbor search at scale.
  • Adds apikey parameter support to PubMedAPIWrapper, allowing authenticated PubMed API access.
  • Adds _select_relevance_score_fn implementation for Tencent VectorDB, enabling correct similarity score normalization.
  • Preserves original document IDs in BM25Retriever, preventing ID loss on retrieval.
+2 moreshow less
  • Updates Databricks Vector Search query constructor to use filter instead of the deprecated filters parameter.
  • Adds context keyword argument support for OpenAI integration.
langchain-tests==0.3.5 NOTES STABLE

LangChain tests 0.3.5 adds standard retriever tests and final AIMessage support in tool_example_to_messages

└──▷ GET THIS VERSION
$ git clone --branch langchain-tests==0.3.5 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-tests==0.3.5
  • Adds standard tests for retrievers via new retriever standard test suite (tests: init retriever standard tests).
  • Supports final AIMessage responses in tool_example_to_messages in langchain-core.
  • Adds standard tests to the CLI, including validation that they run and skipping of vector store tests.
langchain-ollama==0.2.1 NOTES STABLE

langchain-ollama 0.2.1 adds token-level streaming with bound tools and passes extra kwargs through to Ollama requests.

└──▷ GET THIS VERSION
$ git clone --branch langchain-ollama==0.2.1 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-ollama==0.2.1
  • Enables token-level streaming when using bind_tools with ChatOllama, allowing real-time output during tool-augmented calls.
  • Passes extra kwargs through in Ollama requests, giving callers access to additional Ollama API parameters.
  • Adds support for Ollama 0.4.
  • Supports tool calling with nested schemas in ChatOllama.
langchain-community==0.3.9 NOTES STABLE

langchain-community 0.3.9 adds truncation params for OpenAI assistant runs, Perplexity citations in AIMessage, and NumPy 2 support.

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.3.9 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.3.9
  • Adds truncation parameters when an OpenAI assistant's run is created, giving control over context window usage.
  • Adds citations in AIMessage for ChatPerplexity, surfacing source attribution directly in chat responses.
  • Supports NumPy 2 in community integrations.
  • Updates Marqo index settings to use the 2.x API version while retaining backward compatibility with 1.5.x.
Was this useful?

LangChain LangGraph

Sources Release notes → checkpointpostgres==2.0.9 17 RELEASES · 2024-12-03 → 2024-12-20 NOTES STABLE

Build resilient agents.

LangGraph Postgres checkpointer adds ShallowPostgresSaver and AsyncShallowPostgresSaver for lightweight, history-free checkpoint storage.

└──▷ GET THIS VERSION
$ git clone --branch checkpointpostgres==2.0.9 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout checkpointpostgres==2.0.9
  • Adds ShallowPostgresSaver, a drop-in replacement for PostgresSaver that stores only the most recent checkpoint, reducing storage when time travel is not needed.
  • Adds AsyncShallowPostgresSaver, the async counterpart to ShallowPostgresSaver, with the same lightweight storage semantics and a full async interface.
└──▷ BREAKING ON UPGRADE
  • !The batch method has been removed from AsyncPostgresStore; callers must switch to abatch instead.
16 more releases in this issue · 2024-12-03 → 2024-12-20
sdk==0.1.48 NOTES STABLE

LangGraph SDK 0.1.48 adds StudioUser class for fine-grained authorization control over LangGraph Studio UI access.

└──▷ GET THIS VERSION
$ git clone --branch sdk==0.1.48 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout sdk==0.1.48
└──▷ USE IT
Gate a resource to non-Studio users only — useful when you want to block Studio UI access to sensitive operations in production.
python
from langgraph_sdk.auth.types import StudioUser

def my_auth_handler(user, action, resource):
    if isinstance(user, StudioUser):
        raise PermissionError("Studio users cannot access this resource")
    return True
Disable Studio authentication entirely for environments where Studio UI access should be unrestricted.
json
{
  "disable_studio_auth": true
}
  • Adds StudioUser class in langgraph_sdk/auth/types.py representing authenticated users from the LangGraph Studio UI, exposing properties for username, display name, identity, permissions, and auth status.
  • Enables custom authorization handlers to branch on Studio vs. non-Studio users via isinstance(user, StudioUser) checks.
  • Supports disabling Studio authentication entirely via disable_studio_auth: true in langgraph.json.
0.2.60 NOTES STABLE

LangGraph 0.2.60 makes Command.update accept any type and relaxes tool node validation for multi-message responses.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.60 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.60
└──▷ USE IT
Pass a custom non-dict value (e.g. a string or dataclass) through Command.update when routing between nodes — previously impossible without wrapping in a dict.
python
from langgraph.types import Command

# Now valid: update can be any type, including None or a plain string
cmd = Command(goto="next_node", update="my_custom_payload")
Return multiple tool messages from a tool node (e.g. for logging + result) without triggering a validation error, as long as one message matches the tool call ID.
python
from langchain_core.messages import ToolMessage
from langgraph.types import Command

# Both messages returned; validation passes because one has the matching tool_call_id
cmd = Command(
    update={
        "messages": [
            ToolMessage(content="debug info", tool_call_id="other-id"),
            ToolMessage(content="actual result", tool_call_id="call-123"),
        ]
    }
)
  • Extends Command.update to accept any type of value (not just dicts or sequences of tuples), including None, enabling more diverse node-to-node command patterns.
  • Relaxes prebuilt tool_node validation to allow multiple tool messages in a command update, requiring only that at least one message matches the tool call ID.
└──▷ BREAKING ON UPGRADE
  • !The default value of Command.update changed from () (empty tuple) to None; code that checks if command.update == () or relies on the empty-tuple default will behave differently.
sdk==0.1.47 NOTES STABLE

LangGraph SDK 0.1.47 simplifies auth handlers and renames scopes to permissions in the Auth module.

└──▷ GET THIS VERSION
$ git clone --branch sdk==0.1.47 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout sdk==0.1.47
└──▷ USE IT
Return a user object directly from an auth handler instead of the old (scopes, user) tuple pattern.
python
from langgraph_sdk.auth import Auth

auth = Auth()

@auth.authenticate
async def authenticate(authorization: str) -> dict:
    user_id = verify_token(authorization)  # your token logic
    return {"identity": user_id, "permissions": ["runs:create", "threads:read"]}
  • Simplifies authentication handler return type: handlers now return a user representation directly (string, dict, or object) instead of a (scopes, user) tuple.
  • Adds permissions field to MinimalUserDict and permissions property to the BaseUser interface in Auth.types.
  • Updates Authenticator type signature to reflect the new single-object return format.
└──▷ BREAKING ON UPGRADE
  • !The scopes field/property is renamed to permissions throughout the Auth module — any code referencing scopes on auth objects or MinimalUserDict will break.
  • !Authentication handlers must now return a single user representation (string, dict with identity/permissions, or compatible object) instead of a tuple of (scopes, user).
cli==0.1.64 NOTES STABLE

LangGraph CLI now validates dependencies in configuration, with graceful fallback when the field is absent.

└──▷ GET THIS VERSION
$ git clone --branch cli==0.1.64 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout cli==0.1.64
  • Adds dependencies field validation to validate_config, ensuring dependency declarations are checked and included during config processing.
sdk==0.1.46 NOTES STABLE

LangGraph SDK 0.1.46 adds HTTPException to auth handlers for precise HTTP error control

└──▷ GET THIS VERSION
$ git clone --branch sdk==0.1.46 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout sdk==0.1.46
└──▷ USE IT
Return a 403 with a custom message from an auth handler instead of the default 401 Unauthorized.
python
from langgraph_sdk import Auth

auth = Auth()

@auth.authenticate
async def my_auth_handler(token: str):
    if not is_valid(token):
        raise auth.exceptions.HTTPException(
            status_code=403,
            detail="You do not have permission to access this resource."
        )
    return {"user": decode(token)}
  • Adds HTTPException class to Auth.exceptions, letting auth handlers return custom HTTP status codes, error messages, and headers instead of generic failures.
  • Exposes exceptions module on the Auth class for clean, importable access to auth-related exception types.
cli==0.1.63 NOTES STABLE

LangGraph CLI 0.1.63 adds OpenAPI security scheme configuration to AuthConfig for customizing API auth settings.

└──▷ GET THIS VERSION
$ git clone --branch cli==0.1.63 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout cli==0.1.63
  • Adds SecurityConfig TypedDict class for defining OpenAPI security schemes and requirements in authentication config.
  • Extends AuthConfig with a new openapi field of type SecurityConfig, enabling customization of API security settings such as OAuth2 scopes and token endpoints.
cli==0.1.62 NOTES STABLE

LangGraph CLI 0.1.62 adds auth configuration support for LangGraph Studio with a new AuthConfig type.

└──▷ GET THIS VERSION
$ git clone --branch cli==0.1.62 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout cli==0.1.62
└──▷ USE IT
Disable Studio's built-in auth and point to a custom auth handler when running the dev server locally.
json
# langgraph.json
{
  "auth": {
    "path": "./my_auth.py:handler",
    "disable_studio_auth": true
  }
}
  • New AuthConfig TypedDict with path and disable_studio_auth fields enables custom authentication configuration for LangGraph Studio.
  • New auth field on the main Config TypedDict wires auth settings into config validation and Docker environment generation.
  • The dev command now accepts auth configuration, allowing Studio auth to be controlled at dev-server launch time.
sdk==0.1.45 NOTES STABLE

LangGraph SDK 0.1.45 adds an Auth class with decorator-based authentication and fine-grained per-resource authorization.

└──▷ GET THIS VERSION
$ git clone --branch sdk==0.1.45 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout sdk==0.1.45
└──▷ USE IT
Protect all LangGraph resources with a global auth handler that validates a bearer token and returns user scopes.
python
from langgraph_sdk import Auth

auth = Auth()

@auth.authenticate
async def verify_token(token: str):
    # validate token and return user scopes
    user = await my_token_validator(token)
    return {"id": user.id, "scopes": user.scopes}

@auth.on
async def global_handler(ctx, value):
    # allow only requests where the resource owner matches the caller
    if ctx.user.id != value.get("owner"):
        raise Auth.exceptions.HTTPException(status_code=403)
Apply a resource-specific rule so only thread owners can read their own threads, while leaving other resources on the global handler.
python
from langgraph_sdk import Auth

auth = Auth()

@auth.on.threads.read
async def restrict_thread_reads(ctx, value):
    # inject a filter so the query only returns threads owned by the caller
    return {"owner": ctx.user.id}
  • Adds Auth class providing a unified authentication and authorization system for LangGraph applications.
  • Supports decorator-based auth handlers to verify credentials and return user scopes.
  • Enables fine-grained access control per resource (threads, assistants, crons) and per action (create, read, update, delete, search).
  • Implements a hierarchical handler system supporting global fallback handlers alongside specific per-action handlers.
  • Introduces a new types module with typed dictionaries (e.g., ThreadsCreate, AssistantsRead), protocol definitions for user objects and auth handlers, and strongly-typed context objects.
0.2.59 NOTES STABLE

LangGraph 0.2.59 enables config-aware tool execution by passing configuration to prebuilt tool node invocations.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.59 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.59
  • Enables prebuilt tool node to pass the configuration object to tools during both synchronous (invoke) and asynchronous (ainvoke) execution, allowing tools to access runtime configuration parameters.
0.2.58 NOTES STABLE

LangGraph 0.2.58 adds string node names in Command.goto and richer config metadata with defaults and descriptions.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.58 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.58
└──▷ USE IT
Route to a node by name directly in Command.goto instead of wrapping it in a Send object.
python
from langgraph.types import Command

# Previously required Send; now a plain string works
def my_node(state):
    return Command(goto="approval_node")
Inspect richer config metadata — including defaults and descriptions — for a compiled graph.
python
from langgraph.utils.fields import get_enhanced_type_hints

# Get type hints plus defaults and descriptions for a config schema
hints = get_enhanced_type_hints(MyConfigSchema)
print(hints)
  • Supports string values in Command.goto, enabling direct node-name references instead of requiring Send objects for state transitions.
  • Adds get_enhanced_type_hints utility to extract type hints along with default values and descriptions, covering Pydantic models, TypedDict, and dataclasses.
  • Enriches Pregel.config_specs output with default values and descriptions for configuration fields via get_enhanced_type_hints.
0.2.57 NOTES STABLE

LangGraph 0.2.57 adds a functional API with @task/@entrypoint decorators and lets tools return Command objects.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.57 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.57
└──▷ USE IT
Run two LLM calls in parallel inside a functional-API workflow — use @task so both futures resolve concurrently, then collect results in the @entrypoint.
python
from langgraph.func import task, entrypoint

@task
def call_model_a(prompt: str) -> str:
    return llm_a.invoke(prompt)

@task
def call_model_b(prompt: str) -> str:
    return llm_b.invoke(prompt)

@entrypoint()
def compare_models(prompt: str) -> dict:
    future_a = call_model_a(prompt)
    future_b = call_model_b(prompt)
    return {"a": future_a.result(), "b": future_b.result()}

result = compare_models.invoke("Explain quantum entanglement")
Return a Command from a tool to redirect graph control flow — now supported directly in ToolNode without extra wiring.
python
from langchain_core.tools import tool
from langgraph.types import Command

@tool
def escalate_to_human(reason: str) -> Command:
    """Escalate the conversation to a human agent."""
    return Command(goto="human_node", update={"escalation_reason": reason})

# Register with ToolNode as usual — Command routing is handled automatically
from langgraph.prebuilt import ToolNode
tool_node = ToolNode([escalate_to_human])
  • Adds @task decorator (langgraph.func.task) for creating parallel async tasks that return futures, with optional retry policies.
  • Adds @entrypoint decorator (langgraph.func.entrypoint) to wrap regular or generator functions into Pregel graphs as callable entry points.
  • Enables Command objects to be returned directly from LangChain tools via ToolOutputMixin compatibility and ToolNode support.
  • Adds StateGraph support for lists of Command objects and tuple-based state updates in node outputs.
  • Adds _repr_mimebundle_ to Graph for inline Mermaid diagram visualization in Jupyter notebooks.
sdk==0.1.43 NOTES STABLE

LangGraph SDK 0.1.43 adds query-param streaming and expands Command routing flexibility

└──▷ GET THIS VERSION
$ git clone --branch sdk==0.1.43 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout sdk==0.1.43
└──▷ USE IT
Filter a streaming run by passing query parameters directly on the stream call, avoiding manual URL construction.
python
async for chunk in client.stream(
    assistant_id,
    thread_id,
    input=input_data,
    params={"my_filter": "value", "limit": 10},
):
    print(chunk)
Route a command to multiple destinations using the expanded goto field that now accepts a sequence of Send objects or node-name strings.
python
from langgraph.types import Command, Send

cmd = Command(goto=[Send("node_a", {"x": 1}), "node_b"])
  • Adds optional params argument to HttpClient.stream() (async and sync) so query parameters can be passed with streaming requests.
  • Expands Command TypedDict's goto field to accept Send, str, or a sequence of either, enabling richer graph routing in command structures.
└──▷ BREAKING ON UPGRADE
  • !The Command TypedDict field send is renamed to goto; any code referencing Command(send=...) will break on upgrade.
0.2.55 NOTES STABLE

LangGraph 0.2.55 overhauls interrupt/resume with scratchpad tracking and consolidates Send into the goto field

└──▷ GET THIS VERSION
$ git clone --branch 0.2.55 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.55
└──▷ USE IT
Pass both a static node name and a dynamic Send object in a single Command, now that goto accepts both types.
python
from langgraph.types import Command, Send

# Route to a named node and dynamically send a message to another node
cmd = Command(goto=["review_node", Send("process_node", {"input": data})])
Handle multiple sequential interrupts inside one node reliably — the rewritten interrupt function tracks counts so each resume value is matched correctly.
python
from langgraph.types import interrupt

def my_node(state):
    first_answer = interrupt("Please provide your name")
    second_answer = interrupt("Please provide your role")
    return {"name": first_answer, "role": second_answer}
  • Adds CONFIG_KEY_WRITES constant exposing a read-only list of existing task writes to task configuration
  • Adds CONFIG_KEY_SCRATCHPAD constant providing temporary storage scoped to the current task
  • Rewrites the interrupt function with interrupt-count tracking to correctly handle multiple interrupts within the same node
  • Enables goto field on Command to accept both string node names and Send objects, unifying send/goto into one API
  • Deduplicates writes to special channels in PregelLoop.put_writes (last write wins)
└──▷ BREAKING ON UPGRADE
  • !The send field is removed from the Command class; any code passing send= to Command will break — use goto instead.
  • !The CONFIG_KEY_RESUME_VALUE constant is removed; code referencing it directly will break — use CONFIG_KEY_WRITES and CONFIG_KEY_SCRATCHPAD instead.
0.2.54 NOTES STABLE

LangGraph 0.2.54 adds parent-graph command routing, empty-tool ReAct agents, and Command input support for RemoteGraph.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.54 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.54
└──▷ USE IT
Send a command from a subgraph node up to the parent graph to update parent state or redirect control flow.
python
from langgraph.types import Command

def subgraph_node(state):
    # Direct this command at the parent graph instead of the current one
    return Command(goto="some_parent_node", update={"status": "delegated"}, graph=Command.PARENT)
Build a zero-tool ReAct agent for pure LLM reasoning tasks where no external tools are needed.
python
from langgraph.prebuilt import create_react_agent
from langchain_openai import ChatOpenAI

agent = create_react_agent(ChatOpenAI(model="gpt-4o"), tools=[])
result = agent.invoke({"messages": [{"role": "user", "content": "Summarise the history of cryptography."}]})
Pass a Command object directly into a RemoteGraph to resume or redirect a running remote workflow.
python
from langgraph.pregel.remote import RemoteGraph
from langgraph.types import Command

remote = RemoteGraph("my-deployed-graph", url="https://my-langgraph-server")
for chunk in remote.stream(Command(goto="review_node", update={"approved": True}), config={"thread_id": "abc123"}):
    print(chunk)
  • Adds Command.PARENT constant ("__parent__") and a graph field on Command so nodes in a subgraph can route commands up to the parent graph.
  • Adds GraphBubbleUp base exception class and new ParentCommand exception to propagate parent-directed commands cleanly through the graph hierarchy.
  • Enables create_react_agent to accept an empty tools list, producing a simple LLM-only graph without tool-calling plumbing.
  • Enables RemoteGraph.stream and RemoteGraph.invoke to accept Command objects directly as input, with pass-through of additional client kwargs.
  • Graph validation now only requires at least one edge from START; unreachable nodes no longer cause a validation error.
+1 moreshow less
  • Adds Python 3.11+ exception notes in retry mechanisms for richer error diagnostics when tasks fail.
sdk==0.1.42 NOTES STABLE

LangGraph SDK 0.1.42 adds run status filtering, cancel-on-disconnect streaming, and command support in assistant APIs.

└──▷ GET THIS VERSION
$ git clone --branch sdk==0.1.42 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout sdk==0.1.42
└──▷ USE IT
List only runs that are currently pending or running — useful for building dashboards or cleanup scripts that act on in-progress work.
python
runs = await client.runs.list(thread_id="<thread_id>", status="pending")
Stream a run and ensure it is automatically cancelled server-side if your client drops the connection, preventing orphaned background work.
python
async for chunk in client.runs.join_stream(thread_id="<thread_id>", run_id="<run_id>", cancel_on_disconnect=True):
    print(chunk)
Pass a command to an assistant stream to steer execution dynamically at invocation time.
python
async for chunk in client.assistants.stream(assistant_id="<assistant_id>", command=<command>):
    print(chunk)
  • Adds status parameter to RunsAPI.list() to filter runs by execution status.
  • Adds cancel_on_disconnect parameter to RunsAPI.join_stream() to automatically cancel a run when the client disconnects from the stream.
  • Adds command parameter to AssistantAPI.stream(), .create(), and .wait() for finer control over assistant execution.
  • Adds Interrupt type definition and exposes interrupt information on the Thread schema for improved interrupt handling.
checkpointpostgres==2.0.7 NOTES STABLE

langgraph-checkpoint-postgres 2.0.7 adds configurable vector indices (HNSW, IVFFlat, flat) and improved vector search ordering.

└──▷ GET THIS VERSION
$ git clone --branch checkpointpostgres==2.0.7 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout checkpointpostgres==2.0.7
└──▷ USE IT
Use an IVFFlat index with a custom cluster count when you have a large embedding dataset and want to trade recall for speed.
python
from langgraph.store.postgres.base import ANNIndexConfig, IVFFlatConfig

index_config = ANNIndexConfig(
    kind="ivfflat",
    ann_index_config=IVFFlatConfig(nlist=256),
)
  • Adds ANNIndexConfig with a kind field to select vector index type: 'hnsw', 'ivfflat', or 'flat'.
  • Adds HNSWConfig class for tuning HNSW indices via m (max connections per layer) and ef_construction (dynamic candidate list size).
  • Adds IVFFlatConfig class for tuning IVFFlat indices via nlist (number of inverted lists/clusters).
  • Adds automatic vector index creation in BasePostgresStore based on the supplied index configuration.
  • Adds condition field to Migration to support conditional migration execution based on store configuration.
Was this useful?

Letta (formerly MemGPT)

Sources Release notes → 0.6.7 7 RELEASES · 2024-12-04 → 2024-12-31 NOTES STABLE

Letta 0.6.7 adds error codes to Composio errors, a template ID field for agent creation, and message type literals to usage stats.

└──▷ GET THIS VERSION
$ git clone --branch 0.6.7 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:
$ git checkout 0.6.7
  • Adds template_id field to the create agent request, enabling agents to be created from templates.
  • Adds message type literal to usage stats responses for finer-grained consumption tracking.
  • Adds error codes to Composio errors and makes Composio error catching more verbose and granular.
  • Stores handle in configs for improved identity tracking across configurations.
6 more releases in this issue · 2024-12-04 → 2024-12-31
0.6.6 NOTES STABLE

Letta 0.6.6 adds ConditionalToolRules, two new error types, non-pro model support, and SDK renames for tools and inner monologue.

└──▷ GET THIS VERSION
$ git clone --branch 0.6.6 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:
$ git checkout 0.6.6
  • Adds ConditionalToolRules to the SDK for expressing conditional logic around tool execution order and constraints.
  • Adds RateLimitExceededError error class to surface rate-limit failures explicitly in application code.
  • Adds ContextWindowExceededError error class to surface context-window overflow failures explicitly in application code.
  • Renames function to tool throughout the SDK, aligning SDK terminology with the tool abstraction.
  • Renames internal_monologue field in the SDK (internal monologue surface renamed).
+1 moreshow less
  • Extends model support to non-pro model tiers.
└──▷ BREAKING ON UPGRADE
  • !The function naming in the SDK is renamed to tool — any code referencing the old function-named surfaces will need to be updated.
  • !The internal_monologue field is renamed in the SDK — any code referencing the old name will break.
0.6.5 NOTES STABLE

Letta 0.6.5 adds tool call stdout/stderr logs in FunctionResponse and simplifies agent creation with <provider>/<model> shorthand.

└──▷ GET THIS VERSION
$ git clone --branch 0.6.5 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:
$ git checkout 0.6.5
└──▷ TRY IT
Create an agent using the new shorthand llm and embedding fields with a capped context window and per-block memory limits.
$ curl --request POST \
  --url http://localhost:8283/v1/agents/ \
  --header 'Content-Type: application/json' \
  --data '{
    "memory_blocks": [
      {"value": "Name: Sarah", "limit": 5000, "label": "human"},
      {"value": "I am a helpful assistant", "label": "persona"}
    ],
    "llm": "anthropic/claude-3-5-sonnet-20241022",
    "embedding": "openai/text-embedding-ada-002",
    "context_window_limit": 15000
  }'
  • Simplifies agent creation via POST /v1/agents/ by accepting llm and embedding fields in <provider>/<model> format (e.g. anthropic/claude-3-5-sonnet-20241022, openai/text-embedding-ada-002) instead of full configuration objects.
  • Adds context_window_limit field and per-block limit field to POST /v1/agents/ request body, allowing callers to cap the context window size and set character limits on individual memory blocks (e.g. human/persona).
  • Exposes stdout and stderr logs from tool execution in the FunctionResponse object, viewable in the ADE alongside the tool response.
  • Adds an init tool rule for the Anthropic endpoint.
  • Publishes multiplatform Docker images.
+1 moreshow less
  • Separates Passages into distinct database tables.
0.6.3 NOTES STABLE

Letta 0.6.3 adds Python 3.13 support, local HTTPS mode, file support, and a simplified agent-creation REST API.

└──▷ GET THIS VERSION
$ git clone --branch 0.6.3 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:
$ git checkout 0.6.3
└──▷ TRY IT
Create an agent with minimal fields now that tools and agent type default automatically.
$ curl --request POST \
  --url http://localhost:8283/v1/agents/ \
  --header 'Content-Type: application/json' \
  --data '{
  "memory_blocks": [
    {"value": "The human name is Bob the Builder", "label": "human"},
    {"label": "persona", "value": "My name is Sam, the all-knowing sentient AI."}
  ],
  "llm_config": {
    "model": "gpt-4o-mini",
    "model_endpoint_type": "openai",
    "model_endpoint": "https://api.openai.com/v1",
    "context_window": 16000
  },
  "embedding_config": {
    "embedding_endpoint_type": "openai",
    "embedding_endpoint": "https://api.openai.com/v1",
    "embedding_model": "text-embedding-3-small",
    "embedding_dim": 8191
  }
}'
  • Simplifies the POST /v1/agents/ REST API for agent creation — tools and agent type now have defaults, reducing the required payload to memory_blocks, llm_config, and embedding_config.
  • Adds local HTTPS mode support to the server.
  • Adds file support via the new files feature.
  • Adds logs to the response for tool runs.
  • Supports Python 3.13, with upgraded dependencies to match.
0.6.2 NOTES STABLE

Letta 0.6.2 adds an async messages API route, system message support for OSS and Anthropic models, and a streamlined Docker single-command setup.

└──▷ GET THIS VERSION
$ git clone --branch 0.6.2 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:
$ git checkout 0.6.2
└──▷ TRY IT
Run the full Letta service locally with persisted storage and an OpenAI key, no docker-compose required.
$ docker run \
  -v ~/.letta/.persist/pgdata:/var/lib/postgresql/data \
  -p 8283:8283 \
  -e OPENAI_API_KEY="your_api_key" \
  letta/letta
  • Adds async messages API endpoint POST /agent/{agent_id}/messages/async to support long-running agent execution without blocking.
  • Adds system message support for OSS models (via ChatML wrapper) and Anthropic models in the send_message route.
  • Updates Dockerfile so the Letta service can be run with a single docker run command, mounting a data volume at /var/lib/postgresql/data and accepting credentials via OPENAI_API_KEY env var or --env-file .env.
  • Introduces an offline memory agent capability.
0.6.1 NOTES STABLE

Letta 0.6.1 adds external codebase sandboxes for tool execution and improved venv error surfacing.

└──▷ GET THIS VERSION
$ git clone --branch 0.6.1 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:
$ git checkout 0.6.1
  • Supports external codebases as a tool execution sandbox, enabling tools to run inside third-party code environments.
  • Parses and surfaces errors from venv local sandbox execution so failures are visible rather than silent.
  • Returns HTTP 404 when a requested source does not exist, making missing-resource errors explicit.
0.6.0 NOTES STABLE

Letta 0.6.0 adds E2B tool sandboxing, ADE server password protection, Composio sandbox support, and new memory-block and tool-test APIs.

└──▷ GET THIS VERSION
$ git clone --branch 0.6.0 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:
$ git checkout 0.6.0
└──▷ TRY IT
Run tool execution in an isolated E2B cloud sandbox instead of the local process — useful when tools run untrusted or side-effectful code.
$ export E2B_API_KEY=your_e2b_key
export E2B_SANDBOX_TEMPLATE_ID=your_template_id
letta server
Password-protect your local Letta server so it can still be reached by the ADE without exposing an unauthenticated endpoint.
$ export LETTA_SERVER_PASSWORD=password
letta server --ade --secure --port=8283
  • Enables E2B tool sandboxing by setting E2B_API_KEY and E2B_SANDBOX_TEMPLATE_ID environment variables, isolating tool execution in a remote sandbox.
  • Adds --secure flag and LETTA_SERVER_PASSWORD environment variable to letta server so a password-protected local server can still connect to the ADE.
  • Adds endpoints to add default E2B and local sandbox configurations (via the sandbox config API).
  • Adds a POST /v1/tools/run route for testing tool execution by tool_id without running a full agent loop.
  • Adds endpoints to list Composio apps and actions, and adds Composio tools compatibility inside sandboxes.
+5 moreshow less
  • Adds routes for adding/linking new memory blocks to agents and unlinking blocks from agents.
  • Adds a dedicated streaming route, separating streaming from the standard send-message path.
  • Adds per-agent locking on send_message to prevent concurrent state corruption.
  • Supports Pydantic models in tool uploads, plus patched dict/list type handling in tool schemas.
  • Supports passing custom headers to RESTClient for downstream API calls.
└──▷ BREAKING ON UPGRADE
  • !The POST /v1/tools (create_tool) endpoint on v1 routes now errors on duplicate tools instead of upserting.
Was this useful?

Microsoft AutoGen

Sources Release notes → v0.2.40 NOTES

AutoGen v0.2.40 adds a warning when no eligible speaker is found in group chats.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.40 https://github.com/microsoft/autogen.git
# already have the repo? check out this version:
$ git checkout v0.2.40
  • Adds a warning message when no eligible speaker is available in a group chat (NoEligibleSpeaker), surfacing silent failures that previously went unnoticed.
Was this useful?

PydanticAI

Sources Release notes → v0.0.16 7 RELEASES · 2024-12-04 → 2024-12-30 NOTES STABLE

PydanticAI v0.0.16 adds multi-agent support, extends RunContext, and brings Ollama API key config and nested capture_run_messages.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.16 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:
$ git checkout v0.0.16
  • Adds capture_run_messages support for nested agent calls, enabling message capture across multi-agent workflows.
  • Extends RunContext with additional fields/methods to expose more context inside tool and result functions.
  • Adds Ollama API key configuration support for authenticating against Ollama endpoints.
  • Introduces multi-agent usage patterns, allowing agents to delegate to or call other agents.
  • Adds support for X | None = None optional type annotations with the Gemini provider.
6 more releases in this issue · 2024-12-04 → 2024-12-30
v0.0.15 NOTES STABLE

PydanticAI v0.0.15 adds capture_run_messages for message capture and optimizes Mistral model support.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.15 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:
$ git checkout v0.0.15
  • Adds capture_run_messages to replace last_run_messages for capturing run messages.
  • Adds a default to ResultData so agents no longer require an explicit result-type argument.
  • Optimizes Mistral model integration for improved performance.
  • Tool calls are now prioritized over eager text responses when a model returns both.
└──▷ BREAKING ON UPGRADE
  • !last_run_messages is removed; replace all uses with capture_run_messages.
v0.0.14 NOTES STABLE

PydanticAI v0.0.14 adds usage limits, renames Cost to Usage, and supports the openai:o1 model.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.14 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:
$ git checkout v0.0.14
  • Renames Cost to Usage across the library — callers must update any references to the old name.
  • Adds support for usage limits via the new Usage tracking infrastructure.
  • Adds openai:o1 model support.
└──▷ BREAKING ON UPGRADE
  • !Cost is renamed to Usage — any code referencing Cost will break on upgrade.
v0.0.13 NOTES STABLE

PydanticAI v0.0.13 adds Mistral and Anthropic support, new ModelSettings, Gemini 2.0 Flash, and a reworked message format.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.13 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:
$ git checkout v0.0.13
└──▷ USE IT
Point an OpenAI-compatible agent at a local or self-hosted inference server without changing the rest of your agent code.
python
from pydantic_ai import Agent
from pydantic_ai.models.openai import OpenAIModel

model = OpenAIModel('llama-3', base_url='http://localhost:11434/v1')
agent = Agent(model)
result = agent.run_sync('Summarize the threat report.')
print(result.data)
Use the new Mistral provider to run an agent against a Mistral model.
python
from pydantic_ai import Agent
from pydantic_ai.models.mistral import MistralModel

agent = Agent(MistralModel('mistral-large-latest'))
result = agent.run_sync('List the top 5 OWASP API risks.')
print(result.data)
  • Adds base_url kwarg to OpenAIModel to point the client at any OpenAI-compatible endpoint (e.g. local or self-hosted inference servers).
  • Adds messages field to RunContext so tool functions can inspect the full conversation history mid-run.
  • Adds ToolReturnPart message part to pydantic_ai.messages, emitted for every tool call result and included in the message stream.
  • Adds basic ModelSettings class for passing model-level configuration (temperature, etc.) to agent runs.
  • Adds Mistral model support as a new first-class provider.
+6 moreshow less
  • Adds non-streaming Anthropic model support.
  • Adds gemini-2.0-flash-exp to the supported Gemini model names.
  • Adds llama-3.3-70b-versatile to GroqModelName.
  • Supports tool calling when a structured result type is also provided, allowing both to be used simultaneously.
  • Reformats message history as a simple list[ModelRequest | ModelResponse], unifying request and response representations across all providers.
  • Streamed response messages are now captured and included in the message history.
└──▷ BREAKING ON UPGRADE
  • !The message format has changed significantly; existing stored or serialized messages are incompatible with the new list[ModelRequest | ModelResponse] structure.
  • !ToolReturnPart is now emitted for every tool call, adding more message parts than previous releases — code that iterates or counts message parts will see different results.
  • !The field tool_id has been renamed to tool_call_id across message types.
v0.0.12 NOTES STABLE

PydanticAI v0.0.12 adds Ollama support, dynamic tools, and tool-result generation for structured outputs.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.12 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:
$ git checkout v0.0.12
  • Adds Ollama as a supported model provider, enabling local LLM inference within PydanticAI agents.
  • Introduces dynamic tools, allowing tool definitions to be resolved or modified at runtime rather than statically at agent construction.
  • Enables tool-result generation when using structured result types, so structured-output workflows now produce proper tool result messages alongside the response.
v0.0.10 NOTES STABLE

PydanticAI v0.0.10 adds Agent.name for identifying agents in traces and logs.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.10 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:
$ git checkout v0.0.10
└──▷ USE IT
Assign a name to an agent so it appears identifiably in Logfire traces or logs.
python
from pydantic_ai import Agent

agent = Agent('openai:gpt-4o', name='support-agent')
  • Adds Agent.name attribute to label agent instances, enabling identification in observability output.
v0.0.9 NOTES STABLE

PydanticAI v0.0.9 lets you register tools at Agent construction time and return any type from tool functions.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.9 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:
$ git checkout v0.0.9
  • Adds tools parameter to Agent(tools_=[...]) constructor, allowing tools to be registered at instantiation rather than only via decorators.
  • Allows tool functions to return Any type, removing the previous restriction that tool return values had to be a specific type.
Was this useful?

Microsoft Semantic Kernel

Sources Release notes → python-1.17.1 3 RELEASES · 2024-12-05 → 2024-12-19 NOTES STABLE

Semantic Kernel Python 1.17.1 adds Ollama streaming tool calls, new OpenAI execution settings, and a per-request tool limit.

└──▷ GET THIS VERSION
$ git clone --branch python-1.17.1 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout python-1.17.1
└──▷ USE IT
Attach a response store reference and custom metadata to an OpenAI prompt execution call.
python
from semantic_kernel.connectors.ai.open_ai import OpenAIPromptExecutionSettings

settings = OpenAIPromptExecutionSettings(
    store="my-response-store",
    metadata={"session_id": "abc123", "user": "alice"}
)

result = await kernel.invoke_prompt(
    prompt="Summarize the following document.",
    settings=settings
)
  • Adds store and metadata properties to OpenAIPromptExecutionSettings for richer prompt execution control.
  • Enables streaming tool calls for the Ollama integration.
  • Introduces a function_invoke_attempt index included with Streaming Chat Message Content (CMC) for tracking per-function invocation attempts.
  • Adds agent name field regex validation to enforce naming constraints on agents.
  • Includes the sessions plugin status key in the plugin return value.
+1 moreshow less
  • Adds tool limit adjustment per request via TaoChenOSU's contribution.
2 more releases in this issue · 2024-12-05 → 2024-12-19
dotnet-1.32.0 NOTES STABLE

Semantic Kernel .NET 1.32.0 adds Structured Outputs in prompts, declarative agents, MistralAI image content, and a Gemini MIME-type parameter.

└──▷ GET THIS VERSION
$ git clone --branch dotnet-1.32.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout dotnet-1.32.0
  • Adds responseMimeType parameter to GeminiPromptExecutionSettings for explicit control over output MIME type.
  • Adds Structured Outputs support in prompts, enabling schema-constrained LLM responses directly from prompt templates.
  • Adds declarative agents support, allowing agents to be defined and loaded declaratively.
  • Adds image content support for MistralAI function calling.
  • Adds OpenAPI operations filtering, with new samples demonstrating how to selectively expose API operations.
python-1.17.0 NOTES STABLE

Semantic Kernel Python 1.17.0 graduates filters and adds streaming usage-data yield for chat completions.

└──▷ GET THIS VERSION
$ git clone --branch python-1.17.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout python-1.17.0
  • Graduates filters out of experimental status, adding an exception when a duplicate filter is added during registration.
  • Yields StreamingChatMessageContent directly when usage data is available during streaming chat completion responses.
Was this useful?

browser-use

Sources Release notes → 0.1.17 2 RELEASES · 2024-12-03 → 2024-12-10 NOTES STABLE

browser-use 0.1.17 enables multi-step output from the model for up to 10x faster form filling

└──▷ GET THIS VERSION
$ git clone --branch 0.1.17 https://github.com/browser-use/browser-use.git
# already have the repo? check out this version:
$ git checkout 0.1.17
  • Model can now output multiple steps at once, delivering up to 10x performance improvements in form-filling and similar multi-action workflows.
  • More robust CSS selectors for more reliable element targeting.
  • Expanded attribute inclusion in the DOM representation for richer context.
  • Improved handling of multiple concurrent browser instances.
1 more release in this issue · 2024-12-03 → 2024-12-10
0.1.16 NOTES STABLE

browser-use 0.1.16 enables parallel multi-agent browsing with multiple contexts per browser instance and trace/replay saving

└──▷ GET THIS VERSION
$ git clone --branch 0.1.16 https://github.com/browser-use/browser-use.git
# already have the repo? check out this version:
$ git checkout 0.1.16
  • Supports spinning up multiple browser contexts per browser instance, enabling parallel execution of as many agents as needed simultaneously.
  • Adds the ability to save traces and replays of browser agent sessions.
  • Improved DOM processing for more reliable page interaction.
└──▷ BREAKING ON UPGRADE
  • !The controller is detached from browser state — code that previously coupled the controller to browser state will break.
  • !The browser service is split into separate browser and context components — any code referencing the unified browser service must be updated to address them separately.
Was this useful?

camel-ai

Sources Release notes → v0.2.14 3 RELEASES · 2024-12-04 → 2024-12-18 NOTES STABLE

camel-ai v0.2.14 adds an Outlines converter model for structured output and support for the OpenAI O1 model.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.14 https://github.com/camel-ai/camel.git
# already have the repo? check out this version:
$ git checkout v0.2.14
  • Adds OutlinesConverter model for structured output generation via the Outlines integration.
  • Supports the OpenAI O1 model.
2 more releases in this issue · 2024-12-04 → 2024-12-18
v0.2.12 NOTES STABLE

camel-ai v0.2.12 adds Brave Search, SGLang, e2b, Stripe, reward models, structured outputs, and HuggingFace dataset upload.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.12 https://github.com/camel-ai/camel.git
# already have the repo? check out this version:
$ git checkout v0.2.12
  • Adds structured output support for ChatAgent using the OpenAI beta client, enabling typed response schemas from chat interactions.
  • Adds structured output support for Ollama models, enabling schema-constrained responses from locally hosted Ollama instances.
  • Integrates the Brave Web Search API into the search toolkit, giving agents a new web-search backend.
  • Integrates SGLang as a new inference backend in CAMEL.
  • Integrates e2b as a new code execution/sandbox backend.
+6 moreshow less
  • Integrates Stripe as a new toolkit, enabling agents to interact with payment workflows.
  • Adds a reward model component for scoring and evaluating agent outputs.
  • Adds a data collector for dataset generation pipelines.
  • Adds a pipeline to fetch and upload data to HuggingFace datasets.
  • Adds the llama3.3_70B model to the supported model registry.
  • Adds the GAIA benchmark for evaluating agent capabilities.
v0.2.11 NOTES STABLE

camel-ai v0.2.11 adds ModelManager scheduling, NVIDIA platform support, Meshy 3D integration, and structured output improvements.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.11 https://github.com/camel-ai/camel.git
# already have the repo? check out this version:
$ git checkout v0.2.11
└──▷ USE IT
Convert a prompt-response pair into a validated Alpaca training record for fine-tuning dataset construction.
python
from camel.data_collector import AlpacaItem

item = AlpacaItem(instruction='Explain XSS', input='', output='Cross-site scripting is...')
print(item.model_dump())
  • Adds ModelManager class to schedule and load-balance calls across multiple model backends.
  • Adds NVIDIA model platform support, expanding available backends alongside existing OpenAI/Azure/Mistral integrations.
  • Adds logprobs handling in choice response objects, enabling access to token-level log probabilities from model completions.
  • Adds AlpacaItem pydantic class for easy conversion, validation, and structured Alpaca-format output generation.
  • Supports OpenAI structured output as a typed object, enabling schema-validated responses from OpenAI models.
+5 moreshow less
  • Expands CodeExecutionToolkit with additional interpreter backends beyond the existing default.
  • Integrates Meshy text-to-3D model generation as a new toolkit, allowing agents to produce 3D models from text prompts.
  • Adds structured logging support throughout the library.
  • Allows manual addition of filename metadata to documents, with normalized extra metadata fields.
  • Removes api_keys_required constraint for Firecrawl integration to support self-hosted deployments.
Was this useful?

holmesgpt

Sources Release notes → 0.7.2 2 RELEASES · 2024-12-06 → 2024-12-10 NOTES STABLE

SRE Agent - CNCF Sandbox Project

HolmesGPT 0.7.2 adds the ability to fetch deployment configuration data during investigations.

└──▷ GET THIS VERSION
$ git clone --branch 0.7.2 https://github.com/HolmesGPT/holmesgpt.git
# already have the repo? check out this version:
$ git checkout 0.7.2
  • Adds option to fetch deployment config, expanding the Kubernetes context available during investigations.
1 more release in this issue · 2024-12-06 → 2024-12-10
0.7.1 NOTES STABLE

HolmesGPT 0.7.1 adds WatsonX support, kubectl events, grep log search, and memory-request inspection tools.

└──▷ GET THIS VERSION
$ git clone --branch 0.7.1 https://github.com/HolmesGPT/holmesgpt.git
# already have the repo? check out this version:
$ git checkout 0.7.1
  • Adds kubectl_logs_grep tool, enabling Holmes to search pod logs using grep (upgraded to grep -E extended regex) to surface relevant log lines faster.
  • Adds a tool to fetch top memory requests across the cluster, giving the LLM visibility into resource consumption.
  • Adds kubectl events capability so Holmes can retrieve and reason over Kubernetes events during investigations.
  • Enables the LLM to fetch logs from all containers or a specific container within a pod, expanding container-level log coverage.
  • Adds IBM WatsonX as a supported LLM backend, broadening model provider options.
+2 moreshow less
  • Adds tag support to the ask holmes command, allowing queries to be scoped or annotated with tags.
  • Adds LLM evaluations framework for testing and benchmarking Holmes response quality.
Was this useful?
◆  Local LLM Runtimes

Jan AI Jan

Sources Release notes → v0.5.12 3 RELEASES · 2024-12-03 → 2024-12-30 NOTES STABLE

Jan v0.5.12 adds chat width settings, product analytics UI, and routes all thread/message requests through the cortex.cpp backend.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.12 https://github.com/janhq/jan.git
# already have the repo? check out this version:
$ git checkout v0.5.12
  • Adds a chat width setting option for threads, letting users adjust the thumbnail/input box width from the thread settings panel.
  • Reroutes all threads and messages API requests to the cortex.cpp backend, deprecating Jan core's REST module.
  • Adds a product analytics UI for usage insights.
  • Updates the macOS app download to a universal binary supporting both Apple Silicon and Intel.
  • Improves error handling for remote models when there is no internet connection.
+4 moreshow less
  • Defaults the Jan Input Box Settings and Right panel to open on launch.
  • Adds OpenAI gpt-4o-mini and o1 models to the remote model roster.
  • Moves token speed display to the bottom of the chat interface.
  • Sets the recommended model to undefined when no model is available, preventing stale model references.
2 more releases in this issue · 2024-12-03 → 2024-12-30
v0.5.11 NOTES STABLE

Jan v0.5.11 adds a universal macOS build supporting both Apple Silicon and Intel in a single binary.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.11 https://github.com/janhq/jan.git
# already have the repo? check out this version:
$ git checkout v0.5.11
  • Adds a universal macOS binary that runs natively on both Apple Silicon and Intel Macs without Rosetta translation.
v0.5.10 NOTES STABLE

Jan v0.5.10 adds stop word model settings, more Groq models, Anthropic model updates, and an increased Claude 3.5 max-token limit.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.10 https://github.com/janhq/jan.git
# already have the repo? check out this version:
$ git checkout v0.5.10
  • Adds stop word model setting, letting users define stop sequences directly in model configuration.
  • Increases the max-token limit for Claude 3.5 models.
  • Adds more Groq models to the model selection.
  • Adds updated Anthropic model options including newer Claude variants.
  • Updates Jan's client request handling to adapt to API changes from Cortex.
Was this useful?

KoboldCpp

Sources Release notes → v1.80.3 NOTES

KoboldCpp v1.80.3 adds Qwen2-VL multimodal support, Vulkan coopmat1 acceleration, new CLI flags, and LaTeX rendering in Kobold Lite.

└──▷ GET THIS VERSION
$ git clone --branch v1.80.3 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.80.3
└──▷ TRY IT
Offload draft model layers to GPU for faster speculative decoding on a multi-GPU system.
$ koboldcpp --model main_model.gguf --draftmodel draft_model.gguf --draftgpulayers 20 --draftgpusplit 0.6,0.4
Run KoboldCpp with Qwen2-VL multimodal support enabled using a vision projection model.
$ koboldcpp --model Qwen2-VL-7B-Instruct-Q4_K_M.gguf --mmproj mmproj-Qwen2-VL-7B.gguf --usecublas
  • Adds --moeexperts flag to overwrite the number of experts used in MoE models.
  • Adds --failsafe flag to explicitly disable all CPU intrinsics and GPU usage.
  • Adds --draftgpulayers flag to set the number of layers offloaded for a speculative decoding draft model.
  • Adds --draftgpusplit flag to set GPU layer distribution ratio for the draft model across multiple GPUs (defaults to same as main model).
  • Adds suppress_non_speech field to the Whisper API, enabling suppression of noise annotation logits (e.g. barking, doorbell, chime, muzak).
+11 moreshow less
  • Adds q as a URL query alias for query in Kobold Lite (e.g. http://localhost:5001?q=what+is+love).
  • MMQ is now the default for CLI; use the nommq flag to disable (e.g. --usecublas all nommq).
  • Adds multimodal image support for Qwen2-VL (2B and 7B) via mmproj; works on CUDA and CPU backends.
  • Vulkan backend gains coopmat1 support, delivering significantly faster inference on modern Nvidia cards.
  • Restores support for ARM quants (e.g. Q4_0_4_4) in KoboldCpp.
  • Adds LaTeX rendering in Kobold Lite using standard \[...\], \(...\), and $$...$$ syntax alongside markdown.
  • Adds support for AllTalk v2 API in Kobold Lite (AllTalk v1 remains supported automatically).
  • Adds support for Mantella XTTS (XTTS fork) in Kobold Lite.
  • Kobold Lite gains manual audio file upload for transcription via settings.
  • Handles additional generation parameters in Ollama API emulation.
  • Default image generation sampler changed to Euler.
└──▷ BREAKING ON UPGRADE
  • !trim_stop now defaults to true; setups that expected stop sequences to appear in output will no longer receive them without explicitly setting trim_stop to false.
  • !MMQ is now the default for CLI; existing CLI invocations relying on non-MMQ behavior must add nommq (e.g. --usecublas all nommq) to preserve prior behavior.
Was this useful?

LocalAI

Sources Release notes → v2.24.0 NOTES

LocalAI v2.24.0 adds bark.cpp and stablediffusion.cpp backends, silero-vad speech detection, WebUI API key auth, and new P2P config options.

└──▷ GET THIS VERSION
$ git clone --branch v2.24.0 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v2.24.0
└──▷ TRY IT
Generate audio from text locally using the new bark.cpp backend in a single command.
$ local-ai run bark-cpp-small
Install the silero-vad model to enable speech segment detection in audio streams.
$ local-ai models install silero-vad
  • Adds bark.cpp backend for transformer-based text-to-audio generation, installable via local-ai models install bark-cpp-small or runnable with local-ai run bark-cpp-small.
  • Adds stablediffusion.cpp backend for ggml-powered image generation from text descriptions.
  • Adds silero-vad backend for voice activity detection in audio streams, installable via local-ai models install silero-vad or configurable through the WebUI.
  • Adds P2P configuration keys listen_maddrs, dht_announce_maddrs, and bootstrap_peers for fine-grained control of peer-to-peer node addressing and connectivity.
  • WebUI now supports API key authentication, automatically prompting for a key when one or more API keys are configured.
+1 moreshow less
  • Adds real-time token usage reporting during streamed outputs.
└──▷ BREAKING ON UPGRADE
  • !The rwkv.cpp backend has been removed; RWKV model support now routes through llama.cpp.
  • !The bert.cpp backend has been dropped; its functionality is now integrated into llama.cpp.
Was this useful?

SGLang

Sources Release notes → v0.4.1 2 RELEASES · 2024-12-04 → 2024-12-25 NOTES STABLE

SGLang v0.4.1 adds DeepSeek V3 support, a dynamic-scaling fault-tolerant router with /add_worker and remove-worker APIs, MoE Expert Parallel, gemlite quantization, and the new sgl-kernel package.

└──▷ GET THIS VERSION
$ git clone --branch v0.4.1 https://github.com/sgl-project/sglang.git
# already have the repo? check out this version:
$ git checkout v0.4.1
└──▷ TRY IT
Dynamically add a new worker to a running SGLang router without restarting the cluster.
$ curl -X POST http://<router-host>:<port>/add_worker -H 'Content-Type: application/json' -d '{"worker_url": "http://<new-worker-host>:<worker-port>"}'
  • Adds /add_worker API to the SGLang native router, enabling dynamic worker registration at runtime.
  • Adds remove-worker API to the SGLang native router, enabling dynamic worker deregistration and cleanup.
  • Adds lora_path field to chat completion requests and lora_paths to v1_chat_generate_request, enabling per-request LoRA adapter selection.
  • Introduces sgl-kernel as a standalone PyPI package for custom CUDA/HIP kernels, including a TensorRT-LLM-derived custom all-reduce implementation.
  • Adds support for DeepSeek V3 (FP8) on both NVIDIA and AMD GPUs, including MLA optimization and DP attention.
+13 moreshow less
  • Adds MoE Expert Parallel support.
  • Adds gemlite weight-only quantization integration.
  • Adds chunked prefill support for LLaVA-OneVision multimodal models.
  • Adds support for IBM Granite 3.x models.
  • Adds in-batch prefix caching via delay scheduling.
  • Adds retry-based fault tolerance to the cache-aware SGLang router.
  • Adds health-check on workers before they are added to the router.
  • Adds expanded support for Intel Gaudi accelerators.
  • Adds ROCm support for sglang.check_env.
  • Adds FP8 MoE optimizations for AMD GPUs.
  • Optimizes the Triton decoding kernel for long-context inference.
  • Makes the maximum request payload size configurable.
  • Makes Tensor Parallelism composable with both torch.compile and torchao.
1 more release in this issue · 2024-12-04 → 2024-12-25
v0.4.0 NOTES STABLE

SGLang v0.4 adds cache-aware load balancing, xgrammar structured outputs, GGUF support, LoRA in Completion API, and Intel Gaudi accelerator support.

└──▷ GET THIS VERSION
$ git clone --branch v0.4.0 https://github.com/sgl-project/sglang.git
# already have the repo? check out this version:
$ git checkout v0.4.0
└──▷ TRY IT
Enable cache-aware load balancing across multiple SGLang workers to maximize KV-cache reuse and throughput.
$ python -m sglang_router.launch_router --policy cache_aware --worker-urls http://worker1:30000 http://worker2:30000
Set CPU core affinity for SGLang workers on a multi-socket host to reduce NUMA overhead.
$ SGLANG_SET_CPU_AFFINITY=1 python -m sglang.launch_server --model-path meta-llama/Llama-3-8B-Instruct --tp 2
  • Adds SGLANG_SET_CPU_AFFINITY environment variable to control CPU core affinity for multi-socket systems (off by default).
  • Renames data-parallelism rank environment variable from DP_RANK to SGLANG_DP_RANK.
  • Adds get_server_info unified API endpoint, merging three previously separate native APIs into one (also exposes SGLang version and max_total_num_tokens).
  • Introduces cache-aware load-balancing router (sglang-router v0.0.10) delivering up to 1.9x throughput increase and 3.8x higher cache hit rate.
  • Adds more API routes to the router (completion, health, and others previously missing).
+15 moreshow less
  • Supports LoRA in the Completion API.
  • Supports GGUF model format loading.
  • Supports input_embeds as input to the engine API.
  • Adds initial support for Intel Gaudi accelerators.
  • Integrates xgrammar for structured outputs, delivering up to 10x faster constrained decoding.
  • Adds the OLMo2 model.
  • Adds CPU offloading support.
  • Adds zero-overhead batch scheduler yielding a 1.1x throughput increase.
  • Adds data parallelism attention for DeepSeek models with up to 1.9x decoding throughput improvement.
  • Adds prefix match routing for specific tenants in the router.
  • Adds profiling support in the offline benchmark tool.
  • Adds fused_moe_triton benchmark and tuning tools for AMD Instinct GPUs.
  • Adds ability to update weights from disk and retrieve weights by parameter name (Llama).
  • Adds a development Dockerfile.
  • Exposes max_total_num_tokens from the Runtime and Engine API.
└──▷ BREAKING ON UPGRADE
  • !The environment variable DP_RANK is renamed to SGLANG_DP_RANK; any deployment setting DP_RANK must update to SGLANG_DP_RANK.
Was this useful?

oobabooga's Text Generation WebUI (textgen)

Sources Release notes → v2.1 2 RELEASES · 2024-12-19 → 2024-12-31 NOTES STABLE

Parameters tab reorganized with grouped controls and new Instruct and Creative presets in oobabooga textgen v2.1

└──▷ GET THIS VERSION
$ git clone --branch v2.1 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v2.1
  • Adds two new built-in presets, Instruct and Creative, replacing 5 removed presets to reduce the default preset list from 11 to 6.
  • Reorganizes the Parameters tab with grouped input fields (sliders, checkboxes) and headings for parameter types (curve shape, curve cutoff) to reduce visual clutter.
  • Reorganizes the Model tab with similar grouping and heading structure.
  • Improves heading, list, and link styling in chat messages.
  • Improves the streaming typing cursor | appearance during chat.
+1 moreshow less
  • Improves chat colors in light mode.
1 more release in this issue · 2024-12-19 → 2024-12-31
v2.0 NOTES STABLE

text-generation-webui v2.0 overhauls the UI with collapsible sidebars, vertical nav, mobile support, and a new --old-colors flag.

└──▷ GET THIS VERSION
$ git clone --branch v2.0 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v2.0
└──▷ TRY IT
Preserve your team's familiar workflow after upgrading by launching with the legacy color palette.
$ python server.py --old-colors
  • Adds --old-colors launch flag to restore the previous UI color scheme for users who prefer the legacy look.
  • Allows more granular KV cache settings.
  • Redesigns the UI with a vertical left sidebar replacing the top navigation bar (Chat / Default / Notebook tabs).
  • Adds collapsible sidebars for improved mobile navigation.
  • Moves the 'past chats' menu into its own sidebar, visually separated from the chat area.
+1 moreshow less
  • Improves HTML rendering for nested lists with sub-items.
Was this useful?

vLLM

Sources Release notes → v0.6.6.post1 3 RELEASES · 2024-12-17 → 2024-12-27 NOTES STABLE

vLLM v0.6.6.post1 adds FlashInfer sampling kernels for Top-P and Top-K in V1 and restores quantized MoE support.

└──▷ GET THIS VERSION
$ git clone --branch v0.6.6.post1 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.6.6.post1
  • Uses FlashInfer sampling kernel for Top-P and Top-K sampling in the V1 engine, improving sampling performance.
  • Reduces task switching in the V1 API server and improves abort handling for more efficient request lifecycle management.
2 more releases in this issue · 2024-12-17 → 2024-12-27
v0.6.6 NOTES STABLE

vLLM v0.6.6 adds DeepSeek V3 support, online pooling API, S3 model streaming, and V1 engine milestones including VLM prefix caching.

└──▷ GET THIS VERSION
$ git clone --branch v0.6.6 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.6.6
└──▷ TRY IT
Serve DeepSeek V3 across 8 GPUs with an 8K context window on H200 or MI300x hardware.
$ vllm serve deepseek-ai/DeepSeek-V3 --tensor-parallel-size 8 --trust-remote-code --max-model-len 8192
  • Adds --enable-request-id-headers flag to opt in to X-Request-ID echoing (now off by default for performance).
  • Adds --tensor-parallel-size flag support for serving DeepSeek V3 on 8xH200 or MI300x via vllm serve deepseek-ai/DeepSeek-V3 --tensor-parallel-size 8 --trust-remote-code --max-model-len 8192.
  • Adds Online Pooling API for embedding/pooling workloads via the V1 frontend.
  • Supports streaming model weights from S3 using RunAI Model Streamer as an optional loader.
  • Enables loading video inputs from base64 encoding via decord in multimodal requests.
+9 moreshow less
  • Adds Cutlass 2:4 sparsity kernel support combined with FP8/INT8 quantization for accelerated sparse inference.
  • Adds prefix caching support for vision-language models (VLMs) in the V1 engine.
  • Adds min-tokens, repetition, presence, and frequency penalties to the V1 sampler.
  • Adds Tensor Parallel Ray executor support to the V1 engine.
  • Supports IBM Granite 3.1 and JambaForSequenceClassification models.
  • Adds QVQ and QwQ to the list of supported models.
  • Adds PyPI index for every commit and nightly build for easier pre-release installation.
  • Supports automatic conversion of classification and reward models.
  • Adds DeepSeek V3 w8a8 FP8 block-wise quantization support.
└──▷ BREAKING ON UPGRADE
  • !X-Request-ID header echoing is now opt-in instead of on by default; existing deployments that rely on it must add --enable-request-id-headers to re-enable it.
v0.6.5 NOTES STABLE

vLLM v0.6.5 adds xgrammar guided decoding, new model support (Aria, GLM-4, Cross Encoders), AWQ/GPTQ on XPU, TPU prefix caching, and a --version CLI flag.

└──▷ GET THIS VERSION
$ git clone --branch v0.6.5 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.6.5
└──▷ TRY IT
Check the installed vLLM version directly from the CLI without starting a server.
$ vllm --version
  • Adds --version flag to the vLLM CLI for quick version inspection.
  • Switches xgrammar as the default guided decoding backend, replacing the previous default.
  • Adds input_audio field support in frontend requests for audio input.
  • Adds automatic detection of chat content format from AST in the frontend, removing the need to manually specify chat format.
  • Adds AWQ and GPTQ quantization support for the XPU backend.
+14 moreshow less
  • Adds GGUF quantization support on AMD ROCm.
  • Enables prefix caching on TPU.
  • Enables chunked-prefill and prefix-caching on CPU.
  • Adds prefix-cache aware scheduling for improved cache utilization.
  • Adds sliding window support to the scheduler.
  • Adds Machete W4A8 quantization kernel support.
  • Adds HQQ quantization support via Marlin kernel expansion.
  • Adds support for new models: Aria, Cross Encoders, GLM-4, OLMo (November 2024), Telechat2, Cohere R7B, and GritLM embeddings.
  • Adds LoRA support for Internlm2, glm-4v, and Pixtral-HF.
  • Expands torch.compile integration to cover all attention backends and encoder-based models, including dynamic FP8 fusion.
  • Adds ARM AARCH64 platform enablement.
  • Adds GH200 GPU support.
  • Reports multi_modal_placeholders in VLM inference output.
  • Adds benchmarking support for structured outputs and vision datasets, including partial prefix benchmarking and random input generation for prefix benchmarks.
└──▷ BREAKING ON UPGRADE
  • !The default temperature for ChatCompletionRequest is changed from 0.7 to 1.0 to align with OpenAI's default.
Was this useful?
◆  AI Model & Data Infrastructure

Ollama

Sources Release notes → v0.5.4 3 RELEASES · 2024-12-04 → 2024-12-17 NOTES STABLE

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Ollama v0.5.4 adds the Falcon3 family of sub-10B models optimised for science, math, and coding.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.4 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.5.4
└──▷ TRY IT
Pull and run a Falcon3 model locally for coding or math tasks.
$ ollama run falcon3
  • Adds Falcon3 model family (sub-10B parameters) with strong performance in science, math, and coding tasks.
2 more releases in this issue · 2024-12-04 → 2024-12-17
v0.5.2 NOTES STABLE

Ollama v0.5.2 adds EXAONE 3.5 bilingual models (2.4B–32B) and case-insensitive OLLAMA_ORIGINS host matching.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.2 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.5.2
  • Adds EXAONE 3.5 instruction-tuned bilingual (English/Korean) models ranging from 2.4B to 32B parameters, developed by LG AI Research.
  • OLLAMA_ORIGINS now matches hosts case-insensitively, simplifying origin allowlist configuration.
└──▷ BREAKING ON UPGRADE
  • !The Linux ollama-linux-amd64.tgz directory structure has changed — manual Linux installations must retain the new directory layout and contents of the tar file after upgrading.
v0.5.0 NOTES STABLE

Ollama v0.5.0 adds JSON-schema structured outputs and experimental KV cache quantization to cut VRAM usage.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.0 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.5.0
└──▷ TRY IT
Enforce a strict JSON schema on model output so downstream code can parse it reliably without extra validation.
$ curl -X POST http://localhost:11434/api/chat -H "Content-Type: application/json" -d '{"model": "llama3.1", "messages": [{"role": "user", "content": "Tell me about Canada."}], "stream": false, "format": {"type": "object", "properties": {"name": {"type": "string"}, "capital": {"type": "string"}, "languages": {"type": "array", "items": {"type": "string"}}}, "required": ["name", "capital", "languages"]}}'
Run Ollama with 4-bit KV cache quantization to fit longer context windows into limited GPU VRAM.
$ OLLAMA_FLASH_ATTENTION=1 OLLAMA_KV_CACHE_TYPE=q4_0 ollama serve
  • Supports structured outputs via JSON schema in the format parameter across the REST API, Python library, and JavaScript library — constraining model responses to a defined shape.
  • Adds Llama 3.3 (70B) model, offering performance comparable to Llama 3.1 405B.
  • Adds Snowflake Arctic Embed 2, a multilingual frontier embedding model.
  • Experimental OLLAMA_KV_CACHE_TYPE env var enables KV cache quantization at 4-bit (q4_0), 8-bit (q8_0), or 16-bit (f16), reducing VRAM requirements for longer context windows.
Was this useful?

NVIDIA Triton Inference Server

Sources Release notes → v2.53.0 NOTES

v2.53.0 adds vLLM health checks, additional vLLM outputs, multi-node Perf Analyzer support, and signed Windows binaries with long-path and UTF-16 model repo support.

└──▷ GET THIS VERSION
$ git clone --branch v2.53.0 https://github.com/triton-inference-server/server.git
# already have the repo? check out this version:
$ git checkout v2.53.0
  • Adds optional vLLM backend health check that automatically unloads the model when the vLLM engine health check fails.
  • Adds support for requesting additional outputs from the vLLM backend beyond default inference results.
  • Adds multi-node process support to Perf Analyzer for TensorRT-LLM workloads.
  • Windows executables and DLLs are now signed by NVIDIA, removing the untrusted-software popup when starting Triton outside administrator mode.
  • Triton on Windows now supports long path notation for model repositories.
+2 moreshow less
  • Triton on Windows now supports wide character encoding (UTF-16) for model repositories.
  • Improved server stability during gRPC client cancellation.
Was this useful?
Other / Uncategorized
◆  AI OBSERVABILITY

Arize Phoenix

Sources Release notes → arize-phoenix-v7.3.0 8 RELEASES · 2024-12-02 → 2024-12-21 NOTES STABLE

Phoenix 7.3.0 adds pretty-printed JSON for structured trace outputs and updated o1 model parameters in the playground.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v7.3.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v7.3.0
  • Tracing UI now pretty-prints JSON strings for structured data outputs, making LLM response inspection easier.
  • Playground updated with current o1 model listing and parameters.
7 more releases in this issue · 2024-12-02 → 2024-12-21
arize-phoenix-evals-v0.18.0 NOTES STABLE

phoenix.evals now supports multimodal message templates for richer LLM evaluation inputs.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-evals-v0.18.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-evals-v0.18.0
  • Enables phoenix.evals to handle multimodal message templates, allowing evaluations over inputs that combine text and other media types.
arize-phoenix-v7.2.0 NOTES STABLE

Phoenix 7.2.0 improves playground template editor ergonomics.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v7.2.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v7.2.0
  • Enhances template editor ergonomics in the playground UI.
arize-phoenix-v7.1.0 NOTES STABLE

Phoenix 7.1.0 adds arbitrary model name entry, Gemini 2.0 Flash support, and prettier JSON rendering in the playground.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v7.1.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v7.1.0
  • Adds support for gemini-2.0-flash-exp as a selectable model in the Playground.
  • Enables arbitrary string model names in the Playground, removing the restriction to a fixed model list.
  • Prettifies JSON mimeType inputs and outputs rendered in the session details pane.
arize-phoenix-v7.0.0 NOTES STABLE

Arize Phoenix v7.0.0 ships a full Sessions feature: grouped trace views, session details UI, and a new project_sessions database table.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v7.0.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v7.0.0
  • Adds a project_sessions database table (via a new Alembic up migration 4ded9e43755f) to group traces into user sessions, with a back-population migration from existing spans data documented in MIGRATION.md.
  • Adds a Sessions table on the project page showing per-session metrics including trace count, error count, trace latency percentiles (p50 and others), and last trace start time.
  • Adds a session details page with per-session trace latency p50 and error counts.
  • Adds navigation from an individual trace view to its parent session.
  • Enables sorting on the sessions table.
+2 moreshow less
  • Adds substring search filtering on sessions based on root span input/output values.
  • Recognizes session_id and user_id attributes on root spans to associate traces with sessions.
└──▷ BREAKING ON UPGRADE
  • !Upgrading requires running the new Alembic database migration (4ded9e43755f) and optionally back-populating the project_sessions table from existing spans data — see MIGRATION.md#v6x-to-v700.
arize-phoenix-v6.2.0 NOTES STABLE

Arize Phoenix 6.2.0 adds timeout parameters to evaluation client calls and auto-pulls prompt template variables from spans into the playground.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v6.2.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v6.2.0
  • Adds timeout parameters to log_evaluations and get_evaluations client methods, giving callers explicit control over request timeouts.
  • Playground now automatically pulls prompt template variables from spans and captures them on playground spans, enabling faster replay and debugging of traced LLM calls.
arize-phoenix-v6.1.0 NOTES STABLE

Phoenix 6.1.0 adds a cancel button for playground runs and inline invocation parameter error display.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v6.1.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v6.1.0
  • Adds a cancel button to stop in-progress playground runs.
  • Shows invocation parameter errors inline within the playground form instead of failing silently.
arize-phoenix-v6.0.0 NOTES STABLE

Phoenix 6.0 ships a Playground UI for interactive LLM prompt testing and adds evaluations to its OpenAPI schema.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v6.0.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v6.0.0
  • Adds evaluations to the OpenAPI schema, exposing evaluation data through the REST API.
  • Releases the Playground feature — an interactive UI for running and comparing LLM prompts against live providers and datasets, with support for the AZURE_OPENAI_API_KEY environment variable for Azure OpenAI.
Was this useful?

Langfuse

Sources Release notes → v3.5.0 9 RELEASES · 2024-12-03 → 2024-12-23 NOTES STABLE

Langfuse v3.5.0 adds an export status table in project settings and inline LLM connection creation from the model selection dropdown.

└──▷ GET THIS VERSION
$ git clone --branch v3.5.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v3.5.0
  • Adds an export status table to project settings, giving practitioners visibility into the state of their data exports.
  • Enables creation of a new LLM connection directly from the LLM selection dropdown, removing the need to navigate away to configure a connection.
  • Switches in-product feedback links to GitHub Discussions and Issues.
8 more releases in this issue · 2024-12-03 → 2024-12-23
v3.4.0 NOTES STABLE

Langfuse v3.4.0 adds PKCE auth support, dataset score/metrics charts, full usage-type model UI, and a JSON editor toggle for text prompts.

└──▷ GET THIS VERSION
$ git clone --branch v3.4.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v3.4.0
└──▷ TRY IT
Enable PKCE-based OAuth code flow for a self-hosted deployment that uses a custom OIDC provider requiring PKCE.
$ AUTH_CUSTOM_CLIENT_AUTH_METHOD=pkce
  • Adds AUTH_CUSTOM_CLIENT_AUTH_METHOD environment variable to enable PKCE code flow for custom OAuth/OIDC authentication clients.
  • Adds charts for scores and resource metrics on dataset run views.
  • Adds UI to configure all usage types when defining models.
  • Adds a JSON editor toggle for text prompts in the prompt UI.
v3.3.0 NOTES STABLE

Langfuse v3.3.0 adds AUTH_IGNORE_ACCOUNT_FIELDS for IDP field sanitization and per-project ingestion traffic routing.

└──▷ GET THIS VERSION
$ git clone --branch v3.3.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v3.3.0
  • Adds AUTH_IGNORE_ACCOUNT_FIELDS environment variable to sanitize identity-provider fields before account creation, preventing unwanted IDP data from being written to user accounts.
  • Enables redirect of ingestion traffic for specific projects to a secondary queue, supporting traffic isolation and prioritization at the project level.
  • Adds an organizations menu item link across all global UI pages for faster cross-organization navigation.
v2.93.7 NOTES STABLE

Langfuse v2.93.7 adds AUTH_IGNORE_ACCOUNT_FIELDS to strip unwanted IDP fields before account creation.

└──▷ GET THIS VERSION
$ git clone --branch v2.93.7 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.93.7
└──▷ TRY IT
Strip IDP-supplied fields (e.g. role or department) that should not be persisted when Langfuse auto-creates accounts from SSO.
$ AUTH_IGNORE_ACCOUNT_FIELDS=role,department docker compose up
  • Adds AUTH_IGNORE_ACCOUNT_FIELDS environment variable to sanitize specified identity-provider fields before a new account is created, preventing unwanted IDP attributes from being stored.
v3.2.0 NOTES STABLE

Langfuse v3.2.0 adds PostHog integration, flexible cost/usage key tracking, and a revamped experiment modal.

└──▷ GET THIS VERSION
$ git clone --branch v3.2.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v3.2.0
  • Adds PostHog integration processing, enabling LLM observability data to flow into PostHog pipelines.
  • Allows additional cost and usage keys in cost tracking, so custom or non-standard model billing fields can be recorded.
  • New experiment modal in the UI highlights both prompt and custom experiments for easier navigation.
v3.1.0 NOTES STABLE

Langfuse v3.1.0 adds editable API key notes, an observations status chart, and optimistic annotation updates.

└──▷ GET THIS VERSION
$ git clone --branch v3.1.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v3.1.0
  • Adds editable notes to each API key in the UI, enabling teams to document the purpose or owner of individual keys.
  • Adds an observations status chart to the dashboard for visualizing the distribution of observation states.
  • Introduces optimistic UI updates on the annotation form for faster, more responsive annotation workflows.
v3.0.0 NOTES STABLE

Langfuse v3 adds async worker container, Clickhouse, S3/Blob storage, and Redis for high-throughput self-hosted deployments, plus KeyCloak and GitHub Enterprise auth.

└──▷ GET THIS VERSION
$ git clone --branch v3.0.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v3.0.0
  • Adds LANGFUSE_POSTGRES_INGESTION_ENABLED environment variable to control whether traces and scores are read from Postgres in v3 self-hosted deployments.
  • Introduces a new worker container for asynchronous event processing, enabling self-hosted Langfuse to handle hundreds of events per second.
  • Adds Clickhouse as the storage backend for traces, observations, and scores; exports and API routes (/api/public/traces, /metrics/daily) now served from Clickhouse.
  • Adds S3/Blob store support for large object storage in self-hosted deployments, with signed AWS S3 image URLs rendered in trace/observation preview.
  • Adds Redis/Valkey for event queuing and data caching in self-hosted setups; ingestion API rate limits doubled.
+10 moreshow less
  • Adds KeyCloak as an authentication provider for self-hosted instances.
  • Adds GitHub Enterprise as an authentication provider.
  • Adds Gemini and Vertex AI support in the playground and evaluations.
  • Increases comment content character limit to 3,000 characters.
  • Adds inline comment button on each trace preview in session view.
  • Adds a UI for monitoring background migration status.
  • Adds a self-hosted Pro plan entitlement tier.
  • Broadens media content type support for trace/observation ingestion.
  • Adds an explicit confirmation prompt before deleting a dataset in the UI.
  • Adds a 'not found' error page for unknown traces and sessions in the UI.
└──▷ BREAKING ON UPGRADE
  • !Self-hosting v3 requires deploying a second worker container and provisioning Clickhouse, S3/Blob store, and Redis/Valkey — existing Postgres-only deployments must follow the v3 migration guide before upgrading.
  • !Batch export S3 environment variable names have been moved into a new naming pattern; existing docker-compose.yml or environment configs using the old names must be updated.
  • !The LANGFUSE_CSP_DISABLE environment variable has been removed (it did not work); any configs referencing it must be cleaned up.
  • !The public users API has been removed; any integrations calling that endpoint will break.
v2.93.3 NOTES STABLE

Langfuse v2.93.3 adds KeyCloak and GitHub Enterprise as authentication providers.

└──▷ GET THIS VERSION
$ git clone --branch v2.93.3 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.93.3
  • Adds KeyCloak as a supported authentication provider.
  • Adds GitHub Enterprise as a supported authentication provider.
v2.93.1 NOTES STABLE

Langfuse v2.93.1 adds an environment variable to optionally disable CSP headers.

└──▷ GET THIS VERSION
$ git clone --branch v2.93.1 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.93.1
  • Adds LANGFUSE_CSP_DISABLE=true environment variable to optionally disable Content Security Policy headers.
Was this useful?

Weights & Biases Weave

Sources Release notes → v0.51.25 3 RELEASES · 2024-12-03 → 2024-12-17 NOTES STABLE

Weave v0.51.25 adds op-level trace sampling, OpenAI moderation/embeddings tracking, and op configuration for autopatched functions.

└──▷ GET THIS VERSION
$ git clone --branch v0.51.25 https://github.com/wandb/weave.git
# already have the repo? check out this version:
$ git checkout v0.51.25
└──▷ USE IT
Limit trace volume in high-throughput pipelines by sampling only a fraction of op calls.
python
import weave

@weave.op(tracing_sample_rate=0.1)
def my_inference(prompt: str) -> str:
    ...
  • Adds tracing_sample_rate param to weave.op to control what fraction of op calls are traced.
  • Supports op configuration for autopatched functions, starting with OpenAI integrations.
  • Adds tracking for OpenAI moderation and embeddings API calls.
  • Adds an error details button in the UI for expanded error inspection.
2 more releases in this issue · 2024-12-03 → 2024-12-17
v0.51.24 NOTES STABLE

Weave v0.51.24 adds named evals, AzureOpenAI scorer support, op code capture, and Anthropic Chat View support.

└──▷ GET THIS VERSION
$ git clone --branch v0.51.24 https://github.com/wandb/weave.git
# already have the repo? check out this version:
$ git checkout v0.51.24
└──▷ USE IT
Give an evaluation a human-readable name so it is easy to find in the Weave UI rather than relying on auto-generated IDs.
python
evaluation = weave.Evaluation(name='my-rag-eval-v1', dataset=dataset, scorers=[scorer])
await evaluation.evaluate(model)
  • Adds AzureOpenAI support for Scorers, enabling Azure-hosted models to be used as LLM judges in evaluations.
  • Adds option to name Weave evaluations, with automatic memorable name generation when no name is specified.
  • Exposes a simple API to retrieve the captured source code for an op.
  • Supports Anthropic calls in the Chat View UI for inspecting traced conversations.
v0.51.23 NOTES STABLE

Weave v0.51.23 adds VertexAI and Google GenAI integrations, Bedrock LLMs in Playground, and a new Scorers section in the side nav.

└──▷ GET THIS VERSION
$ git clone --branch v0.51.23 https://github.com/wandb/weave.git
# already have the repo? check out this version:
$ git checkout v0.51.23
  • Adds send_message patching for the Google GenAI SDK to capture traces automatically.
  • Implements VertexAI integration for tracing calls made through the VertexAI SDK.
  • Adds Amazon Bedrock LLMs to the Playground for interactive model testing.
  • Adds a new scorers section to the side nav bar, enabling creation and viewing of scorers in the UI.
  • Increases call start/end timestamp resolution to microseconds for finer-grained trace timing.
+1 moreshow less
  • Adds an explicit object preparation hook for types that require custom serialization (e.g. PIL.Image.Image).
Was this useful?
◆  VECTOR DB RAG

Chroma

Sources Release notes → 0.6.0 2 RELEASES · 2024-12-05 → 2024-12-30 NOTES STABLE

Chroma 0.6.0 ships SPANN vector index with full query/update/delete, HNSW query pushdown, full-text-search mixins, and a 30% deserialization speedup.

└──▷ GET THIS VERSION
$ git clone --branch 0.6.0 https://github.com/chroma-core/chroma.git
# already have the repo? check out this version:
$ git checkout 0.6.0
  • Adds GetCollectionWithSegments endpoint to SysDB and propagates segment information from the frontend to the query node, enabling query pushdown.
  • Implements the SPANN (Space Partition Approximate Nearest Neighbor) index with a full read/write path: K-Means clustering, append, update, delete, segment reader, posting list fetch, brute-force distance computation, merge operator, and query orchestrator.
  • Implements rank() for blockfile, replacing the deprecated get_at_index() method.
  • Adds full garbage collection and batched GC for the SPANN index.
  • Adds NAC (Neighborhood Access Control) to the write path.
+10 moreshow less
  • Supports full-text-search mixins for query composition.
  • Exports the Collection type directly from the Python client library.
  • Delivers a ~30% query performance improvement by fixing a double-deserialization issue in the Python layer.
  • Publishes the Helm chart to ECR.
  • Adds sinusoid and sawtooth load patterns to chroma-load for realistic traffic simulation.
  • Enables chroma-load to save and restore running workloads across restarts.
  • Adds support for delayed workloads in chroma-load-start.
  • Adds parameterized query support to chroma-load.
  • Adds metrics-only support to chroma-load.
  • list_collections client methods now return a list of Collection objects instead of raw data.
1 more release in this issue · 2024-12-05 → 2024-12-30
0.5.23 NOTES STABLE

Chroma 0.5.23 introduces SPANN segment/index, hybrid read workload support, and Kubernetes query replicas.

└──▷ GET THIS VERSION
$ git clone --branch 0.5.23 https://github.com/chroma-core/chroma.git
# already have the repo? check out this version:
$ git checkout 0.5.23
  • Introduces SPANN segment and index with append, commit, and flush operations for scalable approximate nearest-neighbor search.
  • Adds support for RI-4 and RI-5 hybrid read workloads in chroma-load.
  • Adds delay support on workloads in chroma-load.
  • Adds figment-based configuration for chroma-load.
  • Adds a chroma-load Dockerfile for containerized load testing.
+1 moreshow less
  • Adds Kubernetes support for query replicas via Helm chart.
Was this useful?

LanceDB

Sources Release notes → python-v0.17.2-beta.0 15 RELEASES · 2024-12-04 → 2024-12-25 NOTES STABLE

LanceDB python-v0.17.2-beta.0 adds IVF_FLAT index creation support on remote tables.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.17.2-beta.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.17.2-beta.0
  • Adds IVF_FLAT index creation on remote tables, enabling ANN search index building against hosted LanceDB instances from the Python client.
  • Adds IVF_FLAT index support on remote tables in the Rust backend, underpinning the Python remote table feature.
14 more releases in this issue · 2024-12-04 → 2024-12-25
v0.14.1 NOTES STABLE

LanceDB v0.14.1 adds hybrid search in async SDK, 4-bit PQ, IVF_FLAT with binary vectors, and FTS options for Node.js.

└──▷ GET THIS VERSION
$ git clone --branch v0.14.1 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.14.1
└──▷ USE IT
Skip the ANN vector index and force an exact search in the Python sync API — useful when index recall is insufficient and you need ground-truth results.
python
results = table.search(query_vector).bypass_vector_index(True).limit(10).to_list()
Safely drop a table in an async workflow without raising an error if it has already been deleted.
python
await db.drop_table("my_table", ignore_missing=True)
Create an IVF_FLAT index on binary vectors using Hamming distance for fast binary similarity search.
python
table.create_index(metric="hamming", index_type="IVF_FLAT", vector_column_name="binary_vec")
  • Adds bypass_vector_index to the Python sync API, letting queries skip the vector index for exact search.
  • Adds ignore_missing parameter to the async drop_table() method in Python, suppressing errors when the table does not exist.
  • Supports Full-Text Search (FTS) options in the Node.js SDK via FtsOptions.
  • Supports offset in the remote client, enabling paginated result retrieval against LanceDB Cloud.
  • Supports Azure account name storage options in sync db.connect, enabling Azure Blob Storage connections by account name.
+4 moreshow less
  • Adds hybrid search support in the Python async SDK, enabling combined vector and full-text search in async workflows.
  • Supports 4-bit Product Quantization (PQ) for significantly compressed vector index storage.
  • Supports IVF_FLAT index type, binary vectors, and Hamming distance metric for binary vector similarity search.
  • Achieves async/sync feature parity on Table in the Python SDK.
python-v0.17.1 NOTES STABLE

LanceDB python-v0.17.1 adds hybrid search in async SDK, 4-bit PQ, IVF_FLAT with binary vectors, and async/sync Table parity.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.17.1 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.17.1
└──▷ USE IT
Force a brute-force scan on a sync table query when you need exact results and want to bypass the ANN index.
python
results = table.search(query_vector).bypass_vector_index(True).limit(10).to_list()
Drop a table in async code without raising an error if it has already been deleted.
python
await db.drop_table("my_table", ignore_missing=True)
  • Adds bypass_vector_index to the sync query API, letting callers force a brute-force scan instead of using an ANN index.
  • Adds ignore_missing parameter to the async drop_table() method, suppressing errors when the table does not exist.
  • Adds FTS (full-text search) options support to the Node.js SDK.
  • Supports hybrid search in the async Python SDK, bringing it to parity with the sync SDK.
  • Supports offset in the remote client, enabling paginated result retrieval against LanceDB Cloud.
+4 moreshow less
  • Supports Azure account name as a storage option in db.connect() for the sync client.
  • Supports 4-bit Product Quantization (PQ) for more aggressive vector compression.
  • Supports IVF_FLAT index type, binary vectors, and Hamming distance as a new distance metric.
  • Achieves async/sync feature parity on the Table API in the Python SDK.
python-v0.17.1-beta.5 NOTES STABLE

LanceDB python-v0.17.1-beta.5 brings async-sync feature parity on the Table API.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.17.1-beta.5 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.17.1-beta.5
  • Adds async-sync feature parity on the Table class, enabling all synchronous Table operations to have async equivalents.
v0.14.1-beta.5 NOTES STABLE

LanceDB v0.14.1-beta.5 brings async-sync feature parity on the Python Table API.

└──▷ GET THIS VERSION
$ git clone --branch v0.14.1-beta.5 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.14.1-beta.5
  • Adds async-sync feature parity on the Python Table class, enabling the same operations across both synchronous and asynchronous usage patterns.
python-v0.17.1-beta.4 NOTES STABLE

LanceDB python-v0.17.1-beta.4 adds FTS options support in Node.js and upgrades to lance 0.21.0b3.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.17.1-beta.4 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.17.1-beta.4
  • Supports full-text search (FTS) options in the Node.js client.
  • Upgrades the underlying lance engine to version 0.21.0b3.
v0.14.1-beta.4 NOTES STABLE

LanceDB v0.14.1-beta.4 adds full-text search options for the Node.js client and upgrades the Lance core to 0.21.0b3.

└──▷ GET THIS VERSION
$ git clone --branch v0.14.1-beta.4 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.14.1-beta.4
  • Adds FTS (full-text search) options support to the Node.js client, bringing parity with other language bindings for configuring full-text search behavior.
  • Upgrades the underlying Lance core library to version 0.21.0b3.
v0.14.1-beta.2 NOTES STABLE

LanceDB v0.14.1-beta.2 adds offset support in the remote client and 4-bit Product Quantization indexing.

└──▷ GET THIS VERSION
$ git clone --branch v0.14.1-beta.2 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.14.1-beta.2
  • Supports 4-bit Product Quantization (PQ) for ANN indexes, reducing memory footprint for large vector datasets.
  • Adds offset support in the remote client, enabling paginated query results against LanceDB Cloud.
python-v0.17.1-beta.2 NOTES STABLE

LanceDB python-v0.17.1-beta.2 adds offset support in the remote client and 4-bit PQ index compression.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.17.1-beta.2 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.17.1-beta.2
  • Supports offset in remote client queries, enabling paginated result retrieval against remote LanceDB instances.
  • Supports 4-bit Product Quantization (PQ) for vector indexes, reducing memory and storage requirements for large-scale ANN search.
v0.14.1-beta.0 NOTES STABLE

LanceDB v0.14.1-beta.0 adds hybrid search to the async Python SDK and Azure account name storage support.

└──▷ GET THIS VERSION
$ git clone --branch v0.14.1-beta.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.14.1-beta.0
└──▷ USE IT
Connect to an Azure-backed LanceDB store using an account name in the synchronous SDK.
python
import lancedb

db = lancedb.connect(
    "az://my-container/my-db",
    storage_options={"account_name": "mystorageaccount"}
)
  • Supports account_name as an Azure storage option in synchronous db.connect calls.
  • Adds hybrid search support to the async Python SDK.
python-v0.17.1-beta.0 NOTES STABLE

LanceDB python-v0.17.1-beta.0 adds hybrid search in the async SDK and Azure account name storage options for sync connections.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.17.1-beta.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.17.1-beta.0
└──▷ USE IT
Connect to an Azure-backed LanceDB instance using an account name in the synchronous client.
python
import lancedb

db = lancedb.connect(
    "az://my-container/my-db",
    storage_options={"account_name": "mystorageaccount"}
)
  • Adds account_name as an Azure storage option in the synchronous db.connect call, enabling Azure Blob Storage authentication by account name.
  • Supports hybrid search in the async SDK, bringing parity with the sync SDK for combined vector and full-text search workflows.
v0.14.0 NOTES STABLE

LanceDB v0.14.0 adds schema evolution APIs, multimodal Voyage embeddings, Azure OpenAI, PyArrow dataset adapter, and FTS options on RemoteTable across all SDKs.

└──▷ GET THIS VERSION
$ git clone --branch v0.14.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.14.0
  • Adds ef search parameter support for HNSW index queries, controllable at query time.
  • Adds checkout and checkout_latest to remote SDKs for version-pinned table access.
  • Adds list_versions to TypeScript, Rust, and remote Python SDKs for enumerating table versions.
  • Adds overwrite and exist_ok modes for create_table on remote connections.
  • Adds FTS options support on RemoteTable, enabling full-text search configuration for remote backends.
+8 moreshow less
  • Adds schema evolution APIs across all SDKs (Python, TypeScript, Rust, remote).
  • Adds a PyArrow dataset adapter for LanceDB tables, enabling interoperability with the PyArrow dataset ecosystem.
  • Adds Azure OpenAI SDK support in the Python embedding integration.
  • Adds multimodal (text + image) capabilities to the Voyage AI embedder.
  • Adds rustls TLS backend support in the Rust SDK.
  • Adds support for remote connection options on remote LanceDB connections.
  • Adds remote DB URI path support with folder prefix for remote storage organisation.
  • Upgrades underlying Lance to v0.20.0, incorporating its latest storage and performance improvements.
└──▷ BREAKING ON UPGRADE
  • !The Python sync Connection API has been restructured for async-sync feature parity — existing sync Connection usage may require updates.
  • !OpenAI embedding error handling now raises on bad embeddings rather than silently continuing — code that relied on the previous lenient behavior will see new exceptions.
python-v0.17.0 NOTES STABLE

LanceDB python-v0.17.0 adds schema evolution APIs, PyArrow dataset adapter, Azure OpenAI SDK, Voyage multimodal embeddings, and remote SDK parity.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.17.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.17.0
└──▷ USE IT
Use the new PyArrow dataset adapter to pass a LanceDB table directly into any PyArrow-compatible workflow.
python
import lancedb
import pyarrow.dataset as ds

db = lancedb.connect("./mydb")
table = db.open_table("embeddings")
dataset = table.to_arrow_dataset()
batches = dataset.to_batches()
  • Adds ef search parameter support for HNSW queries, configurable at query time.
  • Adds checkout and checkout_latest methods to remote SDKs for version pinning.
  • Adds list_versions to the TypeScript, Rust, and remote Python SDKs.
  • Adds overwrite and exist_ok mode options for remote create_table.
  • Adds schema evolution APIs across all SDKs — Python, TypeScript, and Rust.
+9 moreshow less
  • Adds FTS options support on RemoteTable for full-text search configuration.
  • Adds a PyArrow dataset adapter for LanceDB tables, enabling interoperability with the PyArrow ecosystem.
  • Adds support for the Azure OpenAI SDK in the Python client.
  • Adds multimodal (text + image) capabilities to the Voyage embedder.
  • Adds support for remote connection options on the remote LanceDB connection.
  • Adds remote database URI path with folder prefix support.
  • Adds rustls TLS backend support in the Rust SDK.
  • Async-sync feature parity on Connections brings the synchronous Python API in line with the async API.
  • Upgrades to Lance v0.20.0, pulling in all upstream engine improvements.
└──▷ BREAKING ON UPGRADE
  • !The async-sync feature parity change on Connections (feat(python)!: async-sync feature parity on Connections) alters the synchronous Connection API — existing code relying on the previous sync behavior may break.
  • !OpenAI embedding error handling now raises differently for bad embeddings (fix(python)!: handle bad openai embeddings gracefully) — callers that caught or relied on the previous exception type or behavior will be affected.
python-v0.17.0-beta.3 NOTES STABLE

LanceDB python-v0.17.0-beta.3 adds multimodal Voyage embeddings, a PyArrow dataset adapter, and remote DB folder-prefix URI support.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.17.0-beta.3 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.17.0-beta.3
  • Adds a PyArrow dataset adapter for LanceDB tables, enabling LanceDB tables to be consumed directly as pyarrow.dataset.Dataset objects.
  • Adds multimodal capabilities to the Voyage embedder, allowing image and text inputs to be embedded together via the Voyage integration.
  • Supports folder-prefix paths in remote DB URIs, enabling scoped access to a subdirectory within a remote LanceDB store.
v0.14.0-beta.2 NOTES STABLE

LanceDB v0.14.0-beta.2 adds multimodal Voyage embeddings, a PyArrow dataset adapter, and remote DB URI folder prefixes.

└──▷ GET THIS VERSION
$ git clone --branch v0.14.0-beta.2 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.14.0-beta.2
  • Adds a PyArrow dataset adapter for LanceDB tables, enabling LanceDB tables to be used directly as PyArrow datasets.
  • Adds multimodal capabilities to the Voyage embedder, enabling embedding of non-text modalities via Voyage.
  • Adds folder prefix support for remote database URI paths.
Was this useful?

Milvus

Sources Release notes → v2.4.19 3 RELEASES · 2024-12-20 → 2024-12-27 NOTES STABLE

Milvus 2.4.19 adds expression templates for faster hybrid searches and new deletion monitoring metrics.

└──▷ GET THIS VERSION
$ git clone --branch v2.4.19 https://github.com/milvus-io/milvus.git
# already have the repo? check out this version:
$ git checkout v2.4.19
  • Introduces expression templates to accelerate hybrid searches.
  • Adds additional metrics for improved deletion monitoring.
  • Restricts L0 file generation to specific partitions for partitionKey deletion to reduce write amplification.
2 more releases in this issue · 2024-12-20 → 2024-12-27
v2.5.0 NOTES STABLE

Milvus 2.5 adds full-text search (BM25), bitmap indexes, nullable fields, CSV import, clustering compaction, and a cluster management WebUI.

└──▷ GET THIS VERSION
$ git clone --branch v2.5.0 https://github.com/milvus-io/milvus.git
# already have the repo? check out this version:
$ git checkout v2.5.0
└──▷ USE IT
Define a collection with a nullable scalar field and a default value so records missing that field are accepted without error.
python
from pymilvus import MilvusClient, DataType

client = MilvusClient(uri="http://localhost:19530")
schema = client.create_schema()
schema.add_field("id", DataType.INT64, is_primary=True, auto_id=True)
schema.add_field("embedding", DataType.FLOAT_VECTOR, dim=128)
schema.add_field("category", DataType.VARCHAR, max_length=64, nullable=True, default_value="unknown")
client.create_collection("products", schema=schema)
Enable Clustering Compaction on a large collection by setting a scalar clustering key to speed up filtered vector searches.
python
from pymilvus import MilvusClient, DataType

client = MilvusClient(uri="http://localhost:19530")
schema = client.create_schema()
schema.add_field("id", DataType.INT64, is_primary=True, auto_id=True)
schema.add_field("region_id", DataType.INT64, is_clustering_key=True)
schema.add_field("embedding", DataType.FLOAT_VECTOR, dim=256)
client.create_collection("geo_vectors", schema=schema)
  • Supports nullable=True and default values for scalar fields, allowing null data to be omitted on insert without errors.
  • Adds CSV bulk import format alongside the existing JSON and Parquet support.
  • Introduces Clustering Compaction (Beta): specifying a scalar field as a clustering key redistributes data by range, enabling efficient pruning during queries when scalar filters are applied.
  • Introduces Full Text Search via built-in Sparse-BM25 (Tantivy-powered), with built-in analyzers and sparse vector extraction so collections can accept raw text instead of pre-computed vectors.
  • Adds Text Match capability using Tantivy-based analyzers and indexing for precise term-level natural language filtering within vector searches.
+14 moreshow less
  • Adds Bitmap Index, a new scalar index type suited for low-cardinality fields that uses a bit-array representation to accelerate filtered searches.
  • Adds Streaming Node (Beta) component providing Write-Ahead Logging (WAL) services for channel read/write consensus; disabled by default in 2.5, planned for general availability in v3.0.
  • Introduces a built-in Cluster Management WebUI (Beta) for visualizing runtime environment info including segments, channels, node health, slow queries, and task status.
  • Supports multiple HNSW quantization methods via Faiss migration: SQ (Scalar Quantizers), PQ (Product Quantizer), and PRQ (Product Residual Quantizer).
  • Adds IPv6 support for expanded network connectivity.
  • Supports expression templates for query acceleration, improving parsing efficiency for complex filter expressions.
  • Expands GroupBy with customizable group size (number of entries returned per group) and hybrid GroupBy search across multiple vector columns.
  • Adds MVCC support for iterators so in-flight inserts and deletions do not affect ongoing iteration.
  • Adds persistent cursor for QueryIterator, enabling iteration to resume from the last position after a Milvus restart.
  • Adds TLS support for inter-node communication in enterprise and complex network environments.
  • Introduces Local Storage V2, a new local file format improving scalar data load/query efficiency and reducing memory overhead.
  • Aligns RESTful API functionality with other SDKs for consistency.
  • Score-based channel balancing policy dynamically redistributes loads across channels in large-scale deployments.
  • Compaction now removes maximum segment limits in mixed compaction and prioritizes smaller segments first.
└──▷ BREAKING ON UPGRADE
  • !Upgrade to Pulsar 3.0.7 LTS is not compatible with previous Pulsar 2.x versions; existing deployments must upgrade ETCD and Pulsar before using new features (see Upgrade Pulsar from 2.x to 3.x guide).
v2.4.18 NOTES STABLE

Milvus 2.4.18 adds customizable RBAC privilege groups, a new Grant/Revoke API, and RESTful expression templates.

└──▷ GET THIS VERSION
$ git clone --branch v2.4.18 https://github.com/milvus-io/milvus.git
# already have the repo? check out this version:
$ git checkout v2.4.18
  • New Grant/Revoke API lets callers grant or revoke privileges without specifying an ObjectType, using privilege group names directly.
  • alterindex and altercollection now support modifying index and collection properties at runtime.
  • alterdatabase now supports deleting database properties.
  • Adds expression template support for RESTful API query/search requests, enabling parameterized expressions.
  • Adds database-scoped requests to the RESTful API.
+13 moreshow less
  • Enables rate limiting for RESTful V1 endpoints.
  • Introduces customizable privilege groups — create, drop, list, and dynamically add/remove privileges within user-defined groups.
  • Adds nine built-in privilege groups for common operational scenarios: ClusterReadOnly, ClusterReadWrite, ClusterAdmin (cluster-level); DatabaseReadOnly, DatabaseReadWrite, DatabaseAdmin (database-level); CollectionReadOnly, CollectionReadWrite, CollectionAdmin (collection-level).
  • Adds mmap file usage metrics for observability.
  • Adds detailed replica counts per resource group.
  • Adds sparse search metrics counting non-zero values/tokens.
  • Adds collection ID dimension to search request count metrics.
  • Supports score-based balancing for channel policies.
  • Removes the per-round load task limit, allowing more parallel collection loading.
  • Removes the RPC layer of the coordinator when running in standalone or mixed mode, reducing overhead.
  • Supports automatic search retry when topk is reduced and results are insufficient.
  • Allows hyphens in partition names.
  • Sparse index performance improved ~10% via updated Knowhere version.
Was this useful?

Weaviate

Sources Release notes → v1.28.0 6 RELEASES · 2024-12-02 → 2024-12-11 NOTES STABLE

Weaviate v1.28.0 previews RBAC authorization with built-in and custom roles, collection-level isolation, and full CRUD endpoints at /authz/roles.

└──▷ GET THIS VERSION
$ git clone --branch v1.28.0 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.28.0
  • Adds RBAC CRUD endpoints (e.g., POST /authz/roles, returning 409 on conflict) for creating, reading, updating, and deleting roles and permissions in preview.
  • Supports add-permission and remove-permission operations on roles via the new authz API surface.
  • Adds a read_roles field to the schema, enabling role metadata to be returned as part of collection schema responses.
  • Introduces built-in roles with auto-generated permissions, alongside support for fully custom roles and permissions scoped to specific collections.
  • Adds a users domain and associated actions to the RBAC permission model, enabling user-management operations to be gated by role.
+4 moreshow less
  • RBAC policies are persisted across all Raft nodes and reloaded on restart, ensuring cluster-wide consistency.
  • Adds RBAC authorization coverage to GraphQL (including batch GQL), gRPC search, REST batch delete, batch references, and object/reference endpoints.
  • Adds an RBAC audit log component for tracking authorization decisions and pretty-printing resource paths on errors.
  • Enforces collection and tenant existence validation at permission-creation time.
5 more releases in this issue · 2024-12-02 → 2024-12-11
v1.26.12 NOTES STABLE

Weaviate v1.26.12 adds VoyageAI multimodal embeddings, Ollama batch support, and a runtime log-level API.

└──▷ GET THIS VERSION
$ git clone --branch v1.26.12 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.26.12
  • Supports runtime log-level configuration via the API, enabling operators to adjust verbosity without restarting the service.
  • Adds support for the Ollama batch endpoint, improving throughput for Ollama-backed vectorization.
  • Adds a new VoyageAI multimodal module, enabling image and text embeddings through VoyageAI.
  • Adds support for X-Goog-* headers in Google provider clients.
  • Adds environment variable overrides for Azure backup block size and concurrency settings.
+1 moreshow less
  • Adds an option to skip waiting for self-deployed modules on startup, reducing initialization delays in custom module deployments.
v1.25.28 NOTES STABLE

Weaviate v1.25.28 adds a VoyageAI multimodal module for embedding multimodal content.

└──▷ GET THIS VERSION
$ git clone --branch v1.25.28 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.25.28
  • Adds a VoyageAI multimodal module, enabling multimodal embeddings via VoyageAI within Weaviate.
v1.27.8 NOTES STABLE

Weaviate v1.27.8 adds a VoyageAI multimodal module for cross-modal vector search.

└──▷ GET THIS VERSION
$ git clone --branch v1.27.8 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.27.8
  • Adds the VoyageAI multimodal module, enabling vectorization of mixed-modality content via VoyageAI's embedding models.
v1.27.7 NOTES STABLE

Weaviate v1.27.7 adds reindex-references API, maintenance-mode toggle, Azure env overrides, and X-Goog-* header support.

└──▷ GET THIS VERSION
$ git clone --branch v1.27.7 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.27.7
  • Adds environment variable overrides for Azure block size and concurrency settings.
  • Adds support for X-Goog-* headers, enabling Google-specific header passthrough.
  • Adds an option to skip waiting for self-deployed modules on startup.
  • Limits backup search scope to BACKUP_PATH for remote backends, reducing unintended traversal.
  • Adds a reindex-references feature via the debug API to rebuild reference indexes.
+1 moreshow less
  • Enables maintenance mode to be toggled on or off via the /debug API.
v1.25.27 NOTES STABLE

Weaviate v1.25.27 adds environment overrides for Azure block size and concurrency, plus an option to skip waiting for self-deployed modules.

└──▷ GET THIS VERSION
$ git clone --branch v1.25.27 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.25.27
  • Adds environment overrides for Azure block size and concurrency settings.
  • Adds an option to not wait for self-deployed modules on startup.
  • Adds support for X-Goog-* headers in API requests.
Was this useful?
◆  MCP TOOLING

Composio

Sources Release notes → v0.6.9 6 RELEASES · 2024-12-05 → 2024-12-31 NOTES STABLE

Composio v0.6.9 adds custom auth injection for local tools and updated type definitions.

└──▷ GET THIS VERSION
$ git clone --branch v0.6.9 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.6.9
  • Allows injection of custom authentication for local tools, enabling practitioners to supply their own auth credentials when working with locally defined tools.
  • Updates types to align with backend definitions for improved API contract accuracy.
5 more releases in this issue · 2024-12-05 → 2024-12-31
v0.6.8 NOTES STABLE

Composio v0.6.8 adds retry support in Action postprocessor and connected_account access in custom actions.

└──▷ GET THIS VERSION
$ git clone --branch v0.6.8 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.6.8
  • Supports requesting connected_account inside custom actions, enabling action authors to access the connected account context at runtime.
  • Adds retry support in the Action postprocessor, allowing failed action post-processing steps to be retried automatically.
v0.6.7 NOTES STABLE

Composio v0.6.7 adds trigger list support and expands SQL tooling with SQLite and remote database connections.

└──▷ GET THIS VERSION
$ git clone --branch v0.6.7 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.6.7
  • Adds trigger list support, enabling enumeration of available triggers via the Composio client.
  • Enhances the SQL Query Tool with SQLite and remote database support, broadening the range of data sources accessible through Composio actions.
v0.6.4 NOTES STABLE

Composio v0.6.4 adds SDR kit agents, initiate connection support, and TypeScript exports.

└──▷ GET THIS VERSION
$ git clone --branch v0.6.4 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.6.4
  • Adds SDR (Sales Development Representative) kit agents for automated outreach workflows.
  • Adds initiate connection support and new TypeScript exports to the SDK.
  • Updates the Phidata plugin to support the use toolkit interface.
  • Reduces TypeScript bundle size and brings ESLint and TypeScript issues to zero.
v0.6.0 NOTES STABLE

Composio v0.6.0 adds processor support, bundler support, object params for methods, and remove-integration capability.

└──▷ GET THIS VERSION
$ git clone --branch v0.6.0 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.6.0
  • Adds processor support alongside a move to object params for methods, enabling pre/post-processing of tool calls.
  • Adds bundler support for the JavaScript SDK.
  • Adds remove integration support via the CLI/SDK.
  • Revamps the composio apps update CLI command.
  • Improves 400-error handling with richer error messages.
v0.5.51 NOTES STABLE

Composio v0.5.51 adds advanced use-case search in the JS SDK, workflow dispatch, LangGraph integration, and x-request-id propagation.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.51 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.5.51
  • Passes x-request-id header in all Composio API queries, enabling request tracing across distributed calls.
  • Adds advanced use-case search functionality in the JS SDK.
  • Adds workflow dispatch support with improved logging level controls.
  • Adds LangGraph integration for both Python and TypeScript.
  • Makes beta enum generation the default behavior.
Was this useful?

Model Context Protocol Servers

Sources Release notes → typescript-servers-0.6.0 NOTES

Adds EverArt and Thinking MCP servers to the TypeScript server collection.

└──▷ GET THIS VERSION
$ git clone --branch typescript-servers-0.6.0 https://github.com/modelcontextprotocol/servers.git
# already have the repo? check out this version:
$ git checkout typescript-servers-0.6.0
  • Adds EverArt and Thinking servers to the MCP TypeScript server suite.
Was this useful?
my-toolchain — 0 tools
paste an install list to detect your tools

A brew list, a Brewfile, requirements.txt, a Dockerfile — or just the product names, free-form. Nothing leaves your browser.

    browse all tools →