Heads up This site is currently under heavy development.
Subscribe Get it delivered — the daily firehose, filtered to the tools you run, plus the documentation changes vendors never announce. Compare plans →

The AI Toolchain — issue -376, July 31, 2024

THE AI TOOLCHAIN NO. -376
Tail
THE DAILY RELEASE FIREHOSE
PUBLISHED JULY 31, 2024 · EVERY WEEKDAY
EDITIONS tail grep head diff uniq

The daily firehose — everything the toolchain shipped today, already filtered.

// HOW THIS ISSUE IS MADE

We read every release from the 174 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.

VIEW
ISSUE VIEW full issue
Do you prefer this view?
$ tct list   # 33 tools matched
AI & LLM Tooling
◆  AI Coding Agents

Aider

Sources Release notes → v0.47.0 6 RELEASES · 2024-07-01 → 2024-07-31 NOTES STABLE

Aider v0.47.0 adds customizable commit prompts, Conventional Commits support, a full Docker image, and generic command auto-completions.

└──▷ GET THIS VERSION
$ git clone --branch v0.47.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.47.0
└──▷ TRY IT
Enforce a project-specific commit style (e.g., Jira ticket prefix) instead of the default prompt.
$ aider --commit-prompt 'Write a commit message prefixed with the Jira ticket number from the branch name, followed by a short imperative summary.'
Run aider as a non-root user inside Docker without permission errors, using the full-featured image.
$ docker run --user $(id -u):$(id -g) -v $(pwd):/app paulgauthier/aider-full
  • Adds --commit-prompt flag to fully customize the commit message prompt.
  • Adds Conventional Commits guidelines to the default commit message prompt.
  • Uses the strong model as a fallback for generating commit messages and chat summaries.
  • Introduces paulgauthier/aider-full Docker image bundling all extras.
  • Provides generic auto-completions for /commands that lack a dedicated completion override.
+1 moreshow less
  • Switching to code or ask mode no longer triggers a chat history summarization.
5 more releases in this issue · 2024-07-01 → 2024-07-31
v0.46.0 NOTES STABLE

Aider v0.46.0 adds /ask and /chat-mode commands, always-load file config, and improved token cost reporting.

└──▷ GET THIS VERSION
$ git clone --branch v0.46.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.46.0
└──▷ TRY IT
Ask a question about your code without triggering any edits — useful for reconnaissance before making changes.
$ aider
/ask What does the authentication flow in auth.py do?
Always load a conventions or style-guide file into every session so the model follows project standards automatically.
yaml
# .aider.conf.yml
file: CONVENTIONS.md
Switch to help mode mid-session to troubleshoot aider configuration without leaving the chat.
$ /chat-mode help
  • New /ask <question> command lets you query your codebase without triggering any edits.
  • New /chat-mode <mode> command switches between ask, code, and help interaction modes mid-session.
  • Supports file: key in .aider.conf.yml to always load one or more files into every chat session.
  • Enhanced token usage and cost reporting now works during streaming responses.
  • Filename auto-complete for /add and /drop is now case-insensitive.
+1 moreshow less
  • --no-verify-ssl now also disables SSL certificate verification when /web scrapes websites.
v0.45.0 NOTES STABLE

Aider v0.45.0 adds GPT-4o mini support and exposes last 4 chars of API keys in verbose output.

└──▷ GET THIS VERSION
$ git clone --branch v0.45.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.45.0
  • Supports GPT-4o mini, which scores comparably to GPT-3.5 on the code editing benchmark using whole edit format.
  • Improved file-add suggestions on Windows when aider detects relevant files not yet in the chat.
  • Shows last 4 characters of API keys in --verbose output for easier key identification.
v0.44.0 NOTES STABLE

Aider v0.44.0 slashes install size by up to 12x and introduces optional package extras for help, browser, and Playwright.

└──▷ GET THIS VERSION
$ git clone --branch v0.44.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.44.0
└──▷ TRY IT
Check for a new Aider release without starting an interactive session, using the renamed flag.
$ aider --just-check-updated
  • Reduces default pip install size by 3–12x, making minimal installs practical in constrained environments.
  • Adds three optional package extras (aider-chat[help], aider-chat[browser], aider-chat[playwright]) that Aider will prompt to install on demand.
  • Simplifies the output of --models for easier model browsing.
└──▷ BREAKING ON UPGRADE
  • !The --check-update flag is renamed to --just-check-updated; any scripts or aliases using --check-update will break.
  • !The --skip-check-update flag is renamed to --[no-]check-update; any scripts or aliases using --skip-check-update will break.
v0.43.0 NOTES STABLE

Aider v0.43.0 adds in-chat help, multi-undo, and standardized config file loading from multiple paths.

└──▷ GET THIS VERSION
$ git clone --branch v0.43.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.43.0
└──▷ TRY IT
Get contextual help on configuring a setting or troubleshooting an issue without leaving the chat session.
$ /help How do I set a custom model settings file?
  • Adds /help <question> command to ask questions about usage, settings, troubleshooting, and LLM configuration directly inside the chat session.
  • Default --model-settings-file path is now .aider.model.settings.yml.
  • Default --model-metadata-file path is now .aider.model.metadata.json.
  • All config, env, YAML, and JSON files now load from home directory, git root, current working directory, and a named command-line switch — enabling layered configuration.
  • Introduces $HOME/.aider/caches as a new directory for app-wide expendable caches.
+1 moreshow less
  • Allows multiple sequential uses of /undo to step back through multiple changes.
└──▷ BREAKING ON UPGRADE
  • !The default value of --model-settings-file is now .aider.model.settings.yml; setups relying on a previous default path will no longer load automatically.
  • !The default value of --model-metadata-file is now .aider.model.metadata.json; setups relying on a previous default path will no longer load automatically.
v0.41.0 NOTES STABLE

Aider v0.41.0 defaults to Claude 3.5 Sonnet, adds >4k token streaming, image support, and commit message prefixing.

└──▷ GET THIS VERSION
$ git clone --branch v0.41.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.41.0
└──▷ TRY IT
Prefix all aider-generated commits with 'aider:' to make AI-assisted changes easy to identify in git history.
$ aider --attribute-commit-message
  • Adds --attribute-commit-message flag to prefix aider's commit messages with 'aider:'.
  • Aider now defaults to claude-3-5-sonnet-20240620 when ANTHROPIC_API_KEY is set in the environment.
  • Enables streaming responses greater than 4k tokens for Claude 3.5 Sonnet, unlocking large refactors and multi-file code generation in a single pass.
  • Adds image support for Claude 3.5 Sonnet and for GPT-4o and Claude 3.5 Sonnet via OpenRouter.
  • Automatically retries requests on Anthropic overloaded_error responses.
Was this useful?

Cline

Sources Release notes → v1.0.7 2 RELEASES · 2024-07-28 → 2024-07-31 NOTES STABLE

Autonomous coding agent as an SDK, IDE extension, or CLI assistant.

Cline v1.0.7 replaces broad file-listing tools with three focused commands for more precise project exploration.

└──▷ GET THIS VERSION
$ git clone --branch v1.0.7 https://github.com/cline/cline.git
# already have the repo? check out this version:
$ git checkout v1.0.7
  • Adds list_files_top_level command to list only top-level files in a directory.
  • Adds list_files_recursive command to recursively list all files in a project.
  • Adds view_source_code_definitions_top_level command to retrieve source code definitions scoped to task-relevant files only.
└──▷ BREAKING ON UPGRADE
  • !The list_files command has been removed; replace usages with list_files_top_level or list_files_recursive.
  • !The analyze_project command has been removed; replace usages with view_source_code_definitions_top_level.
1 more release in this issue · 2024-07-28 → 2024-07-31
v1.0.4 NOTES STABLE

Cline v1.0.4 adds analyze_project tool, user feedback on tool use, 8192-token output, and API retry support.

└──▷ GET THIS VERSION
$ git clone --branch v1.0.4 https://github.com/cline/cline.git
# already have the repo? check out this version:
$ git checkout v1.0.4
└──▷ TRY IT
Let Claude map your entire project structure before starting a large refactor, so it has full context without manual file sharing.
$ Claude Dev: Open In New Tab
  • New analyze_project tool gives Claude a comprehensive overview of project source code definitions and file structure.
  • Enables user feedback on tool use actions such as terminal commands and file edits.
  • Raises max output tokens to 8192, reducing truncated or placeholder code responses.
  • Adds ability to retry failed API requests, improving resilience against rate limits.
  • Open-in-editor view (via menu bar or Claude Dev: Open In New Tab command palette entry) shows workspace changes more clearly.
+1 moreshow less
  • Adds markdown rendering, memory optimizations, and improved theme support.
Was this useful?

Continue

Sources Release notes → v0.0.53-jetbrains NOTES

Continue v0.0.53 for JetBrains adds .prompt file support and a new onboarding experience.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.53-jetbrains https://github.com/continuedev/continue.git
# already have the repo? check out this version:
$ git checkout v0.0.53-jetbrains
  • Supports .prompt files for defining reusable prompt templates.
  • Introduces a new onboarding experience for first-time setup.
Was this useful?

All Hands AI OpenHands

Sources Release notes → 0.8.2 3 RELEASES · 2024-07-05 → 2024-07-27 NOTES STABLE

OpenHands: AI-Driven Development

OpenHands 0.8.2 adds headless controller mode and SWE-Bench custom Docker namespace support for eval workflows.

└──▷ GET THIS VERSION
$ git clone --branch 0.8.2 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.8.2
  • Adds headless_mode for the Controller, enabling programmatic agent runs without a UI session.
  • Supports pulling SWE-Bench evaluation environments from a custom Docker namespace.
  • Shrinks the runtime image size, reducing pull times and storage overhead.
└──▷ BREAKING ON UPGRADE
  • !The Monologue agent has been removed and is no longer available as an agent type.
  • !Global config has been removed from the sandbox, agent controller, and related components — configurations previously set globally must now be passed explicitly.
2 more releases in this issue · 2024-07-05 → 2024-07-27
0.8.0 NOTES STABLE

OpenHands 0.8.0 adds user confirmation mode, per-agent LLM config, EventStream runtime with browser and Jupyter support, and restores append_file.

└──▷ GET THIS VERSION
$ git clone --branch 0.8.0 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.8.0
  • Adds append_file action back to the agent's file-editing toolkit, enabling agents to append content to files without overwriting them.
  • Implements user confirmation mode: when enabled, OpenHands requests explicit user confirmation before executing bash or Python code.
  • Enables per-agent LLM configuration, allowing each delegated agent to use a distinct LLM config set from the UI.
  • Introduces EventStreamRuntime with an agnostic sandbox, adding Jupyter notebook support and browser interaction to the runtime client.
  • Adds a WebSocket runtime (od-client-runtime) as a new runtime backend option.
+3 moreshow less
  • Displays real-time build logs for the agnostic sandbox image during construction.
  • Deprecates the recall action and search_memory capability, removing them from the agent action surface.
  • Removes support for Background Commands from the runtime architecture.
└──▷ BREAKING ON UPGRADE
  • !Background Commands are no longer supported — any working setup relying on background command execution will break on upgrade.
  • !The recall action and search_memory are deprecated and removed — agents or configurations invoking these will break on upgrade.
0.7.1 NOTES STABLE

OpenHands 0.7.1 adds local Ollama model support, CLI session restore, config templates, and DEBUG logging control.

└──▷ GET THIS VERSION
$ git clone --branch 0.7.1 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.7.1
  • Adds make run-wsl target for running OpenHands under Windows Subsystem for Linux.
  • Enables DEBUG-level logging via a config setting, giving operators fine-grained log control without code changes.
  • Adds a config template feature to bootstrap new configuration files.
  • Adds support for local Ollama models, letting teams run inference entirely on-premises without an external LLM provider.
  • Adds optional CLI session restore, allowing interrupted CLI sessions to be resumed.
+7 moreshow less
  • Enables concurrent CLI operation, improving throughput for command-line workflows.
  • Removes the MAX_CHARS traffic-control limit, lifting a cap on observation size.
  • Allows MAX_ITERATIONS and MAX_BUDGET_PER_TASK to be overridden directly from the web GUI.
  • Improves code editing in the CodeAct agent by using diff-based patching for more reliable file edits.
  • Removes the Docker exec sandbox backend, consolidating on the SSH-based sandbox.
  • Adds automatic LLM retry on internal server errors, improving resilience against transient upstream failures.
  • Docker builds for stable releases now also publish a latest tag, simplifying image pulls.
└──▷ BREAKING ON UPGRADE
  • !The Docker exec sandbox box has been removed; deployments relying on it must migrate to the SSH-based sandbox.
  • !The MAX_CHARS traffic-control setting has been removed; any configuration referencing it will no longer have effect.
  • !Global CLI arguments have been removed; workflows depending on those global args must be updated.
Was this useful?

Zed

Sources Release notes → v0.146.3 5 RELEASES · 2024-07-03 → 2024-07-31 NOTES STABLE

Zed v0.146.3 adds a built-in REPL, multi-formatter support, custom inline assist bindings, and a Ruff extension.

└──▷ GET THIS VERSION
$ git clone --branch v0.146.3 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.146.3
└──▷ USE IT
Configure multiple formatters for Python so Ruff handles both linting and formatting on save alongside Pyright.
json
"languages": {
  "Python": {
    "format_on_save": { "language_server": { "name": "ruff" } },
    "formatter": { "language_server": { "name": "ruff" } },
    "language_servers": ["pyright", "ruff"]
  }
}
Bind a key to trigger inline assist pre-filled with a specific prompt, so you can scaffold boilerplate instantly without typing the prompt each time.
json
[
  {
    "context": "Editor && mode == full",
    "bindings": {
      "ctrl-shift-enter": [
        "assistant::InlineAssist",
        { "prompt": "Build a snake game" }
      ]
    }
  }
]
  • Adds {"restore_on_startup": "last_workspace"} setting to revert to the previous single-workspace restore behavior; new default restores all windows open at quit.
  • Adds {"session": {"restore_unsaved_buffers": false}} setting to control automatic restoration of unsaved buffers across sessions (requires a project to be open).
  • Adds "command_aliases" setting to define abbreviated command names.
  • Extends task templates with shell and hide fields for specifying custom shells and close behavior.
  • Allows format and format_on_save to accept an array of formatting actions; language_server formatter option now accepts a named language server (e.g. {"language_server": {"name": "ruff"}}).
+11 moreshow less
  • Adds custom inline assist keybindings that pre-fill a prompt via the assistant::InlineAssist action with a prompt parameter in keymap.json.
  • Built-in REPL now available, supporting line-by-line, block-by-block (# %%), and arbitrary-selection code execution.
  • Adds Ruff extension for fast Python linting and formatting via a language server integration, configurable under "languages": {"Python": {"language_servers": ["pyright", "ruff"]}}.
  • Adds support for quickly switching between multiple language model providers in the assistant panel.
  • Adds support for gpt-4o-mini as a language model option.
  • Adds ability to automatically generate or manually edit summaries for assistant conversations.
  • Adds Copy, Paste, Select All, and New Terminal to the terminal context menu.
  • Adds a button to copy the SHA from a Git blame entry.
  • Adds ability to sign out of a Supermaven account.
  • Vim: Y now yanks to end of line (matching Neovim behavior).
  • Vim: adds support for count and object motion in the toggle comments action.
4 more releases in this issue · 2024-07-03 → 2024-07-31
v0.145.1 NOTES STABLE

Zed v0.145.1 ships Remote Development over SSH, a /symbols assistant command, gpt-4o-mini support, and file-icon tabs.

└──▷ GET THIS VERSION
$ git clone --branch v0.145.1 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.145.1
└──▷ USE IT
Show file icons on editor tabs to quickly distinguish file types at a glance.
json
{ "tabs": { "file_icons": true } }
Disable function signature popovers if they clutter your editing flow.
json
{ "show_signature_help_after_completion": false }
Use Zed's built-in keyboard-driven file picker on Linux instead of the system XDG dialog.
json
{ "use_system_path_prompts": false }
  • Adds "show_signature_help_after_completion": false to settings.json to disable the new function signature popovers.
  • Adds "tabs": { "file_icons": true } to settings.json to show file icons on buffer tabs.
  • Adds use_system_path_prompts setting (default true) to settings.json; set to false to use Zed's built-in keyboard-driven file prompts instead of XDG/system pickers.
  • Adds /symbols slash command in the assistant panel, which automatically inserts the active file's symbols into the assistant context.
  • Launches Remote Development (alpha) for all users — edit files or run commands on a remote server over SSH, with collaboration support.
+17 moreshow less
  • Adds support for gpt-4o-mini as an assistant model.
  • CLI: Adds ability to open URIs (including zed:// channel URIs) directly from the command line.
  • Linux: Adds zed.dev/channel (zed://) URI support on Linux.
  • Adds :bd, :bn, and :bp buffer navigation commands in Vim mode.
  • Adds - and + Vim motions to jump to the beginning of the line above/below.
  • Maps ctrl-m to enter in the editor in Vim mode.
  • Adds support for following the cursor into the assistant panel during collaboration.
  • Adds runnable tasks for Flutter (including Flutter tasks in the Dart extension).
  • Adds support for pyright workspace configuration.
  • Sets TERM_PROGRAM and TERM_PROGRAM_VERSION environment variables in the integrated terminal.
  • Adds toggle hunk diff and expand-all hunk diffs key bindings.
  • Adds default content for the user's keymap.json file.
  • Remote Development: Allows adding and removing folders from remote projects.
  • Adds ability to select and copy text from information popovers.
  • Adds banners for built-in Zed features when matching keywords are used in the extension search.
  • Linux: Adds a fallback Open file picker when XDG is not working.
  • Linux: Adds a representation of the current focus state to Zed's window style.
└──▷ BREAKING ON UPGRADE
  • !Vim: The built-in binding of - to open the project panel has been removed. Re-add it manually to your keymap file with: {"context":"VimControl", "bindings":{ "-": "pane::RevealInProjectPanel"}}.
  • !Vim: Keymap contexts have been restructured — bindings that rely on VimWaiting or VimOperator being true may break and must be updated per the docs at https://zed.dev/docs/vim#custom-key-bindings.
v0.144.3 NOTES STABLE

Zed v0.144.3 adds native snippet support for all buffers, outline panel filtering, and tailwindcss-language-server classAttributes config.

└──▷ GET THIS VERSION
$ git clone --branch v0.144.3 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.144.3
└──▷ USE IT
Configure Tailwind to recognize custom class attributes (e.g. in Angular or CSS Modules projects) so the language server provides completions in those attributes.
json
{
  "lsp": {
    "tailwindcss-language-server": {
      "settings": {
        "classAttributes": ["class", "className", "ngClass", "styles"]
      }
    }
  }
}
  • Adds classAttributes key under lsp.tailwindcss-language-server.settings in Zed config, letting you declare which attributes Tailwind scans (e.g. class, className, ngClass, styles).
  • Extensions can now ship snippets by including a snippets.json file alongside the extension manifest.
  • Moves snippet support into the core editor so snippets work in any buffer, including plain text — deprecates the separate snippet extension.
  • Adds filtering support in the outline panel.
  • Adds dynamic registration and unregistration of LSP formatting capabilities.
v0.143.6 NOTES STABLE

Zed lands on Linux with macro support, new AI action, IBM Plex fonts, and updated keybindings

└──▷ GET THIS VERSION
$ git clone --branch v0.143.6 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.143.6
  • Adds assistant: insert into editor action (keybinding: cmd-< on macOS, ctrl-< on Linux) to insert AI output directly into the editor.
  • Adds keyboard shortcuts for scrolling in the terminal.
  • Changes default key binding for page-down to move the cursor via editor::MovePageDown; previous scroll-only behavior (editor::PageDown) is now bound to cmd-pagedown on macOS and alt-pagedown on Linux.
  • Adds shift shift as a default binding to open the command palette in the JetBrains keymap.
  • Adds duplicate-line shortcut to the Sublime Text keymap.
+10 moreshow less
  • Adds vim bindings for the outline panel.
  • Adds vim macro support: record with q and replay with @.
  • Changes default fonts to IBM Plex Sans and IBM Plex Mono (previous Zed Sans/Zed Mono fonts require manual download and install).
  • Defaults to a light theme during the day.
  • Adds recognition of *.markdown files as Markdown.
  • Adds updated window controls on Linux.
  • First official stable release of Zed on Linux.
  • Improves power consumption on Intel Macs by preferring integrated GPUs over discrete GPUs.
  • Improves editor performance with large undo histories.
  • Improves performance of 'replace all' in buffer search and project search.
└──▷ BREAKING ON UPGRADE
  • !editor::RevealInFinder is renamed to editor::RevealInFileManager; any keybindings or config referencing the old name will stop working.
v0.142.4 NOTES STABLE

Zed v0.142.4 adds Claude 3.5 Sonnet support, customizable OpenAI-compatible models, and new editor settings including scroll_beyond_last_line and gutter.runnables.

└──▷ GET THIS VERSION
$ git clone --branch v0.142.4 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.142.4
└──▷ USE IT
Configure Zed's assistant to use Claude 3.5 Sonnet via Anthropic for AI-assisted coding.
json
"assistant": {
  "version": "1",
  "provider": {
    "default_model": "claude-3-5-sonnet",
    "name": "anthropic"
  }
}
  • Adds Claude 3.5 Sonnet (claude-3-5-sonnet) as a supported model via the assistant config block with "name": "anthropic" and "default_model": "claude-3-5-sonnet".
  • Adds scroll_beyond_last_line setting to control whether the editor scrolls past the final line.
  • Adds gutter.runnables setting to control whether runnable indicators are displayed in the gutter.
  • Adds active_line_width setting to configure the line width of the active indent guide.
  • Adds ability to customize available models for OpenAI-compatible services.
+10 moreshow less
  • Adds editor: select enclosing symbol command (tree-sitter-based), useful with inline assist to rewrite a function.
  • Adds workspace: clear all notifications command to dismiss all notifications.
  • Adds mouse context action to copy a permalink to a specific line.
  • Adds package version tooltips when hovering over package.json dependency entries.
  • Adds vertical scrollbar to the project panel.
  • Adds ability to remove multi-cursors by clicking on them again.
  • Adds ability to bind shift or other modifier keys in keybindings.
  • Adds Vim auto_surround support.
  • Adds action to surround text in Vim visual mode (no default binding).
  • Adds Markdown Preview shortcut for the Atom keymap.
Was this useful?
◆  AI Agent Frameworks

CrewAI

Sources Release notes → v0.41.0 2 RELEASES · 2024-07-06 → 2024-07-19 NOTES STABLE

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

CrewAI v0.41.0 adds crew planning, task replay, memory reset, LLM retry, and type-safe outputs.

└──▷ GET THIS VERSION
$ git clone --branch v0.41.0 https://github.com/crewAIInc/crewAI.git
# already have the repo? check out this version:
$ git checkout v0.41.0
└──▷ USE IT
Enable pre-execution planning so your crew deliberates a strategy before assigning tasks — useful for complex, multi-step investigations.
python
from crewai import Crew

crew = Crew(
    agents=[...],
    tasks=[...],
    planning=True
)
result = crew.kickoff()
Replay from a specific failed task after a partial run, without restarting the entire crew from scratch.
$ crewai replay <task_id>
Clear stale crew memory before re-running to ensure the crew starts fresh without prior context contaminating results.
$ crewai reset-memory
  • Adds planning=True to Crew instances so crews reason through a plan before executing tasks.
  • Introduces a CLI replay feature to list tasks from the last run and re-execute from a specific task.
  • Enables resetting crew memory before a run via a new reset-memory capability.
  • Adds LLM call retry support so a failed LLM call no longer halts crew execution.
  • All crews and tasks now return typed CrewOutput and TaskOutput objects instead of raw strings.
+3 moreshow less
  • Adds ability to customize the output converter on agents/tasks.
  • Enhances tools with type hinting and new attributes.
  • Adds MultiON Tool integration.
└──▷ BREAKING ON UPGRADE
  • !All crews and tasks now return TaskOutput and CrewOutput objects instead of plain strings — code that treats crew/task return values as strings will break.
1 more release in this issue · 2024-07-06 → 2024-07-19
v0.36.0 NOTES STABLE

CrewAI v0.36.0 adds AgentOps native support, Firecrawl Tools, and tool-result-as-agent-result capability

└──▷ GET THIS VERSION
$ git clone --branch v0.36.0 https://github.com/crewAIInc/crewAI.git
# already have the repo? check out this version:
$ git checkout v0.36.0
  • Adds native AgentOps integration for agent observability and monitoring.
  • Adds Firecrawl Tools for web scraping and crawling within CrewAI agents.
  • Adds the ability to return a tool's result directly as an agent result.
  • Improves the coding Interpreter tool.
  • Adds the ability to create a custom converter class.
Was this useful?

Stanford NLP DSPy

Sources Release notes → 2.4.13 3 RELEASES · 2024-07-06 → 2024-07-29 NOTES STABLE

DSPy 2.4.13 adds configurable LM/RM backoff time and LangChain tool execution support.

└──▷ GET THIS VERSION
$ git clone --branch 2.4.13 https://github.com/stanfordnlp/dspy.git
# already have the repo? check out this version:
$ git checkout 2.4.13
└──▷ USE IT
Slow down retry pressure on rate-limited LM providers by setting a custom backoff interval at startup.
python
dspy.settings.configure(backoff_time=5)
  • Adds backoff_time parameter to dspy.settings.configure() for configurable retry backoff across LM/RM providers.
  • Adds LangChain Tool Execution support.
2 more releases in this issue · 2024-07-06 → 2024-07-29
v2.4.12 NOTES STABLE

DSPy v2.4.12 lets you compile dspy.Predict and dspy.ChainOfThought directly and improves Chat LM adapter support.

└──▷ GET THIS VERSION
$ git clone --branch v2.4.12 https://github.com/stanfordnlp/dspy.git
# already have the repo? check out this version:
$ git checkout v2.4.12
  • Supports compiling dspy.Predict and dspy.ChainOfThought directly as Modules without wrapping them in a dspy.Module object.
  • Improves the experimental=True Chat LM adapter support (enabled via dspy.configure(experimental=True)) introduced in v2.4.11, refining zero-shot generation quality for Chat LMs including GPT-3.5, GPT-4, Llama3, Mixtral, and DBRX.
v2.4.11 NOTES STABLE

DSPy v2.4.11 adds experimental adapter support for smoother Chat LM zero-shot generation via dspy.configure(experimental=True)

└──▷ GET THIS VERSION
$ git clone --branch v2.4.11 https://github.com/stanfordnlp/dspy.git
# already have the repo? check out this version:
$ git checkout v2.4.11
└──▷ USE IT
Activate the new Chat LM adapters to get more predictable zero-shot outputs without changing your existing DSPy program logic.
python
import dspy
dspy.configure(experimental=True)
  • Enables dspy.configure(experimental=True) to activate new adapter support, improving zero-shot generation predictability and accuracy for Chat LMs including GPT-3.5, GPT-4, Llama3, Mixtral, and DBRX.
  • Adds initial support for new adapters with improved handling of Chat LM interactions.
Was this useful?

deepset Haystack

Sources Release notes → v2.3.0 2 RELEASES · 2024-07-04 → 2024-07-15 NOTES STABLE

Haystack v2.3.0 adds experimental package, five new components, and distribution-based rank fusion

└──▷ GET THIS VERSION
$ git clone --branch v2.3.0 https://github.com/deepset-ai/haystack.git
# already have the repo? check out this version:
$ git checkout v2.3.0
└──▷ USE IT
Share a single in-memory document store between a writer pipeline and a retrieval pipeline without duplicating data.
python
from haystack.document_stores.in_memory import InMemoryDocumentStore
from haystack.dataclasses import Document

index = "shared_knowledge_base"
store_writer = InMemoryDocumentStore(index=index)
store_retriever = InMemoryDocumentStore(index=index)

store_writer.write_documents([Document(content="Haystack is an LLM framework.")])
print(store_retriever.count_documents())  # 1 — same memory
Drop documents missing a ranking field instead of letting them pollute scored results.
python
from haystack.components.rankers import MetaFieldRanker

ranker = MetaFieldRanker(meta_field="score", missing_meta="drop")
result = ranker.run(documents=docs)
print(result["documents"])  # only documents that have 'score' metadata
  • Introduces the haystack-experimental package (pip install haystack-experimental), importable via from haystack_experimental.component_type import Component, shipping three initial components: OpenAIFunctionCaller, OpenAPITool, and EvaluationHarness.
  • Adds OpenAIFunctionCaller (in haystack-experimental) to call LLM-returned functions after Chat Generators.
  • Adds OpenAPITool (in haystack-experimental) to translate natural-language instructions into structured payloads for RESTful OpenAPI endpoints.
  • Adds EvaluationHarness (in haystack-experimental) to wrap pipelines and complex evaluation tasks into a single runnable component.
  • Adds TransformersTextRouter component, which uses a Transformers text-classification pipeline to route text inputs to different output connections based on model labels.
+17 moreshow less
  • Adds SentenceWindowRetrieval component for sentence-window retrieval, fetching surrounding context documents for a given chunk from the document store.
  • Adds DOCXToDocument converter component (uses python-docx) to convert Docx files into Haystack Documents.
  • Adds a PPTX-to-Document converter (uses python-pptx) that extracts text from each slide, separating slides with a page break \f so DocumentSplitter can split by slide.
  • Adds Distribution-Based Score Fusion (DBSF) as a new ranking mode in JoinDocuments.
  • Adds missing_meta parameter to MetaFieldRanker controlling handling of documents that lack the ranked meta field; supported values are 'bottom', 'top', and 'drop'.
  • Adds index parameter to InMemoryDocumentStore to enable memory sharing between multiple instances using the same index name.
  • Adds filter_policy init parameter to InMemoryBM25Retriever and InMemoryEmbeddingRetriever with 'replace' or 'merge' options for combining runtime and initial filters.
  • Adds custom Jinja2 filter callables support to ConditionalRouter via user-supplied filter callables accessible in condition expressions.
  • Adds split_id and split_overlap support to DocumentSplitter for finer control over the splitting process.
  • Adds save_to_disk and write_to_disk serialization methods to InMemoryDocumentStore.
  • Adds remove_component method to PipelineBase to delete components and their connections from a pipeline.
  • Adds max_retries and timeout parameters to AzureOpenAIGenerator, AzureOpenAIChatGenerator, AzureOpenAITextEmbedder, and AzureOpenAIDocumentEmbedder; values fall back to OPENAI_MAX_RETRIES (default 5) and OPENAI_TIMEOUT (default 30) environment variables.
  • Adds support for structlog context variables to structured logging.
  • Enables AnswerBuilder to accept ChatMessage objects as input in addition to strings, with metadata automatically added to the answer.
  • Expands LinkContentFetcher content-type support to include glob patterns for text, application, audio, and video types via a flexible handler resolution mechanism.
  • Pipeline serialization to YAML now supports tuples as field values.
  • Extends HuggingFace API components to accept both HF_API_TOKEN and HF_TOKEN environment variable names.
└──▷ BREAKING ON UPGRADE
  • !trafilatura is no longer installed automatically; run pip install trafilatura manually to continue using HTMLToDocument.
  • !The converter_name parameter has been removed from PyPDFToDocument; use the converter init parameter with an instance implementing the PyPDFConverter protocol (convert, to_dict, from_dict) instead, or rely on the provided DefaultConverter class.
  • !HuggingFaceTEITextEmbedder and HuggingFaceTEIDocumentEmbedder have been removed; replace with HuggingFaceAPITextEmbedder and HuggingFaceAPIDocumentEmbedder.
  • !HuggingFaceTGIGenerator and HuggingFaceTGIChatGenerator have been removed; replace with HuggingFaceAPIGenerator and HuggingFaceAPIChatGenerator.
1 more release in this issue · 2024-07-04 → 2024-07-15
v2.2.4 NOTES STABLE

Haystack v2.2.4 adds filter_policy to in-memory retrievers for flexible runtime filter control.

└──▷ GET THIS VERSION
$ git clone --branch v2.2.4 https://github.com/deepset-ai/haystack.git
# already have the repo? check out this version:
$ git checkout v2.2.4
└──▷ USE IT
Use filter_policy='merge' on an InMemoryBM25Retriever so that runtime filters are combined with the retriever's initial filters rather than overwriting them.
python
from haystack.components.retrievers.in_memory import InMemoryBM25Retriever

retriever = InMemoryBM25Retriever(
    document_store=document_store,
    filter_policy='merge'
)
  • Introduces filter_policy init parameter for InMemoryBM25Retriever and InMemoryEmbeddingRetriever, accepting 'replace' or 'merge' to control how runtime filters interact with initial filters.
  • Adds apply_filter_policy function to standardize filter-policy application across all document store-specific retrievers, enabling consistent replace/merge behavior.
Was this useful?

LangChain

Sources Release notes → langchain-openai==0.1.20 37 RELEASES · 2024-07-02 → 2024-07-31 NOTES STABLE

langchain-openai 0.1.20 adds proxy support to base embeddings and TypedDict-to-tool schema conversion.

└──▷ GET THIS VERSION
$ git clone --branch langchain-openai==0.1.20 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-openai==0.1.20
  • Adds proxy support to the OpenAI base embeddings class, enabling embeddings requests to be routed through an HTTP proxy.
  • Adds automatic conversion of TypedDict definitions to tool schemas, allowing TypedDict types to be used directly when defining tools.
36 more releases in this issue · 2024-07-02 → 2024-07-31
langchain-anthropic==0.1.22 NOTES STABLE

langchain-anthropic 0.1.22 adds ToolMessage.status and TypedDict-to-tool-schema conversion support.

└──▷ GET THIS VERSION
$ git clone --branch langchain-anthropic==0.1.22 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-anthropic==0.1.22
  • Introduces ToolMessage.status field on ToolMessage to carry status information for tool call results.
  • Adds support for converting TypedDict types directly to tool schemas, enabling TypedDict-defined inputs to be used as tool definitions.
langchain-core==0.2.26 NOTES STABLE

langchain-core 0.2.26 adds support for using TypedDict to define tool schemas.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.26 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.26
  • Supports converting TypedDict classes into tool schemas, enabling typed Python dicts to be used directly when defining tools.
langchain-core==0.2.25 NOTES STABLE

langchain-core 0.2.25 adds ToolMessage.status field and support for non-pickleable tool call arguments.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.25 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.25
  • Adds ToolMessage.status field to represent the status of a tool message.
  • Supports tool calls with non-pickleable arguments in tools, broadening the range of objects that can be passed as tool call inputs.
langchain-openai==0.1.19 NOTES STABLE

langchain-openai adds support for the gpt-4o-mini model

└──▷ GET THIS VERSION
$ git clone --branch langchain-openai==0.1.19 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-openai==0.1.19
  • Adds gpt-4o-mini as a supported model in the OpenAI integration.
langchain-core==0.2.24 NOTES STABLE

LangChain Core 0.2.24 adds rate limiting abstractions and async support for InMemoryVectorStore

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.24 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.24
└──▷ USE IT
Throttle LLM calls to stay within API rate limits by attaching an InMemoryRateLimiter to your model.
python
from langchain_core.rate_limiters import InMemoryRateLimiter
from langchain_openai import ChatOpenAI

rate_limiter = InMemoryRateLimiter(requests_per_second=2)
llm = ChatOpenAI(model='gpt-4o', rate_limiter=rate_limiter)
response = llm.invoke('Summarize this document.')
Run async similarity searches against an in-memory vector store inside an async pipeline or FastAPI endpoint.
python
from langchain_core.vectorstores import InMemoryVectorStore
from langchain_openai import OpenAIEmbeddings
import asyncio

store = InMemoryVectorStore(embedding=OpenAIEmbeddings())
await store.aadd_texts(['doc one', 'doc two', 'doc three'])
results = await store.asimilarity_search('relevant query', k=2)
  • Adds rate_limiter field to BaseModel along with a RateLimiter abstraction and InMemoryRateLimiter in-memory implementation for controlling request throughput to LLMs.
  • Adds asynchronous support to InMemoryVectorStore, enabling non-blocking vector similarity operations in async LangChain pipelines.
  • Aligns ChatPromptTemplate.__init__ behavior with ChatPromptTemplate.from_messages, so both construction paths are now equivalent.
langchain-cli==0.0.26 NOTES STABLE

LangChain CLI 0.0.26 adds a conversation memory combining persistent vectorstore history with a token buffer.

└──▷ GET THIS VERSION
$ git clone --branch langchain-cli==0.0.26 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-cli==0.0.26
  • Adds a conversation memory type that combines an optionally persistent vectorstore history with a token buffer for richer, scalable chat context management.
langchain-qdrant==0.1.3 NOTES STABLE

langchain-qdrant 0.1.3 adds async similarity search with relevance scores to the Qdrant class.

└──▷ GET THIS VERSION
$ git clone --branch langchain-qdrant==0.1.3 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-qdrant==0.1.3
  • Adds _asimilarity_search_with_relevance_scores method to the Qdrant class for async similarity search returning relevance scores.
langchain-experimental==0.0.63 NOTES STABLE

LangChain Experimental 0.0.63 adds prompt restrictions for non-function-calling LLMs in LLMGraphTransformer and tightens PALValidator blocking.

└──▷ GET THIS VERSION
$ git clone --branch langchain-experimental==0.0.63 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-experimental==0.0.63
  • Adds conditional logic in LLMGraphTransformer to inject restrictions into prompts for LLMs that do not support function calling, enabling graph extraction with a broader set of models.
  • Expands PALValidator to block additional unsafe constructs, hardening code execution paths in PAL chains.
langchain-community==0.2.10 NOTES STABLE

langchain-community 0.2.10 adds dedoc-based document loaders, a link-extraction document transformer, and a progress-bar toggle flag.

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.2.10 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.2.10
  • Adds new document loaders based on the dedoc library for parsing a wide range of document formats.
  • Adds a new document transformer for extracting links from documents.
  • Adds a flag to toggle the progress bar on document loading operations.
langchain==0.2.11 NOTES STABLE

LangChain 0.2.11 adds async methods to ConversationSummaryBufferMemory and relaxes multi-agent return_direct validation.

└──▷ GET THIS VERSION
$ git clone --branch langchain==0.2.11 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain==0.2.11
  • Adds async methods to ConversationSummaryBufferMemory, enabling non-blocking memory summarization in async LangChain pipelines.
  • Removes return_direct validation restriction in multi-agent setups, allowing agents to use return_direct without triggering an error.
  • Updates ContextualCompressionRetriever base_retriever type to RetrieverLike, broadening the range of retriever objects accepted.
langchain-core==0.2.23 NOTES STABLE

langchain-core 0.2.23 relaxes tool/parser type constraints and enables RunnableWithMessageHistory without config

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.23 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.23
  • Enables RunnableWithMessageHistory to run without requiring an explicit config argument.
  • Accepts configurable keys at the top level, reducing nesting when passing configuration.
  • Relaxes type-checking constraints on tools and parsers, allowing broader input types.
langchain-community==0.2.9 NOTES STABLE

langchain-community 0.2.9 adds MongoDB byte store, Riza code execution, TextEmbed, ApertureDB, and new graph/link-extraction integrations

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.2.9 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.2.9
└──▷ USE IT
Persist chat history to a file with explicit UTF-8 encoding when working with non-ASCII content.
python
from langchain_community.chat_message_histories import FileChatMessageHistory

history = FileChatMessageHistory(
    file_path="chat_history.json",
    file_encoding="utf-8",
    json_encoding="utf-8"
)
Cache embeddings or arbitrary bytes in MongoDB as a key-value byte store.
python
from langchain_community.storage import MongoDBByteStore

store = MongoDBByteStore(
    connection_string="mongodb://localhost:27017",
    db_name="langchain",
    collection_name="byte_store"
)
  • Adds file_encoding and json_encoding parameters to FileChatMessageHistory for specifying character and JSON encoding when persisting chat histories.
  • Adds MongoDBByteStore as a new byte store backend for MongoDB.
  • Adds RizaCodeInterpreter tool for Python and JavaScript code execution via the Riza API.
  • Adds TextEmbedEmbeddings integration for the TextEmbed embedding service.
  • Adds ApertureDB as a new vector store backend.
+16 moreshow less
  • Adds keybert-based and GLiNER-based link extractors for graph store pipelines.
  • Adds graph store extractors for constructing knowledge graphs.
  • Adds GraphCypherQAChain support for passing additional user-provided inputs to Cypher generation.
  • Adds stream parameter support to the Cloudflare Workers AI integration.
  • Adds support for advanced text extraction options for PDF documents.
  • Adds hybrid search support for Databricks vector search.
  • Adds You.com conversational API integration.
  • Adds structured output support to ChatTongyi.
  • Adds PebbloSafeLoader support for SharePoint Loader and renames the loader type.
  • Adds checksum verification when sending data to Pebblo Cloud.
  • Adds Neo4j method for associating relationship embeddings, alongside updates to use non-deprecated Cypher methods.
  • Replaces the YouTube channel search API with the playlistItems API in GoogleApiYoutubeLoader._get_document_for_channel for more reliable channel document retrieval.
  • Forces opt-in for WebResearchRetriever (previously enabled by default; addresses CVE-2024-3095).
  • Adds streaming support to HuggingFacePipeline.
  • Adds Azure Search additional options support.
  • Propagates cost information to the OpenAI callback handler.
└──▷ BREAKING ON UPGRADE
  • !WebResearchRetriever now requires explicit opt-in to be enabled; existing setups relying on the default enabled state will need to update their configuration.
langchain==0.2.10 NOTES STABLE

LangChain 0.2.10 adds aadd_documents to ParentDocumentRetriever, a new ListRerank document compressor, and seed control for evaluations.

└──▷ GET THIS VERSION
$ git clone --branch langchain==0.2.10 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain==0.2.10
└──▷ USE IT
Asynchronously ingest documents into a ParentDocumentRetriever without blocking — useful in async pipelines or web servers.
python
await retriever.aadd_documents(documents)
  • Adds aadd_documents async method to ParentDocumentRetriever for non-blocking document ingestion.
  • Adds ListRerank document compressor for reranking retrieved documents using a list-based approach.
  • Passes seed directly into evaluation runs for reproducible LLM evaluation results.
langchain-mongodb==0.1.7 NOTES STABLE

langchain-mongodb 0.1.7 adds index creation helpers, string ID support, and custom options for MongoDBChatMessageHistory.

└──▷ GET THIS VERSION
$ git clone --branch langchain-mongodb==0.1.7 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-mongodb==0.1.7
  • Adds experimental driver-side index creation helper to MongoDBVectorSearch for programmatic index management without leaving Python.
  • Adds string ID support to MongoDBVectorSearch — the vectorstore now accepts and returns string IDs instead of requiring ObjectId types.
  • Adds custom options support to MongoDBChatMessageHistory, allowing callers to pass additional configuration when constructing chat history instances.
langchain-core==0.2.22 NOTES STABLE

LangChain Core 0.2.22 adds Pydantic v1 and v2 BaseModel support in argsschema.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.22 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.22
  • Supports all versions of Pydantic BaseModel in argsschema, enabling tools and chains to accept both Pydantic v1 and v2 model schemas without conversion.
langchain-core==0.2.21 NOTES STABLE

langchain-core 0.2.21 adds InjectedToolArg annotation for marking tool arguments as runtime-injected.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.21 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.21
└──▷ USE IT
Mark a tool argument as runtime-injected so the LLM never sees or fills it — useful for passing session state, user context, or auth tokens into a tool without exposing them to the model.
python
from langchain_core.tools import tool
from langchain_core.tools.base import InjectedToolArg
from typing import Annotated

@tool
def get_user_data(query: str, user_id: Annotated[str, InjectedToolArg]) -> str:
    """Fetch data for the current user."""
    return f"Data for {user_id}: {query}"
  • Adds InjectedToolArg annotation to mark tool arguments that should be injected at runtime rather than supplied by the model.
langchain-openai==0.1.17 NOTES STABLE

langchain-openai 0.1.17 exposes raw response headers from OpenAI API calls.

└──▷ GET THIS VERSION
$ git clone --branch langchain-openai==0.1.17 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-openai==0.1.17
  • Exposes raw HTTP response headers returned by the OpenAI API, enabling access to metadata such as rate-limit and request-ID headers.
langchain==0.2.9 NOTES STABLE

LangChain 0.2.9 adds similarity_score_threshold search type support to MultiVectorRetriever.

└──▷ GET THIS VERSION
$ git clone --branch langchain==0.2.9 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain==0.2.9
  • Adds similarity_score_threshold as a supported search type for MultiVectorRetriever, enabling relevance-filtered retrieval.
langchain-core==0.2.20 NOTES STABLE

langchain-core 0.2.20 adds encoding options for file-based prompt templates and expands message utils for LCEL compatibility.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.20 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.20
  • Adds encoding options when creating a prompt template from a file, enabling non-UTF-8 source files to be loaded correctly.
  • Extends message utility functions to work with LCEL (LangChain Expression Language) pipelines.
  • Updates template format typing to include jinja2 as a Literal value alongside the existing options.
langchain==0.2.8 NOTES STABLE

LangChain 0.2.8 adds configurable generic model support, document_variable_name param, and ToolCall/ToolMessage I/O for Tools.

└──▷ GET THIS VERSION
$ git clone --branch langchain==0.2.8 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain==0.2.8
└──▷ USE IT
Explicitly name the documents variable in a stuff-documents chain when your prompt template uses a non-default variable name.
python
from langchain.chains.combine_documents import create_stuff_documents_chain

chain = create_stuff_documents_chain(
    llm=llm,
    prompt=prompt,
    document_variable_name="context"
)
Select the backing LLM at runtime so a single chain definition works across different model providers.
python
from langchain.chat_models import init_chat_model

model = init_chat_model("gpt-4o", model_provider="openai")
response = model.invoke("Summarize the latest threat report.")
  • Adds document_variable_name parameter to create_stuff_documents_chain, letting callers explicitly name the prompt variable that receives the stuffed documents.
  • Introduces a generic configurable model via init_chat_model, enabling runtime model selection without changing chain code.
  • Supports ToolCall as Tool input and ToolMessage as Tool output, aligning tool invocation with the structured message types used by chat models.
langchain-core==0.2.19 NOTES STABLE

langchain-core 0.2.19 adds args_schema support to as_tool() and includes tool name in tool messages.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.19 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.19
  • Adds args_schema parameter support to the as_tool method, allowing callers to pass a custom schema that controls how tool arguments are validated and described.
  • Adds tool name field to tool messages, making it easier to trace which tool produced a given message in multi-tool chains.
langchain-qdrant==0.1.2 NOTES STABLE

langchain-qdrant 0.1.2 ships a new Qdrant implementation and a new sparse embeddings provider interface.

└──▷ GET THIS VERSION
$ git clone --branch langchain-qdrant==0.1.2 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-qdrant==0.1.2
  • Introduces a new Qdrant implementation replacing the prior integration internals.
  • Adds a new sparse embeddings provider interface (Part 1), enabling sparse vector support in Qdrant-backed retrievers.
langchain-anthropic==0.1.20 NOTES STABLE

langchain-anthropic 0.1.20 adds support for ToolCall as Tool input and ToolMessage as Tool output

└──▷ GET THIS VERSION
$ git clone --branch langchain-anthropic==0.1.20 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-anthropic==0.1.20
  • Supports ToolCall as Tool input and ToolMessage as Tool output, enabling direct round-trip tool-calling workflows between Anthropic models and LangChain tools.
langchain-openai==0.1.16 NOTES STABLE

langchain-openai 0.1.16 adds native support for ToolCall as Tool input and ToolMessage as Tool output.

└──▷ GET THIS VERSION
$ git clone --branch langchain-openai==0.1.16 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-openai==0.1.16
  • Supports ToolCall objects as direct input to Tools and ToolMessage objects as Tool output, enabling richer, more structured tool-call round-trips in LLM pipelines.
langchain-fireworks==0.1.5 NOTES STABLE

langchain-fireworks 0.1.5 adds ToolCall-as-input and ToolMessage-as-output support for Tools

└──▷ GET THIS VERSION
$ git clone --branch langchain-fireworks==0.1.5 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-fireworks==0.1.5
  • Supports ToolCall as Tool input and ToolMessage as Tool output, enabling structured round-trip tool-calling workflows with Fireworks-backed models.
  • Reads tool invocation results from the tool_calls attribute on model responses.
langchain-mistralai==0.1.10 NOTES STABLE

LangChain MistralAI 0.1.10 adds support for ToolCall as Tool input and ToolMessage as Tool output.

└──▷ GET THIS VERSION
$ git clone --branch langchain-mistralai==0.1.10 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-mistralai==0.1.10
  • Supports ToolCall as Tool input and ToolMessage as Tool output, enabling structured tool-calling round-trips in MistralAI-backed chains.
langchain-core==0.2.16 NOTES STABLE

LangChain Core 0.2.16 lets Tools accept ToolCall inputs and return ToolMessage outputs.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.16 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.16
  • Tools now accept ToolCall objects directly as input and can return ToolMessage objects as output, enabling richer, structured tool-call workflows across LangChain integrations.
langchain-core==0.2.15 NOTES STABLE

langchain-core 0.2.15 adds custom event dispatching and richer Mermaid graph metadata rendering.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.15 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.15
  • Adds dispatching for custom events, enabling components to emit and handle user-defined events in the LangChain event stream.
  • Propagates parse_docstring to the tool decorator so tool descriptions are automatically extracted from function docstrings.
  • Renders metadata key-value pairs when drawing Mermaid graphs, and includes metadata in the graph JSON representation.
  • Adds as_tool method version annotation via versionadded for clearer API documentation.
langchain-core==0.2.13 NOTES STABLE

LangChain Core 0.2.13 adds Runnable-to-tool conversion and a new ToolMessage.raw_output field.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.13 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.13
└──▷ USE IT
Inspect the raw, unprocessed tool output when a ToolMessage is returned, useful for debugging or post-processing tool responses.
python
from langchain_core.messages import ToolMessage

msg = ToolMessage(content='42', raw_output={'result': 42, 'status': 'ok'}, tool_call_id='call_1')
print(msg.raw_output)
  • Adds ToolMessage.raw_output field to capture the raw output from a tool invocation alongside the serialized message content.
  • Supports conversion of Runnables to tools, enabling any Runnable to be used directly as a tool in an agent or chain.
  • Moves JSON parsing in the base chat model and output parser to a background thread, unlocking non-blocking parsing for large payloads.
langchain-community==0.2.7 NOTES STABLE

langchain-community 0.2.7 adds PGVector support in PebbloRetrievalQA, SingleStoreDB semantic cache, bind_tools for ChatLiteLLM, and Jira cloud/token auth.

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.2.7 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.2.7
└──▷ USE IT
Authenticate to Jira Cloud using only a token, without supplying a username.
python
from langchain_community.utilities.jira import JiraAPIWrapper

wrapper = JiraAPIWrapper(
    jira_instance_url='https://myorg.atlassian.net',
    jira_api_token='<your-token>',
    cloud=True
)
Bind tools to a ChatLiteLLM model so the LLM can invoke structured functions during a chain.
python
from langchain_community.chat_models.litellm import ChatLiteLLM

llm = ChatLiteLLM(model='gpt-4')
llm_with_tools = llm.bind_tools([my_tool])
Use SingleStoreDB as a semantic cache to avoid redundant LLM calls for similar queries.
python
from langchain_community.cache import SingleStoreDBSemanticCache
import langchain

langchain.llm_cache = SingleStoreDBSemanticCache(
    embedding=my_embeddings,
    host='<singlestore-host>',
    port=3306,
    user='<user>',
    password='<password>',
    database='<db>'
)
  • Adds cloud parameter to JiraAPIWrapper to support Jira Cloud instances alongside server deployments.
  • Adds model_name parameter to GPT4AllEmbeddings for explicit model selection.
  • Adds bind_tools function to ChatLiteLLM for structured tool-calling support.
  • Adds tool_calls response support to the community tool-calls integration.
  • Adds SingleStoreDB semantic cache via SingleStoreDB integration.
+5 moreshow less
  • Supports PGVector as a retriever backend in PebbloRetrievalQA.
  • Allows Jira authentication using only a token, without requiring username/password.
  • Implements asynchronous interface for ChatBaichuan.
  • Restricts Bing search integration to web search as the sole option.
  • Registers pandas DataFrames in DuckDB automatically when creating a vector store.
langchain==0.2.7 NOTES STABLE

LangChain 0.2.7 adds a conversation memory that combines a persistent vectorstore history with a token buffer.

└──▷ GET THIS VERSION
$ git clone --branch langchain==0.2.7 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain==0.2.7
  • Adds a new conversation memory type that combines an optionally persistent vectorstore history with a token buffer, enabling long-term retrieval-augmented memory alongside recent-context windowing.
langchain-core==0.2.12 NOTES STABLE

langchain-core 0.2.12 adds GraphStore, VectorStore upsert methods, and InMemoryChatMessageHistory to core.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.12 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.12
└──▷ USE IT
Persist or overwrite documents in a vector store without duplicating entries — useful in indexing pipelines where the same document may be re-ingested.
python
from langchain_core.vectorstores import VectorStore

# synchronous upsert
vectorstore.upsert(documents)

# async streaming upsert for large batches
async for result in vectorstore.astreaming_upsert(documents):
    print(result)
Use InMemoryChatMessageHistory directly from core in unit tests or lightweight apps without depending on langchain-community.
python
from langchain_core.chat_history import InMemoryChatMessageHistory

history = InMemoryChatMessageHistory()
await history.aadd_messages([HumanMessage(content="Hello")])
print(history.messages)
  • Adds upsert, streaming_upsert, aupsert, and astreaming_upsert methods to the VectorStore abstraction for writing documents with conflict-resolution semantics.
  • Adds Graph Store component to langchain-core, enabling graph-based retrieval as a first-class abstraction.
  • Moves InMemoryChatMessageHistory into langchain-core (previously in langchain-community), making it available without the community package.
  • Extends conversion utilities to handle RemoveMessage, enabling message deletion in conversation history workflows.
  • Unifies function schema parsing across the core library for consistent tool-call handling.
+2 moreshow less
  • Supports streaming tool calls when the called function has no arguments.
  • Replaces @root_validator() with @pre_init across all models, aligning with the updated validation lifecycle.
langchain-openai==0.1.14 NOTES STABLE

langchain-openai 0.1.14 exposes the model request payload for OpenAI calls.

└──▷ GET THIS VERSION
$ git clone --branch langchain-openai==0.1.14 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-openai==0.1.14
  • Exposes the model request payload sent to OpenAI, giving callers visibility into the exact data submitted per request.
langchain-core==0.2.11 NOTES STABLE

langchain-core 0.2.11 adds vector store batch lookup, in-memory cache size limits, a BaseMedia type, and optional Document IDs.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.11 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.11
└──▷ USE IT
Retrieve specific documents from a vector store by their IDs without a similarity search.
python
docs = vectorstore.get_by_ids(["doc-001", "doc-002", "doc-003"])
Cap the in-memory LLM response cache to avoid unbounded memory growth in long-running services.
python
from langchain_core.caches import InMemoryCache
cache = InMemoryCache(maxsize=1000)
  • Adds get_by_ids method to the VectorStore base interface, enabling batch retrieval of documents by ID.
  • Adds maxsize parameter to InMemoryCache to cap memory usage.
  • Adds optional id field to the Document schema for explicit document identification.
  • Introduces BaseMedia base object as a new type in the core schema.
  • Adds RemoveMessage to support removing messages from conversation state.
langchain-ai21==0.1.7 NOTES STABLE

langchain-ai21 0.1.7 adds streaming support for AI21 Labs Jamba models.

└──▷ GET THIS VERSION
$ git clone --branch langchain-ai21==0.1.7 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-ai21==0.1.7
  • Adds streaming support for AI21 Labs Jamba models.
langchain-anthropic==0.1.18 NOTES STABLE

langchain-anthropic 0.1.18 adds stop_reason to ChatAnthropic streaming results.

└──▷ GET THIS VERSION
$ git clone --branch langchain-anthropic==0.1.18 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-anthropic==0.1.18
  • Adds stop_reason field to ChatAnthropic stream result chunks, surfacing why the model stopped generating.
Was this useful?

LangChain LangGraph

Sources Release notes → 0.1.17 9 RELEASES · 2024-07-09 → 2024-07-31 NOTES STABLE

Build resilient agents.

LangGraph 0.1.17 lets update_state() accept None values to preserve configuration without changing state.

└──▷ GET THIS VERSION
$ git clone --branch 0.1.17 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.1.17
└──▷ USE IT
Preserve checkpoint configuration between steps without overwriting any state values — useful when you need to advance step count or merge configurable fields mid-graph.
python
graph.update_state(config, values=None)
  • Supports None as a valid values argument in Pregel.update_state(), enabling configuration-only state updates that leave channel values unchanged.
8 more releases in this issue · 2024-07-09 → 2024-07-31
0.1.10 NOTES STABLE

LangGraph 0.1.10 adds InjectedState for automatic graph-state injection into tools and improves parallel tool execution in ToolNode.

└──▷ GET THIS VERSION
$ git clone --branch 0.1.10 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.1.10
└──▷ USE IT
Give a tool access to the current graph state (e.g., conversation history) without asking the LLM to supply it — useful for retrieval or policy tools that need context the model shouldn't fabricate.
python
from typing import Annotated
from langgraph.prebuilt.tool_node import InjectedState
from langchain_core.tools import tool

class AgentState(TypedDict):
    messages: list
    user_id: str

@tool
def lookup_policy(
    topic: str,
    state: Annotated[AgentState, InjectedState()],
) -> str:
    """Look up company policy, scoped to the current user."""
    user_id = state["user_id"]  # injected automatically; model never sees it
    return fetch_policy(topic, user_id)
  • Adds InjectedState annotation to automatically inject graph state into tool arguments inside ToolNode, so tools can access state fields without the model generating them.
  • Improves parallel execution of tools in ToolNode using config lists via get_config_list from langchain-core.
  • Adds GraphInterrupt error class for structured handling of interruptions in nested graphs.
  • Adds EmptyInputError error class for clearer reporting when graphs receive empty inputs.
  • Enhances checkpoint parent-child relationship tracking and includes parent configuration data in checkpoint tuples, improving support for nested graphs.
0.1.9 NOTES STABLE

LangGraph 0.1.9 adds state_modifier to create_react_agent, custom state schemas, retry policies, and new background executor classes.

└──▷ GET THIS VERSION
$ git clone --branch 0.1.9 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.1.9
└──▷ USE IT
Use state_modifier to prepend a system prompt from the full agent state, giving you access to state fields beyond just messages.
python
from langgraph.prebuilt import create_react_agent
from langchain_openai import ChatOpenAI

def modify_state(state):
    # state is the full graph state, not just messages
    return [{"role": "system", "content": "You are a helpful security analyst."}] + state["messages"]

agent = create_react_agent(
    model=ChatOpenAI(model="gpt-4o"),
    tools=[...],
    state_modifier=modify_state,
)
Define a custom state schema with extra fields so the agent graph carries domain-specific context alongside messages.
python
from typing import TypedDict, Annotated
from langgraph.prebuilt import create_react_agent
from langchain_openai import ChatOpenAI
import operator

class MyAgentState(TypedDict):
    messages: Annotated[list, operator.add]
    user_role: str          # custom field
    session_id: str         # custom field

agent = create_react_agent(
    model=ChatOpenAI(model="gpt-4o"),
    tools=[...],
    state_schema=MyAgentState,
)
  • Adds state_modifier parameter to create_react_agent for finer control over LLM inputs, replacing the now-deprecated messages_modifier.
  • Adds state_schema parameter to create_react_agent, enabling custom graph state definitions beyond the default AgentState.
  • Adds BackgroundExecutor and AsyncBackgroundExecutor classes in langgraph.pregel for structured background task management and cancellation.
  • Adds retry policies for nodes in StateGraph.
  • Adds custom input and output type support to StateGraph.
+3 moreshow less
  • Adds equality comparison (__eq__) to all channel classes (AnyValue, LastValue, Topic, and others), enabling channel state comparisons.
  • Improves graph visualization to include type-hint hints for conditional edges and to create END nodes only when needed.
  • Adds node-existence validation in update_state, surfacing clear errors when a nonexistent node is targeted.
└──▷ BREAKING ON UPGRADE
  • !The messages_modifier parameter of create_react_agent is deprecated; migrate to state_modifier.
cli==0.1.49 NOTES STABLE

LangGraph CLI 0.1.49 adds a dockerfile command to generate customized Dockerfiles for the LangGraph API server.

└──▷ GET THIS VERSION
$ git clone --branch cli==0.1.49 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout cli==0.1.49
└──▷ TRY IT
Generate a ready-to-build Dockerfile from your LangGraph config so you can version-control or customize it before pushing to a registry.
$ langgraph dockerfile --config langgraph.json --output Dockerfile
  • New dockerfile CLI command generates a Dockerfile for the LangGraph API server, accepting a save path and configuration file for customization.
  • Docker image generation now sets PYTHONDONTWRITEBYTECODE=1 and passes --no-cache-dir to pip installs, producing smaller images.
sdk==0.1.26 NOTES STABLE

LangGraph SDK 0.1.26 adds batch run creation, cron job scheduling, and thread conflict handling

└──▷ GET THIS VERSION
$ git clone --branch sdk==0.1.26 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout sdk==0.1.26
└──▷ USE IT
List all scheduled cron jobs for a specific assistant to audit or manage recurring runs.
python
crons = await client.crons.search(assistant_id="asst-abc", limit=20, offset=0)
  • New RunCreate TypedDict enables structured background run creation with fields for thread_id, assistant_id, input, metadata, and run configuration options.
  • New create_batch method on LangGraphClient submits multiple runs in a single API call for more efficient batch operations.
  • New Cron class and search method support scheduled job management, with filtering by assistant_id and thread_id and pagination.
  • New OnConflictBehavior type ("raise" or "do_nothing") controls what happens when a thread is created that already exists, via the new if_exists parameter on Threads.create.
0.1.8 NOTES STABLE

LangGraph 0.1.8 adds node-level metadata support via add_node's new metadata parameter and the NodeSpec class.

└──▷ GET THIS VERSION
$ git clone --branch 0.1.8 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.1.8
└──▷ USE IT
Tag a node with metadata (e.g. owner or risk label) so it appears in graph visualisations and downstream tooling.
python
graph.add_node("my_agent", my_runnable, metadata={"team": "red-team", "criticality": "high"})
  • Adds an optional metadata parameter to Graph.add_node to attach arbitrary metadata to graph nodes, surfaced through NodeSpec instances.
  • Introduces langgraph.graph.graph.NodeSpec, a new class that stores a runnable alongside optional metadata for a node.
  • Propagates node metadata through PregelNode.__init__ into the node's configuration.
  • Exposes node metadata in graph visualizations via the updated CompiledGraph.get_graph method.
0.1.7 NOTES STABLE

LangGraph 0.1.7 adds persistent task-write checkpointing via new put_writes/aput_writes methods, enabling resilient interrupted-workflow recovery.

└──▷ GET THIS VERSION
$ git clone --branch 0.1.7 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.1.7
└──▷ USE IT
Persist mid-run task writes so that an interrupted graph can resume without re-executing completed tasks.
python
from langgraph.checkpoint.sqlite import SqliteSaver

checkpointer = SqliteSaver.from_conn_string('checkpoints.db')

# During a custom checkpointer integration, flush task writes explicitly:
checkpointer.put_writes(config, writes, task_id)
  • Adds put_writes and aput_writes methods to BaseCheckpointer (implemented across Memory, SQLite, and AioSQLite checkpointers) for storing task-specific writes mid-execution.
  • Adds pending_writes field to CheckpointTuple to carry per-task write state that is restored when a checkpoint is reloaded.
  • Tasks with pre-loaded pending_writes are skipped on restart, avoiding redundant re-execution when resuming interrupted workflows.
0.1.6 NOTES STABLE

LangGraph 0.1.6 adds RemoveMessage support for message deletion by ID and handle_tool_errors parameter in ToolNode.

└──▷ GET THIS VERSION
$ git clone --branch 0.1.6 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.1.6
└──▷ USE IT
Disable automatic tool-error suppression in a ToolNode so exceptions propagate directly — useful when you want strict failure semantics in CI or testing.
python
from langgraph.prebuilt import ToolNode

tool_node = ToolNode(tools=[my_tool], handle_tool_errors=False)
Prune a specific message from a running message graph by its ID — handy for trimming context or removing a malformed turn mid-conversation.
python
from langchain_core.messages import RemoveMessage

# Return a RemoveMessage from a node to delete the message with the given ID
def cleanup_node(state):
    return {"messages": [RemoveMessage(id="msg-abc123")]}
  • Adds handle_tool_errors parameter (defaults to True) to ToolNode in langgraph.prebuilt.tool_node, returning a friendly error message instead of raising an exception when a tool fails, so agents can continue the conversation after tool errors.
  • Adds support for RemoveMessage from langchain-core in langgraph.graph.message.add_messages, enabling deletion of specific messages by ID from message graphs, with validation that raises an error if the target message ID does not exist.
cli==0.1.48 NOTES STABLE

LangGraph CLI 0.1.48 adds --debugger-base-url to point the debugger at a custom LangGraph API URL

└──▷ GET THIS VERSION
$ git clone --branch cli==0.1.48 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout cli==0.1.48
└──▷ TRY IT
Point the LangGraph debugger at a remotely accessible API URL so teammates on other machines can use the Studio UI against your local server.
$ langgraph dev --debugger-base-url https://my-dev-server.example.com:8123
  • Adds --debugger-base-url CLI option to specify a custom URL for the debugger to access the LangGraph API, overriding the default http://127.0.0.1:[PORT]; also sets VITE_STUDIO_LOCAL_GRAPH_URL in the debugger container when the option is used.
  • Makes Docker base image pulls verbose during build to provide better visibility into the build process.
Was this useful?

Letta (formerly MemGPT)

Sources Release notes → 0.3.21 3 RELEASES · 2024-07-14 → 2024-07-26 NOTES STABLE

Agent creation API now accepts an optional system prompt, and parallel tool calling can be disabled.

└──▷ GET THIS VERSION
$ git clone --branch 0.3.21 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:
$ git checkout 0.3.21
  • Adds optional system field to the create agent API, allowing a custom system prompt to be provided at agent creation time.
  • Adds support for disabling parallel tool calling.
2 more releases in this issue · 2024-07-14 → 2024-07-26
0.3.20 NOTES STABLE

Letta 0.3.20 adds character limits for persona/human to /config response and fixes inner thoughts for gpt-4o models.

└──▷ GET THIS VERSION
$ git clone --branch 0.3.20 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:
$ git checkout 0.3.20
  • Adds character limits for persona and human fields to the /config API response, giving clients the data needed to enforce input constraints.
  • Improves inner-thought generation for gpt-4o and gpt-4o-mini models via an updated prompt format, enabling these models to produce non-None inner thoughts.
0.3.19 NOTES STABLE

Letta 0.3.19 adds customizable memory classes via BaseMemory and unifies tools/memory in the agent creation API.

└──▷ GET THIS VERSION
$ git clone --branch 0.3.19 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:
$ git checkout 0.3.19
  • Adds BaseMemory base class enabling developers to define custom memory fields and custom memory-editing functions beyond the built-in human/persona fields and core_memory_append/core_memory_replace tools.
  • Adds ChatMemory as the new default memory class, preserving the original human/persona fields and core_memory_append/core_memory_replace editing functions.
  • Extends client.create_agent() to accept memory and tools arguments, allowing custom memory classes and tool lists to be specified at agent creation time; memory-editing methods from the BaseMemory subclass are automatically registered as agent tools.
  • Provides a migration script at scripts/migrate_0.3.18.py for upgrading agents from v0.3.18 to v0.3.19 due to AgentState schema changes.
└──▷ BREAKING ON UPGRADE
  • !Presets are no longer supported as a mechanism to create agents; tool, memory, and system-prompt specification moves into the client.create_agent() interface.
  • !The AgentState schema has changed; agents from v0.3.18 require migration using scripts/migrate_0.3.18.py before use with v0.3.19.
Was this useful?

LlamaIndex

Sources Release notes → v0.10.57 2 RELEASES · 2024-07-03 → 2024-07-23 NOTES STABLE

LlamaIndex v0.10.57 adds streaming tool-call extraction, KG property extraction, async BedrockConverse, and delete_nodes()/clear() across five vector stores.

└──▷ GET THIS VERSION
$ git clone --branch v0.10.57 https://github.com/run-llama/llama_index.git
# already have the repo? check out this version:
$ git checkout v0.10.57
└──▷ USE IT
Filter vector context retrieval results to only those above a similarity threshold, reducing noisy context passed to the LLM.
python
from llama_index.core.retrievers import VectorContextRetriever

retriever = VectorContextRetriever(
    vector_store_index,
    similarity_score=0.75
)
nodes = retriever.retrieve("What is the access control policy?")
Purge all nodes from a Pinecone index (e.g., before a full re-ingestion) using the new clear() method.
python
from llama_index.vector_stores.pinecone import PineconeVectorStore

vector_store = PineconeVectorStore(pinecone_index=pinecone_index)
vector_store.clear()
  • Adds optional similarity_score parameter to VectorContextRetriever to filter retrieved context by minimum similarity threshold.
  • Adds property extraction (using property names and optional descriptions) for knowledge graphs in llama-index-core.
  • Supports attaching output classes directly to LLMs for structured extraction.
  • Adds streaming support for tool calling and structured extraction in llama-index-core.
  • Implements delete_nodes() and clear() methods for Weaviate, OpenSearch, Milvus, Postgres, and Pinecone vector stores.
+3 moreshow less
  • Implements async functionality in BedrockConverse (llama-index-llms-bedrock-converse v0.1.5).
  • Enhances metadata filtering for MongoDB Atlas Vector Search in llama-index-vector-stores-mongodb.
  • Updates Notion reader to handle duplicate pages and combined database+page IDs.
1 more release in this issue · 2024-07-03 → 2024-07-23
v0.10.52 NOTES STABLE

LlamaIndex v0.10.52 adds Iceberg reader, MongoDB hybrid search, LiteLLM proxy embeddings, and async Azure AI Search methods.

└──▷ GET THIS VERSION
$ git clone --branch v0.10.52 https://github.com/run-llama/llama_index.git
# already have the repo? check out this version:
$ git checkout v0.10.52
└──▷ USE IT
Use LiteLLM Proxy Server as your embeddings backend to route through a unified proxy endpoint.
python
from llama_index.embeddings.litellm import LiteLLMEmbedding

embed_model = LiteLLMEmbedding(model="text-embedding-ada-002", api_base="http://localhost:8000")
List all available Notion databases programmatically before loading data.
python
from llama_index.readers.notion import NotionPageReader

reader = NotionPageReader(integration_token="<token>")
databases = reader.list_databases()
print(databases)
  • Adds list_databases method to llama-index-readers-notion for programmatic Notion database discovery.
  • Adds llama-index-embeddings-litellm v0.1.0 integration supporting LiteLLM Proxy Server as an embeddings backend.
  • Adds async methods to llama-index-vector-stores-azureaisearch for non-blocking Azure AI Search operations.
  • Adds Hybrid Search and Full-Text Search to MongoDBAtlasVectorSearch in llama-index-vector-stores-mongodb.
  • Adds llama-index-readers-iceberg v0.1.0 integration for reading Apache Iceberg tables into LlamaIndex.
+5 moreshow less
  • Adds device selection (via sentence_transformers device choice) in llama-index-finetuning.
  • Adds upstage tokenizer and token counting method to llama-index-llms-upstage.
  • Adds API URL configuration to the Firecrawl reader in llama-index-readers-web.
  • Adds automatic retry support to llama-index-readers-notion.
  • Adds KDB.AI REST-compatible mode in llama-index-vector-stores-kdbai.
Was this useful?

Microsoft AutoGen

Sources Release notes → v0.2.33 2 RELEASES · 2024-07-04 → 2024-07-30 NOTES STABLE

AutoGen v0.2.33 adds Qdrant and MongoDB Atlas vector stores, Gemini via VertexAI, and Anthropic Bedrock support for RAG and LLM backends.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.33 https://github.com/microsoft/autogen.git
# already have the repo? check out this version:
$ git checkout v0.2.33
  • Adds Qdrant as a supported VectorDB backend for RetrieveChat RAG pipelines.
  • Adds MongoDB Atlas vector search as a VectorDB backend for AutoGen RAG.
  • Adds Gemini support via Google VertexAI as an LLM provider.
  • Adds Anthropic Bedrock as a supported LLM backend.
  • Adds gpt-4o-mini to the built-in model list.
+1 moreshow less
  • Updates human-input-mode prompt to include the responding agent's name, improving multi-agent conversation clarity.
1 more release in this issue · 2024-07-04 → 2024-07-30
v0.2.32 NOTES STABLE

AutoGen v0.2.32 adds Groq and Cohere client support, expanding non-OpenAI model integrations.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.32 https://github.com/microsoft/autogen.git
# already have the repo? check out this version:
$ git checkout v0.2.32
  • Adds Groq client support, enabling AutoGen agents to use Groq-hosted models as a drop-in LLM backend.
  • Adds Cohere client support, enabling AutoGen agents to use Cohere models as a drop-in LLM backend.
  • Adds tool/function-call support for AnthropicClient and AnthropicAgent in the .NET SDK.
Was this useful?

Microsoft Semantic Kernel

Sources Release notes → dotnet-1.16.1 5 RELEASES · 2024-07-03 → 2024-07-23 NOTES STABLE

Semantic Kernel .NET 1.16.1 adds GenAI support to ONNX connector and enriches auto function invocation filter context.

└──▷ GET THIS VERSION
$ git clone --branch dotnet-1.16.1 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout dotnet-1.16.1
  • Adds GenAI support to Connectors.Onnx, enabling local ONNX model inference through the standard Semantic Kernel GenAI pipeline.
  • Adds additional data to the AutoFunctionInvocationFilterContext to give filter implementations richer context when intercepting automatic function calls.
  • Adds AgentChat serialization support, enabling agent conversation state to be persisted and restored.
  • Adds Assistant V2 support for Agents, aligning the agent framework with the OpenAI Assistants v2 API.
  • Adds Agent History Propagation so conversation history is shared across agents in multi-agent scenarios.
+1 moreshow less
  • Handles missing operationId fields in OpenAPI specs so connectors no longer fail when specs omit that field.
4 more releases in this issue · 2024-07-03 → 2024-07-23
python-1.3.0 NOTES STABLE

Semantic Kernel Python 1.3.0 adds a standalone chat completion agent, Ollama SDK migration, and Azure AI Inference application ID support.

└──▷ GET THIS VERSION
$ git clone --branch python-1.3.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout python-1.3.0
  • Adds application_id support for the Azure AI Inference connector.
  • Introduces the single, non-group chat completion agent class with concept samples.
  • Migrates the Ollama integration to the official Ollama Python SDK.
  • Adds singular get methods to kernel collections for retrieving individual items without iterating.
  • Improves JSON schema generation for Union and Optional type annotations in kernel functions.
dotnet-1.16.0 NOTES STABLE

Semantic Kernel 1.16.0 adds NexusRaven function calling, OpenAPI-as-plugin-description, Kernel-free OpenAPI plugin creation, and graduated Filters API.

└──▷ GET THIS VERSION
$ git clone --branch dotnet-1.16.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout dotnet-1.16.0
└──▷ USE IT
Pass custom JSON serialization options to TextMemoryPlugin when your memory store uses non-default naming or converters.
csharp
var options = new JsonSerializerOptions { PropertyNamingPolicy = JsonNamingPolicy.CamelCase };
var memoryPlugin = new TextMemoryPlugin(memory, jsonSerializerOptions: options);
kernel.ImportPluginFromObject(memoryPlugin);
  • Enables creating a KernelPlugin from an OpenAPI spec without requiring a Kernel instance, simplifying plugin instantiation in DI and test scenarios.
  • Uses the OpenAPI description field as the default plugin description when importing OpenAPI-based plugins.
  • Graduates the Filters API from experimental to stable, making prompt and function invocation filters production-ready.
  • Adds dynamic logging methods to the .NET Agents framework.
  • Supports custom JsonSerializerOptions passed to TextMemoryPlugin for serialization control.
+4 moreshow less
  • Adds a sample demonstrating function calling with the NexusRaven model.
  • Adds a sample showing the model thought process for each function call.
  • Improves DuckDBMemoryStore.RemoveBatchAsync performance by using arrays instead of lists.
  • Improves Pinecone.RemoveBatchFromNamespaceAsync performance.
python-1.2.0 NOTES STABLE

Semantic Kernel Python 1.2.0 adds Mistral AI chat, Azure Model-as-a-Service connector, and cross-model function calling abstraction.

└──▷ GET THIS VERSION
$ git clone --branch python-1.2.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout python-1.2.0
  • Introduces FunctionChoiceBehavior, a new function-calling abstraction that enables function calling for models beyond OpenAI (the existing FunctionCallBehavior continues to work but migration is encouraged).
  • Adds a new Azure Model-as-a-Service connector to the Python SDK.
  • Adds support for function calling via the Azure AI Inference connector.
  • Adds Mistral AI Chat Completion support.
dotnet-1.15.1 NOTES STABLE

Semantic Kernel 1.15.1 adds streaming for ChatCompletionAgent, Gemini system-message support, and single-agent OpenAIAssistantAgent invocation.

└──▷ GET THIS VERSION
$ git clone --branch dotnet-1.15.1 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout dotnet-1.15.1
  • Adds cancellation token support to filter context types.
  • Adds streaming support for ChatCompletionAgent in the Agents framework.
  • Enables single-agent / no-chat invocation of OpenAIAssistantAgent.
  • Supports direct logger association with an Agent.
  • Adds Gemini support for system messages and removes message-order limitations.
+4 moreshow less
  • Supports loading native functions from YAML files.
  • Adds SQL Server JSON support for memory connectors (Dm/sqlserver/json).
  • Adds batch delete query optimization in the SQLite memory connector.
  • Adds plugin selection example using vector search.
Was this useful?

camel-ai

Sources Release notes → v0.1.6.0 2 RELEASES · 2024-07-06 → 2024-07-30 NOTES STABLE

camel-ai v0.1.6.0 adds Gemini 1.5, vLLM, Azure OpenAI, Mistral, Groq-hosted Llama 3/Gemma, GPT-4o Mini, and an IPython kernel code interpreter.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.6.0 https://github.com/camel-ai/camel.git
# already have the repo? check out this version:
$ git checkout v0.1.6.0
  • Adds GPT_4O_MINI model constant for targeting OpenAI's GPT-4o Mini in agents and role-playing sessions.
  • Supports custom token counters via ModelFactory, letting callers override the default counter at construction time.
  • Adds Azure OpenAI API as a model backend, enabling agents to route requests through Azure-hosted OpenAI endpoints.
  • Supports vLLM as a model backend for self-hosted, high-throughput inference.
  • Integrates Gemini 1.5 as a supported model backend.
+4 moreshow less
  • Integrates Mistral AI as a supported model backend.
  • Integrates Groq-hosted Llama 3 (8B and 70B), Mistral.AI, and Gemma (7B and 9B) as model backends via the Groq service.
  • Adds an IPython kernel code interpreter, enabling agents to execute code interactively in an IPython session.
  • Moves tool functions into a dedicated toolkits directory, providing a cleaner import path for agent toolkits.
1 more release in this issue · 2024-07-06 → 2024-07-30
v0.1.5.5 NOTES STABLE

camel-ai v0.1.5.5 adds Claude 3.5, Redis cache, Docker code execution, Jina Reader, and async utilities

└──▷ GET THIS VERSION
$ git clone --branch v0.1.5.5 https://github.com/camel-ai/camel.git
# already have the repo? check out this version:
$ git checkout v0.1.5.5
  • Adds Redis cache storage backend for agent memory and caching workflows.
  • Supports internal_python code interpreter as a callable tool, enabling agents to execute code directly.
  • Adds Docker-based code execution sandbox for isolated, safe code running.
  • Integrates Jina Reader into the loaders API for web content ingestion.
  • Adds a config file mechanism for models using the OpenAI-compatible interface.
+5 moreshow less
  • Adds utility functions to convert synchronous functions to async functions.
  • Adds Claude 3.5 model support.
  • Adds new open-source models to the supported model list.
  • Adds a Discord bot with RAG (retrieval-augmented generation) capability.
  • Updates sentence transformer and OpenAI text embedding integrations.
Was this useful?

holmesgpt

Sources Release notes → 0.2.6 NOTES

SRE Agent - CNCF Sandbox Project

HolmesGPT 0.2.6 adds Slack output for the ask command, streamlined Amazon Bedrock support, and LiteLLM env var support in Helm.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.6 https://github.com/HolmesGPT/holmesgpt.git
# already have the repo? check out this version:
$ git checkout 0.2.6
  • Helm chart now supports LiteLLM environment variables for configuring LLM backends.
  • Adds Slack as a destination for the ask command, enabling query results to be sent directly to Slack channels.
  • Streamlines Amazon Bedrock integration alongside other LLM models for a more seamless setup experience.
  • Adds a post-processing option for verbose ('chatty') AI responses.
  • Updates PagerDuty integration with minor improvements.
+2 moreshow less
  • Adds Prometheus Operator RBAC rules for Holmes to the service account template in the Helm chart.
  • Improves the Kubernetes toolset with minor enhancements.
Was this useful?
◆  Local LLM Runtimes

Jan AI Jan

Sources Release notes → v0.5.2 NOTES

Jan v0.5.2 adds Claude 3.5 Sonnet, spell-check config for chat input, and right-click thread settings.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.2 https://github.com/janhq/jan.git
# already have the repo? check out this version:
$ git checkout v0.5.2
  • Adds spell-check options config for the chat input field.
  • Adds Claude 3.5 Sonnet as a selectable model.
  • Adds a shortcut to open app logs directly from the System Monitor.
  • Enables right-click on thread items to open their settings.
Was this useful?

KoboldCpp

Sources Release notes → v1.71.1 3 RELEASES · 2024-07-01 → 2024-07-25 NOTES STABLE

KoboldCpp v1.71.1 adds shareable .kcppt launch templates, automatic GPU layer guessing via --gpulayers -1, and Vulkan iq4_nl format support.

└──▷ GET THIS VERSION
$ git clone --branch v1.71.1 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.71.1
└──▷ TRY IT
Load a fully pre-configured Llama 3.1-8B setup without manually choosing backend, threads, or GPU layers.
$ koboldcpp.exe --config https://huggingface.co/koboldcpp/kcppt/resolve/main/Llama-3.1-8B.kcppt
Let KoboldCpp auto-detect the optimal number of GPU layers instead of hand-tuning the value.
$ koboldcpp.exe --model mymodel.gguf --gpulayers -1
  • Adds --gpulayers -1 to let KoboldCpp automatically estimate how many GPU layers to offload (experimental).
  • Adds KoboldCpp Launch Templates: shareable .kcppt files that bundle model URLs, a preloaded story, a chat-completions adapter, and full backend/thread/GPU-layer configuration; load one via --config <url-or-path>.
  • Adds iq4_nl quantization format support in the Vulkan backend.
  • Adds TTS narration speed setting in Kobold Lite.
  • Adds support for selecting the greeting message in Character Cards that contain multiple greetings in Kobold Lite.
+2 moreshow less
  • Adds Corpo UI theme availability for chat mode in Kobold Lite.
  • Enables inject-chatnames in Corpo UI to replace the AI's displayed name when toggled on.
2 more releases in this issue · 2024-07-01 → 2024-07-25
v1.70.1 NOTES STABLE

KoboldCpp v1.70.1 adds Corpo Mode UI, DRY sampler, --unpack self-extraction, OpenAI function calling, and raises default context to 4096.

└──▷ GET THIS VERSION
$ git clone --branch v1.70.1 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.70.1
└──▷ TRY IT
Use a pre-bundled chat completions adapter template by filename instead of a full path.
$ koboldcpp.exe --model mymodel.gguf --chatcompletionsadapter Llama-3.json
Run with a 4096-token context window (now the default) explicitly set, targeting an older CPU via the AVX1 binary.
$ koboldcpp_oldcpu.exe --model mymodel.gguf --contextsize 4096
  • Adds --unpack flag enabling self-extraction of KoboldCpp PyInstaller binaries into an empty directory for easy file access and modification; also usable from the GUI launcher.
  • Adds --chatcompletionsadapter selection by bundled template filename (e.g. Llama-3.json), allowing pre-bundled chat completion templates to be referenced without a full path.
  • Raises default --contextsize from 2048 to 4096 and increases the default Chat Completions API output length.
  • Adds DRY dynamic N-gram anti-repetition sampler support.
  • Adds experimental support for OpenAI tools and function calling API.
+5 moreshow less
  • Ships official Windows binaries with AVX1 CUDA support as koboldcpp_oldcpu.exe for older CPUs.
  • Introduces Corpo Mode, a new beginner-friendly ChatGPT-style UI theme for instruct mode in Kobold Lite.
  • Adds support for importing character cards from aicharactercards.com in Kobold Lite.
  • Adds dedicated System Tag and System Prompt support in Kobold Lite.
  • Completely reworks the Kobold Lite settings menu into 4 distinct panels.
v1.69.1 NOTES STABLE

KoboldCpp v1.69.1 adds premade Chat Completions adapters, SD prompt injection fields, Vulkan tensor-split UI, and multi-image LLaVA separator tokens.

└──▷ GET THIS VERSION
$ git clone --branch v1.69.1 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.69.1
└──▷ USE IT
Inject a forced positive and negative prompt for every Stable Diffusion generation request via an adapter config.
yaml
add_sd_prompt: "masterpiece, best quality"
add_sd_negative_prompt: "blurry, low quality, nsfw"
  • Adds add_sd_prompt and add_sd_negative_prompt fields in a loaded adapter to inject forced positive or negative prompts for Stable Diffusion generation.
  • Adds premade Chat Completions adapters selectable in the GUI launcher (via --chatcompletionsadapter) to apply instruct templates for various models and formats when using third-party OpenAI-compatible frontends.
  • Adds a tensor split input field in the GUI launcher for Vulkan backends.
  • Adds separator tokens between multiple images in LLaVA multi-image requests.
  • Kobold Lite can now fall back to an alternative API or endpoint URL on connection failure, including retrying via the OpenAI API.
+2 moreshow less
  • Merges upstream improvements including enhanced MMQ with int8 tensor core support and Gemma 2 features (including IQ MMVQ fixes).
  • KoboldCpp Colab notebook switched to precompiled Linux binaries for faster startup.
Was this useful?

LocalAI

Sources Release notes → v2.19.3 4 RELEASES · 2024-07-01 → 2024-07-28 NOTES STABLE

LocalAI v2.19.3 adds a Llama 3.1 grammar schema and expands the model gallery with 14 new models including Mistral Nemo and Llama 3.1 variants.

└──▷ GET THIS VERSION
$ git clone --branch v2.19.3 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v2.19.3
  • Adds Llama 3.1 grammar schema for structured output generation.
  • Adds function calling template for Llama 3.1 models to the gallery.
  • Adds Llama 3.1 with enforced function calling via grammars to the model gallery.
  • Adds 13 new models to the gallery: llama3.1-claude, darkidol-llama3.1, gemmoy, mistral-nemo, llama3.1-8b-fireplace2, lumimaid-v0.2-12b, darkidol-llama-3.1-8b-instruct-1.1-uncensored, meta-llama-3.1-8b-instruct-abliterated, llama-3.1-70b-japanese-instruct-2407, llama-3.1-8b-instruct-fei-v1-uncensored, openbuddy-llama3.1-8b-v22.1-131k, lumimaid-8b.
3 more releases in this issue · 2024-07-01 → 2024-07-28
v2.19.1 NOTES STABLE

LocalAI v2.19.1 adds P2P federated AI swarms, llama.cpp embeddings, model pull by URL, and a HuggingFace /scan endpoint.

└──▷ GET THIS VERSION
$ git clone --branch v2.19.1 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v2.19.1
└──▷ TRY IT
Stand up a load-balanced federated AI cluster across multiple machines using a shared token.
$ local-ai --p2p --federated
Connect additional worker nodes to an existing P2P swarm using the shared token generated by the primary instance.
$ local-ai --p2p
  • Adds --p2p and --p2p --federated CLI flags to launch federated LocalAI instances that auto-discover each other across networks using a shared token, with optional load balancing.
  • Adds --p2p flag support for distributing model weights across nodes as P2P workers, currently available on the llama.cpp backend.
  • Adds a HuggingFace /scan API endpoint for scanning HuggingFace resources.
  • Enables embedding support in the llama-cpp (gRPC) backend via the embeddings endpoints.
  • Adds model pulling directly from URLs via feat(models): pull models from urls.
+6 moreshow less
  • Adds a 'Swarm' section to the WebUI providing a P2P dashboard with auto-discovery setup instructions and one-liner connection commands.
  • Adds TTS (Text-to-Speech) to binary releases.
  • Updates install.sh to support federated instance setup.
  • Adds the ability to remove a backend from the backend list in the WebUI.
  • Improves tool/function call handling by parsing broken JSON in raw results and using dynamic rules for grammar keys when grammars are disabled.
  • WebUI welcome page now shows models without a config file alongside configured models.
v2.19.0 NOTES STABLE

LocalAI v2.19.0 adds P2P federated instances, llama-cpp embeddings, HuggingFace /scan endpoint, and URL-based model pulling.

└──▷ GET THIS VERSION
$ git clone --branch v2.19.0 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v2.19.0
└──▷ TRY IT
Start a P2P AI swarm node — the generated shared token lets other LocalAI instances auto-discover and join the cluster for load-balanced inference.
$ local-ai --p2p --federated
  • Adds --p2p flag to start LocalAI and generate a shared token for auto-discovering and clustering multiple instances into a load-balanced AI swarm without Docker or Kubernetes.
  • Adds --p2p --federated flags to launch fully federated LocalAI instances that share requests across the cluster, with auto-discovery across different networks.
  • Adds HuggingFace /scan endpoint for scanning HuggingFace model assets.
  • Adds embeddings endpoint support to the llama-cpp (grpc) backend, enabling local embedding generation via llama.cpp.
  • Adds load-balanced option to the P2P federation mode.
+7 moreshow less
  • Supports pulling models directly from URLs via the model management interface.
  • Includes TTS (Text-to-Speech) in binary releases, removing the need for a separate install.
  • Adds federated instance setup support to the install.sh installer script.
  • Adds a P2P 'Swarm' dashboard in the WebUI with one-liner connection instructions and auto-discovery guidance.
  • Improves function/tool calling by parsing broken JSON in raw results and using dynamic rules for grammar keys when grammars are disabled.
  • Allows removing a backend from the backend list via the WebUI.
  • Shows models without a config file in the WebUI welcome/model list page.
v2.18.1 NOTES STABLE

LocalAI v2.18.1 adds backend autodetect fallback and six new models to the gallery.

└──▷ GET THIS VERSION
$ git clone --branch v2.18.1 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v2.18.1
  • Adds backend fallback with autodetection, allowing LocalAI to automatically select an available backend when the primary one is unavailable.
  • Adds new-dawn-llama to the model gallery.
  • Adds l3-aethora-15b-v2 to the model gallery.
  • Adds bungo-l3-8b-iq-imatrix to the model gallery.
  • Adds llama3-8b-darkidol-2.1-uncensored-1048k-iq-imatrix to the model gallery.
+2 moreshow less
  • Adds llm-compiler to the model gallery.
  • Adds llama3-turbcat-instruct-8b to the model gallery.
Was this useful?

SGLang

Sources Release notes → v0.2.0 3 RELEASES · 2024-07-04 → 2024-07-25 NOTES STABLE

SGLang v0.2.0 adds Llama3 405B, Deepseek MoE, Mistral-Nemo, GPTBigCode, and InternLM2 support with OpenAI parallel sampling and VertexAI safety settings.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.0 https://github.com/sgl-project/sglang.git
# already have the repo? check out this version:
$ git checkout v0.2.0
  • Adds support for VertexAI safety settings in API calls.
  • Adds OpenAI API parallel sampling support.
  • Adds new model support for Llama3 405B (including FP8), Deepseek MoE, InternLM2, GPTBigCode, and Mistral-Nemo.
  • Adds incremental detokenization when streaming, reducing time-to-first-token (TTFT) and inter-token latency (ITL) at stream_interval 1.
  • Adds benchmark serving tooling (bench_serving.py) supporting random datasets, non-streaming mode, and TensorRT-LLM comparison benchmarks.
+1 moreshow less
  • Delivers superior or competitive throughput versus TensorRT-LLM and vLLM across Llama-8B to Llama-405B on A100 and H100 GPUs in both FP8 and FP16.
2 more releases in this issue · 2024-07-04 → 2024-07-25
v0.1.20 NOTES STABLE

SGLang v0.1.20 enables CUDA graphs by default, adds Gemma2/MiniCPM/Qwen2 MoE support, and ships Docker images.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.20 https://github.com/sgl-project/sglang.git
# already have the repo? check out this version:
$ git checkout v0.1.20
└──▷ TRY IT
Run the server with P2P connectivity checking enabled to validate GPU-to-GPU links at startup.
$ python -m sglang.launch_server --model-path <model> --enable-p2p-check
  • Adds --enable-p2p-check option to the CLI for peer-to-peer connectivity validation.
  • Exposes logprob options to the sgl.gen API via new LogitsMetadata support.
  • Enables CUDA graph execution by default, delivering 1.5x–2x speedup for small-batch decoding.
  • Adds model support for Gemma2, MiniCPM, and Qwen2 MoE.
  • Adds Docker support with a new Dockerfile.
v0.1.18 NOTES STABLE

SGLang v0.1.18 adds multi-node tensor parallelism, 2x large-batch prefill throughput, ChatGLM support, and new CLI arguments.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.18 https://github.com/sgl-project/sglang.git
# already have the repo? check out this version:
$ git checkout v0.1.18
└──▷ TRY IT
Suppress verbose per-request HTTP logs in production while keeping model-level logging intact.
$ python -m sglang.launch_server --model-path meta-llama/Llama-2-7b-chat-hf --log_level_http warning
Run an offline latency benchmark against a model without standing up a full server.
$ python -m sglang.bench_latency --model-path meta-llama/Llama-2-7b-chat-hf
  • Adds --log_level_http argument to control HTTP request logging independently of the main log level.
  • Adds --dtype argument to expose model dtype selection at server launch.
  • Adds sglang.bench_latency module for offline latency benchmarking.
  • Enables flashinfer kernels by default, delivering a 2x throughput improvement for large-batch prefill workloads.
  • Supports multi-node tensor parallelism, enabling model serving across multiple machines.
+1 moreshow less
  • Adds ChatGLM model support.
Was this useful?

oobabooga's Text Generation WebUI (textgen)

Sources Release notes → v1.12 4 RELEASES · 2024-07-05 → 2024-07-25 NOTES STABLE

oobabooga textgen v1.12 adds Llama 3.1 support across Transformers, ExLlamaV2, and AutoAWQ backends with UI markdown and coloring improvements.

└──▷ GET THIS VERSION
$ git clone --branch v1.12 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v1.12
  • Removes AutoAWQ as a standalone loader; AWQ models (including Llama 3.1 AWQ-INT4) are now loaded directly through Transformers for better compatibility.
  • Adds Llama 3.1 support via Transformers 4.43, ExLlamaV2 0.1.8, and AutoAWQ 0.2.6 backend bumps.
  • Colors text between quote characters in chat and chat-instruct modes for improved readability.
  • Makes the markdown rendering cache infinite (cleared on chat switch) to keep the UI responsive during long 128k-context conversations.
└──▷ BREAKING ON UPGRADE
  • !AutoAWQ is no longer available as a standalone loader; AWQ models must now be loaded through the Transformers loader.
3 more releases in this issue · 2024-07-05 → 2024-07-25
v1.11 NOTES STABLE

textgen v1.11 defaults to chat-instruct mode, adds Mistral-Nemo support, and enables gradio subpath customization for reverse proxies.

└──▷ GET THIS VERSION
$ git clone --branch v1.11 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v1.11
  • Adds support for customizing the gradio subpath for use with a reverse proxy.
  • Adds ChatML-format.json format example for training.
  • Supports Mistral-Nemo via llama-cpp-python bump to 0.2.83.
  • Defaults new sessions to chat-instruct mode, which automatically applies the model's Jinja2 template for higher-quality outputs.
  • Significantly faster and more responsive UI through refactored event handling that reduces connections between the UI and the server.
+1 moreshow less
  • Excludes the instruction template from exports when using 'Save UI defaults to settings.yaml', preventing it from being overwritten by the model template.
v1.10 NOTES STABLE

oobabooga textgen v1.10 adds Gemma-2 support via ExLlamaV2 and new attention-disable flags.

└──▷ GET THIS VERSION
$ git clone --branch v1.10 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v1.10
  • Adds --no_xformers and --no_sdpa flags for ExLlamaV2 (complement the existing --no_flash_attn flag); all three must be used together — or their UI checkboxes enabled — to run Gemma-2 without severe performance degradation.
  • ExLlamaV2 updated to 0.1.7, enabling Gemma-2 model support.
v1.9 NOTES STABLE

oobabooga text-gen v1.9 adds 4-bit/8-bit KV cache for llama.cpp, Gemma-2 support, and a rewritten Whisper STT extension.

└──▷ GET THIS VERSION
$ git clone --branch v1.9 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v1.9
  • Adds 4-bit and 8-bit KV cache options to llama.cpp and llamacpp_HF backends via the existing --cache_4bit and --cache_8bit flags.
  • Adds native Gemma-2 support in Transformers: automatically detects Gemma2ForCausalLM architecture and applies optimal settings (bfloat16/float16 precision and eager attention) without requiring --bf16 --use_eager_attention manually.
  • Automatically obtains the EOT token from Jinja2 templates and adds it to stopping strings, so Llama-3-Instruct stops correctly without manually adding <eot> to custom stopping strings.
  • Rewrites the Whisper STT extension, replacing the Gradio microphone component with a custom microphone element for improved reliability.
  • Increases the chat area size on mobile devices.
Was this useful?

vLLM

Sources Release notes → v0.5.3 3 RELEASES · 2024-07-05 → 2024-07-23 NOTES STABLE

vLLM v0.5.3 adds Llama 3.1, Mistral-Nemo, and Chameleon support, a new vllm CLI, --cpu-offload-gb, and AWQ-Marlin performance gains.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.3 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.5.3
└──▷ TRY IT
Start an OpenAI-compatible serving endpoint using the new serve subcommand.
$ vllm serve meta-llama/Meta-Llama-3.1-8B-Instruct
  • Adds --cpu-offload-gb flag to control how much GPU memory to extend into RAM via CPU offloading.
  • Adds new vllm CLI with three subcommands: serve, complete, and chat.
  • Supports chat completions input in the tokenize endpoint.
  • Adds AWQ support to the Marlin kernel, delivering 1.5–2x performance improvements for existing AWQ models.
  • Supports Meta Llama 3.1, runnable on a single 8xH100 or 8xA100 node with FP8 quantization, or across multiple nodes with BF16 via pipeline parallelism.
+11 moreshow less
  • Enables chunked prefill by default for the Meta Llama 3.1 model series to support long context.
  • Adds a new rope extension method to support long-context workloads.
  • Supports dynamic loading of LoRA adapters from HuggingFace at runtime.
  • Adds pipeline parallel support for Mixtral.
  • Adds support for Mistral-Nemo.
  • Adds initial support for Chameleon (multimodal model).
  • Enables pipeline parallelism via the stdlib multiprocessing module as an alternative to Ray.
  • Adds InfiniBand shared-object support to wheels so multi-node serving with InfiniBand works out of the box.
  • Adds SPMD worker execution using Ray accelerated DAG.
  • Enables MoE with the Pallas GMM kernel on TPU.
  • Wheels now build on Ubuntu 20.04 instead of 22.04, broadening compatibility.
└──▷ BREAKING ON UPGRADE
  • !The Attention.kv_scale field is replaced by separate k_scale and v_scale fields; any code or configuration referencing kv_scale directly will break.
2 more releases in this issue · 2024-07-05 → 2024-07-23
v0.5.2 NOTES STABLE

vLLM v0.5.2 adds a new CLI, PaliGemma/Fuyu-8B support, Medusa speculative decoding, soft-tuned prompts, and cross-Python wheels.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.2 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.5.2
  • New experimental vllm CLI for serving and querying an OpenAI-compatible server without writing Python.
  • Adds support for PaliGemma and Fuyu-8B multimodal models.
  • Adds Medusa speculative decoding with a Top-1 proposer, enabling faster inference with draft-model-free speculation.
  • Adds soft-tuned prompt (prompt adapter) insertion support for customizing model behavior without fine-tuning weights.
  • Releases a Python-version-agnostic wheel so a single build installs across all supported Python versions.
+5 moreshow less
  • Enables bonus tokens in speculative decoding for KV-cache-based models, improving output quality under speculation.
  • Adds ZeroMQ fallback for broadcasting large objects in distributed inference, unblocking large-model multi-node use cases.
  • Adds FP8 support via llm-compressor and CUTLASS kernels for FP8 layers with bias.
  • Exposes vllm.__commit__ attribute carrying the git commit hash for build traceability.
  • Adds deprecation warning when beam search is enabled, signaling planned removal in a future release.
v0.5.1 NOTES STABLE

vLLM v0.5.1 adds pipeline parallelism, Gemma 2/Jamba/DeepSeek-V2/Phi3-Vision support, OpenVINO backend, and speculative decoding improvements.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.1 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.5.1
└──▷ TRY IT
Run the vLLM API server across 4 pipeline stages to serve a large model that doesn't fit on a single GPU.
$ python -m vllm.entrypoints.openai.api_server --model meta-llama/Meta-Llama-3-70B --pipeline-parallel-size 4
  • Adds --pipeline-parallel-size flag to the API server to enable pipeline parallelism across multiple GPUs (early stage).
  • Adds MLPSpeculator and Typical Acceptance Sampler to speculative decoding, plus a new Draft Model Runner.
  • Adds support for sharded tensorized models via the frontend and core engine.
  • Adds continuous streaming of OpenAI response token stats.
  • Adds support for FlashInfer as an optional backend for prefill, decode, and CUDA Graph for decode.
+12 moreshow less
  • Adds w4a16 and Marlin 24 support to compressed-tensors quantization.
  • Adds a faster vectorized FP8 quantize kernel, with FP8 support extended to Ampere GPUs.
  • Adds OpenVINO inference backend.
  • Adds Intel GPU (XPU) initial inference backend.
  • Adds CPU inference support with AVX2 ISA.
  • Adds support for Gemma 2 (recommended with FlashInfer backend v0.0.8 for logits soft cap correctness).
  • Adds support for Jamba, vLLM's first state space model.
  • Adds support for DeepSeek-V2.
  • Adds support for Phi3-Vision, dynamic image size, and a VLM input registry; VLM prompts now use <image> directly instead of complex formatting.
  • Enhances TPU backend support.
  • Enhances distributed communication performance via shared memory.
  • Enhances block manager latency.
└──▷ BREAKING ON UPGRADE
  • !All VLM-specific arguments are removed from engine APIs; they can no longer be set globally via CLI. Prompts must now pass <image> instead of the previous complex prompt formatting.
Was this useful?
◆  AI Model & Data Infrastructure

Ollama

Sources Release notes → v0.3.1 6 RELEASES · 2024-07-02 → 2024-07-30 NOTES STABLE

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Ollama v0.3.1 adds Gemma 2 2B, min_p sampling, auto-detected stop params, and tool_calls finish_reason in the OpenAI-compatible API.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.1 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.3.1
└──▷ TRY IT
Run the new lightweight Gemma 2 2B model for fast, low-resource inference on-device.
$ ollama run gemma2:2b
  • Adds Gemma 2 2B (2-billion-parameter model by Google DeepMind) to the model library via ollama run gemma2:2b
  • Supports min_p sampling option for more controlled text generation
  • OpenAI-compatible API now returns finish_reason: tool_calls when a tool call occurs
5 more releases in this issue · 2024-07-02 → 2024-07-30
v0.3.0 NOTES STABLE

Ollama v0.3.0 adds tool/function-calling support via the Chat API, plus four new models including Llama 3.1 and Mistral Large 2.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.0 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.3.0
└──▷ USE IT
Let a model decide which tool to call to answer a user query — useful for building agents that dispatch to real APIs based on natural language.
python
import ollama

response = ollama.chat(
    model='llama3.1',
    messages=[{'role': 'user', 'content': 'What is the weather in Toronto?'}],
    tools=[{
      'type': 'function',
      'function': {
        'name': 'get_current_weather',
        'description': 'Get the current weather for a city',
        'parameters': {
          'type': 'object',
          'properties': {
            'city': {
              'type': 'string',
              'description': 'The name of the city',
            },
          },
          'required': ['city'],
        },
      },
    }],
)

print(response['message']['tool_calls'])
  • Adds tool calling support to the Chat API, enabling models to invoke functions, browse the web, run code interpreters, and interact with external APIs.
  • Supports Llama 3.1 (8B, 70B, 405B) with native tool-calling capability.
  • Supports Mistral Large 2 (123B) with 128k context, code generation, tool calling, math, and multilingual reasoning.
  • Supports Firefunction v2, an open-weights function-calling model competitive with GPT-4o function calling.
  • Supports Llama-3-Groq-Tool-Use, a series of models optimized for tool use and function calling.
v0.2.8 NOTES STABLE

Ollama v0.2.8 adds Mistral Nemo (12B, 128k context) and NuExtract (3.8B info-extraction) models, plus template validation on create.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.8 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.2.8
└──▷ TRY IT
Run the new Mistral Nemo model to leverage its 128k context window for long-document analysis.
$ ollama run mistral-nemo
Use NuExtract to pull structured data from unstructured text as part of a threat-intel or log-parsing workflow.
$ ollama run nuextract
  • Adds Mistral Nemo, a 12B model with 128k context length built by Mistral AI and NVIDIA, available via ollama run mistral-nemo.
  • Adds NuExtract, a 3.8B Phi-3-based model fine-tuned for structured information extraction.
  • ollama create now validates templates at creation time, catching errors before deployment.
v0.2.6 NOTES STABLE

Ollama v0.2.6 adds Mathstral, a 7B math reasoning model from Mistral AI.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.6 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.2.6
  • Adds Mathstral, a 7B model from Mistral AI optimized for math reasoning and scientific discovery, available via ollama pull mathstral.
v0.2.4 NOTES STABLE

Ollama v0.2.4 enables loading models larger than system memory when disk space is available.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.4 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.2.4
  • Supports loading models larger than system memory by spilling to disk when disk space is available.
v0.2.0 NOTES STABLE

Ollama v0.2.0 adds concurrent request handling, multi-model loading, and three new models including Gemma 2.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.0 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.2.0
└──▷ TRY IT
Check which models are currently loaded into GPU memory and when they will be unloaded.
$ ollama ps
  • New ollama ps subcommand shows which models are currently loaded, along with size, processor utilization, and expiry time.
  • Supports serving multiple simultaneous requests in parallel using only a small amount of additional memory per request — enabling concurrent chat sessions, code completion, document processing, and multi-agent workloads.
  • Supports loading multiple different models into GPU memory at the same time, with automatic load/unload based on request demand and available GPU memory — enabling RAG pipelines where embedding and text completion models run side-by-side.
  • Adds GLM-4, a multilingual general-purpose model competitive with Llama 3, to the Ollama model library.
  • Adds CodeGeeX4, a code-completion and AI software development model, to the Ollama model library.
+2 moreshow less
  • Adds Gemma 2, Google's next-generation model with improved output quality, to the Ollama model library.
  • Returns a descriptive error on Linux when the system lacks sufficient memory to load a model.
Was this useful?

NVIDIA Triton Inference Server

Sources Release notes → v2.48.0 NOTES

Triton v2.48.0 adds custom backend tracing, enhanced failure metrics, and GenAI-Perf support for embeddings, re-rankers, and multi-prompt input.

└──▷ GET THIS VERSION
$ git clone --branch v2.48.0 https://github.com/triton-inference-server/server.git
# already have the repo? check out this version:
$ git checkout v2.48.0
  • Adds --input-file flag to GenAI-Perf to accept multiple user-specified prompts in a single run.
  • Supports tracing custom backend activities via the backend tracing API (see trace.md#custom-backend-tracing).
  • Enhances Failure Count Metrics to include the failure reason of each inference request.
  • Enables profiling of OpenAI-compatible embeddings and Hugging Face TEI re-ranker API-compatible rankings via GenAI-Perf.
  • Updates request-rate handling in OpenAI and HTTP clients so async requests are dispatched at exactly the specified rate.
+2 moreshow less
  • Adds a warning in Perf Analyzer when latency does not stabilize for async models, while still allowing the run to complete.
  • Adds input/output validation in Perf Analyzer, returning an error if user-supplied inputs or outputs are not present in the model.
Was this useful?
Other / Uncategorized
◆  AI OBSERVABILITY

Arize Phoenix

Sources Release notes → arize-phoenix-v4.16.0 10 RELEASES · 2024-07-02 → 2024-07-30 NOTES STABLE

Phoenix v4.16.0 adds a feedback tab to span details, a span aside with timing info, and sort ordering for annotation fields.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.16.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.16.0
  • Adds sort order argument to SpanAnnotation and TraceAnnotation fields, enabling ordered retrieval of annotation data.
  • Adds a feedback tab to span details in the UI, surfacing annotation feedback directly within span inspection.
  • Adds a span aside panel with timing info and feedback in the trace view.
  • Adds a trace stream toggle in the preferences context.
  • Allows retries for annotation insertions when the corresponding span or trace does not yet exist, reducing dropped annotations during ingestion.
9 more releases in this issue · 2024-07-02 → 2024-07-30
arize-phoenix-v4.15.0 NOTES STABLE

Phoenix 4.15 adds containedInDataset GraphQL field, annotation macros, dataset edit UI, and lazy span loading.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.15.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.15.0
  • Adds containedInDataset boolean field to GraphQL Spans type, enabling queries that filter spans by dataset membership.
  • Adds annotation macro and filter condition snippets to the project page UI for faster annotation workflows.
  • Adds dataset edit UI and support for supplying dataset metadata at creation time.
  • Adds version mismatch checks to warn when client and server versions differ.
  • Implements lazy loading of spans in the trace UI, enabling performant rendering of large traces.
+1 moreshow less
  • Annotations now automatically refetch when annotation data changes, keeping the UI in sync without manual refresh.
arize-phoenix-v4.14.0 NOTES STABLE

Phoenix v4.14.0 adds an annotations UI and extends the evals DSL with an annotations symbol.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.14.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.14.0
  • Extends the evals DSL to accept the annotations symbol, enabling annotation data to be referenced directly in evaluation expressions.
  • Adds a new annotations UI for viewing and managing span/trace annotations.
arize-phoenix-v4.13.0 NOTES STABLE

Phoenix v4.13.0 adds a GraphQL resolver to query all annotation names on a project.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.13.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.13.0
  • Adds a GraphQL resolver that returns all annotation names on a project, enabling programmatic discovery of annotation surfaces.
arize-phoenix-v4.12.0 NOTES STABLE

Arize Phoenix 4.12.0 adds timeout arguments to client methods.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.12.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.12.0
  • Adds timeout arguments to client methods, enabling callers to control request duration limits.
arize-phoenix-v4.11.0 NOTES STABLE

Phoenix v4.11.0 adds a Guardrail span kind and a GraphQL resolver for span annotations.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.11.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.11.0
  • Adds GraphQL resolver for querying annotations on a span, enabling programmatic retrieval of span-level annotation data.
  • Adds GUARDRAIL span kind type, extending the span taxonomy to cover guardrail components in LLM pipelines.
arize-phoenix-v4.10.0 NOTES STABLE

Phoenix v4.10.0 adds GraphQL mutations and REST routes for span and trace annotations, plus UI copy of IDs.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.10.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.10.0
  • Adds REST routes for span and trace annotations, enabling programmatic annotation of spans and traces via HTTP.
  • Adds GraphQL mutations for span and trace annotations, exposing annotation operations over the GQL API.
  • Adds UI ability to copy span and trace IDs directly from the annotations interface.
arize-phoenix-v4.8.0 NOTES STABLE

Phoenix 4.8.0 adds a REST endpoint to delete datasets from experiments.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.8.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.8.0
  • Adds a REST endpoint to delete a dataset in the experiments API.
arize-phoenix-v4.7.0 NOTES STABLE

Phoenix v4.7.0 adds image rendering for messages in the UI.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.7.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.7.0
  • Renders images inline within messages in the trace/span UI.
arize-phoenix-v4.6.0 NOTES STABLE

Phoenix v4.6.0 ships datasets, experiments, and LLM evaluators with new client methods, GraphQL resolvers, and environment-variable auth headers.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.6.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.6.0
└──▷ USE IT
Decorate a custom function to register it as an evaluator for experiment runs.
python
import phoenix as px
from phoenix.evals import create_evaluator

@create_evaluator
def my_evaluator(output, expected):
    return output.strip() == expected.strip()
Use reference as an alias for expected in an evaluator to match either naming convention from dataset examples.
python
import phoenix as px
from phoenix.evals import create_evaluator

@create_evaluator
def exact_match(output, reference):  # 'reference' is an alias for 'expected'
    return output.strip() == reference.strip()
  • Adds reference as an alias for expected in evaluator argument bindings via **datasets** evaluator function signatures.
  • Adds get_dataset_by_name client method to retrieve datasets by name.
  • Adds a client method for appending to existing datasets.
  • Adds create_evaluator decorator for defining custom evaluators.
  • Adds built-in LLM evaluators and a relevance evaluator for experiment outputs.
+35 moreshow less
  • Adds basic evaluators for string experiment outputs.
  • Adds ability to set auth headers via environment variables.
  • Adds ability to clear data older than a specified date.
  • Adds patchDatasetExamples GraphQL mutation to update dataset examples.
  • Adds compareExperiments GraphQL resolver for side-by-side experiment comparison.
  • Adds annotations resolver on the DatasetRun GraphQL type.
  • Adds experiments resolver on the DatasetExample GraphQL type.
  • Adds runs resolver on the Experiment GraphQL type.
  • Adds span resolver on the DatasetExample GraphQL type.
  • Adds project resolver on Span GraphQL type.
  • Adds GraphQL field linking a trace to its project.
  • Adds deleteDataset GraphQL mutation and corresponding UI.
  • Adds deleteExamples GraphQL mutation and corresponding UI.
  • Adds GraphQL resolver for adding spans to datasets.
  • Adds GraphQL dataset versions connection.
  • Adds a JSON endpoint to retrieve dataset versions.
  • Adds a dataset upload REST endpoint.
  • Adds JSONL download option (including OpenAI-format JSONL) to the dataset download menu.
  • Adds CSV download for datasets via the UI.
  • Adds dataframe transformation support for datasets.
  • Adds ability to create datasets dynamically from the client.
  • Adds example and experiment counts to the datasets table.
  • Adds pagination to the dataset examples table.
  • Adds sequence numbers for experiments belonging to the same dataset.
  • Captures traces from experiments and their evaluations.
  • Posts each experiment/evaluation run result immediately upon completion.
  • Prints experiment summaries after runs complete.
  • Prints the URL to the dataset when it is uploaded.
  • Allows evaluator functions with unrecognized parameters that have default values.
  • Enforces read-only mode by denying v1 REST routes and GraphQL mutations when readonly.
  • Adds multi-select on spans/traces tables for bulk dataset addition.
  • Adds a dataset creation UI and example modal.
  • Displays the latest dataset version in the UI.
  • Adds a link to view the source span from a dataset example.
  • Exposes API playgrounds from the datasets UI.
Was this useful?

Langfuse

Sources Release notes → v2.67.0 11 RELEASES · 2024-07-02 → 2024-07-31 NOTES STABLE

Langfuse v2.67.0 adds resizable table columns, dashboard filters for user/version/release, and date range filtering for prompt metrics.

└──▷ GET THIS VERSION
$ git clone --branch v2.67.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.67.0
  • Adds Sentry sampling configuration for the worker via environment variable.
  • Extends dashboard filters to include user, version, and release dimensions.
  • Adds a date range filter to prompt metrics for scoped performance views.
  • Introduces resizable columns in table views across the UI.
  • Adds an info message in the column selector to guide column configuration.
10 more releases in this issue · 2024-07-02 → 2024-07-31
v2.66.0 NOTES STABLE

Langfuse v2.66.0 adds version/release trace filters, promptName/promptVersion on observations, Redis API key and prompt caching, and configurable JWT session duration.

└──▷ GET THIS VERSION
$ git clone --branch v2.66.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.66.0
└──▷ TRY IT
Filter traces to a specific release version to scope investigations to a single deployment.
$ curl -X GET 'https://<your-langfuse-host>/api/public/traces?version=1.2.0&release=prod' \
  -H 'Authorization: Bearer <secret-key>'
Set a shorter JWT session lifetime (e.g., 1 hour) for stricter auth controls in self-hosted deployments.
$ AUTH_SESSION_MAX_AGE=3600
  • Adds version and release query filters to the GET /traces and GET /observations API routes, enabling precise retrieval of traces and observations by deployment version or release.
  • Adds promptName and promptVersion fields to observations returned by the API, exposing which prompt and version drove each LLM call.
  • Adds AUTH_SESSION_MAX_AGE environment variable to customize JWT session duration, with a 5-minute polling interval.
  • Adds server-side Redis caching for API keys and prompts, reducing database load on high-throughput deployments.
  • Adds a connection-check endpoint for ClickHouse to verify infrastructure health.
+1 moreshow less
  • Adds a separate date range filter to UI tables for traces and generations.
v2.65.0 NOTES STABLE

Langfuse v2.65.0 adds image rendering in markdown, datetime filters, and gpt-4o mini support in playground and evals.

└──▷ GET THIS VERSION
$ git clone --branch v2.65.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.65.0
  • Adds gpt-4o mini as a supported model in the playground and evals.
  • Extends date filters to full datetime precision across the UI.
  • Renders inline images in markdown view when a markdown image URL is provided.
v2.64.0 NOTES STABLE

Langfuse v2.64.0 adds a new REQUESTS billing unit, gpt-4o-mini model support, and improved long-string display in the UI.

└──▷ GET THIS VERSION
$ git clone --branch v2.64.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.64.0
  • Adds REQUESTS as a new unit type for model cost tracking, enabling per-request pricing models.
  • Adds built-in support for the gpt-4o-mini model.
  • Long strings in the trace UI now collapse with an '... expand' control and preserve whitespace when expanded.
v2.63.0 NOTES STABLE

Langfuse v2.63.0 adds a UI toggle to enable or disable markdown rendering in pretty format view.

└──▷ GET THIS VERSION
$ git clone --branch v2.63.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.63.0
  • Adds a button in the UI to enable or disable markdown rendering when the pretty format is selected for trace/observation output.
v2.62.0 NOTES STABLE

Langfuse v2.62.0 adds markdown rendering on the Trace page and expands full string display in table rows.

└──▷ GET THIS VERSION
$ git clone --branch v2.62.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.62.0
  • Adds markdown rendering for content displayed on the Trace page in the UI.
v2.61.0 NOTES STABLE

Langfuse v2.61.0 adds a GET /sessions endpoint and expands time-based filters across existing GET APIs.

└──▷ GET THIS VERSION
$ git clone --branch v2.61.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.61.0
  • Adds GET /sessions API endpoint for retrieving session data programmatically.
  • Adds additional time-based filters to existing GET APIs for more precise querying.
  • Defaults the dashboard date range to 1 day for faster initial load performance.
v2.60.0 NOTES STABLE

Langfuse v2.60.0 adds non-numeric score support via API and new 5-minute/3-hour dashboard timeframes.

└──▷ GET THIS VERSION
$ git clone --branch v2.60.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.60.0
  • Adds support for non-numeric scores and score configs via the API, dropping the non-null constraint on the value field in the scores table — enabling categorical/qualitative scoring alongside numeric scores.
  • Adds 5-minute and 3-hour timeframe options to the dashboard for finer-grained monitoring windows.
v2.59.1 NOTES STABLE

Langfuse v2.59.1 adds AWS Bedrock Anthropic model name support and formatted token number display.

└──▷ GET THIS VERSION
$ git clone --branch v2.59.1 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.59.1
  • Adds AWS Bedrock model names for Anthropic models, enabling accurate token and cost tracking for Bedrock-hosted Anthropic usage.
  • Token counts in the UI are now formatted for readability (e.g., large numbers displayed with separators).
v2.59.0 NOTES STABLE

Langfuse v2.59.0 adds a models API route and expand/collapse controls for the trace timeline.

└──▷ GET THIS VERSION
$ git clone --branch v2.59.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.59.0
  • Adds models API routes, enabling programmatic management of model definitions.
  • Adds expand/collapse all buttons to the trace timeline UI for faster navigation of complex traces.
  • Fetches metadata individually on generations and traces tables, improving UI performance for large datasets.
v2.58.0 NOTES STABLE

Langfuse v2.58.0 adds ARM64 Docker builds, datasets v2 API, custom OAuth scopes, and manual Postgres migration control.

└──▷ GET THIS VERSION
$ git clone --branch v2.58.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.58.0
  • Adds AUTH_CUSTOM_SCOPE environment variable to override the OAuth scopes used in custom OAuth provider setups.
  • Adds LANGFUSE_AUTO_POSTGRES_MIGRATION_DISABLED environment variable to disable automatic Postgres migrations on startup, enabling manual migration control.
  • Introduces datasets v2 API with a new typed public API interface.
  • Publishes official Docker images for the arm64 architecture.
  • Auto-selects the first operator in the filter builder UI, reducing clicks when constructing filters.
Was this useful?

Weights & Biases Weave

Sources Release notes → v0.50.12 6 RELEASES · 2024-07-08 → 2024-07-25 NOTES STABLE

Weave v0.50.12 adds HTTP debug logging via environment variable and automatic redaction of Authorization headers in traces.

└──▷ GET THIS VERSION
$ git clone --branch v0.50.12 https://github.com/wandb/weave.git
# already have the repo? check out this version:
$ git checkout v0.50.12
  • Adds an environment variable to enable HTTP logging for debugging purposes.
5 more releases in this issue · 2024-07-08 → 2024-07-25
v0.50.11 NOTES STABLE

Weave v0.50.11 adds LangChain integration, CallsIter caching/slicing, threading helpers, and URL-persisted pagination state.

└──▷ GET THIS VERSION
$ git clone --branch v0.50.11 https://github.com/wandb/weave.git
# already have the repo? check out this version:
$ git checkout v0.50.11
  • Adds caching and slicing support for CallsIter, enabling more efficient iteration over large call collections.
  • Adds threading helpers via feat(weave) to simplify concurrent thread usage in Weave workflows.
  • Adds LangChain integration, enabling tracing and evaluation of LangChain-based applications with Weave.
  • Updated column management dialog improves control over visible columns in the trace table UI.
  • Stores pagination state in the URL, so table pagination position is preserved and shareable across sessions.
v0.50.10 NOTES STABLE

Weave v0.50.10 adds Cohere and Groq autopatch integrations, bulk deletion mode, and URL-persistent call grid sorting.

└──▷ GET THIS VERSION
$ git clone --branch v0.50.10 https://github.com/wandb/weave.git
# already have the repo? check out this version:
$ git checkout v0.50.10
  • Adds autopatch integration with Groq, enabling automatic tracing of Groq chat calls.
  • Adds Cohere chat models integration for automatic tracing of Cohere calls.
  • Introduces bulk deletion mode in the UI for removing multiple calls at once.
  • Stores the calls grid sort state in the URL, making sorted views shareable and persistent across sessions.
  • Improves ergonomics for interacting with private Weave instances.
v0.50.8 NOTES STABLE

Weave v0.50.8 adds DSPy integration, a new column management popup, and an updated OpenAI integration design pattern.

└──▷ GET THIS VERSION
$ git clone --branch v0.50.8 https://github.com/wandb/weave.git
# already have the repo? check out this version:
$ git checkout v0.50.8
  • Adds new DSPy integration, enabling tracing and observability for DSPy-based LLM pipelines.
  • Introduces a new column management popup in the UI for controlling visible columns in trace/eval tables.
  • Updates the OpenAI integration to adhere to a new design pattern, aligning it with the broader integration architecture.
  • Adds a rename button to the overflow menu for objects in the UI.
v0.50.7 NOTES STABLE

Weave v0.50.7 adds a Use tab to call details and renders Anthropic input images as thumbnails in the UI.

└──▷ GET THIS VERSION
$ git clone --branch v0.50.7 https://github.com/wandb/weave.git
# already have the repo? check out this version:
$ git checkout v0.50.7
  • Adds a 'Use' tab to call details for quick reference on how to access or replay a call.
  • Renders Anthropic input images as thumbnails in the call detail view.
v0.50.6 NOTES STABLE

Weave v0.50.6 adds call feedback UI, a new .call() method on ops, and promotes get_current_call to a top-level API.

└──▷ GET THIS VERSION
$ git clone --branch v0.50.6 https://github.com/wandb/weave.git
# already have the repo? check out this version:
$ git checkout v0.50.6
└──▷ USE IT
Retrieve the Call object from a decorated op to inspect call metadata (ID, inputs, outputs) without a separate lookup.
python
import weave

@weave.op()
def my_llm_call(prompt: str) -> str:
    return "response"

result, call = my_llm_call.call("What is the capital of France?")
print(call.id)
Inspect the currently executing call from inside any function in the call stack, useful for adding dynamic metadata mid-execution.
python
import weave

@weave.op()
def process(data: str) -> str:
    current = weave.get_current_call()
    print(current.id)
    return data
  • Adds call function to decorated ops, returning a Call object alongside the op's result — accessible as my_op.call(...).
  • Promotes get_current_call to a top-level API, making the active call inspectable from anywhere without internal imports.
  • Adds a feedback tab to the call details page in the UI, surfacing notes and emoji reactions per call.
  • Adds UI to attach notes and emoji reactions to individual calls.
  • Adds basic call renaming in the UI.
+1 moreshow less
  • New sidebar design in the web UI.
Was this useful?
◆  VECTOR DB RAG

Chroma

Sources Release notes → 0.5.4 NOTES

Chroma 0.5.4 adds configurable block size, HNSW cache reads, S3 retries, collection config storage, and faster JSON via orjson.

└──▷ GET THIS VERSION
$ git clone --branch 0.5.4 https://github.com/chroma-core/chroma.git
# already have the repo? check out this version:
$ git checkout 0.5.4
  • Adds configurable block size via [ENH] Configurable block size, letting operators tune storage layout for their workloads.
  • Introduces Collection Configuration Storage to persist per-collection configuration alongside data.
  • Switches the Python client HTTP layer from requests to httpx for improved async and timeout support.
  • Adds timeouts to the log client, S3 storage layer, and sysdb client to bound hung operations in distributed deployments.
  • Enables reading directly from the HNSW cache, reducing redundant index loads during queries.
+7 moreshow less
  • Adds automatic S3 retry logic to improve resilience against transient object-storage failures.
  • Supports metadata updates where the new value is a different type than the existing value.
  • Uses orjson in the Python client for faster JSON serialization/deserialization.
  • Uses binary search in the positional posting list for improved query performance.
  • Adds a __repr__ to the Collection object for clearer interactive inspection.
  • Improves OpenAPI type definitions for better client code generation.
  • Adds panic capture in query-service handlers and task operators to prevent silent worker crashes.
Was this useful?

LanceDB

Sources Release notes → python-v0.11.0 7 RELEASES · 2024-07-13 → 2024-07-26 NOTES STABLE

LanceDB python-v0.11.0 adds reciprocal rank fusion reranking and HuggingFace-compatible transformers in Node.js

└──▷ GET THIS VERSION
$ git clone --branch python-v0.11.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.11.0
  • Adds a reciprocal rank fusion (RRF) reranker for combining multiple retrieval result sets.
  • Adds HuggingFace-compatible transformers embedding support to the Node.js SDK.
  • Upgrades the underlying Lance storage engine to v0.15.0.
└──▷ BREAKING ON UPGRADE
  • !The timeout argument in the LanceDB Node.js SDK has been corrected; existing code passing timeout values may break if the previous (incorrect) argument name or position was relied upon.
6 more releases in this issue · 2024-07-13 → 2024-07-26
v0.8.0 NOTES STABLE

LanceDB v0.8.0 adds reciprocal rank fusion reranking, HuggingFace-compatible transformers for Node.js, and upgrades Lance to 0.15.0

└──▷ GET THIS VERSION
$ git clone --branch v0.8.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.8.0
  • Adds a reciprocal rank fusion (RRF) reranker for combining hybrid search result rankings.
  • Adds HuggingFace-compatible transformers embedding support in the Node.js SDK.
  • Upgrades the underlying Lance storage engine to v0.15.0.
└──▷ BREAKING ON UPGRADE
  • !The timeout argument in the LanceDB Node.js SDK has been corrected — existing code passing timeout in the old form may break on upgrade.
python-v0.10.2 NOTES STABLE

LanceDB python-v0.10.2 adds native HuggingFace sentence-transformers embedding support via Rust.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.10.2 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.10.2
  • Adds HuggingFace sentence-transformers as a natively supported embedding provider via the Rust backend.
v0.7.2 NOTES STABLE

LanceDB v0.7.2 adds Hugging Face sentence-transformers embedding support for the Rust SDK.

└──▷ GET THIS VERSION
$ git clone --branch v0.7.2 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.7.2
  • Adds Hugging Face sentence-transformers embedding integration to the Rust SDK.
v0.7.1 NOTES STABLE

LanceDB v0.7.1 adds configurable timeout support to the VectorDB Node SDK.

└──▷ GET THIS VERSION
$ git clone --branch v0.7.1 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.7.1
  • Adds configurable timeout support to the VectorDB Node SDK.
python-v0.10.0 NOTES STABLE

LanceDB python-v0.10.0 adds DynamoDB commit store, Jina embeddings/reranking, explain_plan, fast search, and binary field updates.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.10.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.10.0
└──▷ USE IT
Use Jina embeddings and the Jina reranker together in a LanceDB retrieval pipeline.
python
from lancedb.embeddings import get_registry
from lancedb.rerankers import JinaReranker

jina_embed = get_registry().get('jina').create()
reranker = JinaReranker()

results = table.search('cybersecurity threat intelligence') \
    .rerank(reranker=reranker) \
    .to_pandas()
  • Adds explain_plan function to inspect query execution plans.
  • Adds fast search flag support in Rust-backed queries.
  • Enables DynamoDB as a commit store backend for distributed coordination.
  • Adds Jina integration for both embedding generation and reranking in Python.
  • Supports creating additional vector index types beyond the previous set.
+1 moreshow less
  • Supports update operations over binary fields.
v0.7.0 NOTES STABLE

LanceDB v0.7.0 adds DynamoDB commit store, Jina embeddings/reranking, new vector index types, and explain_plan for query inspection.

└──▷ GET THIS VERSION
$ git clone --branch v0.7.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.7.0
└──▷ TRY IT
Update rows in a Node.js table using a SQL expression for dynamic value computation.
$ await tbl.update({ valuesSql: { price: 'price * 1.1' } })
  • Adds update({values | valuesSql}) to the Node.js table API, enabling row updates via value maps or raw SQL expressions.
  • Adds explain_plan function for inspecting query execution plans.
  • Makes tbl.search() chainable in the Node.js client.
  • Adds DynamoDB commit store support for distributed, cloud-backed transaction coordination.
  • Adds Jina integration in Python for both embedding generation and reranking.
+4 moreshow less
  • Enables the fast search flag in the Rust client.
  • Supports creating additional vector index types beyond the previously available options.
  • Supports updates over binary fields.
  • Adds compatibility with multiple Arrow versions in the Node.js public interface.
Was this useful?

Milvus

Sources Release notes → v2.3.20 NOTES

Milvus v2.3.20 adds a proxy queue wait-time metric and upgrades Go to 1.21 for C++ pprof profiling.

└──▷ GET THIS VERSION
$ git clone --branch v2.3.20 https://github.com/milvus-io/milvus.git
# already have the repo? check out this version:
$ git checkout v2.3.20
  • Adds a new metric to record the duration that requests wait in the proxy queue, improving observability of request latency at the proxy layer.
  • Updates Knowhere to v2.2.7, allowing Milvus to be compiled against glibc versions ≤ 2.30.
Was this useful?

Qdrant

Sources Release notes → v1.10.0 NOTES

Qdrant v1.10 adds a Universal Query API, multivector/ColBERT support, float16/uint8 datatypes, S3 snapshot storage, and configurable collection defaults.

└──▷ GET THIS VERSION
$ git clone --branch v1.10.0 https://github.com/qdrant/qdrant.git
# already have the repo? check out this version:
$ git checkout v1.10.0
└──▷ TRY IT
Create a collection using float16 dense vectors to halve memory usage for large embedding datasets.
$ curl -X PUT 'http://localhost:6333/collections/my_collection' \
  -H 'Content-Type: application/json' \
  -d '{
    "vectors": {
      "size": 1536,
      "distance": "Cosine",
      "datatype": "float16"
    }
  }'
  • Adds POST /collections/{collection_name}/points/query Universal Query API supporting search, recommendations, discovery, and payload ordering in a single request, with hybrid search via result fusion and multi-stage re-scoring.
  • Adds float16 datatype for dense vectors, halving memory consumption with minimal accuracy loss.
  • Adds float16 and uint8 datatype options for sparse vector indexes, reducing memory by 2x and 4x respectively.
  • Adds Inverse Document Frequency (IDF) modifier for sparse vectors, enabling streaming updates for BM25 and BM42 embeddings.
  • Adds S3-compatible storage backend for snapshots.
+6 moreshow less
  • Adds ability to configure default collection parameters (quantization, vector storage, replication factor) applied to all new collections.
  • Adds ability to overwrite global optimizer configuration per collection, enabling separation of indexing and searching roles within a single cluster.
  • Adds support for multivectors, enabling native use of late-interaction models such as ColBERT and storing a dynamic number of vectors per point with shared payload.
  • Adds issue reporting to surface potential performance problems and misconfigurations.
  • Applies Delta Encoding and bitpacking compression for sparse vectors, reducing their memory footprint by up to 75%.
  • Skips serialization of empty fields in search responses, reducing payload size and network traffic.
Was this useful?

Weaviate

Sources Release notes → v1.26.1 3 RELEASES · 2024-07-18 → 2024-07-23 NOTES STABLE

Weaviate v1.26.1 adds JinaAI reranker API support for improved search result ranking.

└──▷ GET THIS VERSION
$ git clone --branch v1.26.1 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.26.1
  • Adds support for the JinaAI reranker API, enabling JinaAI-powered result reranking in search pipelines.
2 more releases in this issue · 2024-07-18 → 2024-07-23
v1.26.0 NOTES STABLE

Weaviate v1.26.0 adds tenant offloading to S3, multi-target vector search, scalar quantization, async replication, and improved range filters.

└──▷ GET THIS VERSION
$ git clone --branch v1.26.0 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.26.0
└──▷ USE IT
Enable the new range filter index on a numeric property to accelerate large-scale numeric range queries.
json
{
  "class": "Product",
  "properties": [
    {
      "name": "price",
      "dataType": ["number"],
      "indexRangeFilters": true
    }
  ]
}
Search across multiple named vectors in a single GraphQL query for more comprehensive retrieval.
json
{
  Get {
    Article(
      nearText: {
        concepts: ["climate change"],
        targets: { combinationMethod: minimum, targetVectors: ["title", "body"] }
      }
    ) {
      title
      body
    }
  }
}
  • Adds OFFLOAD_S3_ENDPOINT environment variable (renamed from S3_ENDPOINT_URL) to configure S3-compatible object storage for tenant offloading.
  • Adds FROZEN tenant status via REST and gRPC APIs, enabling inactive tenant data to be offloaded to S3-compatible object storage to reduce compute costs.
  • Adds IndexRangeFilters property config to enable a new roaring-set range index, drastically improving performance of numeric range queries at scale.
  • Adds a reindex endpoint to the REST API.
  • Adds Scalar Quantization (SQ) vector compression, mapping floating-point vector values to integers to reduce storage size while maintaining search accuracy.
+11 moreshow less
  • Adds async (Merkle tree-based) replication to keep replicas consistent with minimal performance impact.
  • Adds multi-target vector search, allowing a single query to search across multiple named vectors simultaneously via GraphQL and gRPC.
  • Adds generative-anthropic as a new generative module (Module Generative Anthropic).
  • Adds dynamic generative module syntax with GraphQL and gRPC support, enabling runtime selection of generative modules.
  • Adds an environment variable to disable the Go profiler setup.
  • Adds API-based modules (including multi2vec-palm) enabled by default.
  • Enables concurrent batch vectorization requests, improving throughput for bulk ingestion.
  • Changes HNSW default max connections to 32 for improved index performance.
  • Makes offload S3 bucket auto-creation configurable.
  • Enables auto tenant activation/deactivation as part of the offloading workflow.
  • Supports concurrent tenant update operations.
└──▷ BREAKING ON UPGRADE
  • !Tenant activity status update requests are now limited to 100 tenants per request (official client libraries batch automatically).
  • !The S3_ENDPOINT_URL environment variable is renamed to OFFLOAD_S3_ENDPOINT.
  • !The UNFROZEN tenant status is removed; use the supported active/frozen lifecycle instead.
v1.25.8 NOTES STABLE

Weaviate v1.25.8 adds opt-in Sentry error reporting and a new flag to force full-replica shard searches.

└──▷ GET THIS VERSION
$ git clone --branch v1.25.8 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.25.8
  • Adds a new flag to force search to query all replicas of a shard when possible, improving search completeness in replicated deployments.
  • Integrates Sentry error reporting (opt-in, disabled by default) with automatic reporting of vector search failures and shard initialization errors.
Was this useful?
◆  MCP TOOLING

Composio

Sources Release notes → v0.3.29 7 RELEASES · 2024-07-09 → 2024-07-26 NOTES STABLE

Composio v0.3.29 adds SWE Docker images and auto-login when adding tools.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.29 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.3.29
  • Adds SWE Docker images for sandboxed software-engineering agent workflows.
  • Adds auto-login flow when adding a tool via composio add, reducing manual authentication steps.
6 more releases in this issue · 2024-07-09 → 2024-07-26
v0.3.28 NOTES STABLE

Composio v0.3.28 adds a JavaScript SWE (Software Engineering) agent example and accompanying JS SWE documentation.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.28 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.3.28
  • Adds a JavaScript SWE (Software Engineering) agent example, expanding Composio's agentic workflow support to JS environments.
v0.3.26 NOTES STABLE

Composio v0.3.26 adds COMPOSIO_BASE_URL config, JS SDK workspace support, and an in-memory file manager.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.26 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.3.26
  • Adds COMPOSIO_BASE_URL environment variable to configure the base URL for the Composio service.
  • Adds workspace support to the JavaScript SDK.
  • Adds an in-memory file manager.
  • Passes OAuth scope through the authorization flow.
  • Adds a CLI release flow.
+1 moreshow less
  • Adds a Docker release flow.
v0.3.24 NOTES STABLE

Composio v0.3.24 adds OAuth scope selection when adding connections and automatic GitHub token retrieval for agent workspaces.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.24 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.3.24
  • Adds support for specifying OAuth scopes when adding a connection via composio add.
  • Reads GitHub access token automatically from the Composio account for agent workspaces, removing the need to supply it manually.
  • Switches Docker-based agent workspaces to use the tooling server.
v0.3.21 NOTES STABLE

Composio v0.3.21 adds LangGraph plugin, FlyIO workspace, paramiko shell sessions, code indexing, and new toolset methods.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.21 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.3.21
  • Adds get_agent_instruction method to the toolset for retrieving agent instructions directly from tool configurations.
  • Adds file_uploadable option to support file upload capabilities in tool definitions.
  • Adds 'Add integration by id' function for retrieving integrations by their identifier.
  • Introduces a LangGraph plugin, enabling Composio tool use within LangGraph agent workflows.
  • Integrates paramiko for interactive shell sessions, enabling SSH-based interactive execution environments.
+3 moreshow less
  • Adds FlyIO workspace support for running agent workloads on FlyIO infrastructure.
  • Adds code indexing capability for semantic search and navigation over codebases.
  • Adds a scheduler agent example built with CrewAI.
v0.3.19 NOTES STABLE

Composio v0.3.19 adds an @action decorator for custom actions and a new Spider scraper & crawler tool integration.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.19 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.3.19
  • Adds @action decorator (importable at top level) to define custom actions directly in Python code.
  • Adds Spider scraper and crawler tool integration for web scraping and crawling workflows.
  • Ports Docker utilities to swekit for software-engineering kit workflows.
v0.3.17 NOTES STABLE

Composio v0.3.17 adds Camel-AI plugin, Cloudflare AI integration, Zep tool, multi-workspace support, and shell exit code reading.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.17 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.3.17
  • Adds $COMPOSIO_DEV_MODE environment variable for development mode configuration.
  • Adds composio-camel plugin, integrating Composio with the Camel-AI framework.
  • Adds Cloudflare AI as a supported integration.
  • Adds zep as a supported tool within Composio.
  • Adds a composio-core package for core library functionality.
+6 moreshow less
  • Adds support for reading exit codes on shells, enabling more reliable shell-based workflows.
  • Adds support for multiple workspaces, allowing concurrent isolated execution environments.
  • Adds support for user inputs within agent workflows.
  • Adds a Slack assistant integration.
  • Enables end-to-end evaluation on Composio-hosted Docker images.
  • Sets up host shell using Docker scripts for SWE agent environments.
Was this useful?
my-toolchain — 0 tools
paste an install list to detect your tools

A brew list, a Brewfile, requirements.txt, a Dockerfile — or just the product names, free-form. Nothing leaves your browser.

    browse all tools →