Heads up This site is currently under heavy development.
Subscribe Get it delivered — the daily firehose, filtered to the tools you run, plus the documentation changes vendors never announce. Compare plans →

The AI Toolchain — issue -375, August 31, 2024

THE AI TOOLCHAIN NO. -375
Tail
THE DAILY RELEASE FIREHOSE
PUBLISHED AUGUST 31, 2024 · EVERY WEEKDAY
EDITIONS tail grep head diff uniq

The daily firehose — everything the toolchain shipped today, already filtered.

// HOW THIS ISSUE IS MADE

We read every release from the 174 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.

VIEW
ISSUE VIEW full issue
Do you prefer this view?
$ tct list   # 32 tools matched
AI & LLM Tooling
◆  AI Coding Agents

Aider

Sources Release notes → v0.54.0 7 RELEASES · 2024-08-06 → 2024-08-28 NOTES STABLE

Aider v0.54.0 adds interactive shell commands, LLM output sharing, and a self-upgrade switch.

└──▷ GET THIS VERSION
$ git clone --branch v0.54.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.54.0
└──▷ TRY IT
Keep LLM context fresh by automatically feeding shell command output back to the model during a coding session.
$ aider --suggest-shell-commands
Update Aider to the latest PyPI release without leaving the tool or running pip manually.
$ aider --upgrade
  • Shell and /run commands are now interactive in pty-capable environments, enabling real-time input during command execution.
  • New --suggest-shell-commands / --no-suggest-shell-commands flag controls whether Aider proposes shell commands and optionally feeds their output back to the LLM.
  • New --upgrade switch installs the latest Aider release directly from PyPI without leaving the tool.
  • Adds model settings support for gemini/gemini-1.5-pro-exp-0827 and gemini/gemini-1.5-flash-exp-0827.
  • Performance improvements to autocomplete in large and monorepo codebases.
6 more releases in this issue · 2024-08-06 → 2024-08-28
v0.53.0 NOTES STABLE

Aider v0.53.0 adds prompt cache keepalive pings, bulk confirmation controls, and a dev-branch installer.

└──▷ GET THIS VERSION
$ git clone --branch v0.53.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.53.0
└──▷ TRY IT
Pull the latest unreleased Aider changes from the main branch to test cutting-edge features before a formal release.
$ aider --install-main-branch
  • Adds --cache-keepalive-pings to periodically ping the API every 5 minutes and prevent prompt cache expiration.
  • Enables bulk accept/reject of add-URL and run-shell confirmation prompts in a single action.
  • Adds --install-main-branch flag to upgrade directly to the latest development version of Aider.
  • Surfaces model metadata information when running with --verbose.
  • Extends extra_headers support to the weak model, enabling Anthropic beta features for that model tier.
v0.52.0 NOTES STABLE

Aider v0.52.0 adds interactive shell command suggestions, a new /reset command, and repo map size control.

└──▷ GET THIS VERSION
$ git clone --branch v0.52.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.52.0
└──▷ TRY IT
Reset an entire session — drop all tracked files and clear history — to start a clean context mid-conversation.
$ /reset
Widen the repo map when working without explicitly added files, so aider has more codebase context to draw on.
$ aider --map-multiplier-no-files 4
  • Adds automatic shell command suggestions after edits — offers to launch a browser, install dependencies, run DB migrations, execute the program, or run new tests.
  • New /reset command drops all files and clears chat history in one step.
  • New --map-multiplier-no-files flag controls the repo map size multiplier when no files are loaded in chat.
  • Switches default OpenAI model to gpt-4o-2024-08-06.
  • /read and /drop now expand ~ to the home directory.
+1 moreshow less
  • Displays the active chat mode in the aider prompt.
└──▷ BREAKING ON UPGRADE
  • !The default repo map size multiplier when no files are in chat is reduced to 2 (previously higher); this changes aider's context behavior on upgrade without any config change.
v0.51.0 NOTES STABLE

Aider v0.51.0 adds Anthropic prompt caching, configurable repo-map refresh, and improved Jupyter Notebook editing.

└──▷ GET THIS VERSION
$ git clone --branch v0.51.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.51.0
└──▷ TRY IT
Prevent repo map recomputation on every interaction in a monorepo — recompute only when tracked files change.
$ aider --map-refresh files
  • Adds --cache-prompts flag to enable prompt caching for Anthropic models, covering the system prompt, repo map, and /read-only files.
  • Adds --map-refresh flag with modes always, files, manual, and auto to control how often the repo map recomputes — useful for large or monorepos.
  • Improves editing performance on Jupyter Notebook .ipynb files.
  • Shows which config YAML file is loaded when running with --verbose.
v0.50.0 NOTES STABLE

Aider v0.50.0 adds DeepSeek Coder support, infinite output for more models, and new chat-mode switching.

└──▷ GET THIS VERSION
$ git clone --branch v0.50.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.50.0
└──▷ TRY IT
Use DeepSeek Coder as your backend for a coding session with extended 8k-token output.
$ aider --deepseek
Launch directly into ask mode for exploratory Q&A, then request a code edit in-place without switching tools.
$ aider --chat-mode ask
# then inside the session:
/code refactor the authentication module to use bcrypt
  • New --deepseek switch enables DeepSeek Coder with 8k token output.
  • Infinite output (streaming past normal limits) now supported for DeepSeek Coder and Mistral models, in addition to Anthropic models.
  • New --chat-mode <mode> switch lets you launch directly into ask, help, or code mode.
  • New /code <message> command lets you request a code edit without leaving ask mode.
v0.49.0 NOTES STABLE

Aider v0.49.0 adds read-only file context, clipboard pasting, in-script slash commands, and new model shortcuts.

└──▷ GET THIS VERSION
$ git clone --branch v0.49.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.49.0
└──▷ TRY IT
Include a read-only reference file (e.g., a shared schema outside your repo) so aider can see it without editing it.
$ aider --read ../shared/schema.sql src/models.py
Paste a screenshot or copied code from your clipboard directly into an aider session for analysis or editing.
$ /clipboard
Run aider non-interactively in a CI script and include slash commands in the message to control chat behavior.
$ aider --message "/read ../policy.md Summarize any security policy violations in auth.py" auth.py
  • Adds /read command and --read flag to include read-only files in chat context, including files outside the git repo.
  • New /clipboard command pastes images or text from the clipboard directly into the chat (replaces /add-clipboard-image).
  • Enables in-chat / commands inside scripted aider messages for automation workflows.
  • Adds --mini flag as a shorthand to use gpt-4o-mini.
  • Adds --attribute-commit-message-author to prefix commit messages with 'aider: ' only when aider authored the changes.
+5 moreshow less
  • Adds --attribute-commit-message-committer to prefix all commit messages with 'aider: ' regardless of author.
  • Adds support for openai/gpt-4o-2024-08-06 model.
  • /tokens now displays the active model alongside token counts.
  • Shows scraped markdown content when a URL is added via /web.
  • Removes the obsolete 16k token hard limit on commit diffs, deferring to per-model limits instead.
└──▷ BREAKING ON UPGRADE
  • !--attribute-commit-message is replaced by --attribute-commit-message-author; setups using --attribute-commit-message must migrate to the new flag.
v0.48.0 NOTES STABLE

Aider v0.48.0 adds clipboard image input, subtree scoping, and unlocks repo maps for any model.

└──▷ GET THIS VERSION
$ git clone --branch v0.48.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.48.0
└──▷ TRY IT
Scope aider to a subdirectory of a large monorepo to avoid indexing the entire repo and speed up context building.
$ cd services/auth && aider --subtree-only
Enable repo map on a model that wouldn't use one by default, giving it structural context of your codebase.
$ aider --map-tokens 1024 --model <your-model>
Add a screenshot or diagram from your clipboard into the chat to give aider visual context.
$ /add-clipboard-image
  • New /add-clipboard-image command lets you paste images directly into the chat.
  • New --subtree-only flag scopes aider to the current directory subtree, improving large and mono-repo performance.
  • Use --map-tokens 1024 to enable repo map with any model, not just defaults.
  • Supports Sonnet's 8k output window.
Was this useful?

Cline

Sources Release notes → v1.5.6 3 RELEASES · 2024-08-15 → 2024-08-31 NOTES STABLE

Autonomous coding agent as an SDK, IDE extension, or CLI assistant.

Cline v1.5.6 lets you edit Claude's file changes directly in the diff view before accepting them.

└──▷ GET THIS VERSION
$ git clone --branch v1.5.6 https://github.com/cline/cline.git
# already have the repo? check out this version:
$ git checkout v1.5.6
  • Enables direct editing of Claude's proposed file changes in the right side of the diff view before accepting.
  • Adds 'Revert Block' button in the diff view center to undo inline placeholders like // rest of code here.
2 more releases in this issue · 2024-08-15 → 2024-08-31
v1.4.0 NOTES STABLE

Cline v1.4.0 adds auto-approved read-only file access and sliding window context management for 200k+ token tasks.

└──▷ GET THIS VERSION
$ git clone --branch v1.4.0 https://github.com/cline/cline.git
# already have the repo? check out this version:
$ git checkout v1.4.0
└──▷ HOW TO FIND IT
Enable auto-approved read-only access so Claude can freely browse your codebase without interrupting you for every file read — useful for large exploration or refactoring tasks.
📍In VSCode, go to Extensions › Cline › Extension Settings and enable "Always allow read-only operations".
  • New 'Always allow read-only operations' setting lets Claude read files and view directories without requiring per-action approval.
  • Implements sliding window context management to keep long-running tasks alive beyond the 200k token context limit.
v1.2.0 NOTES STABLE

Cline v1.2.0 adds Anthropic Prompt Caching support, cutting costs up to 90% and latency up to 85%.

└──▷ GET THIS VERSION
$ git clone --branch v1.2.0 https://github.com/cline/cline.git
# already have the repo? check out this version:
$ git checkout v1.2.0
  • Supports Anthropic Prompt Caching for Claude 3.5 Sonnet and Claude 3.0 Haiku, reducing API costs up to 90% and latency up to 85%.
Was this useful?

Continue

Sources Release notes → v0.8.47-vscode NOTES

Continue v0.8.47 adds headless browser crawling and text-to-speech in the chat window.

└──▷ GET THIS VERSION
$ git clone --branch v0.8.47-vscode https://github.com/continuedev/continue.git
# already have the repo? check out this version:
$ git checkout v0.8.47-vscode
  • Adds text-to-speech (TTS) support in the chat window.
  • Switches documentation crawling to a headless browser for more complete page rendering and better results.
  • Improves support for WatsonX models.
Was this useful?

All Hands AI OpenHands

Sources Release notes → 0.9.1 3 RELEASES · 2024-08-01 → 2024-08-29 NOTES STABLE

OpenHands: AI-Driven Development

OpenHands 0.9.1 adds a CLI mode, prompt caching for Sonnet/Haiku, and specialized micro agents for CodeAct.

└──▷ GET THIS VERSION
$ git clone --branch 0.9.1 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.9.1
  • Adds CLI mode, enabling OpenHands to be driven from the command line without the web UI.
  • Adds prompt caching to CodeActAgent for Anthropic Sonnet and Haiku models, reducing latency and token costs on repeated context.
  • Introduces micro agents as specializations of CodeAct, allowing targeted agent behaviors for specific tasks.
  • Improves model selection UI in settings for easier LLM configuration.
2 more releases in this issue · 2024-08-01 → 2024-08-29
0.9.0 NOTES STABLE

OpenHands 0.9.0 adds vision LLM support, a Security Analyzer, async LLM calls, and switches to EventStream Runtime by default.

└──▷ GET THIS VERSION
$ git clone --branch 0.9.0 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.9.0
  • Adds vision input support for LLMs with vision capabilities, enabling image-aware agent interactions.
  • Adds a Security Analyzer functionality for automated security review workflows.
  • Enhances the LLM class with async support for non-blocking model calls.
  • Implements copy_to for Runtime, allowing files to be pushed directly into the agent's runtime environment.
  • Supports injecting additional dependencies into the OpenHands runtime Docker image at launch.
+7 moreshow less
  • Switches the default runtime to EventStream Runtime.
  • Clears conversation history at the start of each new task to avoid context bleed between sessions.
  • Adds collapsible resizers in the UI for a more flexible workspace layout.
  • Integrates the Aider Benchmark for agent evaluation.
  • Agents can now accept per-agent configuration via agent config, enabling fine-grained control.
  • Adds warning messages when a config file contains unknown keys, helping catch misconfiguration early.
  • Adds error observations to the CodeAct SWE agent so it can recover from execution failures.
└──▷ BREAKING ON UPGRADE
  • !The project is renamed from OpenDevin to OpenHands — any references to the old name in configs, Docker images, or scripts will need updating.
  • !The default runtime is now EventStream Runtime instead of the previous default — existing setups relying on the old default runtime behavior may behave differently without explicit configuration.
0.8.3 NOTES STABLE

OpenHands 0.8.3 adds a UI toggle for agent selection and Dev Container support for GitHub Codespaces.

└──▷ GET THIS VERSION
$ git clone --branch 0.8.3 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:
$ git checkout 0.8.3
  • Adds a UI toggle to enable or disable agent selection (defaults to off, hiding agent selection from end users).
  • Adds Dev Container configuration for GitHub Codespaces, enabling one-click cloud development environments.
Was this useful?

Zed

Sources Release notes → v0.149.3 3 RELEASES · 2024-08-07 → 2024-08-20 NOTES STABLE

Zed AI launches with image paste, Prompt Caching, GPT-4o Copilot Chat, and 8192-token Claude Sonnet 3.5 output

└──▷ GET THIS VERSION
$ git clone --branch v0.149.3 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.149.3
└──▷ USE IT
Show render performance metrics in the status bar to spot frame-rate regressions while developing themes or extensions.
json
// In your Zed settings.json
{
  "performance": {
    "show_in_status_bar": true
  }
}
Bind a key to type a literal comma without triggering a multi-key chord that starts with comma.
json
// In your Zed keymap.json
[
  {
    "bindings": {
      ", ,": ["editor::HandleInput", ","]
    }
  }
]
Cycle the cursor between center, top, and bottom of the viewport with a single key, similar to Emacs recenter-top-bottom.
json
// In your Zed keymap.json
[
  {
    "bindings": {
      "ctrl-l": "editor::ScrollCursorCenterTopBottom"
    }
  }
]
  • Adds performance.show_in_status_bar: true setting (macOS-only) to display time-to-first-window-draw and FPS in the status bar.
  • Adds editor::ScrollCursorCenterTopBottom action for toggling scroll position with a single key binding.
  • Adds editor::HandleInput action to allow typing symbols that conflict with keymaps (e.g. '", ,": ["editor::HandleInput", ","]' to type a literal comma without timeout).
  • Adds support for pasting images into the Assistant Panel as context (currently macOS and Anthropic models only).
  • Adds Prompt Caching support for Anthropic models, dramatically lowering cost and improving performance for supported models.
+13 moreshow less
  • Adds support for 8192 output tokens from Claude Sonnet 3.5.
  • Adds GPT-4o support for Copilot Chat.
  • Adds UI indicators in the assistant panel showing which messages have been cached.
  • Adds syntax highlighting for tagged template literals in javascript, typescript, and tsx for css, html, js, json, sql, ts, yaml, and yml tags.
  • Adds support for recognizing CUDA files as C++.
  • Assistant workflow steps can now be applied and reverted directly from within the assistant panel.
  • AI Workflows can now create new files in folders that did not previously exist.
  • Adds a context token count display when hovering over token counts in the inline assist.
  • Adds more context when using assistant: Quote selection to insert text into the assistant panel.
  • Allows the model to control indentation during inline transformations, improving experience in Python and other indentation-sensitive languages.
  • Vim: Adds support for range syntax in commands and prefills the command line with :'<,'> from visual mode.
  • Adds a popup displayed when the keymap is invalid.
  • REPL: Reduces default stdout/stderr line count to 32 for improved visuals.
2 more releases in this issue · 2024-08-07 → 2024-08-20
v0.148.0 NOTES STABLE

Zed v0.148.0 adds tool calling for OpenAI/Ollama, REPL markdown rendering, and a new 'go to declaration' editor action.

└──▷ GET THIS VERSION
$ git clone --branch v0.148.0 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.148.0
  • Adds editor: go to declaration editor action for LSP-based declaration navigation.
  • Prompt templates for inline transformation (editor and terminal) can now be overridden by placing files in ~/.config/zed/prompts/templates.
  • The ordering of language_servers in settings now controls which server is treated as primary.
  • Adds ctrl-alt-enter (ctrl-option-enter on macOS) keybinding for repl::RunInPlace, keeping screen position and cursor in place.
  • Adds update_display_data support for REPL, enabling live-updating outputs.
+7 moreshow less
  • Adds markdown rendering for Jupyter/REPL outputs, supporting Deno.jupyter.md (Deno/TypeScript) and IPython.display.Markdown (IPython).
  • Adds tool calling capabilities to OpenAI and Ollama models in the assistant.
  • Adds menu items to quickly switch between Supermaven and Copilot inline completions when a provider is not yet configured.
  • VTSLS now uses the local instance if one is available on PATH.
  • Adds logging of raw kernel output from REPL in debug mode.
  • Adds a popup displayed when settings are invalid.
  • Improved Rust test detection to match attributes containing the test substring.
└──▷ BREAKING ON UPGRADE
  • !Vim keybindings for go-to actions have changed: g d is now 'Go to definition', g D is 'Go to declaration', g y is 'Go to type definition', and g I is 'Go to implementation' — any custom bindings relying on the previous mapping for g D will behave differently.
v0.147.2 NOTES STABLE

Zed v0.147.2 adds GitHub Copilot Chat, inline terminal assistant, font fallback settings, and SSH remoting terminal support.

└──▷ GET THIS VERSION
$ git clone --branch v0.147.2 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.147.2
└──▷ USE IT
Configure font fallbacks for the editor buffer and UI so characters missing from your primary font render correctly.
json
{
  "buffer_font_fallbacks": ["Noto Sans Mono", "Symbols Nerd Font"],
  "ui_font_fallbacks": ["Noto Sans"],
  "terminal": {
    "font_fallbacks": ["Noto Sans Mono"]
  }
}
Generate a shell command from a plain-English description without leaving the terminal.
📍# Inside the Zed integrated terminal, press ctrl-enter, # type your description (e.g. 'list all listening TCP ports'), # and accept the generated command.
  • Adds ui_font_fallbacks, buffer_font_fallbacks, and terminal.font_fallbacks settings for font fallback configuration.
  • Adds GitHub Copilot Chat as an AI assistant option, available in the model dropdown after signing into GitHub Copilot within Zed.
  • Adds ctrl-enter keybind to invoke the inline assistant in the terminal, enabling natural-language generation of terminal commands.
  • Adds support for language server tracing to the LSP log view.
  • Adds terminal and task support to the experimental SSH remoting alpha.
+13 moreshow less
  • Adds comment.doc scope to enable styled doc comments in Rust.
  • Adds support for Vim digraphs.
  • Adds support for binding motions in Vim insert mode.
  • Adds {count} support for >/< indent operators in Vim visual mode.
  • Adds a Markdown preview button to the toolbar; Option|Alt+Click opens the preview in a side pane.
  • Adds double-click on blank space in the project panel to create a new file.
  • Adds tab switcher support in the Assistant panel.
  • Adds ability to select and copy text from diagnostic popovers.
  • Adds 'copy absolute path' option to the tab context menu.
  • Improves environment-variable detection for tasks so that direnv, asdf, mise, and similar tools are automatically picked up.
  • Improves the Rust outline panel to include static items.
  • Linux/X11: Adds support for keyboard layout hot-plugging.
  • Changes the project panel to auto-fold directories by default.
└──▷ BREAKING ON UPGRADE
  • !SSH remoting alpha removes the ability to specify gh cs ssh or gcloud compute ssh as connection commands; see https://zed.dev/docs/remote-development for alternatives.
Was this useful?

shell-gpt

Sources Release notes → 1.4.4 NOTES

shell-gpt 1.4.4 enables function calling on Groq and other non-OpenAI models, and switches the default model to gpt-4o.

└──▷ GET THIS VERSION
$ git clone --branch 1.4.4 https://github.com/TheR1D/shell_gpt.git
# already have the repo? check out this version:
$ git checkout 1.4.4
  • Supports function calling on Groq and other compatible models via the new OpenAI function-calling format.
  • Changes the default model to gpt-4o for all interactions.
└──▷ BREAKING ON UPGRADE
  • !The default model is changed to gpt-4o; existing setups that relied on the previous default model will now use gpt-4o unless overridden in configuration.
Was this useful?
◆  AI Agent Frameworks

CrewAI

Sources Release notes → v0.51.0 NOTES

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

CrewAI v0.51.0 adds crew testing/evaluation, pipelines, four new tools (Vision, DALL-E, MySQL, NL2SQL), and a sliding context window.

└──▷ GET THIS VERSION
$ git clone --branch v0.51.0 https://github.com/crewAIInc/crewAI.git
# already have the repo? check out this version:
$ git checkout v0.51.0
└──▷ USE IT
Assign a cheaper or faster LLM specifically to the planning step so your expensive model is reserved for agent execution.
python
from crewai import Crew, Agent, Task, Process
from langchain_openai import ChatOpenAI

planner_llm = ChatOpenAI(model="gpt-4o-mini")

crew = Crew(
    agents=[...],
    tasks=[...],
    process=Process.sequential,
    planning=True,
    planning_llm=planner_llm
)
crew.kickoff()
Give agents the ability to generate images on demand during a workflow using the new DALL-E Tool.
python
from crewai_tools import DallETool
from crewai import Agent

image_agent = Agent(
    role="Image Creator",
    goal="Generate visuals from descriptions",
    backstory="You create images for marketing campaigns.",
    tools=[DallETool()]
)
Enable natural-language database querying so agents can answer data questions without writing SQL manually.
python
from crewai_tools import NL2SQLTool
from crewai import Agent

db_agent = Agent(
    role="Data Analyst",
    goal="Answer business questions from the database",
    backstory="You query databases using plain English.",
    tools=[NL2SQLTool(db_uri="mysql+pymysql://user:pass@host/dbname")]
)
  • Adds crew testing and evaluation framework for assessing crew performance.
  • Introduces Pipeline structure for composing multi-crew workflows.
  • Adds sliding context window to manage long-running agent context automatically.
  • Supports setting a dedicated LLM for the planning step, separate from agent LLMs.
  • New crew run CLI command for executing CrewAI projects.
+8 moreshow less
  • Allows all agent/task attributes to be defined in YAML project configuration.
  • New Vision Tool for enabling agents to process and reason about images.
  • New DALL-E Tool for generating images from within agent workflows.
  • New MySQL Tool for querying MySQL databases from agents.
  • New NL2SQL Tool for translating natural language queries into SQL.
  • File-saving now serializes dict outputs as JSON when writing to disk.
  • Enables verbose settings for tool outputs to aid in debugging and observability.
  • Adds new GitHub project templates for bootstrapping CrewAI projects.
Was this useful?

deepset Haystack

Sources Release notes → v2.4.0 NOTES

Haystack v2.4.0 adds local LLM support in evaluators, a new AnswerJoiner, and richer embedding controls via truncate_dim and precision.

└──▷ GET THIS VERSION
$ git clone --branch v2.4.0 https://github.com/deepset-ai/haystack.git
# already have the repo? check out this version:
$ git checkout v2.4.0
└──▷ USE IT
Run faithfulness evaluation against a local LLM endpoint instead of OpenAI, with custom generation parameters.
python
from haystack.components.evaluators import FaithfulnessEvaluator

evaluator = FaithfulnessEvaluator(
    api_params={
        "api_base_url": "http://localhost:11434/v1",
        "generation_kwargs": {"temperature": 0.0, "max_tokens": 512},
    }
)
result = evaluator.run(questions=["What is RAG?"], contexts=[["RAG combines retrieval and generation."]], responses=["RAG is a retrieval-augmented generation approach."])
Produce compact, quantized embeddings for a large document corpus to reduce memory usage during semantic search.
python
from haystack.components.embedders import SentenceTransformersDocumentEmbedder

embedder = SentenceTransformersDocumentEmbedder(
    model="sentence-transformers/all-MiniLM-L6-v2",
    truncate_dim=128,
    precision="int8",
)
  • Adds api_params init parameter to ContextRelevanceEvaluator and FaithfulnessEvaluator, enabling custom generation_kwargs and api_base_url for local LLM evaluation via any OpenAI-compatible endpoint.
  • Adds truncate_dim parameter to Sentence Transformers Embedders for truncating embeddings, especially useful for Matryoshka Representation Learning models.
  • Adds precision parameter to Sentence Transformers Embedders for quantized embeddings, enabling corpus size reduction for semantic search.
  • Adds model_kwargs and tokenizer_kwargs to TransformersSimilarityRanker, SentenceTransformersDocumentEmbedder, and SentenceTransformersTextEmbedder, supporting options like model_max_length and torch_dtype.
  • Adds unicode_normalization parameter to DocumentCleaner, supporting NFC, NFD, NFKC, and NFKD normalization modes.
+6 moreshow less
  • Adds ascii_only parameter to DocumentCleaner to convert diacritic letters to ASCII equivalents and strip other non-ASCII characters.
  • Adds max_retries and timeout parameters to AzureOpenAIChatGenerator, AzureOpenAIDocumentEmbedder, and AzureOpenAITextEmbedder initializations.
  • Allows streaming_callback to be passed at pipeline run time to OpenAIGenerator and OpenAIChatGenerator, eliminating the need to recreate pipelines for streaming callbacks.
  • Enhanced filter application logic in retrievers to support merging of init-time and runtime filters with logical operators for complex metadata filtering combinations.
  • New AnswerJoiner component that combines multiple lists of Answer objects into a single list using Concatenate join mode.
  • Introduces a utility function to deserialize a generic Document Store from the init_parameters of a serialized component.
└──▷ BREAKING ON UPGRADE
  • !ContextRelevanceEvaluator now returns only the list of relevant sentences per context (not all sentences), and scores 1 if any relevant sentence is found, 0 otherwise.
  • !DynamicPromptBuilder and DynamicChatPromptBuilder are removed; use PromptBuilder and ChatPromptBuilder instead.
  • !OutputAdapter and ConditionalRouter can no longer return user inputs.
  • !Multiplexer is removed; use BranchJoiner instead.
  • !Deprecated init parameters extractor_type and try_others are removed from HTMLToDocument.
  • !SentenceWindowRetrieval component is renamed to SentenceWindowRetriever.
  • !Utility functions serialize_callback_handler and deserialize_callback_handler are removed; use serialize_callable and deserialize_callable instead.
Was this useful?

LangChain

Sources Release notes → langchain-community==0.2.15 20 RELEASES · 2024-08-01 → 2024-08-30 NOTES STABLE

langchain-community 0.2.15 adds SparkLLM function calling, SambaStudio GenericV2 embeddings, Neo4j self-query support, and OpenSearch Serverless semantic cache.

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.2.15 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.2.15
  • Adds function call support to the ChatSparkLLM / SparkLLM chat model integration.
  • Adds SambaStudio embeddings GenericV2 API support.
  • Adds a Neo4j query constructor for the self-query retriever.
  • Adds ID field back to Azure AI Search results.
  • Enables Amazon OpenSearch Serverless (aoss) as a semantic cache store.
+1 moreshow less
  • Adds support for passing extra params when executing functions in UCFunctionToolkit.
19 more releases in this issue · 2024-08-01 → 2024-08-30
langchain-prompty==0.0.3 NOTES STABLE

langchain-prompty 0.0.3 adds a template format parameter to create_chat_prompt and fixes double-templating.

└──▷ GET THIS VERSION
$ git clone --branch langchain-prompty==0.0.3 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-prompty==0.0.3
  • Adds a template format parameter to create_chat_prompt in langchain_prompty, letting callers explicitly control which templating engine is applied to the prompt.
langchain-ollama==0.1.2 NOTES STABLE

langchain-ollama 0.1.2 adds base_url, headers, and auth parameters plus standard tracing params for LLMs.

└──▷ GET THIS VERSION
$ git clone --branch langchain-ollama==0.1.2 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-ollama==0.1.2
  • Adds base_url, headers, and auth parameters to the Ollama integration, enabling connections to custom or authenticated Ollama endpoints.
  • Implements standard tracing parameters for LLMs across the Ollama integration, aligning tracing output with the rest of the LangChain ecosystem.
langchain-community==0.2.14 NOTES STABLE

LangChain Community 0.2.14 adds relevance score support to PineconeHybridSearchRetriever.

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.2.14 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.2.14
  • Adds relevance score output to PineconeHybridSearchRetriever results.
langchain-community==0.2.13 NOTES STABLE

langchain-community 0.2.13 adds MMR to Neo4j vector, async support in PebbloRetrievalQA, Nebula Chat model, TiDB vector index, and more.

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.2.13 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.2.13
  • Adds where argument support to ChromaDB delete() for filtered document deletion.
  • Adds args_schema to SearxSearchResults tool for structured argument validation.
  • Adds metadata filter support to CassandraGraphVectorStore.
  • Adds score function for similarity_score_threshold in OpenSearch vector store.
  • Adds MMR (Maximal Marginal Relevance) retrieval support to Neo4j vector store.
+11 moreshow less
  • Adds Access Token Authentication to Azure Search Vector Store.
  • Adds async support for prompt APIs in PebbloRetrievalQA.
  • Adds ToolMessage support for ChatZhipuAI.
  • Adds support for the Nebula Chat model.
  • Adds vector index support for TiDB vector store.
  • Adds usage_metadata to Qianfan generate/agenerate responses.
  • Adds retry logic for session-expired exceptions in Neo4j.
  • Adds additional supported blockchains to the Blockchain Document Loader.
  • Updates default PPLX model to the supported llama-3.1 model.
  • Updates AzureMLEndpointApiType class endpoint.
  • Adds langchain_version field when calling the Pebblo discover API.
langchain-core==0.2.35 NOTES STABLE

langchain-core 0.2.35 adds nested subgraph rendering in Mermaid, chunk separator control in merge_message_runs, and recursive additionalProperties in strict OpenAI functions.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.35 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.35
└──▷ USE IT
Merge consecutive messages while controlling the separator between chunks — useful when you want newlines or custom delimiters instead of the default.
python
from langchain_core.messages.utils import merge_message_runs

merged = merge_message_runs(messages, chunk_separator="\n")
  • Adds chunk_separator option to merge_message_runs to control how message chunks are joined when merging.
  • Supports drawing nested subgraphs in draw_mermaid, enabling richer visual graph representations.
  • Adds additionalProperties recursively to OpenAI function schemas when strict mode is enabled.
  • Adds _api.rename_parameter utility to support renaming parameters in functions without breaking callers.
langchain-core==0.2.34 NOTES STABLE

langchain-core 0.2.34 adds a LangSmith document loader and allows bound models as token counters in trim_messages.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.34 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.34
  • Adds a LangSmith document loader to langchain-core for loading documents directly from LangSmith.
  • Allows bound models (e.g. models with pre-configured parameters) to be passed as the token_counter argument in trim_messages, expanding its flexibility.
  • Supports OpenAI-format dicts as message inputs, broadening interoperability with OAI-style message representations.
  • Adds @beta decorator to previously unmarked GraphVectorStore extension classes in core and community.
langchain-community==0.2.12 NOTES STABLE

LangChain Community 0.2.12 adds FireCrawl LLM extraction, financialdatasets.ai stock tools, SharePoint extended metadata, and ZhipuAI structured output.

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.2.12 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.2.12
  • Adds dimension parameter to ZhipuAIEmbeddings for controlling embedding output size.
  • Adds bind_tools and with_structured_output methods to ChatZhipuAI for structured LLM interactions.
  • Adds llm-extraction option to the FireCrawl Document Loader for AI-powered content extraction during crawls.
  • Adds stock market tools from financialdatasets.ai as new community tools.
  • Adds kwargs support to CassandraGraphVectorStore for extended configuration.
+5 moreshow less
  • Supports Personal Access Token authorization in ConfluenceLoader.
  • Extends SharePointLoader to load metadata for the root folder.
  • Makes profile_name optional in AthenaLoader.
  • Updates polygon.py to support business-tier subscriptions.
  • Adds cost tracking for Bedrock Anthropic Claude 3.5 Sonnet in BedrockAnthropicTokenUsageCallbackHandler.
langchain==0.2.13 NOTES STABLE

LangChain 0.2.13 adds DocumentIndex support in the index API and strict tool calling for OpenAI models.

└──▷ GET THIS VERSION
$ git clone --branch langchain==0.2.13 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain==0.2.13
  • Adds support for DocumentIndex in the index API, enabling document indexing workflows via the new integration.
  • Enables strict tool calling for OpenAI models via core and openai packages.
  • Changes default prompt-pulling behavior to use the LangSmith SDK first, falling back to LangChain Hub.
langchain-core==0.2.30 NOTES STABLE

langchain-core 0.2.30 adds a secrets-from-env factory and from_env utility for cleaner credential wiring.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.30 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.30
  • Adds from_env utility function for looking up secrets and configuration values directly from environment variables.
  • Adds standard tracing parameters for retrievers, expanding LangSmith observability to retriever components.
  • Autodetects more LangSmith (ls) parameters, reducing manual tracing configuration.
langchain-openai==0.1.21 NOTES STABLE

langchain-openai 0.1.21 adds strict tool calling and JSON Schema support for structured output.

└──▷ GET THIS VERSION
$ git clone --branch langchain-openai==0.1.21 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-openai==0.1.21
  • Adds json_schema support to ChatOpenAI.with_structured_output, enabling JSON Schema-based structured output responses.
  • Enables strict tool calling mode for ChatOpenAI, giving tighter control over tool invocation behavior.
langchain-mongodb==0.1.8 NOTES STABLE

langchain-mongodb gains Hybrid and Full-Text Search Retrievers plus improved search index commands.

└──▷ GET THIS VERSION
$ git clone --branch langchain-mongodb==0.1.8 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-mongodb==0.1.8
  • Adds Hybrid Search and Full-Text Search Retrievers for MongoDB Atlas, enabling combined vector + keyword and pure keyword retrieval workflows.
  • Improves search index management commands for MongoDB Atlas vector stores.
langchain-openai==0.1.21rc2 NOTES STABLE

langchain-openai 0.1.21rc2 adds JSON Schema support in with_structured_output and strict tool calling mode.

└──▷ GET THIS VERSION
$ git clone --branch langchain-openai==0.1.21rc2 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-openai==0.1.21rc2
  • Adds json_schema support to ChatOpenAI.with_structured_output, enabling structured output via OpenAI's JSON Schema response format.
  • Enables strict tool calling mode for ChatOpenAI, allowing tools to be invoked with OpenAI's strict parameter enforcement.
langchain-core==0.2.29 NOTES STABLE

langchain-core 0.2.29 adds DocumentIndex abstraction, index API support, and strict tool calling for OpenAI.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.29 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.29
  • Introduces DocumentIndex abstraction, a new interface for document storage and retrieval backends.
  • Adds support for DocumentIndex in the index API, enabling use of the new abstraction with existing indexing workflows.
  • Enables strict tool calling for OpenAI-backed language models.
  • Adds disable_streaming support to the base language model interface.
  • Sets context propagation in RunnableSequence and RunnableParallel for improved tracing and context handling.
+1 moreshow less
  • Includes dependencies in sys_info output for easier environment diagnostics.
langchain-openai==0.1.21rc1 NOTES STABLE

LangChain OpenAI 0.1.21rc1 enables strict tool calling for OpenAI models.

└──▷ GET THIS VERSION
$ git clone --branch langchain-openai==0.1.21rc1 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-openai==0.1.21rc1
  • Enables strict tool calling mode for OpenAI integrations.
langchain-core==0.2.29rc1 NOTES STABLE

langchain-core 0.2.29rc1 adds strict tool calling support and a new DocumentIndex abstraction for the index API.

└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.2.29rc1 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-core==0.2.29rc1
  • Introduces DocumentIndex abstraction, a new base class for document index integrations.
  • Adds DocumentIndex support to the index API, enabling document indexing workflows against the new abstraction.
  • Enables strict tool calling mode for OpenAI tool/function calls.
langchain-community==0.2.11 NOTES STABLE

langchain-community 0.2.11 adds new integrations, tools support, and retriever capabilities across a broad set of providers.

└──▷ GET THIS VERSION
$ git clone --branch langchain-community==0.2.11 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-community==0.2.11
└──▷ USE IT
Safely instantiate WebResearchRetriever when your setup requires outbound HTTP calls that were previously blocked by default.
python
from langchain_community.retrievers import WebResearchRetriever

retriever = WebResearchRetriever.from_llm(
    llm=llm,
    search=search,
    allow_dangerous_requests=True
)
Point the Firecrawl document loader at a self-hosted or alternative Firecrawl API endpoint.
python
from langchain_community.document_loaders.firecrawl import FireCrawlLoader

loader = FireCrawlLoader(
    url="https://example.com",
    api_url="https://my-firecrawl-instance.internal"
)
docs = loader.load()
Filter reranked results to only those above a relevance threshold using FlashrankRerank.
python
from langchain_community.document_compressors.flashrank_rerank import FlashrankRerank

reranker = FlashrankRerank(score_threshold=0.5)
filtered_docs = reranker.compress_documents(documents=docs, query="my query")
  • Adds allow_dangerous_requests parameter to WebResearchRetriever.from_llm constructor to explicitly gate dangerous HTTP requests.
  • Replaces filters argument with filter in DatabricksVectorSearch — callers must update their keyword argument.
  • Adds auth passthrough parameter to Ollama LLM requests via langchain_community Ollama integration.
  • Adds score_threshold parameter to flashrank_rerank.py for controlling reranking cutoff.
  • Adds api_url parameter to document_loaders.firecrawl to support specifying a custom Firecrawl API endpoint.
+19 moreshow less
  • Adds filtered vector search support to Azure Cosmos DB vector store.
  • Adds self-query retriever support for HANA Cloud Vector Engine.
  • Adds bind_tools and structured output support to MiniMaxChat.
  • Adds bind_tools support to ChatMlflow.
  • Adds tool calling support to ChatBaichuan (Baichuan model).
  • Adds tool and structured output support to OCI Generative AI.
  • Adds tools support for LiteLLM via feat(community).
  • Adds tool calling functionality to PremAI ([Community] PremAI Tool Calling).
  • Adds support for named arguments in the GitHub toolkit.
  • Adds artifact field to Tavily search results.
  • Integrates the Yi family of models as a new community provider.
  • Adds ScrapingAnt loader as a new community document loader integration.
  • Adds Product Quantization as a retriever option in community retrievers.
  • Updates VDMS vectorstore with new capabilities.
  • Adds prompt governance support in pebblo_retrieval.
  • Implements content-size-based batching in PebbloSafeLoader.
  • Replaces Tencent Cloud integration with the official Tencent Cloud SDK.
  • Enhances Brave Search results with extra snippets for richer result details.
  • Raises LangChainException instead of a bare Exception in langchain_community.vectorstores.azuresearch.
└──▷ BREAKING ON UPGRADE
  • !The filters argument in DatabricksVectorSearch is replaced by filter; existing code using filters= will break.
langchain-experimental==0.0.64 NOTES STABLE

langchain-experimental 0.0.64 adds a Relik graph transformer and per-call config support for graph document conversion.

└──▷ GET THIS VERSION
$ git clone --branch langchain-experimental==0.0.64 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-experimental==0.0.64
  • Adds RelikGraphTransformer for extracting graph structures using the Relik model.
  • Adds config parameter to convert_to_graph_documents to pass runtime configuration per call.
  • Adds ImagePromptTemplate compatibility to OllamaFunctions for multimodal prompt support.
langchain==0.2.12 NOTES STABLE

langchain 0.2.12 adds Bedrock Converse and Ollama support to init_chat_model(), plus a HANA Cloud self-query retriever.

└──▷ GET THIS VERSION
$ git clone --branch langchain==0.2.12 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain==0.2.12
  • Adds ChatBedrockConverse support to init_chat_model(), allowing Bedrock Converse models to be initialised via the unified model-factory function.
  • Adds ChatOllama support to init_chat_model(), importing from langchain-ollama with a fallback to langchain-community.
  • Adds a self-query retriever for HANA Cloud Vector Engine in langchain-community, enabling structured metadata filtering against SAP HANA Cloud.
langchain-ollama==0.1.1 NOTES STABLE

langchain-ollama 0.1.1 adds seed, base_url, and image-input support to ChatOllama.

└──▷ GET THIS VERSION
$ git clone --branch langchain-ollama==0.1.1 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout langchain-ollama==0.1.1
└──▷ USE IT
Pin Ollama responses to a fixed seed so results are reproducible across runs — useful for evals or regression testing.
python
from langchain_ollama import ChatOllama

llm = ChatOllama(model="llama3", seed=42)
response = llm.invoke("Explain prompt injection in one sentence.")
print(response.content)
Point ChatOllama at a remote or non-default Ollama server — useful when the model runs on a separate host in your lab or cluster.
python
from langchain_ollama import ChatOllama

llm = ChatOllama(model="llama3", base_url="http://ollama-host:11434")
response = llm.invoke("Summarize this alert.")
print(response.content)
  • Adds seed parameter to ChatOllama for reproducible, deterministic LLM outputs.
  • Adds base_url parameter to ChatOllama, enabling connections to non-default or remote Ollama instances.
  • Supports image inputs for multimodal use cases in langchain_ollama.
  • Adds TypedDict to tool schema conversion support for Ollama integrations.
Was this useful?

LangChain LangGraph

Sources Release notes → 0.2.15 19 RELEASES · 2024-08-03 → 2024-08-30 NOTES STABLE

Build resilient agents.

create_react_agent now accepts a ToolNode instance directly, enabling reuse of tool configurations across agents.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.15 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.15
└──▷ USE IT
Reuse a pre-configured ToolNode across two agents to share tool setup (e.g., auth, retries) without duplicating it.
python
from langgraph.prebuilt import ToolNode, create_react_agent

shared_tool_node = ToolNode([search_tool, calculator_tool])

agent_a = create_react_agent(model_a, shared_tool_node)
agent_b = create_react_agent(model_b, shared_tool_node)
Wire a StateGraph node directly to END without a prior add_node(END) call, reducing boilerplate in graph definitions.
python
from langgraph.graph import StateGraph, END

builder = StateGraph(MyState)
builder.add_node("analyze", analyze_fn)
builder.add_edge("analyze", END)  # No explicit add_node(END) needed
graph = builder.compile()
  • Enables passing a ToolNode instance directly to create_react_agent, so existing tool configurations can be reused across multiple agents without duplication.
  • Supports connecting StateGraph edges directly to the END node without explicitly adding it first, making graph construction more concise.
18 more releases in this issue · 2024-08-03 → 2024-08-30
sdk==0.1.30 NOTES STABLE

LangGraph SDK 0.1.30 adds state-value filtering for thread search and makes runs.join() return final thread state.

└──▷ GET THIS VERSION
$ git clone --branch sdk==0.1.30 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout sdk==0.1.30
└──▷ USE IT
Filter threads to only those whose state contains a specific value — useful for finding active conversations in a given topic or stage.
python
threads = await client.threads.search(values={"topic": "billing", "status": "open"})
Block until a run completes and immediately inspect the final thread state without a separate fetch call.
python
final_state = await client.runs.join(thread_id, run_id)
print(final_state)
  • Adds values parameter to client.threads.search() for filtering threads by their state values.
  • Changes client.runs.join() to return a dictionary containing the final thread state instead of None.
  • Introduces Json type as a replacement for the Metadata type to better reflect its semantic purpose.
└──▷ BREAKING ON UPGRADE
  • !The Metadata type is renamed to Json; code importing or referencing Metadata will break.
  • !client.runs.join() now returns a dictionary containing the final thread state instead of None; code that assumes a None return value will break.
checkpoint==1.0.7 NOTES STABLE

LangGraph Checkpoint 1.0.7 adds parent checkpoint references and pending-send tracking across checkpoint operations.

└──▷ GET THIS VERSION
$ git clone --branch checkpoint==1.0.7 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout checkpoint==1.0.7
  • Adds parents field to CheckpointMetadata, mapping checkpoint namespace to checkpoint ID for relationship tracking between checkpoints.
  • Adds pending-send tracking in InMemorySaver: get_tuple now includes pending_sends from parent checkpoints, and list gains improved namespace filtering.
└──▷ BREAKING ON UPGRADE
  • !The score field in CheckpointMetadata is replaced by the parents field — any code reading or writing score will break.
cli==0.1.52 NOTES STABLE

LangGraph CLI 0.1.52 adds Node.js/LangGraphJS deployment support with dedicated Docker configuration.

└──▷ GET THIS VERSION
$ git clone --branch cli==0.1.52 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout cli==0.1.52
└──▷ USE IT
Configure a LangGraphJS project for deployment by specifying the Node.js version in your langgraph config file.
json
{
  "node_version": "20",
  "graphs": {
    "my_graph": "./src/graph.ts:graph"
  }
}
  • Adds node_version field to the LangGraph config TypedDict, enabling Node.js (LangGraphJS) project deployments alongside existing Python support.
  • Adds node_config_to_docker function to generate Docker configurations for Node.js projects, automatically selecting the langchain/langgraphjs-api base image.
  • Adds validation for the node_version config field (currently enforces version "20") to catch misconfigured Node.js projects early.
  • Updates build, prepare, and deployment CLI commands to operate correctly against both Python and Node.js environments.
checkpointpostgres==1.0.4 NOTES STABLE

LangGraph Postgres checkpointer now accepts connection pools for high-concurrency deployments.

└──▷ GET THIS VERSION
$ git clone --branch checkpointpostgres==1.0.4 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout checkpointpostgres==1.0.4
└──▷ USE IT
Use a connection pool with PostgresSaver to handle many concurrent LangGraph checkpoints without exhausting database connections.
python
from psycopg_pool import ConnectionPool
from langgraph.checkpoint.postgres import PostgresSaver

pool = ConnectionPool("postgresql://user:password@localhost/db", min_size=2, max_size=10)
saver = PostgresSaver(pool)
Use an async connection pool with AsyncPostgresSaver for high-concurrency async LangGraph applications.
python
from psycopg_pool import AsyncConnectionPool
from langgraph.checkpoint.postgres.aio import AsyncPostgresSaver

pool = AsyncConnectionPool("postgresql://user:password@localhost/db", min_size=2, max_size=10)
saver = AsyncPostgresSaver(pool)
  • Adds ConnectionPool support to PostgresSaver, enabling psycopg connection pool usage alongside direct connections for high-concurrency scenarios.
  • Adds AsyncConnectionPool support to AsyncPostgresSaver for async workflows requiring pooled database connections.
  • Enhances list() and alist() methods to include pending writes in returned checkpoint tuples.
sdk==0.1.29 NOTES STABLE

LangGraph SDK 0.1.29 adds disconnect/completion lifecycle controls and a new join_stream() method for live run output.

└──▷ GET THIS VERSION
$ git clone --branch sdk==0.1.29 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout sdk==0.1.29
└──▷ USE IT
Attach to an in-progress run mid-flight to tail its output in real time — useful when a run was started in the background and you want to surface results to a user later.
python
async for chunk in client.runs.join_stream(thread_id, run_id):
    print(chunk)
Start a streaming run that auto-cancels if the user closes the connection, and deletes resources once it completes — keeps infra clean in high-volume deployments.
python
async for chunk in client.runs.stream(
    thread_id,
    assistant_id,
    input=input_data,
    on_disconnect="cancel",
    on_completion="delete",
):
    print(chunk)
Create a background run that retains its output after completion so you can inspect results later.
python
run = await client.runs.create(
    thread_id,
    assistant_id,
    input=input_data,
    on_completion="keep",
)
  • Adds on_disconnect parameter to stream() and wait() — set to "cancel" or "continue" to control what happens to a run when the client disconnects.
  • Adds on_completion parameter to stream(), create(), and wait() — set to "delete" or "keep" to control resource cleanup after a run finishes.
  • Adds join_stream() method to attach to an already-running run and receive its real-time output without buffering prior output.
  • Adds DisconnectMode and OnCompletionBehavior types for structured lifecycle control in typed clients.
0.2.13 NOTES STABLE

LangGraph 0.2.13 adds runtime-only managed values and reimplements Context to skip unnecessary serialization.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.13 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.13
└──▷ USE IT
Declare a runtime-only managed value to inject a context manager into your graph without it being serialized to checkpoints.
python
from langgraph.managed.base import ManagedValue

class MyRuntimeValue(ManagedValue, runtime=True):
    ...
  • Adds a runtime flag to ManagedValue that marks values as created at runtime and excluded from serialization/deserialization.
  • Adds replace_runtime_values and replace_runtime_placeholders methods to ManagedValueMapping for safe handling of runtime placeholders during graph serialization.
  • Reimplements Context as a managed value (langgraph.managed.context.ContextManagedValue) with runtime=True, integrating it with the managed value system instead of the channel system.
cli==0.1.51 NOTES STABLE

LangGraph CLI 0.1.51 adds Redis 6 to Docker Compose for caching and message queuing.

└──▷ GET THIS VERSION
$ git clone --branch cli==0.1.51 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout cli==0.1.51
  • Adds Redis 6 as a managed Docker Compose service with health-check gating, so langgraph-api only starts after Redis is healthy.
  • Injects REDIS_URI environment variable (redis://langgraph-redis:6379) automatically into the langgraph-api service.
checkpoint==1.0.4 NOTES STABLE

LangGraph Checkpoint 1.0.4 adds error-write support, an ERROR constant, and exception serialization in JsonPlusSerializer.

└──▷ GET THIS VERSION
$ git clone --branch checkpoint==1.0.4 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout checkpoint==1.0.4
└──▷ USE IT
Capture and persist a node error into a checkpoint write so downstream nodes or retry logic can inspect it.
python
from langgraph.checkpoint.serde.types import ERROR

# In a custom checkpointer's put_writes, tag a failed write with the ERROR sentinel
writes = [(ERROR, exception_value)]
await checkpointer.put_writes(config, writes, task_id)
  • Adds ERROR = "__error__" constant in langgraph.checkpoint.serde.types to represent error types in checkpoint writes.
  • Supports special write types including error handling via WRITES_IDX_MAP in InMemorySaver.put_writes.
  • Enables JsonPlusSerializer to serialize BaseException objects by encoding them using their constructor arguments.
  • Includes pending writes in checkpoint list output from InMemorySaver.
└──▷ BREAKING ON UPGRADE
  • !The current_tasks field is removed from the Checkpoint TypedDict; any code reading or writing checkpoint["current_tasks"] will break.
  • !empty_checkpoint, copy_checkpoint, and create_checkpoint no longer include current_tasks in their returned dictionaries.
0.2.10 NOTES STABLE

LangGraph 0.2.10 adds error and interrupt fields to debug task result payloads for richer execution tracing.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.10 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.10
└──▷ USE IT
Inspect task-level errors and interrupts during a graph run by reading the enriched debug stream.
python
for chunk in graph.stream(inputs, stream_mode="debug"):
    if chunk["type"] == "task_result":
        payload = chunk["payload"]
        if payload["error"]:
            print("Task error:", payload["error"])
        if payload["interrupts"]:
            print("Interrupts:", payload["interrupts"])
  • Adds error: Optional[str] and interrupts: list[dict] fields to TaskResultPayload for capturing task-level errors and interrupts in debug output.
  • Enhances put_writes on PregelLoop to automatically stream updates and debug information without manual wiring.
  • Adds stream_keys as a class attribute on PregelLoop for explicit management of streaming outputs.
  • Updates map_debug_task_results to accept task-writes pairs and support both string and sequence stream key formats.
└──▷ BREAKING ON UPGRADE
  • !The map_debug_task_results function signature now accepts task-writes pairs instead of just tasks — callers passing tasks alone will break.
  • !The tick method on PregelLoop has had parameters removed — code passing those now-removed parameters will break.
  • !The SyncPregelLoop and AsyncPregelLoop constructor signatures have changed to support the new streaming architecture — existing instantiation code may break.
  • !map_output_updates now expects the new task-writes tuple format — callers using the old format will break.
  • !ERROR and INTERRUPT keys are now filtered out of regular output streams by map_output_updates — code relying on seeing those keys in regular output will no longer receive them.
sdk==0.1.28 NOTES STABLE

LangGraph SDK 0.1.28 adds custom HTTP headers support and checkpoint namespace field for state configs.

└──▷ GET THIS VERSION
$ git clone --branch sdk==0.1.28 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout sdk==0.1.28
└──▷ USE IT
Attach a tenant ID or trace header to every SDK request when operating in a multi-tenant or instrumented environment.
python
from langgraph_sdk import get_client

client = get_client(
    url="https://your-langgraph-endpoint",
    headers={"x-tenant-id": "acme-corp", "x-trace-id": "abc123"},
)
Retrieve a checkpoint scoped to a specific namespace to isolate state across parallel graph executions.
python
state = await client.threads.get_state(
    thread_id="<thread_id>",
    checkpoint_id="<checkpoint_id>",
    checkpoint_ns="pipeline-a",
)
  • Adds a headers parameter to get_client for injecting custom HTTP headers into all API requests, with validation blocking reserved headers like x-api-key.
  • Adds a checkpoint_ns field to state configurations in get_state and create for namespace-scoped checkpoint lookups.
└──▷ BREAKING ON UPGRADE
  • !The thread_ts field is renamed to checkpoint_id in state configurations for LangGraphClient.get_state and LangGraphClient.create — any code referencing thread_ts will break.
0.2.7 NOTES STABLE

LangGraph 0.2.7 adds SharedValue and a pluggable store system for persisting state across graph nodes.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.7 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.7
└──▷ USE IT
Persist shared state across nodes in a compiled graph using the built-in in-memory store.
python
from langgraph.graph.state import StateGraph
from langgraph.managed.shared_value import SharedValue
from langgraph.store.memory import MemoryStore

store = MemoryStore()
graph = StateGraph(...)
# SharedValue field is accessible and writable by all nodes
graph.add_node("node_a", node_a_fn)
graph.add_node("node_b", node_b_fn)
app = graph.compile(store=store)
Batch async store operations to reduce round-trips when many nodes read/write shared state concurrently.
python
from langgraph.store.memory import MemoryStore
from langgraph.store.batch import AsyncBatchedStore

batched_store = AsyncBatchedStore(MemoryStore())
app = graph.compile(store=batched_store)
Check at runtime whether a managed value can be mutated before attempting an update.
python
from langgraph.managed.base import is_writable_managed_value, is_readonly_managed_value

if is_writable_managed_value(my_value):
    await my_value.aupdate(new_data)
elif is_readonly_managed_value(my_value):
    print("This value cannot be updated")
  • New SharedValue class enables shared, writable state across graph nodes with optional scoping by configuration.
  • New WritableManagedValue abstract class extends the managed values system with update() and aupdate() methods for sync/async mutations.
  • New store parameter on StateGraph.compile() wires a persistent storage backend into the graph.
  • New BaseStore abstract class defines a standard interface (list/update, sync and async) for pluggable storage engines.
  • New MemoryStore provides a ready-to-use in-memory implementation of BaseStore.
+3 moreshow less
  • New AsyncBatchedStore wraps any BaseStore to batch async operations for higher-throughput workloads.
  • New utility functions is_readonly_managed_value and is_writable_managed_value allow runtime inspection of managed value types.
  • New ChannelKeyPlaceholder and ChannelTypePlaceholder objects support dynamic injection of channel key and type metadata.
0.2.6 NOTES STABLE

LangGraph 0.2.6 adds structured graph interrupts with timing context and a new NodeInterrupt exception for in-node signaling.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.6 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.6
└──▷ USE IT
Pause a node mid-execution (e.g., to await human approval) and surface structured timing context to the caller.
python
from langgraph.errors import NodeInterrupt

def review_node(state):
    if state["needs_approval"]:
        raise NodeInterrupt("Waiting for human approval before proceeding")
    return state
Inspect which interrupts fired and when after catching a GraphInterrupt to decide how to resume.
python
from langgraph.errors import GraphInterrupt

try:
    result = graph.invoke(inputs)
except GraphInterrupt as e:
    for interrupt in e.interrupts:
        print(f"Interrupted {interrupt.when}: {interrupt.value}")
  • New Interrupt dataclass captures structured interruption events with a when field ("before", "during", "after") and an optional value.
  • New NodeInterrupt exception lets node logic explicitly signal a mid-execution interrupt without raising a generic error.
  • Enhanced GraphInterrupt now stores a list of Interrupt objects, giving full context on when and how many interrupts occurred.
  • Adds interrupts field to PregelTask for per-task interrupt visibility useful in debugging and flow control.
  • Adds CONFIG_KEY_TASK_ID constant to track task identifiers through the configuration system.
+1 moreshow less
  • should_interrupt now returns the list of executable tasks to be interrupted instead of a boolean, enabling precise per-task interrupt control.
└──▷ BREAKING ON UPGRADE
  • !langgraph.pregel.algo.should_interrupt return type changed from bool to a list of executable tasks — any code that checks the return value as a boolean will behave incorrectly.
0.2.5 NOTES STABLE

LangGraph 0.2.5 adds task-level error tracking in state snapshots and a new ERROR constant for consistent failure visibility.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.5 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.5
└──▷ USE IT
Inspect task-level errors after a graph run to understand which node failed and why.
python
snapshot = await graph.aget_state(config)
for task in snapshot.tasks:
    if task.error is not None:
        print(f"Task {task.id} failed with: {task.error}")
  • Adds ERROR = "__error__" constant (reserved key) for consistent error tracking and propagation across graph execution.
  • Enhances StateSnapshot with a new tasks field that surfaces task-level error details in state history.
  • Introduces enhanced PregelTask class with id and optional error fields to uniquely identify tasks and capture exceptions.
  • Adds tasks_w_writes debug function to associate tasks with their writes and any errors for richer checkpoint debug output.
  • Extends get_state / aget_state on Pregel to include proper step numbers and task error information in returned snapshots.
└──▷ BREAKING ON UPGRADE
  • !The __call__ method of ManagedValue has its signature changed from __call__(self, step: int, task: PregelTaskDescription) to __call__(self, step: int) — any custom ManagedValue subclass that accepts a task parameter will break.
  • !The __call__ method of IsLastStepManager has its signature changed from __call__(self, step: int, task: PregelExecutableTask) to __call__(self, step: int) — any code calling this with a task argument will break.
  • !PregelTaskDescription is replaced by the new PregelTask class — code that references or type-hints PregelTaskDescription directly will break.
checkpoint==1.0.3 NOTES STABLE

JsonPlusSerializer gains native support for pathlib, regex, decimal, deque, IP address, and time types.

└──▷ GET THIS VERSION
$ git clone --branch checkpoint==1.0.3 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout checkpoint==1.0.3
  • Supports serialization of pathlib.Path, re.Pattern, decimal.Decimal, deque, IPv4/IPv6 address types, date, time, and ZoneInfo in JsonPlusSerializer.
  • Deserialization now returns None gracefully when a module or attribute is missing, instead of raising an exception.
checkpointpostgres==1.0.1 NOTES STABLE

LangGraph PostgreSQL checkpointer gains versioned schema migrations and JSON+Plus metadata serialization.

└──▷ GET THIS VERSION
$ git clone --branch checkpointpostgres==1.0.1 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout checkpointpostgres==1.0.1
└──▷ USE IT
Run versioned schema migrations on an existing PostgreSQL checkpoint database so it stays in sync after upgrading.
python
from langgraph.checkpoint.postgres import PostgresSaver

with PostgresSaver.from_conn_string("postgresql://user:pass@localhost/db") as saver:
    saver.setup()  # applies all pending MIGRATIONS instead of recreating tables
Use the async saver with the same versioned migration support in an async workflow.
python
from langgraph.checkpoint.postgres.aio import AsyncPostgresSaver

async with AsyncPostgresSaver.from_conn_string("postgresql://user:pass@localhost/db") as saver:
    await saver.setup()  # applies MIGRATIONS for the async variant
  • Adds versioned database migrations (MIGRATIONS list) for both PostgresSaver and AsyncPostgresSaver, replacing one-shot static table creation.
  • Introduces JsonPlusSerializer-backed _load_metadata and _dump_metadata methods for consistent, richer metadata serialization across sync and async savers.
└──▷ BREAKING ON UPGRADE
  • !The is_setup flag has been removed from PostgresSaver and AsyncPostgresSaver in favor of the new versioned setup method; any code that reads or sets is_setup will break.
0.2.0 NOTES STABLE

LangGraph 0.2 ships dedicated checkpointer libraries for SQLite and Postgres, including the previously cloud-only PostgresSaver.

└──▷ GET THIS VERSION
$ git clone --branch 0.2.0 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout 0.2.0
└──▷ USE IT
Use the SQLite checkpointer for local development with persistent state across runs without standing up a database server.
python
from langgraph.checkpoint.sqlite import SqliteSaver

with SqliteSaver.from_conn_string("./local_state.db") as checkpointer:
    graph = app.compile(checkpointer=checkpointer)
    result = graph.invoke(
        {"messages": ["Hello"]},
        config={"configurable": {"thread_id": "dev-session-1"}}
    )
  • New langgraph-checkpoint package exposes BaseCheckpointSaver, SerializationProtocol, and MemorySaver as a standalone base library.
  • New langgraph-checkpoint-sqlite package provides SqliteSaver / AsyncSqliteSaver for local and experimental workflows.
  • New langgraph-checkpoint-postgres package open-sources the production-grade PostgresSaver previously available only in LangGraph Cloud.
  • New new_versions parameter in BaseCheckpointSaver.put enables further optimization of custom checkpointer implementations.
  • Graph stream output now includes outputs from all nodes, including nodes that return no state writes (previously silent nodes were omitted).
└──▷ BREAKING ON UPGRADE
  • !thread_ts and parent_ts are renamed to checkpoint_id and parent_checkpoint_id respectively (via langgraph_checkpoint==1.0.0).
  • !Re-exported imports like from langgraph.checkpoint import BaseCheckpointSaver no longer work; use from langgraph.checkpoint.base import BaseCheckpointSaver instead.
  • !SQLite checkpointers have been moved to a separate library — pip install langgraph-checkpoint-sqlite is now required to use them.
  • !The .from_conn_string method of SqliteSaver / AsyncSqliteSaver is now a context manager.
  • !Graph stream output now emits {'node_1': None} for nodes that return no state writes, changing the shape of streamed output for graphs with such nodes.
checkpoint==1.0.1 NOTES STABLE

LangGraph checkpoint 1.0.1 adds binary serialization, channel-version API, and context-manager support for MemorySaver.

└──▷ GET THIS VERSION
$ git clone --branch checkpoint==1.0.1 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout checkpoint==1.0.1
└──▷ USE IT
Use MemorySaver as a context manager to ensure clean resource teardown in tests or short-lived scripts.
python
from langgraph.checkpoint.memory import MemorySaver

with MemorySaver() as saver:
    # saver is fully initialised; resources released on exit
    checkpoints = list(saver.list(config))
Persist raw binary blobs (e.g. embeddings or serialised models) directly in checkpoint state — now round-trippable through JsonPlusSerializer.
python
from langgraph.checkpoint.serde.jsonplus import JsonPlusSerializer

serde = JsonPlusSerializer()
type_tag, encoded = serde.dumps_typed(b"\x89PNG\r\n")
restored = serde.loads_typed((type_tag, encoded))
assert isinstance(restored, bytes)
  • Adds bytes and bytearray serialization support to JsonPlusSerializer, enabling binary data in checkpointed state.
  • Introduces ChannelVersions type alias (dict[str, Union[str, int, float]]) for type-safe channel version handling.
  • Extends BaseCheckpointSaver.put and aput with a new new_versions: ChannelVersions parameter exposing channel version info at write time.
  • Implements sync and async context manager interfaces (__enter__/__exit__/__aenter__/__aexit__) on MemorySaver for explicit resource management.
└──▷ BREAKING ON UPGRADE
  • !The put and aput methods on BaseCheckpointSaver (and MemorySaver) now require a new_versions: ChannelVersions parameter — any custom subclass that overrides these methods without the new parameter will break.
sdk==0.1.27 NOTES STABLE

LangGraph SDK 0.1.27 adds optional URL client init, ASGI transport support, thread copy, and assistant if_exists dedup control.

└──▷ GET THIS VERSION
$ git clone --branch sdk==0.1.27 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:
$ git checkout sdk==0.1.27
└──▷ USE IT
Connect to a local LangGraph server without specifying a URL — useful in dev environments where defaults are sufficient.
python
from langgraph_sdk import get_client

client = get_client()  # url is now optional
Create an assistant idempotently — safe to run in setup scripts without worrying about duplicate errors.
python
assistant = await client.assistants.create(
    graph_id="my_graph",
    config={"configurable": {"model": "gpt-4o"}},
    if_exists="return_existing",
)
Duplicate a thread to branch off a conversation without modifying the original.
python
new_thread = await client.threads.copy(thread_id="<thread_id>")
  • Makes the url parameter optional in get_client, with intelligent defaults so local dev requires no explicit URL.
  • Adds ASGI transport support in get_client with correct root path configuration.
  • Adds if_exists parameter to AssistantsAPI.create for controlling behavior on duplicate assistant creation.
  • Adds a new ThreadsAPI.copy method for duplicating existing threads.
  • Makes GraphSchema fields (input_schema, state_schema, config_schema) optional for better TypeScript interoperability.
Was this useful?

Letta (formerly MemGPT)

Sources Release notes → 0.3.24 2 RELEASES · 2024-08-01 → 2024-08-17 NOTES STABLE

Letta 0.3.24 ships an updated alpha revision of the developer portal.

└──▷ GET THIS VERSION
$ git clone --branch 0.3.24 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:
$ git checkout 0.3.24
  • Updates the developer portal to the latest alpha revision.
1 more release in this issue · 2024-08-01 → 2024-08-17
0.3.22 NOTES STABLE

Letta 0.3.22 adds templated system prompts, in-session system prompt editing, and a core memory size flag to the CLI and Python client.

└──▷ GET THIS VERSION
$ git clone --branch 0.3.22 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:
$ git checkout 0.3.22
└──▷ TRY IT
Allow a long custom persona file to load without hitting the default core memory limit.
$ memgpt run --core-memory-limit 6000 --persona <persona_name>
  • Adds --system flag to memgpt run to specify a custom system prompt when creating a new agent.
  • Adds --core-memory-limit flag to memgpt run to override the default core memory size limit (applies to both human and persona sections) for a new agent.
  • Adds /systemswap CLI command to replace the system prompt of an already-running agent mid-session.
  • Adds system_prompt= keyword argument to client.create_agent() in the Python client for programmatic system prompt customization.
  • Supports f-string-style templated system prompts using the {CORE_MEMORY} placeholder, letting practitioners reposition the dynamic core memory block anywhere in the prompt.
Was this useful?

LlamaIndex

Sources Release notes → v0.10.68 2 RELEASES · 2024-08-01 → 2024-08-21 NOTES STABLE

LlamaIndex v0.10.68 adds nested workflow services, tool calling for Cohere/AI21, GigaChat LLM, and streaming token counts for OpenAI.

└──▷ GET THIS VERSION
$ git clone --branch v0.10.68 https://github.com/run-llama/llama_index.git
# already have the repo? check out this version:
$ git checkout v0.10.68
└──▷ USE IT
Use the @step decorator without parentheses to register a workflow step with less boilerplate.
python
from llama_index.core.workflow import Workflow, step

class MyWorkflow(Workflow):
    @step
    async def my_step(self, ctx, ev):
        return ...
  • Adds @step decorator support without parentheses in llama-index-core workflows, simplifying step registration syntax.
  • Introduces workflow services (nested workflows) in llama-index-core, enabling workflows to be composed and reused as sub-components of larger workflows.
  • Removes the requirement to specify the allowed_query_fields parameter when using cypher_validator in the TextToCypher retriever.
  • Adds truncate support to llama-index-postprocessor-nvidia-rerank [0.2.1] and updates the default model to nvidia/nv-rerankqa-mistral-4b-v3.
  • Adds streaming token count support to llama-index-llms-openai [0.1.31].
+10 moreshow less
  • Adds tool calling support for achat in llama-index-llms-cohere [0.2.2].
  • Adds AI21 Tools support to llama-index-llms-ai21 [0.3.2].
  • Adds GigaChat LLM integration via new package llama-index-llms-gigachat [0.1.0].
  • Adds token counting support for the Bedrock LLM integration in llama-index-llms-bedrock [0.1.13].
  • Exposes structured schema for Amazon Neptune in llama-index-graph-stores-neptune [0.1.8].
  • Adds static input shape support for OpenVINO embedding and reranker in llama-index-embeddings-openvino [0.2.1].
  • Switches llama-index-embeddings-ollama [0.2.0] to use the native Ollama client for embeddings.
  • Removes the OpenAI dependency from llama-index-core, reducing mandatory third-party coupling.
  • Improves the llama-index-core token counter to handle more response types.
  • Enhances the Google Drive reader in llama-index-readers-google [0.3.1] for improved functionality and usability.
1 more release in this issue · 2024-08-01 → 2024-08-21
v0.10.59 NOTES STABLE

LlamaIndex v0.10.59 adds event-driven Workflows, LongRAG pack, FalkorDB graph store, GitLab reader, and function-calling for Ollama.

└──▷ GET THIS VERSION
$ git clone --branch v0.10.59 https://github.com/run-llama/llama_index.git
# already have the repo? check out this version:
$ git checkout v0.10.59
└──▷ USE IT
Use the LongRAG pack to retrieve and answer over long documents with minimal chunking loss.
python
from llama_index.packs.longrag import LongRAGPack

pack = LongRAGPack(documents=documents, llm=llm)
response = pack.run("What are the key findings in this report?")
print(response)
  • Introduces Workflow class in llama-index-core for event-driven orchestration of LlamaIndex pipelines.
  • Adds llama-index-packs-longrag [0.1.0] — a new LlamaPack implementing the LongRAG retrieval pattern.
  • Adds llama-index-graph-stores-falkordb [0.1.5] with FalkorDBPropertyGraphStore for property graph storage via FalkorDB.
  • Adds llama-index-readers-gitlab [0.1.0] — a new GitLab reader integration for ingesting GitLab content.
  • Adds llama-index-postprocessor-tei-rerank [0.1.0] — re-ranking support via Text Embedding Interface.
+8 moreshow less
  • Adds llama-index-embeddings-textembed [0.0.1] — new embedding integration for the textembed backend.
  • Adds function calling support and a toggle for it in llama-index-llms-ollama [0.2.2].
  • Adds proper async embedding support to llama-index-embeddings-ollama [0.1.3].
  • Adds HNSW index construction option to PGVectorStore in llama-index-vector-stores-postgres.
  • Enhances MilvusVectorStore in llama-index-vector-stores-milvus with flexible index management for overwriting.
  • Updates llama-index-llms-openllm to support OpenLLM 0.6.
  • Expands span coverage for query pipeline tracing in llama-index-core.
  • Adds feature to context chat engine allowing previous chunks to be inserted into the current context window.
Was this useful?

Microsoft AutoGen

Sources Release notes → v0.2.35 2 RELEASES · 2024-08-12 → 2024-08-20 NOTES STABLE

AutoGen v0.2.35 adds Mistral v1.0.1 support, .NET Anthropic cache control, and decouples RetrieveChat from RetrieveAssistantAgent.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.35 https://github.com/microsoft/autogen.git
# already have the repo? check out this version:
$ git checkout v0.2.35
  • Updates Mistral client class to support the new Mistral v1.0.1 package.
  • Adds cache control support to the .NET Anthropic client.
  • Removes dependency on RetrieveAssistantAgent for RetrieveChat, enabling more flexible retrieval-augmented chat setups.
└──▷ BREAKING ON UPGRADE
  • !TransformChatHistory and CompressibleAgent are removed; any code referencing these classes will break on upgrade.
1 more release in this issue · 2024-08-12 → 2024-08-20
v0.2.34 NOTES STABLE

AutoGen v0.2.34 adds async nested chats, a global silent param, Azure AI Inference integration, and last_speaker tracking in GroupChat.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.34 https://github.com/microsoft/autogen.git
# already have the repo? check out this version:
$ git checkout v0.2.34
└──▷ USE IT
Silence all agent output globally when running an automated pipeline where console chatter is unwanted.
python
agent = ConversableAgent(
    name="assistant",
    silent=True,
    llm_config={"config_list": config_list},
)
Run nested chats asynchronously to avoid blocking the event loop in async applications.
python
result = await initiator.a_initiate_chats(chat_queue)
  • Adds silent global parameter to ConversableAgent to suppress output across all agents from a single setting.
  • Supports async nested chats, enabling non-blocking multi-agent conversation flows.
  • Adds last_speaker attribute to GroupChatManager for tracking which agent spoke last in a group chat.
  • Introduces AutoGen.AzureAIInference package (.NET) for Azure AI Inference model support.
  • Adds DotnetInteractiveKernelBuilder to the AutoGen.DotnetInteractive package (.NET).
+4 moreshow less
  • Adds DotnetInteractiveStdioConnector to AutoGen.DotnetInteractive (.NET) for stdio-based kernel connectivity.
  • Adds a runtime factory ([CAP]) for more flexible agent runtime instantiation.
  • Adds support for gpt-4o-2024-08-06 model in the model catalogue.
  • Enhances tool calling support for Cohere models.
Was this useful?

Microsoft Semantic Kernel

Sources Release notes → python-1.8.0 8 RELEASES · 2024-08-05 → 2024-08-22 NOTES STABLE

Semantic Kernel Python 1.8.0 adds OpenTelemetry metrics instrumentation to the kernel.

└──▷ GET THIS VERSION
$ git clone --branch python-1.8.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout python-1.8.0
  • Adds metrics instrumentation to the kernel, exposing counters, histograms, and observable gauges via OpenTelemetry for observability into kernel operations.
7 more releases in this issue · 2024-08-05 → 2024-08-22
dotnet-1.17.2 NOTES STABLE

Semantic Kernel 1.17.2 adds Azure CosmosDB MongoDB and NoSQL vector store connectors, server-variable OpenAPI support, and agent chat improvements.

└──▷ GET THIS VERSION
$ git clone --branch dotnet-1.17.2 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout dotnet-1.17.2
  • Adds Azure CosmosDB for MongoDB connector implementing the new vector memory store design (Microsoft.SemanticKernel.Connectors.AzureCosmosDBMongoDB).
  • Adds Azure CosmosDB for NoSQL connector implementing the new vector memory store design (Microsoft.SemanticKernel.Connectors.AzureCosmosDBNoSQL).
  • Allows JsonSerializerOptions and user-agent string to be passed through vector store options down to the underlying client.
  • Adds support for OpenAPI descriptions that include server variables, enabling dynamic base-URL resolution at runtime.
  • Adds OpenAPI customization hooks for fine-grained control over how OpenAPI operations are mapped to kernel functions.
+5 moreshow less
  • Maps OpenAPI parameter types to KernelParameterMetadata for richer parameter introspection in OpenAPI-backed functions.
  • Introduces 'Root' agent selection for .NET Agents, enabling explicit designation of the starting agent in multi-agent scenarios.
  • Adds Reset support for AgentChat, allowing conversation state to be cleared without recreating the chat instance.
  • Adds a classifiable KernelFunction logger for structured, filterable logging of kernel function invocations.
  • Allows chat history mutation from auto-function invocation filters in the MistralAI connector.
python-1.7.0 NOTES STABLE

Semantic Kernel Python 1.7.0 adds instrumentation to kernel functions with logging, tracing, and Application Insights monitoring.

└──▷ GET THIS VERSION
$ git clone --branch python-1.7.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout python-1.7.0
  • Adds instrumentation (logs and traces) to kernel functions, with a sample application for monitoring via Application Insights.
python-1.6.0 NOTES STABLE

Semantic Kernel Python 1.6.0 adds agent group chat and chat reset capabilities.

└──▷ GET THIS VERSION
$ git clone --branch python-1.6.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout python-1.6.0
  • Introduces agent group chat functionality, enabling multiple agents to participate in a shared conversation.
  • Introduces agent chat reset functionality, allowing an agent chat session to be cleared and restarted.
dotnet-1.17.1 NOTES STABLE

Semantic Kernel .NET Agents gain a ChatHistory Reducer Pattern for managing conversation history.

└──▷ GET THIS VERSION
$ git clone --branch dotnet-1.17.1 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout dotnet-1.17.1
  • Introduces the ChatHistory Reducer Pattern for .NET Agents, enabling controlled reduction of chat history passed to agents during multi-turn conversations.
dotnet-1.17.0 NOTES STABLE

Semantic Kernel dotnet-1.17.0 adds VectorStore abstractions with 5 sample implementations and an AI Model Router demo.

└──▷ GET THIS VERSION
$ git clone --branch dotnet-1.17.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout dotnet-1.17.0
  • Adds VectorStore abstractions and 5 sample implementations, enabling pluggable vector storage backends for retrieval-augmented workflows.
  • Moves VectorStore dependency-injection extensions to the core namespace, making them available without extra package references.
  • Adds an AI Model Router demo showing how to route prompts across multiple AI models within the same Semantic Kernel pipeline.
  • Adds metadata identification of assistant code-interpreter responses in the .NET Agents framework, surfacing interpreter output distinctly from chat completions.
python-1.5.0 NOTES STABLE

Semantic Kernel Python 1.5.0 adds new memory stores and vector store data models including a Pandas-backed store.

└──▷ GET THIS VERSION
$ git clone --branch python-1.5.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout python-1.5.0
  • Adds new memory stores and collections, including a Pandas-backed memory store and new vector store data model support.
python-1.4.0 NOTES STABLE

Semantic Kernel Python 1.4.0 adds Google AI, Vertex AI, Mistral AI embeddings, OpenAI Assistant Agent, and OpenTelemetry support.

└──▷ GET THIS VERSION
$ git clone --branch python-1.4.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout python-1.4.0
└──▷ USE IT
Use the new Google AI connector to power a chat completion workflow with a Gemini model and function calling.
python
from semantic_kernel.connectors.ai.google_ai import GoogleAIChatCompletion

chat_service = GoogleAIChatCompletion(
    gemini_model_id="gemini-1.5-pro",
    api_key="<your-google-ai-api-key>"
)
  • Adds OpenTelemetry integration for distributed tracing and observability within Semantic Kernel Python workflows.
  • Adds a Google AI connector with function-calling support, enabling Gemini models as chat completion backends.
  • Adds a Vertex AI connector with function-calling support for Google Cloud-hosted model endpoints.
  • Introduces a non-chat, non-streaming OpenAIAssistantAgent class for stateful assistant interactions, including samples and tests.
  • Adds a Mistral AI embedding connector, expanding vector/embedding generation options beyond OpenAI.
Was this useful?

camel-ai

Sources Release notes → v0.1.6.1 NOTES

camel-ai v0.1.6.1 adds Workforce orchestration, Task primitives, Firecrawl integration, multi-modal DALL-E support, and structured function-call responses.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.6.1 https://github.com/camel-ai/camel.git
# already have the repo? check out this version:
$ git checkout v0.1.6.1
  • Adds Task class to camel, providing a first-class primitive for defining and managing agent tasks.
  • Adds Workforce class for orchestrating multiple agents working together on a shared workload.
  • Integrates Firecrawl as a new tool, enabling agents to crawl and extract web content.
  • Adds AgentOps observability settings, allowing configuration of AgentOps tracking for agent runs.
  • Supports structured responses via function calls, enabling agents to return typed, schema-constrained output.
+1 moreshow less
  • Supports multi-modal input and multi-modal output (including DALL-E image generation) within a single agent.
Was this useful?
◆  Local LLM Runtimes

Jan AI Jan

Sources Release notes → v0.5.3 NOTES

Jan v0.5.3 adds GGUF metadata extraction on import, NVIDIA engine support, OpenRouter model settings, and a configurable data folder.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.3 https://github.com/janhq/jan.git
# already have the repo? check out this version:
$ git checkout v0.5.3
  • Adds GGUF metadata extraction when importing models, surfacing model details automatically during the import flow.
  • Adds an NVIDIA engine option for running local models via the new add nvidia engine capability.
  • Adds OpenRouter model settings panel, allowing per-model configuration of OpenRouter-specific parameters.
  • Adds the ability to change the Jan data folder path from the UI, with the default now set to the app's userData directory.
  • Adds OpenRouter request endpoint setting back into configuration.
+8 moreshow less
  • Adds chunk count display in the retrieval UI.
  • Embeds Cortex into Jan as a JS module, replacing the prior separate process integration.
  • Enables managing and configuring cloud/remote models directly from the 'My Models' screen and the threads screen.
  • Adds keyboard shortcut to delete and clean a thread.
  • Enables copying model instructions from the UI.
  • Adds a new starter screen for first-run experience.
  • Preserves model settings across sessions so per-model configuration is not lost on restart.
  • Adds a model assistant tab to the assistant panel.
└──▷ BREAKING ON UPGRADE
  • !The default Jan data folder path has changed to the app's userData directory; existing data at the previous location will require migration.
  • !Docker and Kubernetes deployment support is deprecated and removed.
  • !Internal REST endpoints have been disabled due to a vulnerability issue; integrations relying on those endpoints will break.
Was this useful?

KoboldCpp

Sources Release notes → v1.74 3 RELEASES · 2024-08-02 → 2024-08-31 NOTES STABLE

KoboldCpp v1.74 adds XTC sampler, a --nomodel flag for external API providers, and SSL support for Horde workers.

└──▷ GET THIS VERSION
$ git clone --branch v1.74 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.74
└──▷ TRY IT
Launch the Lite WebUI without a local model so you can point it at an external provider like Gemini or OpenAI on the same machine.
$ koboldcpp.exe --nomodel
  • Adds --nomodel flag to launch the Lite WebUI without loading a local model, enabling selection of external API providers such as Horde, Gemini, or OpenAI.
  • Adds xtc_probability and xtc_threshold sampling parameters for the new XTC (Exclude Top Choices) creative-writing sampler; recommended starting values are xtc_threshold=0.15 and xtc_probability=0.5.
  • Horde Worker now supports connecting to SSL-secured KoboldCpp instances (use --nocertify for self-signed certificates) and enforces a 5-minute per-request timeout to prevent stalls.
  • Adds automatic image resizing and letterboxing for LLaVA/MiniCPM multimodal inputs to improve handling of non-standard image dimensions.
  • MacOS now defaults to full GPU offload when -1 is passed to gpulayers.
+1 moreshow less
  • Adds support for the Llama-3.1-Minitron-4B-Width model architecture.
2 more releases in this issue · 2024-08-02 → 2024-08-31
v1.73.1 NOTES STABLE

KoboldCpp v1.73.1 adds IPv6 dual-stack support, macOS ARM binaries, and a new --prompt pure CLI mode.

└──▷ GET THIS VERSION
$ git clone --branch v1.73.1 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.73.1
└──▷ TRY IT
Run a one-shot prompt from the terminal and capture the model's response to stdout — useful for scripting or quick tests without launching the GUI.
$ ./koboldcpp --model mymodel.gguf --prompt "Summarize the risks of prompt injection" --promptlimit 200
Benchmark the model with a custom prompt to measure tokens/sec while also seeing the generated response.
$ ./koboldcpp --model mymodel.gguf --prompt "Once upon a time" --promptlimit 100 --benchmark
  • Adds --prompt flag for pure CLI mode: runs a single prompt entirely from the command line, suppressing all other console output and piping the response to stdout.
  • Adds --promptlimit flag to control output length when using --prompt CLI mode.
  • Combines --prompt and --promptlimit with --benchmark to enable benchmarking with a custom prompt and capturing the response.
  • --multiuser now defaults to true; set --multiuser 0 to disable multi-user mode.
  • Adds dual-stack IPv6 network support, allowing a single KoboldCpp instance to serve both IPv4 and IPv6 addresses automatically on the same port.
+5 moreshow less
  • Adds official macOS PyInstaller binary builds (koboldcpp-mac-arm64) for M1, M2, and M3 Macs, eliminating the need to self-compile.
  • Adds support for Minitron and MiniCPM multimodal models (including image input via mmproj file).
  • Adds letterboxing mode for images in Kobold Lite.
  • Pre-filters to the top 5,000 token candidates before sampling, improving sampling speed on models with large vocabularies.
  • Moved chat completions adapter selection to the Model Files tab in the GUI.
└──▷ BREAKING ON UPGRADE
  • !--multiuser now defaults to true; existing setups that relied on multi-user mode being disabled by default must explicitly set --multiuser 0.
v1.72 NOTES STABLE

KoboldCpp v1.72 adds Vulkan-accelerated Stable Diffusion image generation and Gemma2 2B support.

└──▷ GET THIS VERSION
$ git clone --branch v1.72 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.72
  • Adds GPU-accelerated Stable Diffusion image generation on Vulkan backends.
  • GPU layers now defaults to -1 in GUI mode, preserving existing layer counts instead of overwriting them, with predicted layer count shown as an overlay label.
  • Auto GPU layer estimation now accounts for loaded image and Whisper models when calculating VRAM headroom.
  • Adds Gemma2 2B support via upstream merge.
  • Kobold Lite now supports SSE streaming over the OpenAI API, enabling use with alternative backends.
Was this useful?

LocalAI

Sources Release notes → v2.20.1 2 RELEASES · 2024-08-22 → 2024-08-23 NOTES STABLE

LocalAI v2.20 adds FLUX-1 image gen, strict JSON mode, multi-cluster P2P, gallery disable, and Hugging Face integration.

└──▷ GET THIS VERSION
$ git clone --branch v2.20.1 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v2.20.1
└──▷ TRY IT
Run two logically separate P2P clusters on the same network by giving each a distinct network ID.
$ export LOCALAI_P2P_NETWORK_ID=550e8400-e29b-41d4-a716-446655440000
local-ai run --p2p
Disable the model gallery endpoint to lock down a production deployment.
$ export LOCALAI_DISABLE_GALLERY_ENDPOINT=true
local-ai run
  • Adds LOCALAI_DISABLE_GALLERY_ENDPOINT environment variable to disable the gallery endpoint and its UI routes.
  • Adds LOCALAI_RANDOM_WORKER environment variable to disable load balancing (now enabled by default in federated mode).
  • Adds LOCALAI_TARGET_WORKER environment variable to target a specific worker in federated mode.
  • Adds LOCALAI_P2P_NETWORK_ID environment variable (set to a shared UUID) to run multiple logically separated P2P clusters within the same network using the same token.
  • Adds strict: true field in API calls to enforce grammar-compliant JSON outputs via BNF grammar rules, matching OpenAI's Structured Outputs spec.
+6 moreshow less
  • Adds json_schema as a supported format_type; when set, BNF grammars are automatically generated from the schema.
  • Adds FLUX-1 image generation support (flux.1-dev and flux.1-schnell in the model gallery), including federated mode.
  • Adds a network explorer and community pools UI at explorer.localai.io, enabling sharing and discovery of LocalAI instances.
  • Adds P2P load balancing enabled by default across federated clusters.
  • LocalAI is now available as a selectable option inside Hugging Face's local apps for one-click model deployment.
  • Adds Gemma 2 to the model guesser for automatic backend selection.
└──▷ BREAKING ON UPGRADE
  • !The gpt4all.cpp backend is removed; gpt4all models in ggml format are no longer compatible.
  • !The petals backend is removed; use LocalAI's P2P federation capabilities as a replacement.
1 more release in this issue · 2024-08-22 → 2024-08-23
v2.20.0 NOTES STABLE

LocalAI v2.20.0 adds FLUX-1 image generation, OpenAI strict mode, multi-cluster P2P networking, and a global community explorer.

└──▷ GET THIS VERSION
$ git clone --branch v2.20.0 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v2.20.0
└──▷ TRY IT
Enforce structured JSON output that matches a schema in a single API call, without changing your model config.
$ curl http://localhost:8080/v1/chat/completions \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "my-model",
    "messages": [{"role": "user", "content": "Return info about a user"}],
    "response_format": {
      "type": "json_schema",
      "json_schema": {
        "name": "user",
        "schema": {"type": "object", "properties": {"name": {"type": "string"}, "age": {"type": "integer"}}, "required": ["name", "age"]}
      }
    },
    "strict": true
  }'
  • Adds strict: true to API call payloads to enforce BNF-grammar-backed JSON outputs, matching OpenAI's Structured Outputs spec; when format_type is set to json_schema, BNF grammars are auto-generated from the schema.
  • Adds LOCALAI_DISABLE_GALLERY_ENDPOINT environment variable to disable the gallery endpoint and its UI routes.
  • Adds LOCALAI_P2P_NETWORK_ID environment variable (set to a shared UUID) to run multiple logically separated P2P clusters on the same network using the same token.
  • Adds LOCALAI_TARGET_WORKER environment variable to target a specific worker in federated mode.
  • Adds LOCALAI_RANDOM_WORKER environment variable to disable the new default load-balancing behavior across P2P workers.
+4 moreshow less
  • Adds json_schema as a supported format_type value in API requests, enabling schema-driven structured output.
  • Adds FLUX-1 image generation support via the Diffusers backend, including flux.1-dev and flux.1-schnell gallery models, usable in federated mode.
  • Launches a network explorer at explorer.localai.io and a public demo instance at demo.localai.io, backed by community P2P pools.
  • LocalAI is now selectable as a local app within Hugging Face, enabling one-click model deployment.
└──▷ BREAKING ON UPGRADE
  • !The gpt4all.cpp backend is removed; gpt4all models in ggml format are no longer compatible.
  • !The petals backend is removed; workloads must migrate to LocalAI's P2P federation capabilities.
  • !P2P load balancing is now enabled by default; existing setups that relied on random worker selection must set LOCALAI_RANDOM_WORKER to restore the previous behavior.
Was this useful?

SGLang

Sources Release notes → v0.2.9 NOTES

SGLang v0.2.9 adds chunked prefill, DeepSeek v2 support, AWQ Marlin quantization, and logprobs in the OpenAI chat API.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.9 https://github.com/sgl-project/sglang.git
# already have the repo? check out this version:
$ git checkout v0.2.9
└──▷ TRY IT
Cap the total number of tokens the server will hold in flight to avoid OOM on large batch workloads.
$ python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct --max-total-tokens 131072
Expose a custom model name when serving a local checkpoint so OpenAI-compatible clients see a stable identifier.
$ python -m sglang.launch_server --model-path /weights/my-llama --served-model-name my-llama-v1
  • Adds --max-total-tokens CLI argument to control the total token budget for the server.
  • Adds --disable_ignore_eos support in bench_serving.py for benchmarking scenarios that require EOS suppression.
  • Adds served_model_name to customize the model ID when running in local mode via the OpenAI-compatible API server.
  • Renames response fields: prefill_token_logprobs is now input_token_logprobs; decode_token_logprobs is now output_token_logprobs.
  • Adds chunked prefill support, including operation when radix cache is disabled.
+6 moreshow less
  • Adds support for logprobs in the OpenAI chat completion API.
  • Adds support for offline batch (file) processing via the OpenAI API interface.
  • Adds AWQ Marlin quantization support (awq_marlin).
  • Adds DeepSeek v2 model support.
  • Adds chat template for InternLM2-Chat.
  • Vectorizes logprob computation for a performance improvement in log-probability workloads.
└──▷ BREAKING ON UPGRADE
  • !prefill_token_logprobs is renamed to input_token_logprobs and decode_token_logprobs is renamed to output_token_logprobs — any client parsing these field names will break on upgrade.
Was this useful?

oobabooga's Text Generation WebUI (textgen)

Sources Release notes → v1.14 2 RELEASES · 2024-08-01 → 2024-08-20 NOTES STABLE

textgen v1.14 adds --tokenizer-dir flag for llamacpp_HF and faster multi-file model downloads.

└──▷ GET THIS VERSION
$ git clone --branch v1.14 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v1.14
  • Adds --tokenizer-dir flag for use with llamacpp_HF to specify a custom tokenizer directory.
  • Model downloader now uses a single session for all files in a download, reducing per-file startup latency.
1 more release in this issue · 2024-08-01 → 2024-08-20
v1.13 NOTES STABLE

textgen v1.13 adds Llama 3.1 support, manual context-length entry, and improved model download progress.

└──▷ GET THIS VERSION
$ git clone --branch v1.13 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v1.13
  • Makes compress_pos_emb, n_ctx, max_seq_len, and truncation_length editable number fields instead of sliders, allowing precise manual entry of context lengths.
  • Adds Llama 3.1 support via llama-cpp-python 0.2.85 bump, including better handling of the Llama 3.1 Jinja2 template (optional 'tools' headers now suppressed).
  • Model downloader progress bar now shows filename, file size, and download speed per file.
Was this useful?

vLLM

Sources Release notes → v0.5.5 2 RELEASES · 2024-08-05 → 2024-08-23 NOTES STABLE

vLLM v0.5.5 adds multi-step GPU scheduling, audio model support, GGUF loading with tensor parallelism, and new entrypoint APIs.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.5 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.5.5
└──▷ TRY IT
Reduce CPU scheduling overhead by pipelining 8 GPU steps ahead — useful for maximizing single-GPU throughput on large models.
$ vllm serve meta-llama/Meta-Llama-3-8B --num-scheduler-steps 8
Run chat-style inference directly from the LLM class without spinning up an HTTP server.
python
from vllm import LLM
llm = LLM(model='meta-llama/Meta-Llama-3-8B-Instruct')
outputs = llm.chat([{'role': 'user', 'content': 'Explain zero-day vulnerabilities.'}])
print(outputs[0].outputs[0].text)
  • Adds --num-scheduler-steps parameter to vllm serve and AsyncLLMEngine to schedule multiple GPU steps in advance, delivering ~20% QPS improvement for single-GPU 8B and 30B models.
  • Adds a chat method to the LLM class for direct chat-style inference without going through the HTTP server.
  • Adds prompt_logprobs support in the Chat Completion API.
  • Supports embeddings in the run_batch API.
  • Supports loading GGUF models with tensor parallelism.
+17 moreshow less
  • Adds support for the first audio model, UltravoxModel.
  • Supports Jamba 1.5 models.
  • Supports image embeddings as input for vision models.
  • Supports SigLIP encoder and alternative decoders for LLaVA models.
  • Supports serving encoder/decoder models with cross-attention architecture.
  • Adds EAGLE speculative decoding implementation with Top-1 proposer.
  • Uses target model max length as default for draft model in speculative decoding.
  • Adds W8A16 load-time quantization for TPU backend.
  • Adds fp8 Linear Layer support for AMD ROCm.
  • Expands MoE weight loading and adds Fused Marlin MoE Kernel.
  • Adds Machete Hopper-optimized mixed precision linear kernel.
  • Registers custom ops for torch.compile kernel support.
  • Adds span metrics for model_forward, scheduler, and sampler time.
  • Optimizes prefix caching performance.
  • Uses flashinfer sampling kernel when available, yielding ~7% decoding throughput speedup.
  • Reduces Python allocations for ~24% throughput speedup.
  • Supports multi-host inference on TPU with optimized RoPE.
1 more release in this issue · 2024-08-05 → 2024-08-23
v0.5.4 NOTES STABLE

vLLM v0.5.4 adds new models, W4A8 quantization, guided decoding for offline LLM, ZeroMQ-based server split, and TPU/Intel parallelism.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.4 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.5.4
  • Adds support for guided decoding for offline LLM inference.
  • Separates the OpenAI server's HTTP request handling from the model inference loop using zeromq, delivering a 20% speedup in time-to-first-token and 2x improvement in inter-token latency.
  • Adds W4A8 quantization support.
  • Adds support for reading bitsandbytes (bnb) pre-quantized models.
  • Tunes FP8 and INT8 kernels for Ada Lovelace and SM75 T4 GPUs.
+11 moreshow less
  • Adds FlashInfer support in DraftModelRunner for speculative decoding.
  • Adds observability enhancements for speculative decoding.
  • Adds pipeline parallelism support for DeepSeek v2, Qwen, Qwen2, and Nemotron models.
  • Adds vision language model support for InternVL2 and BLIP-2.
  • Adds support for MiniCPM-V vision language model.
  • Adds H2O Danube3-4b model.
  • Adds Nemotron model family (Nemotron-3, Nemotron-4, Minitron).
  • Enables TPU collective communication and tensor parallelism (TP) for the async engine with reduced compile time.
  • Enables multiprocessing and tensor parallelism on the Intel CPU backend.
  • Delivers 15% throughput improvement in large-batch scenarios by using Python's native array data structure for padding.
  • Reduces log-probability computation latency from ~30ms to ~5ms in large-batch scenarios when logprobs=None.
Was this useful?
◆  AI Model & Data Infrastructure

Microsoft ONNX Runtime

Sources Release notes → v1.19.0 NOTES

ONNX Runtime v1.19.0 adds TensorRT 10.2, CUDA 12/CuDNN 9 defaults, INT4 QDQ, FlashAttention on CPU, and new GenAI model support.

└──▷ GET THIS VERSION
$ git clone --branch v1.19.0 https://github.com/microsoft/onnxruntime.git
# already have the repo? check out this version:
$ git checkout v1.19.0
  • Adds sdpa_kernel provider option to the CUDA Execution Provider to choose the kernel used for Scaled Dot-Product Attention.
  • Adds QDQ support for INT4 quantization in CPU and CUDA Execution Providers.
  • Adds C APIs for language, vision, and audio processors in Extensions, including a new FeatureExtractor for Whisper.
  • Adds new CUDA custom operators in Extensions: MulSigmoid, Transpose2DCast, ReplaceZero, AddSharedInput, and MulSharedInput.
  • Introduces Java CUDA 12 packages published on Maven.
+22 moreshow less
  • Adds Java bindings for GenAI (build from source).
  • Supports enabling EpContext via session options in the OpenVINO Execution Provider.
  • Enables refittable embedded engine in TensorRT when an ONNX model is provided as a byte stream.
  • Implements FlashAttention on CPU to improve performance for GenAI prompt workloads.
  • Implements DeformConv operator support.
  • Expands CUDA Execution Provider op support to include Tile (bf16).
  • Expands CPU Execution Provider op support to include GroupQueryAttention and SparseAttention (for Phi-3 small).
  • Expands QNN Execution Provider op support: HardSigmoid, ConvTranspose 3d, Clip (int32 data), Matmul (int4 weights), Conv (int4 weights), prelu (fp16).
  • Adds Conv + Clip/Relu fusion support in the QNN Execution Provider.
  • Adds support for OpenVINO 2024.3.
  • Updates TensorRT Execution Provider to support TensorRT 10.2.
  • Updates DirectML from 1.14.1 to 1.15.1 with ONNX opset support expanded from 17 to 20.
  • Adds support for building quantized GenAI models using AWQ and GPTQ methods.
  • Adds GenAI support for new models: Qwen, Llama 3.1, Gemma 2, and Phi-3 small.
  • Adds Android support for GenAI (build from source).
  • Publishes GenAI packages for Windows ARM.
  • Adds support for the Phi-3 Small Tokenizer and a new OpenAI tiktoken format for fast loading of BPE tokenizers in Extensions.
  • Adds NumPy 2.x support.
  • Updates default GPU packages to use CUDA 12.x and CuDNN 9.x (previously CUDA 11.x/CuDNN 8.x); CUDA 11.x/CuDNN 8.x packages moved to the aiinfra VS feed.
  • Updates QNN Execution Provider to support QNN SDK 2.25.
  • Improves CPU operator coverage for WebNN (now supported by Chrome).
  • Adds additional CoreML ML Program operators for mobile.
└──▷ BREAKING ON UPGRADE
  • !Default GPU packages now use CUDA 12.x and CuDNN 9.x; CUDA 11.x/CuDNN 8.x packages are no longer in the default feed and have been moved to the aiinfra VS feed.
  • !Xamarin support has been removed; projects targeting Xamarin will no longer build.
  • !macOS 11 is no longer supported; the minimum supported macOS version is now 12.
  • !iOS 12 is no longer supported; the minimum supported iOS version is now 13.
  • !JavaScript packaging for onnxruntime-web has been updated in ways that introduce slight incompatibilities when apps bundle onnxruntime-web.
Was this useful?

Ollama

Sources Release notes → v0.3.9 5 RELEASES · 2024-08-02 → 2024-08-31 NOTES STABLE

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Ollama v0.3.9 adds path support to OLLAMA_HOST and improves error messaging for unsupported models.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.9 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.3.9
└──▷ TRY IT
Route Ollama through a reverse proxy that serves it at a subpath rather than the root.
$ OLLAMA_HOST=https://myproxy.example.com/ollama ollama run llama3.1
  • Supports URL paths in OLLAMA_HOST, enabling deployments behind reverse proxies with subpath routing.
  • Shows improved error messages when attempting to run unsupported models.
4 more releases in this issue · 2024-08-02 → 2024-08-31
v0.3.7 NOTES STABLE

Ollama v0.3.7 adds Hermes 3, Phi 3.5, and SmolLM models plus CUDA 12 support for up to 10% GPU performance gains.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.7 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.3.7
└──▷ TRY IT
Run the new Hermes 3 model with tool-calling capabilities for agentic workflows.
$ ollama run hermes3
  • Adds Hermes 3 (Nous Research flagship LLM with tool-calling support) via ollama run hermes3.
  • Adds Phi 3.5, a 3.8B-parameter lightweight model competitive with larger models.
  • Adds SmolLM family of small models at 135M, 360M, and 1.7B parameters trained on a new high-quality dataset.
  • Adds CUDA 12 support, improving performance by up to 10% on newer NVIDIA GPUs.
  • Improves throughput of ollama pull and ollama push on slower network connections.
+1 moreshow less
  • Linux distribution now ships as a tar.gz archive bundling the ollama binary with required libraries.
└──▷ BREAKING ON UPGRADE
  • !Ollama on Linux is now distributed as a tar.gz file instead of a standalone binary; existing install scripts or package pipelines that expected a bare binary will need to be updated to extract the archive.
v0.3.6 NOTES STABLE

Ollama v0.3.6 adds Phi-3 Safetensors import, faster GGUF importing, and progress feedback for ollama create.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.6 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.3.6
  • Supports importing Phi-3 models from Safetensors via ollama create.
  • Shows progress information during GGUF file imports in ollama create.
  • Faster GGUF file importing by minimizing file copies.
v0.3.4 NOTES STABLE

Ollama v0.3.4 adds a batch embedding API with normalization and metrics, plus three new multilingual embedding models.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.4 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.3.4
└──▷ TRY IT
Generate normalized embeddings for multiple documents in one round-trip — useful for bulk indexing into a vector store.
$ curl http://localhost:11434/api/embed -d '{"model": "bge-m3", "input": ["Why is the sky blue?", "Why is the grass green?"]}'
Enforce strict input-length limits when embedding — the call errors rather than silently truncating, preventing silent data loss in pipelines.
$ curl http://localhost:11434/api/embed -d '{"model": "bge-large", "input": ["Some long document..."], "truncate": false}'
  • New /api/embed endpoint supports batch embedding generation — submit multiple documents in a single request.
  • Normalized embeddings now returned by default from /api/embed, improving similarity search accuracy.
  • New truncate parameter on /api/embed lets callers enforce strict input-length control.
  • Embedding API responses now include load_duration, total_duration, and prompt_eval_count performance metrics.
  • Adds BGE-M3, a multilingual multi-granularity large embedding model from BAAI.
+3 moreshow less
  • Adds BGE-Large, a large English embedding model.
  • Adds Paraphrase-Multilingual, a multilingual embedding model supporting 50+ languages.
  • NUMA support is now autodetected to improve inference performance on multi-socket systems.
v0.3.3 NOTES STABLE

Ollama v0.3.3 adds timing and token-count metrics to both native and OpenAI-compatible embedding APIs.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.3 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.3.3
└──▷ TRY IT
Benchmark embedding latency and token throughput for a model without external tooling — metrics are now returned inline.
$ curl http://localhost:11434/api/embed -d '{"model": "nomic-embed-text", "input": "Why is the sky blue?"}' | jq '{total_duration, load_duration, prompt_eval_count}'
Track token usage from the OpenAI-compatible embeddings endpoint when integrating Ollama with OpenAI SDK tooling.
$ curl http://localhost:11434/v1/embeddings -H 'Content-Type: application/json' -d '{"model": "nomic-embed-text", "input": "Why is the sky blue?"}' | jq '.usage'
  • Adds total_duration, load_duration, and prompt_eval_count statistics to the /api/embed response.
  • Adds usage metrics to the /v1/embeddings OpenAI compatibility endpoint.
Was this useful?

NVIDIA Triton Inference Server

Sources Release notes → v2.49.0 NOTES

Triton v2.49.0 adds vLLM metrics reporting, BF16 via DLPack, GPU device ID pinning per instance, and expanded GenAI-Perf profiling.

└──▷ GET THIS VERSION
$ git clone --branch v2.49.0 https://github.com/triton-inference-server/server.git
# already have the repo? check out this version:
$ git checkout v2.49.0
└──▷ USE IT
Enable vLLM token and latency metrics reporting so Triton exposes them via its metrics endpoint.
protobuf
parameters: {
  key: "REPORT_CUSTOM_METRICS"
  value: {
    string_value:"yes"
  }
}
Benchmark a custom prompt set against an OpenAI-compatible embeddings endpoint instead of synthetic data.
$ genai-perf --input-file prompts.jsonl
  • Enables vLLM metrics reporting (vllm:prompt_tokens_total, vllm:generation_tokens_total, vllm:time_to_first_token_seconds) by setting REPORT_CUSTOM_METRICS to yes in config.pbtxt.
  • Adds gpu_device_ids field to TensorRT-LLM backend instance configuration, allowing GPU device IDs to be specified per model instance.
  • GenAI-Perf now accepts multiple user-specified prompts via --input-file, enabling custom prompt-set benchmarking.
  • Python backend now supports BF16 tensors via DLPack.
  • GenAI-Perf can now profile OpenAI-compatible embeddings and Hugging Face TEI re-ranker API-compatible rankings.
+1 moreshow less
  • Loaded model versions whose model files are unmodified are no longer reloaded when the model config is updated to load new versions, reducing unnecessary reload overhead.
Was this useful?
Other / Uncategorized
◆  AI OBSERVABILITY

Arize Phoenix

Sources Release notes → arize-phoenix-v4.32.0 17 RELEASES · 2024-08-02 → 2024-08-29 NOTES STABLE

Phoenix 4.32.0 adds auth login/logout, system key deletion, tool schema display, and toggleable project auto-refresh.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.32.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.32.0
  • Adds UI toggle to turn off auto-refresh of projects, reducing noise when reviewing stable traces.
  • Adds login/logout flow wired up through the auth system.
  • Enables deletion of system API keys via the auth interface.
  • Displays tool schema definitions inline in the UI for inspecting LLM tool call structures.
16 more releases in this issue · 2024-08-02 → 2024-08-29
arize-phoenix-v4.31.0 NOTES STABLE

Arize Phoenix v4.31.0 adds a gallery view with expandable images for vision trace data.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.31.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.31.0
  • Adds an image gallery view in the UI for vision traces, with support for expanding individual images.
arize-phoenix-v4.30.0 NOTES STABLE

Arize Phoenix v4.30.0 adds a new project onboarding experience.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.30.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.30.0
  • Introduces a new project onboarding flow to guide users through initial project setup.
arize-phoenix-v4.29.0 NOTES STABLE

Phoenix v4.29.0 adds Experiments API to OpenAPI schema and a delete mutation for system API keys.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.29.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.29.0
  • Adds Experiments API endpoints to the OpenAPI schema, making experiment operations formally documented and client-generatable.
  • Adds a deleteSystemApiKey GraphQL mutation for removing system API keys.
arize-phoenix-v4.28.0 NOTES STABLE

Phoenix 4.28.0 adds a UI modal for creating users and a refreshed login screen.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.28.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.28.0
  • Adds a 'Create User' modal to the UI for managing user accounts directly from the interface.
  • Refreshed login screen with improved visual design.
arize-phoenix-v4.27.0 NOTES STABLE

Phoenix v4.27.0 adds list_experiments client method, clipboard copy for experiment IDs, and onboarding demo projects.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.27.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.27.0
└──▷ USE IT
Retrieve all experiments for a dataset to audit or compare runs programmatically.
python
import phoenix as px

client = px.Client()
experiments = client.list_experiments()
  • Adds list_experiments client method to programmatically retrieve experiments from the Phoenix client.
  • Adds a flag to force fixture ingestion on existing databases (in addition to limiting fixture loading to new DBs only).
  • Adds a minimal login page for auth-enabled deployments.
  • Enables copying experiment IDs to the clipboard directly from the experiments UI.
  • Introduces onboarding demo projects to help new users get started quickly.
arize-phoenix-v4.26.0 NOTES STABLE

Phoenix v4.26.0 adds login/logout routes and a createUser mutation for authentication support.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.26.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.26.0
  • Adds login and logout routes and a createUser mutation to support user authentication workflows.
arize-phoenix-v4.25.0 NOTES STABLE

Phoenix v4.25.0 adds system API keys with expiry support, a new phoenix.otel package, and a UI for managing system keys.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.25.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.25.0
  • New phoenix.otel package provides a dedicated OpenTelemetry integration layer for Phoenix.
  • Introduces system API key creation with optional expiry support, manageable via a new system API keys UI.
arize-phoenix-v4.24.0 NOTES STABLE

Phoenix 4.24.0 adds concurrency control for experiments and separates user vs. system API key resolvers.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.24.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.24.0
└──▷ USE IT
Speed up a large experiment run by executing tasks in parallel instead of sequentially.
python
run_experiment(dataset, task=my_task, concurrency=10)
Run evaluations concurrently to reduce wall-clock time when scoring many experiment results.
python
evaluate_experiment(experiment, evaluators=[my_evaluator], concurrency=5)
  • Adds concurrency parameter to run_experiment and evaluate_experiment to control parallel execution of experiments.
  • Adds user/system API key resolvers, separating user-scoped and system-scoped key management.
  • Adds user role support in auth, excluding system accounts from user-facing lists.
arize-phoenix-evals-v0.15.0 NOTES STABLE

arize-phoenix-evals v0.15.0 exposes configuration for the initial rate limit on LLM eval calls.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-evals-v0.15.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-evals-v0.15.0
  • Exposes configuration for the initial rate limit, allowing practitioners to tune request pacing from the start of an eval run.
arize-phoenix-v4.23.0 NOTES STABLE

Phoenix v4.23.0 adds authentication controls with a settings page and users table in the UI.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.23.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.23.0
  • Adds a Settings page to the UI exposing the auth_enabled flag for managing authentication configuration.
  • Adds a user GraphQL query to retrieve user information via the Phoenix GQL API.
  • Adds a Users table within the Settings page to view and manage user accounts.
arize-phoenix-v4.22.0 NOTES STABLE

Phoenix v4.22.0 adds annotation filter actions to span and trace tables in the UI.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.22.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.22.0
  • Adds annotation filter actions to span and trace tables, enabling users to filter table views by annotation values directly from the UI.
arize-phoenix-v4.21.0 NOTES STABLE

Phoenix v4.21.0 adds a call-to-action prompt for span annotations in the UI.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.21.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.21.0
  • Adds a call-to-action prompt in the UI to guide users toward creating span annotations.
arize-phoenix-v4.20.0 NOTES STABLE

Phoenix v4.20.0 adds span annotations to dataset example metadata.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.20.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.20.0
  • Adds span annotations to dataset example metadata, making annotation data available alongside examples in datasets.
arize-phoenix-v4.19.0 NOTES STABLE

Phoenix v4.19.0 shows all annotations in the annotation summary on the project page header.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.19.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.19.0
  • Displays all annotations in the annotation summary within the project page header for at-a-glance visibility across a project.
arize-phoenix-v4.18.0 NOTES STABLE

Phoenix v4.18.0 adds annotation summaries, human span annotation editing, and slug support for session.view.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.18.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.18.0
  • Supports a slug parameter in session.view for direct project navigation.
  • Adds annotation summaries to projects, surfacing aggregate label and score data at the project level.
  • Enables editing of existing human span annotations in the UI.
arize-phoenix-v4.17.0 NOTES STABLE

Phoenix v4.17.0 adds a feedback column to spans/traces tables and a condensed trace tree view.

└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v4.17.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout arize-phoenix-v4.17.0
  • Adds a feedback column to the spans and traces tables that surfaces all annotations at a glance.
  • Introduces a condensed trace tree layout in the UI for a denser view of trace hierarchies.
Was this useful?

Langfuse

Sources Release notes → v2.75.1 9 RELEASES · 2024-08-06 → 2024-08-30 NOTES STABLE

Langfuse v2.75.1 adds custom rate limits per organization for Langfuse Cloud.

└──▷ GET THIS VERSION
$ git clone --branch v2.75.1 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.75.1
  • Adds custom rate limits configurable per organization on Langfuse Cloud.
8 more releases in this issue · 2024-08-06 → 2024-08-30
v2.75.0 NOTES STABLE

Langfuse v2.75.0 adds tag filters across all tables, persistent filter state in session storage, and broad frontend performance improvements.

└──▷ GET THIS VERSION
$ git clone --branch v2.75.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.75.0
  • Adds tag filter to the generations table and scores table, and adds trace tags as a column/filter in generations, sessions, and score tables.
  • Persists table and dashboard filter state — including date range — in session storage so filters survive page navigation.
  • Adds a jump-to-page input in table pagination for faster navigation across large result sets.
  • Significant frontend performance improvements across traces, sessions, generations, and scores tables by parallelizing database queries and splitting total-count queries to reduce initial load time.
  • Displays eval config sampling rate in the UI.
v2.74.0 NOTES STABLE

Langfuse v2.74.0 adds markdown rendering support for comments in the UI.

└──▷ GET THIS VERSION
$ git clone --branch v2.74.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.74.0
  • Adds markdown rendering support for comments in the UI.
v2.73.0 NOTES STABLE

Langfuse v2.73.0 adds multi-modal trace viewing with support for OpenAI content part format (images and text).

└──▷ GET THIS VERSION
$ git clone --branch v2.73.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.73.0
  • Adds multi-modal trace rendering in the UI, supporting the OpenAI content part format for displaying images and text within traces.
v2.72.0 NOTES STABLE

Langfuse v2.72.0 adds dataset duplication, object-level comments, and Stripe-powered cloud billing.

└──▷ GET THIS VERSION
$ git clone --branch v2.72.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.72.0
  • Adds a duplicate dataset button in the UI to quickly clone existing datasets.
  • Adds comments on objects (traces, observations, etc.) directly within the UI.
  • Adds Stripe checkout, customer portal, and usage metering to Langfuse Cloud billing settings.
  • Adds billing period and next invoiced amount display to Langfuse Cloud billing settings.
v2.71.0 NOTES STABLE

Langfuse v2.71.0 adds score analytics dashboards with aggregate and time series charts, plus audit logs for score configs.

└──▷ GET THIS VERSION
$ git clone --branch v2.71.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.71.0
  • Adds aggregate and time series charts per score to the dashboard, enabling score analytics visualization.
  • Adds audit logs for score config changes.
v2.70.0 NOTES STABLE

Langfuse v2.70.0 adds Organizations support, enterprise UI customization, and Redis-backed ingestion and export queues.

└──▷ GET THIS VERSION
$ git clone --branch v2.70.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.70.0
  • Adds enterprise UI customization (configurable docs, support, and feedback links) via self-host enterprise edition settings.
  • Adds Organizations support, enabling multi-organization management within a single Langfuse instance.
  • Moves batch export queue from web to Redis, improving reliability and scalability of data exports.
  • Ingestion pipeline now returns early and routes trace events through Redis, reducing latency for tracing workloads.
└──▷ BREAKING ON UPGRADE
  • !The LANFUSE_WEB_MIGRATION_DISABLED environment variable has been removed.
v2.69.0 NOTES STABLE

Langfuse v2.69.0 adds per-score columns in data tables, removes beta from trace timeline, and adds gpt-4o-2024-08-06 pricing and eval support.

└──▷ GET THIS VERSION
$ git clone --branch v2.69.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.69.0
  • Adds gpt-4o-2024-08-06 model pricing and makes it available in the playground and evals.
  • Breaks out scores into individual columns in data tables for easier comparison across traces and observations.
  • Removes the beta flag from the trace timeline view, marking it generally available.
v2.68.0 NOTES STABLE

Langfuse v2.68.0 adds lastUpdatedAt, lastConfig, and date-range filters to the GET /v2/prompts API endpoint.

└──▷ GET THIS VERSION
$ git clone --branch v2.68.0 https://github.com/langfuse/langfuse.git
# already have the repo? check out this version:
$ git checkout v2.68.0
└──▷ TRY IT
Fetch only prompts updated within a specific window — useful for polling or change-detection pipelines.
$ curl -X GET 'https://<your-langfuse-host>/api/public/v2/prompts?fromUpdatedAt=2024-06-01T00:00:00Z&toUpdatedAt=2024-06-30T23:59:59Z' \
  -H 'Authorization: Basic <base64-encoded-key>'
  • Adds lastUpdatedAt field to GET /v2/prompts responses, exposing when each prompt was last modified.
  • Adds lastConfig attribute and fromUpdatedAt / toUpdatedAt query parameters to GET /v2/prompts, enabling date-range filtering of prompt listings.
  • Extends the maximum prompt label length from the previous limit to 36 characters in the UI.
Was this useful?

Weights & Biases Weave

Sources Release notes → v0.51.0 3 RELEASES · 2024-08-13 → 2024-08-29 NOTES STABLE

Weave v0.51.0 adds server-side ref expansion and Python/curl export options for calls.

└──▷ GET THIS VERSION
$ git clone --branch v0.51.0 https://github.com/wandb/weave.git
# already have the repo? check out this version:
$ git checkout v0.51.0
  • Adds Python and curl export options for calls, letting practitioners generate ready-to-run code from traced call data in the UI.
  • Adds server-side ref expansion, resolving object references on the server rather than the client.
2 more releases in this issue · 2024-08-13 → 2024-08-29
v0.50.15 NOTES STABLE

Weave v0.50.15 adds Cerebras and Anthropic streaming integrations, PIL image support, call stream column selection, and evaluations page filtering.

└──▷ GET THIS VERSION
$ git clone --branch v0.50.15 https://github.com/wandb/weave.git
# already have the repo? check out this version:
$ git checkout v0.50.15
└──▷ USE IT
Trace a streaming Anthropic call end-to-end in a Weave-instrumented project.
python
import weave
import anthropic

weave.init('my-project')
client = anthropic.Anthropic()

with client.messages.stream(
    model='claude-3-opus-20240229',
    max_tokens=256,
    messages=[{'role': 'user', 'content': 'Summarize the water cycle.'}]
) as stream:
    for text in stream.text_stream:
        print(text, end='', flush=True)
Log a PIL image as a first-class Weave artifact inside a traced op.
python
import weave
from PIL import Image

weave.init('my-project')

@weave.op()
def process_image(path: str):
    img = Image.open(path)
    return img  # PIL Image is now serialized natively by Weave

process_image('screenshot.png')
  • Adds invoke as a valid infer method for WeaveObject, expanding how model inference can be triggered.
  • Adds simple column selection in call stream queries, letting callers retrieve only the fields they need.
  • Adds first-class image support for PIL images, with a registered image serializer and type serializer in the manifest.
  • Adds Anthropic Messages.stream support in the integration layer, enabling tracing of streaming Anthropic calls.
  • Adds Cerebras as a supported integration.
+5 moreshow less
  • Adds filtering and column management to the evaluations page UI.
  • Adds a new filter UI across the application for improved trace and call filtering.
  • Adds automatic renderer guessing for string values in the data table UI.
  • Reference docs now include an interactive OpenAPI Spec viewer.
  • Disallows cross-project reference lookups, scoping object references to their originating project.
└──▷ BREAKING ON UPGRADE
  • !Cross-project reference lookups are no longer permitted; references are now scoped to their originating project and will fail if they point across project boundaries.
v0.50.14 NOTES STABLE

Weave v0.50.14 adds object mutation support, data export (JSON/JSONL/CSV), configurable user settings, and feedback deletion in the UI.

└──▷ GET THIS VERSION
$ git clone --branch v0.50.14 https://github.com/wandb/weave.git
# already have the repo? check out this version:
$ git checkout v0.50.14
  • Adds export of trace/call data to JSON, JSONL, CSV, or selected rows to CSV directly from the UI.
  • Adds limited mutation support for Table and WeaveTable objects, enabling in-place updates to tracked datasets.
  • Adds limited mutation support for other Weave objects (excluding WeaveTable) via the object mutations API.
  • Adds configurable user settings via the new user settings feature in the Python API.
  • Adds feedback deletion capability in the UI, allowing users to remove previously submitted feedback entries.
+4 moreshow less
  • Models, Datasets, and Custom Objects now display object properties as columns when viewing all versions in the UI.
  • Adds a new backend costs query API powering LLM token cost tracking, backed by an llm_token_prices table.
  • Adds CMD-K keyboard shortcut for search within the Weave docs site.
  • Overhauled Python API documentation with source links and improved Pydantic object rendering.
Was this useful?
◆  MCP TOOLING

Composio

Sources Release notes → v0.5.11 7 RELEASES · 2024-08-05 → 2024-08-31 NOTES STABLE

Composio v0.5.11 adds composio triggers show command for inspecting trigger details from the CLI.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.11 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.5.11
└──▷ TRY IT
Inspect the details of a configured trigger without leaving the terminal.
$ composio triggers show
  • Adds composio triggers show subcommand to inspect trigger details directly from the CLI.
6 more releases in this issue · 2024-08-05 → 2024-08-31
v0.5.7 NOTES STABLE

Composio v0.5.7 adds AgentOps integration and a new website roaster tool.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.7 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.5.7
  • Adds AgentOps integration for agent observability and monitoring.
  • Adds website_roaster tool for website analysis.
  • Adds logging support to the core client.
v0.5.0 NOTES STABLE

Composio v0.5.0 adds human-in-the-loop support and removes legacy auth endpoints.

└──▷ GET THIS VERSION
$ git clone --branch v0.5.0 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.5.0
  • Adds human-in-the-loop workflow capability, enabling agent actions to pause and await human approval or input before proceeding.
  • Removes auth endpoints, consolidating authentication surface.
└──▷ BREAKING ON UPGRADE
  • !Auth endpoints have been removed; integrations relying on those endpoints will break on upgrade.
v0.4.5 NOTES STABLE

Composio v0.4.5 adds OpenAPI-spec-based JavaScript SDK generation.

└──▷ GET THIS VERSION
$ git clone --branch v0.4.5 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.4.5
  • Generates a JavaScript SDK directly from the OpenAPI spec, enabling JS-native integration with Composio's action and trigger surfaces.
v0.4.3 NOTES STABLE

Composio v0.4.3 adds processors and metadata as plugin toolset arguments and a new frontend agent.

└──▷ GET THIS VERSION
$ git clone --branch v0.4.3 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.4.3
  • Adds processors and metadata as plugin toolset arguments, enabling per-plugin configuration of request/response processing and contextual metadata.
  • Adds a frontend agent capability to the platform.
v0.4.2 NOTES STABLE

Composio v0.4.2 adds Vercel AI SDK and Phidata integrations plus pre/post action processors

└──▷ GET THIS VERSION
$ git clone --branch v0.4.2 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.4.2
  • Adds pre/post action processors and top-level metadata config support, enabling hooks to run before and after any action execution.
  • New Vercel AI SDK integration, allowing Composio tools to be used directly within Vercel AI workflows.
  • New Phidata plugin, adding Composio support for the Phidata agent framework.
  • Updates e2b sandbox support in the JS SDK (bumped to v0.1.12).
v0.4.1 NOTES STABLE

Composio v0.4.1 adds browser tool support, LangGraph scaffolding, system tools, and a LlamaIndex agent integration.

└──▷ GET THIS VERSION
$ git clone --branch v0.4.1 https://github.com/ComposioHQ/composio.git
# already have the repo? check out this version:
$ git checkout v0.4.1
  • Adds a browser tool integration for agent-driven web interaction.
  • Adds LangGraph scaffolding to support LangGraph-based agent workflows.
  • Adds system tools and a Rewind integration example.
  • Adds a LlamaIndex agent integration.
  • Enables API key retrieval from login credentials, streamlining authentication setup.
Was this useful?
◆  VECTOR DB RAG

LanceDB

Sources Release notes → python-v0.13.0-beta.1 5 RELEASES · 2024-08-07 → 2024-08-23 NOTES STABLE

LanceDB python-v0.13.0-beta.1 adds scalar index support on remote tables, FTS query/index on RemoteTable/AsyncTable, and a new delete_unverified parameter.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.13.0-beta.1 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.13.0-beta.1
  • Adds delete_unverified parameter to the Python delete API, enabling unverified deletes on tables.
  • Supports querying and indexing full-text search (FTS) on RemoteTable and AsyncTable.
  • Allows new scalar index types to be created on remote tables.
4 more releases in this issue · 2024-08-07 → 2024-08-23
v0.10.0-beta.1 NOTES STABLE

LanceDB v0.10.0-beta.1 adds scalar index types on remote tables, FTS query/index on RemoteTable/AsyncTable, and a delete unverified parameter for Python and Node.js.

└──▷ GET THIS VERSION
$ git clone --branch v0.10.0-beta.1 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.10.0-beta.1
  • Adds delete unverified parameter to the Python client, enabling unverified deletes via the Python API.
  • Adds delete unverified support to the Node.js client for unverified delete operations.
  • Supports querying and indexing Full-Text Search (FTS) on RemoteTable and AsyncTable.
  • Allows new scalar index types to be created on remote tables.
python-v0.13.0-beta.0 NOTES STABLE

LanceDB python-v0.13.0-beta.0 migrates FTS to lance-index and adds bitmap/label-list scalar index support to the async API.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.13.0-beta.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.13.0-beta.0
└──▷ USE IT
Collect async query results into a Python list without manually awaiting an iterator.
python
results = await table.query().where("category = 'news'").to_list()
Create a bitmap scalar index on a column via the Python async API for fast low-cardinality filtering.
python
await table.create_scalar_index("category", index_type="BITMAP")
  • Adds to_list() to the async Python API, enabling async result collection from query results.
  • Adds bitmap and label list scalar index creation via the Python async API.
  • Migrates full-text search (FTS) backend from tantivy to lance-index, replacing the previous FTS engine.
  • Adds bitmap and label list index types to the Node.js API.
└──▷ BREAKING ON UPGRADE
  • !Full-text search (FTS) is migrated from tantivy to lance-index; any existing tantivy-based FTS indexes or configurations will break on upgrade.
v0.10.0-beta.0 NOTES STABLE

LanceDB v0.10.0-beta.0 migrates FTS to lance-index and adds bitmap/label-list scalar indexes in Python and Node.js

└──▷ GET THIS VERSION
$ git clone --branch v0.10.0-beta.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.10.0-beta.0
  • Adds to_list() to the Python async API for collecting query results asynchronously.
  • Adds bitmap and label-list scalar index creation via the Python async API.
  • Adds bitmap and label-list index types to the Node.js API.
  • Migrates full-text search (FTS) from tantivy to lance-index, replacing the underlying FTS engine.
└──▷ BREAKING ON UPGRADE
  • !FTS indexes are migrated from tantivy to lance-index; existing tantivy-backed FTS indexes will not be compatible and must be rebuilt.
python-v0.12.0 NOTES STABLE

LanceDB Python v0.12.0 adds WatsonX embeddings, multi-vector reranking, and remote table embedding support.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.12.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.12.0
  • Adds WatsonX embeddings to the embedding function registry for use with LanceDB tables.
  • Adds multi-vector reranking support, enabling reranking across multiple vector search results in a single query.
  • Supports embedding functions on remote tables, bringing parity with local table embedding workflows.
  • Upgrades lance to v0.16, improving the underlying storage and query engine.
└──▷ BREAKING ON UPGRADE
  • !Upgrading lance to 0.16 is a breaking change; existing setups depending on the prior lance version may require migration.
Was this useful?

Milvus

Sources Release notes → v2.4.10 3 RELEASES · 2024-08-14 → 2024-08-30 NOTES STABLE

Milvus 2.4.10 adds upsert with AutoID, partial field loading, RBAC backup/restore API, and expanded MMAP controls.

└──▷ GET THIS VERSION
$ git clone --branch v2.4.10 https://github.com/milvus-io/milvus.git
# already have the repo? check out this version:
$ git checkout v2.4.10
  • Adds a new API for backing up and restoring RBAC configurations, enabling disaster recovery and portability of access-control policies.
  • Introduces readonly, readwrite, and admin privilege groups to simplify the RBAC grant process.
  • Adds RBAC message support for Change Data Capture (CDC).
  • Adds new database properties to restrict read access to databases.
  • Supports upsert operations on collections with AutoID enabled.
+5 moreshow less
  • Adds beta preview of partial field loading, allowing specific fields of a collection to be loaded rather than the full schema.
  • Expands MMAP configuration options with more general controls over MMAP behavior to optimize memory usage.
  • Adds support for HTTP v1/v2 throttling.
  • Adds hit segment number metrics for the query hook.
  • Enhanced tracing now encodes traceid and spanid as hex strings.
2 more releases in this issue · 2024-08-14 → 2024-08-30
v2.4.8 NOTES STABLE

Milvus 2.4.8 adds clustering compaction, OTLP HTTP export, async CGO search, and expanded system metrics.

└──▷ GET THIS VERSION
$ git clone --branch v2.4.8 https://github.com/milvus-io/milvus.git
# already have the repo? check out this version:
$ git checkout v2.4.8
  • Adds range_search_k parameter support in Knowhere to speed up range searches.
  • Adds OTLP HTTP exporter support for observability and monitoring.
  • Introduces configurable database properties max collections and disk quota, dynamically modifiable at runtime.
  • Enables configuration of replica numbers and resource groups at the cluster, database, and collection levels with support for dynamic modifications.
  • Implements clustering compaction — data redistributed based on a designated clustering key to reduce scanned data and enhance query efficiency.
+10 moreshow less
  • Separates compaction from the Shard DataNode, allowing any DataNode to perform compaction independently for improved fault tolerance and scalability.
  • Adds client pooling support in QueryNode within the proxy/delegator for improved performance.
  • Integrates Sonic for JSON marshaling/unmarshaling in Gin and RestfulV1 handlers to reduce CPU overhead.
  • Introduces an in-memory cache for authentication result retrieval.
  • Enables memory-mapped file support for growing segments.
  • Improves access logs with RESTful API support, consistency level logging, and distinction between system and user errors.
  • Applies blocked Bloom filters to accelerate filter construction and querying.
  • Expands system metrics to cover force-deny-writing state, queue latency, disk quota, task execution time, binlog size, insert rate, memory high water level, RESTful API metrics, and search latency.
  • Changes the default AutoIndex metric types for FloatVector and BinaryVector to Cosine and Hamming respectively for open-source users.
  • Introduces fixed versions for third-party C++ dependency libraries hosted on JFrog Cloud using Conan Recipe Revisions (RREV) to stabilize supply chain management.
└──▷ BREAKING ON UPGRADE
  • !The AutoIndex metric types for FloatVector and BinaryVector are changed to Cosine and Hamming respectively; existing open-source deployments relying on the previous defaults will behave differently after upgrade.
  • !Developers on operating systems other than Ubuntu 22.04 may need to upgrade their glibc version due to the newly fixed third-party dependency versions.
v2.3.21 NOTES STABLE

Milvus v2.3.21 adds disk quota, max insert rate, and query node memory metrics alongside a changed autoindex default metric type.

└──▷ GET THIS VERSION
$ git clone --branch v2.3.21 https://github.com/milvus-io/milvus.git
# already have the repo? check out this version:
$ git checkout v2.3.21
  • Adds metrics to track disk quota usage.
  • Adds metrics to record maxinsertrate and querynodememoryhighwaterlevel.
  • Adds tracking for the number of times Milvus enters a force-deny-writing state.
  • Changes the default metric type for autoindex.
Was this useful?

Qdrant

Sources Release notes → v1.11.1 2 RELEASES · 2024-08-12 → 2024-08-27 NOTES STABLE

Qdrant v1.11.1 adds MatchAny/Except filtering for UUID indexes and non-blocking payload index builds.

└──▷ GET THIS VERSION
$ git clone --branch v1.11.1 https://github.com/qdrant/qdrant.git
# already have the repo? check out this version:
$ git checkout v1.11.1
  • Supports MatchAny and Except filter conditions on UUID indexes, enabling set-based inclusion/exclusion filtering on UUID payload fields.
  • Non-blocking payload index building keeps the collection available for queries while indexes are constructed in the background.
  • Includes the list of cluster peers in telemetry data.
  • Improves navigation and collection view in the Web UI.
  • Allows modifying data before writing to disk for copy-on-write operations.
1 more release in this issue · 2024-08-12 → 2024-08-27
v1.11.0 NOTES STABLE

Qdrant v1.11.0 adds GroupBy in Query API, UUID payload index, Distribution-based Score Fusion, random sampling, and a graph-based collection explorer.

└──▷ GET THIS VERSION
$ git clone --branch v1.11.0 https://github.com/qdrant/qdrant.git
# already have the repo? check out this version:
$ git checkout v1.11.0
└──▷ HOW TO FIND IT
Explore vector neighborhoods visually and check real-time search quality without leaving the browser.
📍In the Qdrant Web UI, open a collection and select 'Graph Exploration' to browse vector neighborhoods, or select 'Search Quality' to evaluate retrieval quality in real time.
  • Adds group_by support to the Query API, enabling grouped vector search results in a single request.
  • Introduces a UUID payload index type for indexing and filtering on UUID fields.
  • Adds on-disk index support for Keyword, Integer, Datetime, Float, and UUID indexes, reducing RAM requirements for large collections.
  • Adds random sampling support in the Query API for approximate or exploratory queries.
  • Adds Distribution-based Score Fusion (DBSFusion) as a new score fusion strategy for hybrid search.
+2 moreshow less
  • New graph-based collection exploration tool in the Web UI for visualizing vector neighborhoods.
  • New real-time search quality check tool in the Web UI.
Was this useful?

Weaviate

Sources Release notes → v1.26.3 3 RELEASES · 2024-08-20 → 2024-08-29 NOTES STABLE

Weaviate v1.26.3 adds hybrid search score cutoffs, Databricks Foundation Model API support for LLM and embeddings, and a FriendliAI generative module.

└──▷ GET THIS VERSION
$ git clone --branch v1.26.3 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.26.3
  • Adds cutoff threshold support for hybrid search queries, enabling score-based result filtering.
  • Adds support for Databricks Foundation Model API as an LLM backend.
  • Adds support for Databricks Foundation Model API as an embedding backend.
  • Adds a new generative module for FriendliAI, enabling use of FriendliAI models for RAG workflows.
└──▷ BREAKING ON UPGRADE
  • !This release is marked [BROKEN] / [DO NOT USE]: a bug may cause cluster data deletion in certain setups. Weaviate recommends upgrading directly to v1.26.6 instead.
2 more releases in this issue · 2024-08-20 → 2024-08-29
v1.25.13 NOTES STABLE

Weaviate v1.25.13 adds Mistral text2vec module and concurrent vectorization — but is flagged broken; upgrade to v1.25.20.

└──▷ GET THIS VERSION
$ git clone --branch v1.25.13 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.25.13
  • Adds Mistral text2vec module, enabling Mistral-backed text vectorization for collections.
  • Adds concurrent vectorization support, allowing multiple vectors to be computed in parallel during ingestion.
└──▷ BREAKING ON UPGRADE
  • !This release contains a bug that may cause cluster data deletion in certain setups. It is marked [DO NOT USE]; upgrade to v1.25.20 instead.
v1.24.23 NOTES STABLE

Weaviate v1.24.23 adds an experimental repair endpoint for cluster data repair operations.

└──▷ GET THIS VERSION
$ git clone --branch v1.24.23 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.24.23
  • Adds an experimental repair endpoint for repairing data in a Weaviate cluster.
Was this useful?
my-toolchain — 0 tools
paste an install list to detect your tools

A brew list, a Brewfile, requirements.txt, a Dockerfile — or just the product names, free-form. Nothing leaves your browser.

    browse all tools →