Heads up This site is currently under heavy development.
Subscribe Get it delivered — the daily firehose, filtered to the tools you run, plus the documentation changes vendors never announce. Compare plans →

The AI Toolchain — issue -388, July 31, 2023

THE AI TOOLCHAIN NO. -388
Tail
THE DAILY RELEASE FIREHOSE
PUBLISHED JULY 31, 2023 · EVERY WEEKDAY
EDITIONS tail grep head diff uniq

The daily firehose — everything the toolchain shipped today, already filtered.

// HOW THIS ISSUE IS MADE

We read every release from the 174 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.

VIEW
ISSUE VIEW full issue
Do you prefer this view?
$ tct list   # 18 tools matched
AI & LLM Tooling
◆  AI Coding Agents

Aider

Sources Release notes → v0.10.1 7 RELEASES · 2023-07-06 → 2023-07-24 NOTES STABLE

Aider v0.10.1 adds /git command, multiline input via Meta-ENTER, and auto-.gitignore for aider files.

└──▷ GET THIS VERSION
$ git clone --branch v0.10.1 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.10.1
└──▷ TRY IT
Run a git log or status check without leaving your aider chat session.
$ /git log --oneline -5
  • Adds /git command to run git commands directly from inside an aider chat session.
  • Adds /add and /drop commands now always resolve paths relative to the git root for consistency.
  • Supports multiline chat messages via Meta-ENTER (or Esc+ENTER in some environments).
  • Adds version-check against PyPI on startup, notifying users when a newer release is available.
  • Forces --no-pretty mode automatically when aider detects it is running inside a VSCode terminal.
6 more releases in this issue · 2023-07-06 → 2023-07-24
v0.10.0 NOTES STABLE

Aider v0.10.0 adds /git in-chat command, multiline input via Meta-ENTER, and auto .gitignore for aider files.

└──▷ GET THIS VERSION
$ git clone --branch v0.10.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.10.0
└──▷ TRY IT
Run a git log or status check without leaving your aider session.
$ /git log --oneline -10
  • Adds /git command to run git commands directly from inside an aider chat session.
  • Adds --no-pretty auto-detection: forces --no-pretty mode when aider detects it is running inside a VSCode terminal.
  • Supports multiline chat messages via Meta-ENTER (or Esc+ENTER in some environments).
  • Checks PyPI for newer versions on startup and notifies the user when an update is available.
  • Updates keyboard interrupt logic so two Ctrl-C presses within two seconds always force-exits aider.
v0.9.0 NOTES STABLE

Aider v0.9.0 adds Azure OpenAI support and a new --show-repo-map flag.

└──▷ GET THIS VERSION
$ git clone --branch v0.9.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.9.0
└──▷ TRY IT
Inspect the repo map Aider will send to the model before starting a session.
$ aider --show-repo-map
  • Adds --show-repo-map flag to display the repository map.
  • Supports OpenAI models hosted on Azure.
v0.8.3 NOTES STABLE

Aider v0.8.3 adds --dark-mode, --light-mode, and --encoding flags plus glob support in /add and /drop.

└──▷ GET THIS VERSION
$ git clone --branch v0.8.3 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.8.3
└──▷ TRY IT
Launch Aider with a dark terminal background so syntax colors remain legible.
$ aider --dark-mode
Add all Python files in a directory at once using glob wildcards instead of listing files individually.
$ /add src/**/*.py
Work with a codebase that uses a non-UTF-8 encoding, such as Latin-1 source files.
$ aider --encoding latin-1
  • Adds --dark-mode and --light-mode CLI flags to select terminal colors optimized for dark or light backgrounds.
  • Adds --encoding flag to specify file encoding (defaults to utf-8); also passed into ctags which is required to return utf-8.
  • Adds --code-theme flag to control pygments syntax highlighting style of code blocks.
  • Enables glob wildcard support in the /add and /drop commands for flexible file selection.
  • Prompts to create a git repository when none is found, enabling GPT code-change tracking from the start.
v0.8.2 NOTES STABLE

Aider v0.8.2 adds glob support in /add and /drop, new --encoding and --code-theme flags, and automatic git repo prompting.

└──▷ GET THIS VERSION
$ git clone --branch v0.8.2 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.8.2
└──▷ TRY IT
Scan a project with a non-utf-8 codebase by specifying the correct encoding at startup.
$ aider --encoding latin-1 src/legacy_module.py
Add all Python files in a directory at once using glob wildcards instead of listing them individually.
$ /add src/**/*.py
Apply a dark pygments theme to code blocks for easier reading in light terminals.
$ aider --code-theme monokai main.py
  • Adds --encoding flag to specify file encoding (defaults to utf-8); also passed through to ctags, which must return utf-8.
  • Adds --code-theme flag to control pygments styling of code blocks.
  • Supports glob wildcards in /add and /drop commands for bulk file management.
  • Prompts to create a git repo when none is found, enabling GPT code-change tracking from first use.
v0.8.1 NOTES STABLE

Aider v0.8.1 adds git repo auto-init, glob support in /add and /drop, and an --encoding flag for ctags.

└──▷ GET THIS VERSION
$ git clone --branch v0.8.1 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.8.1
└──▷ TRY IT
Add all Python files in a subdirectory at once using glob wildcards instead of listing them individually.
$ /add src/**/*.py
Work with a codebase that uses a non-UTF-8 encoding, ensuring files are read and written correctly.
$ aider --encoding latin-1 myfile.c
  • Supports glob wildcards in /add and /drop commands, enabling bulk file management in a session.
  • Passes --encoding into ctags and requires utf-8 output, improving reliability of code indexing.
  • Prompts to create a git repo when none is found, so GPT code changes are tracked from the start.
  • Adds --code-theme switch to control pygments styling of code blocks.
  • Adds --encoding switch to specify a non-default text encoding when reading/writing files.
v0.8.0 NOTES STABLE

Aider v0.8.0 adds --encoding and --code-theme switches plus improved Windows support.

└──▷ GET THIS VERSION
$ git clone --branch v0.8.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.8.0
└──▷ TRY IT
Scan a codebase on a Windows machine that uses a non-UTF-8 locale, specifying the correct encoding to avoid decoding errors.
$ aider --encoding cp1252 myfile.py
Customize the syntax-highlighting theme for code blocks to match a dark terminal palette.
$ aider --code-theme monokai myfile.py
  • Adds --encoding switch to specify the character encoding used when reading and writing text files (defaults to utf-8).
  • Adds --code-theme switch to control pygments syntax-highlighting style for code blocks in the terminal.
  • Reads and writes text files explicitly with utf-8 encoding by default, benefiting Windows users.
  • Improves Windows support with path-separator bug fixes and a new CI step that runs the full test suite on Windows.
  • Provides better status messages explaining why ctags is disabled when it cannot be used.
Was this useful?

Zed

Sources Release notes → v0.96.2 4 RELEASES · 2023-07-05 → 2023-07-26 NOTES STABLE

Zed v0.96.2 adds PHP/Svelte/Bash LSP support, file icons, split resizing, and new editor settings.

└──▷ GET THIS VERSION
$ git clone --branch v0.96.2 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.96.2
  • Adds search::SelectAllMatches action (default Alt + Enter) to place carets and select all buffer search results simultaneously.
  • Adds buffer_line_height setting to control editor line height.
  • Adds indent_size setting to the project panel.
  • Adds file and folder icons to the project panel, with an option to disable them via project panel settings.
  • Adds split resizing to the center pane group; double-clicking a pane divider resets the split (disabled when active_pane_magnification is non-default).
+9 moreshow less
  • Adds syntax highlighting and LSP support for PHP.
  • Adds syntax highlighting and LSP support for Svelte.
  • Adds syntax highlighting for Bash and shell scripts.
  • Adds modifiers for opening files and symbols in a new pane, and for navigating to definitions and type definitions in a new pane.
  • Adds rust-analyzer postfix completions and other completions with pre-resolved additional text edits.
  • Adds a setting to mute the microphone on call join (enabled by default).
  • Adds an option for configuring where the close button appears on editor tabs.
  • Adds an option for showing git status on editor tabs.
  • Adds ctrl+[ as a Vim-mode alias for Escape.
3 more releases in this issue · 2023-07-05 → 2023-07-26
v0.95.2 NOTES STABLE

Zed v0.95.2 adds a preview channel, modal git branch switcher, and several Vim motion improvements.

└──▷ GET THIS VERSION
$ git clone --branch v0.95.2 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.95.2
  • Adds modal git branch switcher, triggered via alt-cmd-b.
  • Introduces Zed's preview channel for early access to new features.
  • Enables branch creation directly from the recent branches dropdown query.
  • Highlights search results on the scrollbar for easier navigation.
  • Adds Vim paragraph motion support with { and } keys.
+2 moreshow less
  • Adds ^ as a motion in Vim actions.
  • Adds ctrl-c to exit Vim visual mode.
v0.94.3 NOTES STABLE

Zed v0.94.3 adds inlay hints, project/branch switcher, null keybinding disables, and broken LSP auto-repair.

└──▷ GET THIS VERSION
$ git clone --branch v0.94.3 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.94.3
└──▷ USE IT
Disable a keybinding you never want triggered — useful for reclaiming a shortcut Zed captures by default.
json
{ "bindings": { "cmd-k": null } }
  • Adds support for disabling keybindings by setting them to null in keymap config.
  • Adds support for inlay hints in the editor.
  • Adds a project and branch switcher under the project name.
  • Adds the ability to create new folders directly from the create-file action.
  • Adds support for invoking assistant: quote selection (cmd->) when editing a multi-buffer.
+1 moreshow less
  • Adds automatic detection and reinstallation of broken language servers.
v0.93.3 NOTES STABLE

Zed v0.93.3 adds voice chat, a redesigned collaboration UI, and extensive Vim mode improvements.

└──▷ GET THIS VERSION
$ git clone --branch v0.93.3 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.93.3
  • Adds voice chat to the collaboration feature.
  • Redesigned collaboration UI.
  • Adds Vim >/< indent/outdent support.
  • Adds Vim ~ for toggling case.
  • Adds Vim tab navigation with gt/ctrl-pagedown and gT/ctrl-pageup.
+5 moreshow less
  • Adds Vim s substitute command.
  • Adds Vim go to definition/go back with ctrl-]/ctrl-o.
  • Adds count support for Vim scrolling shortcuts.
  • Adds Vim line joining with ctrl-j or shift-J.
  • Adds count modifier support for Vim arrow keys (e.g. 5<down> moves down 5 lines).
Was this useful?

shell-gpt

Sources Release notes → 0.9.4 NOTES

shell-gpt 0.9.4 lets you point --model at any OpenAI-compatible local API, enabling air-gapped LLM usage.

└──▷ GET THIS VERSION
$ git clone --branch 0.9.4 https://github.com/TheR1D/shell_gpt.git
# already have the repo? check out this version:
$ git checkout 0.9.4
  • Changes --model from an enum to a free-form string, allowing it to accept any model name including those served by self-hosted, OpenAI-compatible endpoints such as LocalAI.
  • Supports locally hosted language models via any OpenAI-compatible API server (e.g. LocalAI), enabling offline or cost-free LLM usage on your own hardware.
└──▷ BREAKING ON UPGRADE
  • !The --model parameter type changed from an enum to a string; any tooling or scripts that relied on enum validation of --model values should be verified for compatibility.
Was this useful?
◆  AI Agent Frameworks

AutoGPT

Sources Release notes → v0.4.6 2 RELEASES · 2023-07-11 → 2023-07-28 NOTES STABLE

AutoGPT v0.4.6 adds a plugin text-embedding hook and graceful plugin failure handling.

└──▷ GET THIS VERSION
$ git clone --branch v0.4.6 https://github.com/Significant-Gravitas/AutoGPT.git
# already have the repo? check out this version:
$ git checkout v0.4.6
  • Adds plugin.handle_text_embedding hook, enabling plugins to intercept and override the text embedding pipeline.
  • Gracefully handles plugin loading failures so a single broken plugin no longer halts the agent.
1 more release in this issue · 2023-07-11 → 2023-07-28
v0.4.4 NOTES STABLE

AutoGPT v0.4.4 defaults to GPT-4, adds CLI args for agent identity, command aliases, and ships the long-awaited core re-arch.

└──▷ GET THIS VERSION
$ git clone --branch v0.4.4 https://github.com/Significant-Gravitas/AutoGPT.git
# already have the repo? check out this version:
$ git checkout v0.4.4
└──▷ TRY IT
Force GPT-3.5 across all tasks to control costs while experimenting with a new agent configuration.
$ python -m autogpt --gpt3only
Bootstrap a fully defined agent non-interactively in CI or scripted pipelines without an interactive prompt.
$ python -m autogpt --ai_name 'ReconBot' --ai_role 'OSINT researcher' --ai_goals 'Enumerate subdomains of example.com' 'Summarise findings to report.md'
  • Adds --gpt3only and --gpt4only CLI flags to override model selection at runtime without changing config.
  • Adds CLI args ai_name, ai_role, and ai_goals to define agent identity directly from the command line.
  • SMART_LLM (formerly SMART_LLM_MODEL) now defaults to GPT-4 for high-accuracy tasks such as agent command selection; FAST_LLM (formerly FAST_LLM_MODEL) is used for lighter tasks like summarization.
  • Introduces the autogpt/core module — the re-architecture project — now shipping in master and integrated starting with the Configuration subsystem.
  • Adds command aliases to the agent command system, reducing the need for exact command-name matching.
+1 moreshow less
  • Agent key bindings are now configurable via environment variables.
└──▷ BREAKING ON UPGRADE
  • !SMART_LLM now defaults to GPT-4 instead of the previous default, which will increase API costs for users who have not explicitly set a model.
Was this useful?

deepset Haystack

Sources Release notes → v1.19.0 NOTES

Haystack v1.19 adds Elasticsearch 8 support, a RecentnessRanker, Anthropic Claude 2, and Llama 2 on SageMaker.

└──▷ GET THIS VERSION
$ git clone --branch v1.19.0 https://github.com/deepset-ai/haystack.git
# already have the repo? check out this version:
$ git checkout v1.19.0
└──▷ TRY IT
Use the new Elasticsearch 8 backend by installing the dedicated extra — auto-detection picks the right Document Store at import time.
$ pip install farm-haystack[elasticsearch8]
Run Llama 2 chat hosted on AWS SageMaker through PromptNode by supplying the endpoint name, AWS profile, and EULA acceptance attribute.
python
from haystack.nodes import PromptNode

prompt_node = PromptNode(
    model_name_or_path="sagemaker-llama-2-chat-endpoint-name",
    model_kwargs={
        "aws_profile_name": "my_aws_profile_name",
        "aws_custom_attributes": {"accept_eula": True}
    }
)
chat = [[{"role": "user", "content": "Summarize CVE mitigations for Log4Shell."}]]
print(prompt_node(chat))
  • Adds farm-haystack[elasticsearch8] install extra and ElasticsearchDocumentStore auto-detection that selects the correct backend based on the installed Elasticsearch client version (covers ES 8 and ES <=7.5).
  • Adds farm-haystack[elasticsearch7] install extra alongside the new elasticsearch8 extra for explicit version pinning.
  • Introduces RecentnessRanker in haystack.nodes with date_meta_field, ranking_mode, and weight parameters to blend document age with relevance scores.
  • Adds embed_meta_fields support to Ranker nodes, enabling metadata to be included in the text used for ranking.
  • Adds support for list-typed embed_meta_fields when embedding metadata fields in retrievers.
+9 moreshow less
  • Extends Anthropic Claude support to Claude 2 models with updated context window sizes and a new streaming API via PromptNode.
  • Enables Llama 2 (including chat variant) on AWS SageMaker via PromptNode using aws_profile_name and aws_custom_attributes in model_kwargs.
  • Upgrades dependency to transformers v4.31.0, enabling Llama 2 support for local inference.
  • Adds global progress bar suppression capability to pipelines.
  • Adds OpenAI-Organization header support for OpenAI authentication.
  • Introduces LinkContentFetcher node by extracting link-retrieval logic from WebRetriever into a standalone component.
  • Adds BM25 retrieval support for MemoryDocumentStore.
  • Adds batch mode for MemoryRetriever (v2).
  • Introduces a Store protocol (v2) and extends pipeline.add_component to support stores.
Was this useful?

LangChain

Sources Release notes → v0.0.248 32 RELEASES · 2023-07-02 → 2023-07-31 NOTES STABLE

LangChain v0.0.248 adds an Anthropic functions wrapper and agent, Runnable support for Tools, and partial formatting for chat messages.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.248 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.248
  • Implements the Runnable interface for Tools, enabling tools to be composed directly into LCEL chains.
  • Adds an Anthropic functions wrapper (add anthropic functions wrapper) to bring function-calling-style structured output to Anthropic models.
  • Adds an initial Anthropic agent built on the new functions wrapper.
  • Supports partial formatting for chat messages in ChatPromptTemplate, allowing templates to be partially populated before final invocation.
  • Changes runnable.bind().bind() to merge/combine kwargs rather than creating nested wrapper objects, enabling cleaner chained binding.
31 more releases in this issue · 2023-07-02 → 2023-07-31
v0.0.247 NOTES STABLE

LangChain v0.0.247 adds Runnable.bind, RunnableMap, retry events, Few Shot Chat Prompt, and new LLM/embedding integrations.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.247 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.247
└──▷ USE IT
Attach a fixed stop sequence to any runnable so every invoke/stream/batch call uses it automatically.
python
from langchain.schema.runnable import RunnableLambda

base = RunnableLambda(lambda x: x)
bound = base.bind(stop=["\nObservation:"])
result = bound.invoke("What is 2+2?")
Build a parallel step with RunnableMap to fan out a single input to multiple runnables in one call.
python
from langchain.schema.runnable import RunnableMap, RunnableLambda

chain = RunnableMap({
    "summary": RunnableLambda(lambda x: x["text"][:100]),
    "length": RunnableLambda(lambda x: len(x["text"])),
})
result = chain.invoke({"text": "LangChain makes composing LLM pipelines easy."})
Use FewShotChatMessagePromptTemplate to inject labeled examples into a chat prompt before the user query.
python
from langchain.prompts import FewShotChatMessagePromptTemplate, ChatPromptTemplate
from langchain.prompts import HumanMessagePromptTemplate, AIMessagePromptTemplate

example_prompt = ChatPromptTemplate.from_messages([
    HumanMessagePromptTemplate.from_template("{input}"),
    AIMessagePromptTemplate.from_template("{output}"),
])
few_shot = FewShotChatMessagePromptTemplate(
    examples=[{"input": "2+2", "output": "4"}, {"input": "3+3", "output": "6"}],
    example_prompt=example_prompt,
)
final_prompt = ChatPromptTemplate.from_messages([few_shot, ("human", "{question}")])
print(final_prompt.format_messages(question="5+5"))
  • Adds Runnable.bind() method to attach kwargs to a Runnable that are forwarded to all invoke, stream, and batch calls when it runs.
  • Supports using RunnableMap directly as a first-class component in chains.
  • Adds RoPE scaling parameters from llama.cpp via new params exposed on the llama.cpp integration.
  • Adds FunctionMessage to _message_from_dict so function-call messages round-trip through serialization.
  • Adds retry events support on any run type, enabling configurable retry behavior across chains, agents, and other runnables.
+7 moreshow less
  • Adds FewShotChatMessagePromptTemplate for few-shot prompting with chat models.
  • Adds a 'Create PR' tool to the GitHub toolkit.
  • Adds Xinference LLM and embeddings integration.
  • Adds Minimax LLM integration.
  • Adds AwaEmbedding embeddings integration.
  • Adds Meilisearch vector store integration.
  • Expands ChatPromptTemplate to support additional message formats.
v0.0.245 NOTES STABLE

LangChain v0.0.245 adds a Dropbox document loader for ingesting files directly from Dropbox.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.245 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.245
  • Adds support for loading files from Dropbox as a document source.
v0.0.5 NOTES STABLE

LangChain v0.0.5 adds ToTChain, async support for PlanAndExecute and Cohere, Confluence markdown, and Azure Cognitive Search custom profiles.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.5 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.5
  • Adds ToTChain, a new Tree of Thought chain for multi-step reasoning via deliberate exploration.
  • Adds async support to PlanAndExecute chain, enabling non-blocking plan-and-execute workflows.
  • Adds async support for the Cohere integration.
  • Adds markdown format option to the Confluence loader.
  • Adds custom index and scoring profile support to the Azure Cognitive Search integration.
+1 moreshow less
  • Optimizes cosine_similarity_top_k function performance.
v0.0.244 NOTES STABLE

LangChain v0.0.244 adds a DuckDuckGo News search tool and cross-namespace object deserialization.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.244 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.244
  • Adds ability to load (deserialize) objects from namespaces other than the default LangChain namespace, enabling cross-namespace object reuse.
  • Adds a DuckDuckGo News search tool, extending the existing DuckDuckGo integration to support news-specific queries.
v0.0.243 NOTES STABLE

LangChain v0.0.243 adds a Web Research Retriever, Databricks MLflow Callback support, and Amazon OpenSearch Serverless (AOSS) integration.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.243 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.243
  • Adds Amazon OpenSearch Serverless (AOSS) support to the OpenSearch vector store integration.
  • Adds Databricks support to the MLflow Callback handler, enabling experiment tracking when running chains on Databricks.
  • Adds a new Web Research Retriever for grounding chain responses with live web search results.
└──▷ BREAKING ON UPGRADE
  • !Removes operator overloading for BaseMessage — code that used operators on BaseMessage instances will break.
v0.0.4 NOTES STABLE

LangChain v0.0.4 adds Databricks support to MLflow Callback, a Web Research Retriever, and Amazon OpenSearch Serverless (AOSS) support.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.4 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.4
  • Adds Amazon OpenSearch Serverless (AOSS) support to the OpenSearch integration.
  • Adds Databricks support to the MLflow Callback handler.
  • Adds a Web Research Retriever for retrieval-augmented generation from live web sources.
v0.0.242 NOTES STABLE

LangChain v0.0.242 adds AgentExecutorIterator, HuggingGPT, ArangoDB graph QA, Etherscan loader, LocalAI embeddings, and async transform chain support.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.242 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.242
  • Adds AgentExecutorIterator to enable step-by-step iteration over agent execution, allowing callers to inspect or react to intermediate agent steps programmatically.
  • Adds async support for TransformChain, enabling non-blocking use in async pipelines.
  • Adds SelfQueryRetriever support for DeepLake vector store.
  • Adds ArangoDB/AQL support to the Graph QA Chain via a new ArangoGraphQAChain integration.
  • Adds EtherscanLoader document loader for pulling on-chain data into LangChain pipelines.
+7 moreshow less
  • Adds LocalAIEmbeddings for generating embeddings via a locally hosted LocalAI instance.
  • Adds a hybrid retriever that requires no external service, combining dense and sparse retrieval locally.
  • Adds HuggingGPT integration for multi-model task orchestration via Hugging Face models.
  • Adds stop sequence support to the Replicate LLM integration.
  • Extends Cube Semantic Loader with additional functionality for richer semantic layer queries.
  • Adds GPU and language setting controls to the NLP Cloud LLM integration.
  • Adds filter parameter support to the Supabase vector store query, aligning with current Supabase API.
└──▷ BREAKING ON UPGRADE
  • !The default value of with_history for ChatGLM is changed to False.
v0.0.2 NOTES STABLE

LangChain v0.0.2 adds LlamaAPI integration and prompt ergonomics improvements.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.2 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.2
  • Adds LlamaAPI as a supported LLM integration.
  • Improves prompt ergonomics for building prompt templates.
v0.0.1 NOTES STABLE

LangChain v0.0.1 adds MultiOn client toolkit and kwargs support for Baseten models.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.1 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.1
  • Adds kwargs support for Baseten models, enabling pass-through of arbitrary keyword arguments at inference time.
  • Introduces the MultiOn client toolkit for browser-automation agent workflows.
  • Sets up a dedicated experimental package with its own release action for incubating new capabilities separately from the stable library.
v0.0.240 NOTES STABLE

LangChain v0.0.240 adds the MultiOn client toolkit, kwargs support for Baseten models, and a new experimental package.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.240 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.240
  • Adds kwargs support for Baseten models, allowing arbitrary keyword arguments to be passed through to the model.
  • Adds the MultiOn client toolkit, enabling browser-automation agent capabilities via MultiOn.
  • Introduces a new experimental package/module as a separate release target for cutting-edge, pre-stable features.
v0.0.1rc3 NOTES STABLE

LangChain v0.0.1rc3 adds kwargs support for Baseten models and sets up a new experimental package.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.1rc3 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.1rc3
  • Adds kwargs support for Baseten models, enabling pass-through of arbitrary model parameters at invocation time.
  • Sets up a new experimental package and release action, establishing a separate distribution surface for experimental LangChain features.
v0.0.240rc1 NOTES STABLE

LangChain v0.0.240rc1 adds kwargs support for Baseten models and sets up a new experimental module.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.240rc1 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.240rc1
  • Adds kwargs support for Baseten models, enabling pass-through of additional parameters at invocation time.
  • Sets up a new experimental package/module with its own release action, separating experimental features from the main library.
v0.0.1rc1 NOTES STABLE

LangChain v0.0.1rc1 adds kwargs support for Baseten models and sets up an experimental module.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.1rc1 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.1rc1
  • Adds kwargs support for Baseten models, enabling pass-through of arbitrary keyword arguments.
  • Sets up a new experimental package/module with its own release action, providing a dedicated space for experimental features.
v0.0.1rc0 NOTES STABLE

LangChain v0.0.1rc0 adds kwargs support for Baseten models and sets up an experimental package.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.1rc0 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.1rc0
  • Adds kwargs support for Baseten models, enabling pass-through of additional model parameters at call time.
  • Sets up a new experimental package/module as a dedicated home for experimental LangChain features.
v0.0.240rc0 NOTES STABLE

LangChain v0.0.240rc0 adds kwargs support for Baseten models and sets up an experimental module.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.240rc0 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.240rc0
  • Adds kwargs support for Baseten models, enabling pass-through of arbitrary keyword arguments to the underlying model.
  • Sets up a new experimental package/module, introducing a dedicated space for experimental LangChain features.
v0.0.239 NOTES STABLE

LangChain v0.0.239 adds Neptune graph QA chain, Predibase LLM, GitHub toolkit, async Qdrant, and Replicate streaming

└──▷ GET THIS VERSION
$ git clone --branch v0.0.239 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.239
  • Adds NeptuneGraph integration and an openCypher QA chain for querying Amazon Neptune graph databases.
  • Adds Predibase as a new LLM provider integration.
  • Adds a GitHub toolkit for agent-based interactions with GitHub repositories.
  • Adds with_history option for the ChatGLM integration to enable conversation history support.
  • Adds async support to Qdrant local mode, enabling non-blocking vector store operations.
+5 moreshow less
  • Adds streaming support to the Replicate LLM integration.
  • Adds an async HTML loader and HTML2Text transformer for non-blocking document ingestion.
  • Exposes the generated SQL command directly from SQLDatabaseChain, allowing callers to inspect the query without parsing output.
  • Adds embedding and vector store provider info as run tags for improved tracing and observability.
  • Adds new fields to the Metaphor search integration.
v0.0.238 NOTES STABLE

LangChain v0.0.238 adds NLP Cloud embeddings, Amadeus travel tools, Golden Query Tool, Portkey LLMOps, and a GeoDataFrame document loader.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.238 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.238
  • Adds endpoint_url parameter to embeddings/bedrock.py, enabling custom Bedrock endpoint targeting.
  • Adds openai_api_model attribute to Doctran models for explicit model selection.
  • Integrates NLP Cloud embeddings endpoint as a new embeddings provider.
  • Adds Geopandas.GeoDataFrame document loader for ingesting geospatial data.
  • Adds Amadeus Flight and Travel Search Tool for querying live flight and travel data.
+5 moreshow less
  • Adds Golden Query Tool integration for knowledge graph-backed question answering.
  • Adds Portkey LLMOps integration for LLM observability and monitoring.
  • Adds llama-v2 support to local document QA workflows.
  • Adds Google Place ID to the Google Places tool response payload.
  • Adds Datadog-LangChain integration documentation and support.
v0.0.236 NOTES STABLE

LangChain v0.0.236 adds MLflow AI Gateway integration, Google Cloud Enterprise Search retriever, and Weaviate score exposure.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.236 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.236
  • Adds text_content kwarg to BrowserlessLoader to control content extraction behavior.
  • Adds WeaviateHybridSearchRetriever option to expose relevance scores in results.
  • Exposes Kendra result item DocumentAttributes in document metadata for richer retrieval context.
  • Adds new Google Cloud Enterprise Search retriever integration.
  • Adds integration for MLflow AI Gateway as an LLM/chat model backend.
+8 moreshow less
  • Adds optional post-processing support for Unstructured loaders.
  • Adds metadata and page_content filters for documents in AwaDB vector store.
  • Allows additional params to be passed through to OpenAIEmbeddings.
  • Allows chat models that do not return token usage to work without errors.
  • Implements 'Lost in the Middle' document reordering for long-context retrievers, placing most relevant documents at the beginning and end of context.
  • Updates Azure OpenAI API version default to 2023-05-15.
  • Adds compatibility with Azure OpenAI API version 2023-07-01-preview.
  • Upgrades ChromaDB dependency to 0.4.0.
v0.0.235 NOTES STABLE

LangChain v0.0.235 adds Xorbits agent, Redis Sentinel support, ChatGLM2-6B LLM, BM25 retriever, and Claude v2 integration.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.235 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.235
  • Adds BM25 retrieval module for sparse keyword-based document retrieval.
  • Supports Redis Sentinel database connections for high-availability Redis setups.
  • Adds Xorbits agent for data analysis workflows using the Xorbits framework.
  • Adds LLM integration for ChatGLM(2)-6B API, enabling use of the ChatGLM family of models.
  • Updates Anthropic integration to support claude-v2 model.
v0.0.234 NOTES STABLE

LangChain v0.0.234 adds Rockset loader, GPT4All embeddings, async Qdrant, Google Images search, and HuggingFace truncation support.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.234 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.234
└──▷ USE IT
Generate embeddings locally with GPT4All as a drop-in replacement for cloud embedding providers.
python
from langchain.embeddings import GPT4AllEmbeddings

embeddings = GPT4AllEmbeddings()
vectors = embeddings.embed_documents(["document one", "document two"])
  • Adds truncate argument to HuggingFaceTextGenInference class to control text truncation behavior.
  • Implements async API for the Qdrant vector store, enabling non-blocking operations.
  • Integrates Rockset as a new document loader.
  • Adds GPT4All embeddings support.
  • Adds Google Images search support as a new tool.
+1 moreshow less
  • Improves the MediaWiki document loader with additional capabilities and unit tests.
v0.0.233 NOTES STABLE

LangChain v0.0.233 adds Azure AD token auth, Tongyi Qwen LLM, ElasticsearchDatabaseChain, and a Browserless loader.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.233 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.233
  • Adds ElasticsearchDatabaseChain for natural-language interaction with Elasticsearch analytics databases.
  • Enables Azure Active Directory token-based authentication for OpenAI completions access.
  • Adds LLM integration for Alibaba DAMO Academy's Tongyi Qwen API.
  • Adds browserless document loader for headless browser-based web scraping.
  • Adds document limit support to AzureCognitiveSearchRetriever.
+7 moreshow less
  • Adds async load function to PlaywrightURLLoader, matching its sync counterpart.
  • Supports passing auth objects in TextRequestsWrapper for authenticated HTTP requests.
  • Enables nesting of chain groups for more composable chain structures.
  • Adds few-shot examples support for VertexAI chat models.
  • Adds batch text embedding support for Weaviate vector store.
  • Normalizes trajectory evaluation scores in the trajectory eval component.
  • Makes recursive URL loader yield results incrementally while crawling.
v0.0.231 NOTES STABLE

LangChain v0.0.231 adds Kobold AI LLM wrapper, chat_history support, Qdrant collection reuse, and custom Bedrock endpoint URLs.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.231 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.231
  • Adds custom endpoint URL support to bedrock.py, enabling users to point the Bedrock integration at non-default or private endpoints.
  • Adds chat_history support to the relevant chain/agent components.
  • Adds finish_reason to generation info in ChatOpenAI responses.
  • Adds new LLM wrapper for Kobold AI, expanding the set of supported local model backends.
  • Reuses an existing Qdrant collection when configured properly in Qdrant.from_texts, avoiding unnecessary re-creation.
+1 moreshow less
  • Adds supported properties for NotionDB document loader metadata fields.
v0.0.230 NOTES STABLE

LangChain v0.0.230 adds CPAL chain, Pinecone V4 support, and 'generate' early stopping for OpenAIFunctionsAgent.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.230 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.230
  • Supports generate as an early stopping method for OpenAIFunctionsAgent, giving more control over agent termination behavior.
  • Adds Pinecone V4 support to the Pinecone vector store integration.
  • Introduces CPAL (Causal Program-Aided Language) chain as a new reasoning chain type.
v0.0.229 NOTES STABLE

LangChain v0.0.229 adds new loaders, ZepMemory, spaCy sentencizer, and MMR search for MongoDB Atlas.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.229 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.229
  • Adds ids parameter to ElasticVectorSearch.from_texts method for caller-supplied document IDs.
  • Adds UnstructuredTSVLoader for loading TSV files as documents.
  • Adds ZepMemory class with improved metadata handling in ZepChatMessageHistory.
  • Adds max_marginal_relevance_search method to MongoDBAtlasVectorSearch for MMR-based retrieval.
  • Adds spaCy sentencizer text splitter integration.
+3 moreshow less
  • Adds async chain support for CTransformers LLM backend.
  • Adds Xorbits DataFrame document loader.
  • Adds Datadog Logs document loader.
v0.0.228 NOTES STABLE

LangChain v0.0.228 adds clustering-based embeddings filter, string/embedding evaluators, JinaChat, and a Context callback handler.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.228 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.228
└──▷ USE IT
Return only a raw JSON schema from a structured output parser, useful when feeding the schema directly to another system.
python
from langchain.output_parsers import StructuredOutputParser, ResponseSchema

parser = StructuredOutputParser.from_response_schemas([
    ResponseSchema(name='answer', description='The answer to the question')
])
print(parser.get_format_instructions(only_json=True))
  • Adds EmbeddingsFilter using clustering to reduce redundant vectors in retrieval pipelines ('The Fellowship of the Vectors' embeddings filter).
  • Adds StringDistanceEvalChain and EmbeddingDistanceEvalChain evaluators for programmatic run evaluation.
  • Adds load_run_evaluator and a single-run eval loader to support LangSmith-style evaluation workflows.
  • Supports filters and namespaces in Pinecone similarity_score_threshold similarity search.
  • Adds OpenAIWhisperParser support for passing an api_key argument directly.
+6 moreshow less
  • Adds a verbose parameter to the LlamaCpp integration.
  • Adds a callback handler for Context (getcontext.ai) to enable conversation analytics.
  • Integrates JinaChat as a new chat model provider.
  • Allows passing custom prompts to GraphIndexCreator.
  • Adds requires_reference as an explicitly listed parameter in evaluator functions.
  • Adds a only_json parameter to get_format_instructions on structured output parsers to return only the JSON schema.
v0.0.226 NOTES STABLE

LangChain v0.0.226 adds HumanInputChatModel, Agent Trajectory evaluation, Load Evaluator, and a generic OpenAI function chain.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.226 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.226
└──▷ USE IT
Evaluate every step an agent took on a task, not just the final answer, using the new trajectory interface.
python
from langchain.evaluation import load_evaluator

evaluator = load_evaluator('trajectory')
result = evaluator.evaluate_agent_trajectory(
    input='What is the capital of France?',
    agent_trajectory=trajectory,
    prediction=final_answer
)
print(result)
Limit how many DataFrame rows the pandas agent sees to reduce token usage on large datasets.
python
from langchain.agents import create_pandas_dataframe_agent
from langchain.llms import OpenAI
import pandas as pd

df = pd.read_csv('data.csv')
agent = create_pandas_dataframe_agent(OpenAI(temperature=0), df, number_of_head_rows=3)
agent.run('Which column has the most null values?')
Use HumanInputChatModel to manually drive a chain during local debugging without calling a live LLM.
python
from langchain.chat_models import HumanInputChatModel
from langchain.schema import HumanMessage

chat = HumanInputChatModel()
response = chat([HumanMessage(content='Summarize the risks in this contract.')])
print(response.content)
  • Adds number_of_head_rows parameter to the pandas agent, letting callers control how many rows are shown to the agent for context.
  • Adds HumanInputChatModel, a chat model implementation that accepts input from a human at the terminal — useful for testing and debugging chains interactively.
  • Adds Agent Trajectory Interface for evaluating the full sequence of actions an agent takes, not just its final output.
  • Adds Load Evaluator utility to instantiate evaluators by name at runtime without manually constructing them.
  • Adds a generic OpenAI function chain, enabling structured function-calling workflows without writing a custom chain.
+7 moreshow less
  • Adds elasticknn to the vector store init exports, making ElasticKNN available via the standard LangChain import path.
  • Adds vector similarity search with scores to the Chroma vector store.
  • Adds Re-use Trajectory Evaluator support, allowing a single trajectory evaluator instance to be applied across multiple runs.
  • Adds automatic retry logic for Vertex LLM calls to handle transient API errors.
  • Adds preset parameter to the TextGen LLM integration, allowing a named preset to be passed at invocation time.
  • Enables PromptLayerChatOpenAI to support function call parameters, bringing it to parity with the base OpenAI chat model.
  • Adds function call params to LLM invocation params so they are captured in run metadata and callbacks.
v0.0.225 NOTES STABLE

LangChain v0.0.225 adds pg_hnsw, SPARQL, Marqo, TruLens, DataForSEO, Cube, and custom run metadata support.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.225 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.225
  • Adds token_max parameter to control maximum token usage in map-reduce document combination chains.
  • Supports adding custom metadata to runs via the runs API, enabling richer observability tagging.
  • Adds tags support for LangChainTracer, including a dedicated eval tag for evaluator runs.
  • Adds pg_hnsw vector store integration for PostgreSQL HNSW-based similarity search.
  • Adds SPARQL support for graph database queries.
+11 moreshow less
  • Adds TruLens integration for LLM observability and evaluation.
  • Adds DataForSEO integration as a new tool/retriever.
  • Adds SceneXplain integration.
  • Adds Marqo as a new vector store backend.
  • Adds a document loader for the Cube Semantic Layer.
  • Adds concurrency support to GitbookLoader for faster document loading.
  • Adds serialized object to the retriever start callback, improving tracing fidelity.
  • Implements delete interface on the AnalyticDB vector store.
  • Enables InMemoryDocstore to be constructed without providing an initial dictionary.
  • Adds progress bar (tqdm) to embedding operations for visibility into long-running batch calls.
  • Marks additional output parsers as serializable, aligning with the LangChain JS implementation.
v0.0.224 NOTES STABLE

LangChain v0.0.224 adds async support for the Python REPL tool and updated SingleStore connection attributes.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.224 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.224
  • Adds arun async method to the Python REPL tool, enabling non-blocking code execution in async chains.
  • Updates SingleStoreVectorStore to support changing connection attributes in the database connection.
v0.0.223 NOTES STABLE

LangChain v0.0.223 adds HugeGraphQAChain for Gremlin graph queries and tags/events to callback/tracer infrastructure.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.223 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.223
  • Adds HugeGraphQAChain to support Gremlin-based graph query generation and QA over HugeGraph.
  • Adds tags to all callback handler methods, enabling richer filtering and routing of callback events.
  • Adds events to tracer runs, surfacing finer-grained lifecycle data in traces.
  • Uses serialized format for messages in the tracer, improving structured message representation in trace output.
v0.0.222 NOTES STABLE

LangChain v0.0.222 adds Brave Search loader, JSON Lines support, SpacyEmbeddings, and Pinecone filter-delete

└──▷ GET THIS VERSION
$ git clone --branch v0.0.222 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.222
└──▷ USE IT
Ingest a JSON Lines file into a vector store using the updated JSONLoader.
python
from langchain.document_loaders import JSONLoader

loader = JSONLoader(file_path='events.jsonl', jq_schema='.text', json_lines=True)
docs = loader.load()
  • Adds filter and delete-all options to the Pinecone integration's delete function, and updates the base VectorStore delete interface to match.
  • Adds JSON Lines support to JSONLoader, enabling ingestion of .jsonl files alongside standard JSON.
  • Adds BraveSearch document loader for pulling Brave Search results into the document pipeline.
  • Adds SpacyEmbeddings class for generating embeddings using spaCy models.
  • Vectara integration updated with new capabilities.
v0.0.221 NOTES STABLE

LangChain v0.0.221 adds Arthur, PromptLayer, and Flyte callback handlers, Zep auth, attachment support in UnstructuredEmailLoader, and a new Retriever interface with callbacks.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.221 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.221
  • Enables UnstructuredEmailLoader to process email attachments, expanding document ingestion beyond the email body itself.
  • Adds Arthur callback handler for tracking and monitoring LLM runs via the Arthur platform.
  • Adds PromptLayer callback handler for logging and observability through PromptLayer.
  • Adds Flyte callback handler for integrating LangChain runs into Flyte pipelines.
  • Adds authentication support to the Zep memory integration.
+2 moreshow less
  • Introduces a new Retriever interface with callback support, enabling observability hooks throughout retrieval.
  • Adds parameter support on GoogleSearchApiWrapper for customizing search queries.
Was this useful?
◆  Local LLM Runtimes

KoboldCpp

Sources Release notes → v1.37.1a 4 RELEASES · 2023-07-07 → 2023-07-24 NOTES STABLE

KoboldCpp v1.37.1 adds an embedded Horde Worker, LLAMA2 70B support, and exposes --tensor_split for CUDA multi-GPU use.

└──▷ GET THIS VERSION
$ git clone --branch v1.37.1a https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.37.1a
└──▷ TRY IT
Share your local GGML model with the AI Horde without any extra software — the worker runs in the background alongside normal inference.
$ koboldcpp.exe --model mymodel.gguf --hordeconfig 'MyHordeModel' 512 2048 'my-api-key-here' 'MyWorkerName'
Retrieve per-generation performance details including stopping reason and token counts from the API.
$ curl http://localhost:5001/api/extra/perf
  • Extends --hordeconfig to accept 5 parameters — [hordemodelname] [hordegenlength] [hordemaxctx] [hordeapikey] [hordeworkername] — which starts an embedded AI Horde worker that serves requests automatically in the background, eliminating the need for separate tools like HaidraScribe/KAIHordeBridge.
  • Exposes --tensor_split for splitting model layers across multiple CUDA GPUs, matching upstream behavior.
  • Retains --blasbatchsize 1024 support after it was removed upstream (note: scratch and KV buffer sizes will be larger when used).
  • Adds LLAMA2 70B model support, with GQA automatically set to 8 upon detection.
  • Adds additional fields to /api/extra/perf response, including stopping reason and generated token counts for the last generation.
+1 moreshow less
  • Adds experimental Kepler architecture (e.g. K80) as a CUDA build target.
3 more releases in this issue · 2023-07-07 → 2023-07-24
v1.36 NOTES STABLE

KoboldCpp v1.36 replaces --linearrope with --ropeconfig for unified RoPE tuning and exposes new perf data via /api/extra/perf.

└──▷ GET THIS VERSION
$ git clone --branch v1.36 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.36
└──▷ TRY IT
Run LLAMA2 at native 4K context without any RoPE scaling, taking full advantage of the model's built-in tuning.
$ koboldcpp.exe --model llama2-7b.gguf --contextsize 4096 --ropeconfig 1.0 10000
Extend context beyond the model's native limit using 2x linear RoPE scaling.
$ koboldcpp.exe --model llama2-7b.gguf --contextsize 8192 --ropeconfig 0.5 10000
Query per-request token counter and performance metrics from the API for monitoring throughput.
$ curl http://localhost:5001/api/extra/perf
  • Adds --ropeconfig <scale> <base> CLI argument to control both RoPE frequency scale (Linear) and RoPE frequency base (NTK-Aware) in a single flag, replacing the removed --linearrope flag — e.g. --ropeconfig 0.5 10000 for 2x linear scale or --ropeconfig 1.0 10000 for native LLAMA2 4K tuning.
  • Exposes additional token counter data through the API endpoint /api/extra/perf.
  • Automatically configures long-context NTK-Aware RoPE based on the --contextsize parameter by default, with no manual tuning required.
  • Adds --ropeconfig support in the GUI for ease of use.
  • Updates Kobold Lite with improved whitespace trim support and a new toggle for partial chat responses.
└──▷ BREAKING ON UPGRADE
  • !The --linearrope flag has been removed; replace it with --ropeconfig <scale> <base> (e.g. --ropeconfig 0.5 10000 for equivalent 2x linear scaling).
v1.35 NOTES STABLE

KoboldCpp v1.35 adds CUDA 8-bit MMV acceleration, a new /api/extra/perf endpoint, and --linearrope context scaling.

└──▷ GET THIS VERSION
$ git clone --branch v1.35 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.35
└──▷ TRY IT
Run a SuperHOT fine-tuned model with linear RoPE scaling to match its recommended 0.25 scale at 8K context.
$ koboldcpp.exe --model superhot-13b.gguf --linearrope --contextsize 8192
Poll real-time prompt-processing and generation timing from a running instance to benchmark throughput.
$ curl http://localhost:5001/api/extra/perf
  • Adds --linearrope launch parameter to enable linear RoPE scaling (using 2048 as base) as an alternative to NTK-Aware RoPE; combine with --contextsize 8192 for a 0.25 linear scale suited to SuperHOT models.
  • Exposes prompt-processing and generation timing via new API endpoint GET /api/extra/perf.
  • Enables CUDA 8-bit MMV mode (quantized dot products) for formats q4_0, q4_1, q5_0, and q5_1, delivering significant GPU throughput gains when full GPU offload is used; K-quants and CL are unaffected.
  • Adds Save and Load settings options to the GUI launcher.
  • Adds 'All Devices' selection in the GUI for CUDA multi-GPU configurations.
+1 moreshow less
  • Displays a warning when poor sampler orders are detected, nudging users toward the default configuration.
v1.34.2 NOTES STABLE

KoboldCpp v1.34.2 adds NTK-aware RoPE scaling to 8K context, --bantokens, per-generation sampler_order/mirostat, and a new customtkinter GUI.

└──▷ GET THIS VERSION
$ git clone --branch v1.34.2 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.34.2
└──▷ TRY IT
Block unwanted tokens globally — useful when a model repeatedly abuses specific characters or substrings.
$ koboldcpp.exe --model mymodel.ggml --contextsize 4096 --bantokens [ a ooo
Route inference to a specific GPU (e.g. the third card) in a multi-GPU rig while staying in low-VRAM mode.
$ koboldcpp.exe --model mymodel.ggml --usecublas lowvram 2 --contextsize 8192
Use per-generation mirostat sampling via the /generate API instead of global defaults.
$ curl -X POST http://localhost:5001/api/v1/generate -H 'Content-Type: application/json' -d '{"prompt": "Once upon a time", "mirostat": 2, "mirostat_tau": 5.0, "mirostat_eta": 0.1, "sampler_order": [6,0,1,3,4,2,5]}'
  • Adds --bantokens CLI flag to block a list of token substrings from being generated — e.g. --bantokens [ a ooo bans all tokens matching those substrings.
  • Adds --usecublas lowvram <index> syntax for selecting a specific GPU by index when using CUDA multi-GPU setups.
  • Adds sampler_order and mirostat/tau/eta parameters to the /generate API, settable per-generation request.
  • Switches RoPE scaling to NTK-aware method driven by the existing --contextsize parameter, with support up to 8K context.
  • Extends NTK-aware scaled RoPE support to GPT-NeoX and GPT-J model architectures, enabling longer context (e.g. 4K) on older models.
+3 moreshow less
  • Adds 3K and 6K as selectable context size options alongside existing sizes.
  • Adds a new customtkinter-based GUI with more configurable settings; requires the customtkinter Python module on Linux and macOS (bundled in Windows .exe builds).
  • Kobold Lite now displays submitted contexts after each generation and adds two new scenarios plus limited Tavern v2 card support.
Was this useful?

LocalAI

Sources Release notes → v1.23.0 3 RELEASES · 2023-07-16 → 2023-07-29 NOTES STABLE

LocalAI v1.23.0 adds rope settings, negative prompt support, and stream cancellation when clients disconnect.

└──▷ GET THIS VERSION
$ git clone --branch v1.23.0 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v1.23.0
  • Adds rope settings and negative prompt support to model configuration, replacing the grammar backend.
  • Cancels stream generation automatically when a streaming client disconnects, freeing backend resources.
└──▷ BREAKING ON UPGRADE
  • !The grammar backend has been dropped; configurations relying on it will break on upgrade.
2 more releases in this issue · 2023-07-16 → 2023-07-29
v1.22.0 NOTES STABLE

LocalAI v1.22.0 adds a new llama-master backend, JSONSchema ref resolution for planners, and a Llama 2 chat message template.

└──▷ GET THIS VERSION
$ git clone --branch v1.22.0 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v1.22.0
  • Adds the llama-master backend for running llama.cpp models via the latest upstream llama.cpp code.
  • Adds a chat message template for Llama 2 models to correctly format multi-turn conversation prompts.
  • Improves backend internals with general backends improvements in this release.
└──▷ BREAKING ON UPGRADE
  • !The backend formerly named llama-master is renamed to llama; the backend formerly named llama is renamed to llama-grammar — any model config or API calls referencing these backend names must be updated.
v1.21.0 NOTES STABLE

LocalAI v1.21.0 adds gRPC backends, LocalAI functions, Falcon model support, and verbose_json transcription.

└──▷ GET THIS VERSION
$ git clone --branch v1.21.0 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v1.21.0
  • Adds gRPC-based backends, enabling a new extensible backend architecture for model serving.
  • Adds support for Falcon 7B and 40B models via ggllm.cpp.
  • Adds LocalAI functions capability for function-calling workflows.
  • Adds partial support for verbose_json format in the transcribe endpoint (Whisper).
Was this useful?

oobabooga's Text Generation WebUI (textgen)

Sources Release notes → v1.5 5 RELEASES · 2023-07-12 → 2023-07-26 NOTES STABLE

oobabooga text-generation-webui v1.5 adds a new extension hook, automatic instruction templates, and drops FlexGen support.

└──▷ GET THIS VERSION
$ git clone --branch v1.5 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v1.5
  • Introduces chat_input_modifier extension function in extensions/example/script.py as the replacement for the deprecated input_hijack hook.
  • Switches to the dark theme as the new default UI appearance.
  • Removes FlexGen backend support, which has been made obsolete by llama.cpp and 4-bit quantization.
  • Adds a detailed extension authoring example at extensions/example/script.py with updated extension documentation.
└──▷ BREAKING ON UPGRADE
  • !input_hijack is deprecated in favour of chat_input_modifier; existing extensions using input_hijack will need to migrate to the new function.
  • !FlexGen support is removed; any setup relying on the FlexGen backend will no longer work after upgrading.
4 more releases in this issue · 2023-07-12 → 2023-07-26
v1.4 NOTES STABLE

oobabooga textgen v1.4 adds llama-2-70b GGML support and expands OpenAI extension with images and logit_bias/logprobs.

└──▷ GET THIS VERSION
$ git clone --branch v1.4 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v1.4
  • OpenAI extension gains support for logit_bias and logprobs parameters, image handling, embeddings, and token endpoints — with improved error reporting and updated docs.
  • Adds llama-2-70b GGML model support.
  • Bumps exllama module to 0.0.8 with expanded LoRA support.
  • Bumps bitsandbytes to 0.41.0 for faster inference speeds.
v1.3 NOTES STABLE

oobabooga textgen v1.3 adds Llama-v2 support, customizable RoPE for GGML, and LoRA loading via AutoGPTQ 0.3.0.

└──▷ GET THIS VERSION
$ git clone --branch v1.3 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v1.3
  • Adds Llama-v2 instruction template with auto-detection of truncation length.
  • Adds customizable RoPE (Rotary Position Embedding) support for GGML models.
  • Adds Airoboros-v1.2 instruction template.
  • AutoGPTQ updated to 0.3.0, enabling LoRA loading out of the box for GPTQ models.
  • LoRA menu selection is now preserved when loading a model (no longer reset on model load).
+1 moreshow less
  • Disables 'Autoload the model' by default, and disables auto-loading at startup even when only one model is available.
└──▷ BREAKING ON UPGRADE
  • !The 'Autoload the model' setting is now disabled by default; setups that relied on automatic model loading at startup will need to re-enable it manually.
v1.2 NOTES STABLE

v1.2 adds a llamacpp_HF loader, exllama perplexity evaluation, logits processor support in extensions, and token probability/perplexity colorization.

└──▷ GET THIS VERSION
$ git clone --branch v1.2 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v1.2
  • New llamacpp_HF loader adds a llama.cpp backend variant compatible with the Hugging Face tokenizer interface.
  • Extensions can now register custom logits processors, enabling token-level generation control from extension code.
  • Enables perplexity evaluation for models loaded with the exllama backend.
  • Increases the alpha value limit for NTK RoPE scaling on exllama and exllama_HF loaders, supporting longer context extrapolation.
  • New 'Color tokens by probability and/or perplexity' extension visualizes per-token generation confidence in the UI.
v1.1 NOTES STABLE

oobabooga text-generation-webui v1.1 adds low-VRAM llama.cpp mode, token auth for model downloads, and TensorBoard/W&B training integration.

└──▷ GET THIS VERSION
$ git clone --branch v1.1 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v1.1
  • Adds low VRAM mode support to the llama.cpp module for running larger models on constrained hardware.
  • Adds token authorization for downloading models, enabling authenticated access to gated or private model repositories.
  • Adds context_instruct field to the API and loads the default model instruction template automatically.
  • Expands models/config.yaml with entries for platypus/gplatty, longchat, vicuna-33b, Redmond-Hermes-Coder, wizardcoder, and additional models.
  • Adds TensorBoard and Weights & Biases integration for monitoring training runs.
+6 moreshow less
  • Adds default environment variable values to the Docker Compose file for easier out-of-box deployment.
  • Adds ability to load all text files from a subdirectory for training datasets.
  • Adds a feature to log a sample of the training dataset for inspection during fine-tuning.
  • Chat history downloads now generate more detailed file names.
  • Disables wandb remote HTTP requests by default.
  • --load-in-4bit quantization is significantly faster following a bitsandbytes Windows wheel update.
Was this useful?

vLLM

Sources Release notes → v0.1.2 NOTES

vLLM v0.1.2 adds GPTBigCode, MPT, and BLOOM model support plus a ChatCompletion endpoint in the OpenAI demo server.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.2 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.1.2
  • Adds ChatCompletion endpoint to the OpenAI-compatible demo server, enabling chat-style API interactions.
  • Adds support for GPTBigCode models.
  • Adds support for MPT and BLOOM models.
  • Supports custom tokenizers.
Was this useful?
◆  AI Model & Data Infrastructure

Ollama

Sources Release notes → v0.0.12 3 RELEASES · 2023-07-11 → 2023-07-26 NOTES STABLE

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Ollama v0.0.12 adds ollama cp for renaming models, k-quant support, and localhost CORS access for its API.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.12 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.0.12
  • Adds support for running k-quant models.
  • ollama create now automatically pulls models referenced in a FROM instruction that are not available locally.
  • Enables Apple Accelerate framework for performance improvements.
  • Ollama's API now accepts requests from websites hosted on localhost (CORS support).
2 more releases in this issue · 2023-07-11 → 2023-07-26
v0.0.11 NOTES STABLE

Ollama v0.0.11 adds ollama list and ollama rm subcommands plus checksum verification on ollama pull.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.11 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.0.11
└──▷ TRY IT
Audit local model storage to see what is taking up disk space before deciding what to remove.
$ ollama list
Free up disk space by removing a model you no longer need.
$ ollama rm llama2:13b
  • New ollama list subcommand displays all locally downloaded models with their size and last-modified time.
  • New ollama rm subcommand deletes a locally stored model by name.
  • The ollama pull subcommand now verifies downloaded model integrity against its checksum.
v0.0.3 NOTES STABLE

Ollama v0.0.3 adds larger prompt support, better error reporting, and moves logs to ~/.ollama/logs

└──▷ GET THIS VERSION
$ git clone --branch v0.0.3 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.0.3
  • Logs are now written to ~/.ollama/logs for easier debugging and audit.
  • ollama run now supports a larger prompt, removing a previous size constraint.
  • ollama run now prints better errors when a problem is encountered.
  • Much faster performance across the board.
Was this useful?

NVIDIA Triton Inference Server

Sources Release notes → v2.36.0 NOTES

Triton v2.36.0 adds PyTorch implicit state, TF SavedModel direct serving, OpenTelemetry ensemble tracing, DLPack CUDA shared memory, Java bindings, and S3 repo scaling past 1000 files.

└──▷ GET THIS VERSION
$ git clone --branch v2.36.0 https://github.com/triton-inference-server/server.git
# already have the repo? check out this version:
$ git checkout v2.36.0
  • Adds model loading APIs to python_backend for BLS (Business Logic Scripting) usage.
  • Supports direct serving of TensorFlow SavedModel via python_backend without a dedicated TF backend.
  • Supports unpacked Conda execution environments in python_backend for custom dependency management.
  • Adds DLPack tensor support to Triton Python client CUDA shared memory utilities.
  • Adds implicit state management to pytorch_backend.
+3 moreshow less
  • Extends OpenTelemetry trace mode to cover ensemble model tracing.
  • Adds Java binding of the Triton in-process C++ API via javacpp-presets.
  • Supports S3 model repositories containing more than 1000 files.
Was this useful?
Other / Uncategorized
◆  AI OBSERVABILITY

Arize Phoenix

Sources Release notes → 0.0.30 2 RELEASES · 2023-07-11 → 2023-07-26 NOTES STABLE

Arize Phoenix 0.0.30 adds RAG retrieval troubleshooting with corpus datasets, distance metrics, and visual retrieval overlays in the point cloud.

└──▷ GET THIS VERSION
$ git clone --branch 0.0.30 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout 0.0.30
└──▷ USE IT
Construct a Phoenix dataset directly from an OpenInference-formatted dataframe, skipping manual schema wiring.
python
import phoenix as px

ds = px.Dataset.from_open_inference(open_inference_df)
px.launch_app(primary=ds)
  • Adds phoenix.Dataset.from_open_inference class method to construct datasets directly from OpenInference-formatted data.
  • Supports passing a knowledge base as a corpus dataset so Phoenix can inspect how a retrieval system queries for relevant documents in a vector store.
  • Automatically computes Euclidean distance between query and document embeddings as a retrieval metric, surfaced as a time-series view.
  • Renders retrieval connection lines in the UMAP point cloud, visually overlaying which vector store clusters the retriever pulls from.
  • Displays corpus points as octahedrons in the 3D point cloud to distinguish them from primary dataset points.
+4 moreshow less
  • Shows per-query corpus coverage percentage ('% query') in the embeddings panel.
  • Surfaces retrieved documents and their distances in the slide-over detail panel.
  • Accepts ISO 8601 timestamps as valid input across datasets.
  • Allows string-only responses (without an accompanying embedding) to be ingested.
1 more release in this issue · 2023-07-11 → 2023-07-26
v0.0.28 NOTES STABLE

Arize Phoenix v0.0.28 adds a relationships schema and parsing for retrieval data.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.28 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout v0.0.28
  • Adds relationships schema and parsing for retrieval data, enabling structured representation of retrieval relationships in Phoenix.
Was this useful?
◆  VECTOR DB RAG

Chroma

Sources Release notes → 0.4.0 NOTES

Chroma 0.4.0 adds custom header and direct URL support for the HTTP client, plus a new SQLite backend.

└──▷ GET THIS VERSION
$ git clone --branch 0.4.0 https://github.com/chroma-core/chroma.git
# already have the repo? check out this version:
$ git checkout 0.4.0
  • Adds custom HTTP header and direct URL support when connecting to a Chroma server, enabling authenticated and proxy-friendly client configurations.
  • Introduces a SQLite-backed storage engine as a new persistence option.
Was this useful?

LanceDB

Sources Release notes → python-v0.1.16 9 RELEASES · 2023-07-06 → 2023-07-31 NOTES STABLE

LanceDB v0.1.16 adds a Pydantic ORM layer with LanceModel and to_pydantic(), plus drop_table if-exists support.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.1.16 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.1.16
└──▷ USE IT
Define a typed vector schema with Pydantic and convert similarity-search results directly back to model instances.
python
import lancedb
from lancedb.pydantic import LanceModel, vector

class Document(LanceModel):
    text: str
    vector: vector(384)

db = lancedb.connect("/tmp/mydb")
table = db.create_table("docs", schema=Document.to_arrow_schema())
table.add([Document(text="hello world", vector=[0.1] * 384)])

results = table.search([0.0] * 384).limit(5).to_pydantic(Document)
print(results)
  • Adds LanceModel base class and vector() field type from lancedb.pydantic, enabling schema generation via LanceModel.to_arrow_schema() and round-tripping search results back to Pydantic models with .to_pydantic(<ModelClass>).
  • Implements drop table if exists support.
  • Makes pandas an optional dependency in LanceDB, reducing default install size.
8 more releases in this issue · 2023-07-06 → 2023-07-31
v0.1.17 NOTES STABLE

LanceDB v0.1.17 adds Linux ARM build support for the Node.js package.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.17 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.1.17
  • Adds Linux ARM build for the Node.js package, enabling LanceDB to run on ARM-based Linux hosts.
v0.1.15 NOTES STABLE

LanceDB v0.1.15 adds Node.js remote SDK support, host override, and AWS_ENDPOINT passthrough.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.15 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.1.15
  • Passes the AWS_ENDPOINT environment variable through to storage layer, enabling custom S3-compatible endpoint configuration.
  • Adds initial Node.js remote SDK support, allowing Node clients to connect to a remote LanceDB server.
  • Implements db.TableNames() for the remote Node.js SDK, enabling table discovery against a remote instance.
  • Adds host override support in the Node.js remote SDK for directing client connections to a custom host.
python-v0.1.12 NOTES STABLE

LanceDB python-v0.1.12 passes the AWS_ENDPOINT environment variable for custom S3-compatible storage endpoints.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.1.12 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.1.12
  • Supports the AWS_ENDPOINT environment variable to direct LanceDB at custom S3-compatible storage backends (e.g. MinIO, LocalStack).
v0.1.14 NOTES STABLE

LanceDB v0.1.14 adds Windows support for the Node.js SDK and exposes table schema and version in the Rust API.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.14 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.1.14
  • Exposes table schema and version via the Rust SDK (Table now surfaces schema and version fields).
  • Adds Windows support for the Node.js SDK.
v0.1.11-python NOTES STABLE

LanceDB v0.1.11 adds remote table listing, Pydantic-to-Arrow schema conversion, and Iterator[RecordBatch] table creation

└──▷ GET THIS VERSION
$ git clone --branch v0.1.11-python https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.1.11-python
  • Supports creating a table by passing an Iterator[RecordBatch] as the data source, enabling streaming ingestion of large datasets.
  • Adds conversion of Pydantic models to Arrow Schema, letting callers define table structure with typed Python models.
  • Adds schema serialization to JSON via a new schema-to-JSON conversion path.
  • Exposes table schema and version in the Rust layer, surfacing them through the Python get table schema API.
  • Enables listing tables from a remote LanceDB service via the Python client.
+1 moreshow less
  • Supports adding records to a remote table via the Python remote API.
v0.1.13 NOTES STABLE

LanceDB v0.1.13 adds an options object to the Node.js connect method and splits Node binaries into separate packages.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.13 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.1.13
  • Adds an options object parameter to the Node.js connect method for configurable database connections.
  • Splits Node.js binaries into separate packages for leaner installs.
v0.1.10-python NOTES STABLE

LanceDB v0.1.10 adds empty table creation and changes the default write mode to error on conflict.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.10-python https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.1.10-python
  • Changes the default write mode from drop to error, so accidental overwrites now raise an error instead of silently dropping data.
  • Supports creation of an empty table without requiring initial data to be provided.
  • AWS credentials are now cached until 30 seconds before expiry, reducing redundant credential fetches in cloud-backed datasets.
└──▷ BREAKING ON UPGRADE
  • !The default write mode is changed from drop to error: existing code that relied on the silent drop-and-overwrite behavior will now raise an error on conflicting writes.
v0.1.10 NOTES STABLE

LanceDB v0.1.10 adds named vector column targeting, dot product support, IVF PQ config exposure, and WriteMode for Node table creation.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.10 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.1.10
└──▷ USE IT
Overwrite an existing index without recreating the table, useful after bulk data updates.
javascript
await table.createIndex({ replace: true });
Create or overwrite a table with explicit WriteMode to safely re-run ingestion pipelines.
javascript
const table = await db.createTable('embeddings', data, { writeMode: WriteMode.Overwrite });
  • Exposes IVF PQ index configuration in the Node.js client, letting callers tune partitioning and quantization parameters when building vector indexes.
  • Adds replace flag to the JavaScript createIndex API, allowing an existing index to be overwritten in place without dropping the table.
  • Supports WriteMode in the Node.js createTable API (re-exported from lancedb in Rust), enabling append, overwrite, or create-or-append semantics at table creation time.
  • Supports specifying a named vector column for vector search, so tables with multiple vector columns can target the correct one explicitly.
  • Adds dot product distance metric support in the JavaScript/Node.js client for vector similarity search.
+1 moreshow less
  • Makes the object store construction hook public, enabling custom storage backend injection.
Was this useful?

Milvus

Sources Release notes → v2.2.12 NOTES

Milvus 2.2.12 adds high-level RESTful APIs, vector retrieval by ID, json_contains filtering, and GCS/OSS access-key support.

└──▷ GET THIS VERSION
$ git clone --branch v2.2.12 https://github.com/milvus-io/milvus.git
# already have the repo? check out this version:
$ git checkout v2.2.12
  • Adds a high-level RESTful API that listens on the same port as gRPC, simplifying client-side operations (note: a token must be set even when authentication is disabled).
  • Adds json_contains expression support for filtering on JSON fields in searches and queries.
  • Enables bulk-insert to support partition keys.
  • Enables the chunk manager to use GCS and OSS object storage with an access key.
  • Adds minCPUParallelTaskNumRatio config to improve parallelism when a single task's estimated CPU usage exceeds total CPU capacity.
+5 moreshow less
  • Supports setting the vector field as an output field in ANN searches and queries against HNSW-, DiskANN-, or IVF-FLAT-indexed collections.
  • Makes compaction RPC timeout and maximum parallelism configurable.
  • Writes cache files to the cacheStorage.rootpath directory.
  • Adds a PK index for string data types, improving query performance on string primary keys.
  • Changes default log level to info.
Was this useful?

Qdrant

Sources Release notes → v1.3.1 NOTES

Qdrant v1.3.1 adds SIGTERM shutdown support and uses configured temp directory for snapshot uploads.

└──▷ GET THIS VERSION
$ git clone --branch v1.3.1 https://github.com/qdrant/qdrant.git
# already have the repo? check out this version:
$ git checkout v1.3.1
  • Supports SIGTERM signal for graceful shutdown of Qdrant.
  • Snapshot uploads now use the configured temporary directory instead of a hardcoded path.
  • Improves validation of search API requests.
Was this useful?

Weaviate

Sources Release notes → v1.20.0 NOTES

Weaviate v1.20 adds native multi-tenancy, autocut result filtering, RelativeScore fusion, two reranker modules, and PQ GA.

└──▷ GET THIS VERSION
$ git clone --branch v1.20.0 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.20.0
└──▷ TRY IT
Create a new class with multi-tenancy enabled, then add tenants so each gets a strongly isolated shard.
$ curl -X POST http://localhost:8080/v1/schema \
  -H 'Content-Type: application/json' \
  -d '{"class": "Document", "multiTenancyConfig": {"enabled": true}}'

curl -X POST http://localhost:8080/v1/schema/Document/tenants \
  -H 'Content-Type: application/json' \
  -d '[{"name": "tenant-acme"}, {"name": "tenant-globex"}]'
List all tenants in a class to audit tenant membership in a multi-tenant deployment.
$ curl http://localhost:8080/v1/schema/Document/tenants
  • Introduces native multi-tenancy with strong tenant isolation, supporting 50,000+ tenants per node and millions of tenants with billions of objects in a multi-node cluster; enable via class schema configuration.
  • Adds GET /tenants endpoint to list tenants of a multi-tenant class, plus endpoints to create and delete tenants for a specific class.
  • Supports full single-tenant object CRUD, batch operations, and batch reference operations, with tenant key immutability enforced.
  • Extends the nodes API to surface multi-tenant class information.
  • Adds multi-tenancy support to GQL Get{} and GQL Aggregate{} queries, including nearObject and nearText with tenant context.
+8 moreshow less
  • Adds replication support for multi-tenant classes.
  • Enables Prometheus metrics for classes with multi-tenancy enabled.
  • Introduces autocut for bm25, nearVector, nearObject, and nearXXX queries to automatically cut off unrelated results.
  • Adds autocut and a RelativeScore fusion algorithm to hybrid search for improved result quality.
  • Introduces reranker-transformers module for post-retrieval reranking using transformer models.
  • Introduces reranker-cohere module for post-retrieval reranking using the Cohere API.
  • Adds status code metrics distinguishing OK, user error, and server error responses for better observability of request success and failure rates.
  • Product Quantization (PQ) moves to general availability, with dynamic rescoring of results and a configurable training limit.
Was this useful?
my-toolchain — 0 tools
paste an install list to detect your tools

A brew list, a Brewfile, requirements.txt, a Dockerfile — or just the product names, free-form. Nothing leaves your browser.

    browse all tools →