Heads up This site is currently under heavy development.
Subscribe Get it delivered — the daily firehose, filtered to the tools you run, plus the documentation changes vendors never announce. Compare plans →

The AI Toolchain — issue -386, September 30, 2023

THE AI TOOLCHAIN NO. -386
Tail
THE DAILY RELEASE FIREHOSE
PUBLISHED SEPTEMBER 30, 2023 · EVERY WEEKDAY
EDITIONS tail grep head diff uniq

The daily firehose — everything the toolchain shipped today, already filtered.

// HOW THIS ISSUE IS MADE

We read every release from the 174 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.

VIEW
ISSUE VIEW full issue
Do you prefer this view?
$ tct list   # 19 tools matched
AI & LLM Tooling
◆  AI Coding Agents

Aider

Sources Release notes → v0.14.1 2 RELEASES · 2023-09-08 → 2023-09-30 NOTES STABLE

Aider v0.14.1 improves /add and /drop path handling and shows available models when a requested model is unavailable.

└──▷ GET THIS VERSION
$ git clone --branch v0.14.1 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.14.1
  • The /add and /drop commands now accept absolute filenames and quoted filenames.
  • /add validates that files are within the git repo or root before adding them.
  • Shows models supported by the API/key when the requested model is not available.
  • Warns users when in-chat file paths are relative to the git repo root.
1 more release in this issue · 2023-09-08 → 2023-09-30
v0.14.0 NOTES STABLE

Aider v0.14.0 adds Claude 2 and multi-LLM support via OpenRouter and requires Python 3.9+.

└──▷ GET THIS VERSION
$ git clone --branch v0.14.0 https://github.com/Aider-AI/aider.git
# already have the repo? check out this version:
$ git checkout v0.14.0
  • Adds support for Claude 2 and other LLMs through OpenRouter integration, expanding beyond OpenAI models.
  • Publishes documentation for running the aider benchmarking suite.
└──▷ BREAKING ON UPGRADE
  • !Aider now requires Python >= 3.9; installations running Python 3.8 or earlier will no longer work.
Was this useful?

Zed

Sources Release notes → v0.105.4 4 RELEASES · 2023-09-06 → 2023-09-27 NOTES STABLE

Zed v0.105.4 adds natural-language semantic search, new project-search key bindings, and editor multi-match selection.

└──▷ GET THIS VERSION
$ git clone --branch v0.105.4 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.105.4
└──▷ USE IT
Enable semantic search so you can query your codebase in natural language from the project search panel.
json
{
  "semantic_index": {
    "enabled": true
  }
}
Select every occurrence of the highlighted token in the file to rename or refactor them in one pass.
📍cmd-shift-l
  • Enables semantic search via the OPENAI_API_KEY environment variable and semantic_index.enabled key in settings.json, letting practitioners search a repository with natural language queries.
  • Adds alt-cmd-s key binding to toggle Semantic Search Mode in project search.
  • Adds alt-cmd-g key binding to toggle Regex Search Mode in project search.
  • Adds alt-cmd-x key binding to toggle Text Search Mode in project search.
  • Adds editor::SelectAllMatches command, bound to cmd-shift-l, to select all matching occurrences of the current selection.
+3 moreshow less
  • New project searches now default to the last-used search mode and settings.
  • Adds an 'Open in Terminal' action to the context menu on folders in the project panel.
  • Vim mode gains support for shift-d and shift-x to delete in visual mode.
└──▷ BREAKING ON UPGRADE
  • !The cmd-shift-l binding previously assigned to editor::DuplicateLine is now assigned to editor::SelectAllMatches.
3 more releases in this issue · 2023-09-06 → 2023-09-27
v0.104.4 NOTES STABLE

Zed v0.104.4 adds buffer search-and-replace, Nushell syntax highlighting, and expanded Vim command support.

└──▷ GET THIS VERSION
$ git clone --branch v0.104.4 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.104.4
  • Adds 'replace' functionality to buffer search.
  • Adds syntax highlighting for Nushell script files.
  • Adds Vim g s / g S bindings to show symbols in the current buffer or workspace.
  • Adds Vim ZZ and ZQ bindings to close the current item.
  • Adds Vim support for counts with insert actions (2i, 2o, 2a, etc.).
+4 moreshow less
  • Adds Vim _ and g_ motions.
  • Adds Vim . to replay the last action.
  • Improves command palette ordering: commands are now sorted lexicographically and by use count in the current session.
  • Improves auto-indentation when using the inline assistant.
v0.103.1 NOTES STABLE

Zed v0.103.1 adds Tailwind CSS autocomplete, a CSS language server, and Vim S substitute-line support.

└──▷ GET THIS VERSION
$ git clone --branch v0.103.1 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.103.1
  • Adds Vim S command to substitute the current line.
  • Adds basic Tailwind CSS autocomplete support.
  • Adds a CSS language server providing autocomplete and linting.
v0.102.1 NOTES STABLE

Zed v0.102.1 adds Inline Assist AI code generation, dynamic inlay hints, relative line numbers, and Python venv auto-activation in the terminal.

└──▷ GET THIS VERSION
$ git clone --branch v0.102.1 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.102.1
  • Adds ctrl-enter keybinding to trigger the new 'Inline Assist' feature, allowing AI-powered transformation of a selection or code generation at the cursor.
  • Adds "ctrl-shift-:": "editor::ToggleInlayHints" as a default key binding to toggle inlay hints.
  • Adds relative_line_numbers setting to enable relative line number display in the editor.
  • Adds detect_venv setting for the terminal to automatically activate Python virtual environments on terminal creation.
  • Adds support for dynamic inlay hints, enabling LSP servers to provide hints that update as code changes.
+4 moreshow less
  • Adds Vim g {j,k,up,down,$,^,0,home,end} motions to navigate in display coordinates.
  • Adds Vim z o and z c commands to open and close folds.
  • Adds Vim z f in visual mode to fold the current selection.
  • Improves project search to report results sooner.
Was this useful?
◆  AI Agent Frameworks

deepset Haystack

Sources Release notes → v1.21.0 2 RELEASES · 2023-09-04 → 2023-09-27 NOTES STABLE

Haystack v1.21.0 adds gpt-3.5-turbo-instruct support, a Haystack 2.0 preview install extra, and a revamped PineconeDocumentStore.

└──▷ GET THIS VERSION
$ git clone --branch v1.21.0 https://github.com/deepset-ai/haystack.git
# already have the repo? check out this version:
$ git checkout v1.21.0
└──▷ TRY IT
Try Haystack 2.0 preview components without pulling in the full core dependency set.
$ pip install farm-haystack[preview]
Migrate PineconeDocumentStore queries from namespaces to the new metadata-based API after upgrading.
python
from haystack.document_stores.pinecone import DOCUMENT_WITH_EMBEDDING

# Retrieve documents that have an embedding
docs_with_embedding = doc_store.get_all_documents(type_metadata=DOCUMENT_WITH_EMBEDDING)

# Retrieve documents without an embedding
docs_without_embedding = doc_store.get_all_documents(type_metadata="no-vector")
  • Adds support for OpenAI's gpt-3.5-turbo-instruct model via PromptNode, enabling use of OpenAI's latest instruct-tuned completion model in existing pipelines.
  • Introduces farm-haystack[preview] installation extra to try Haystack 2.0 components and pipeline design, while also making core dependencies leaner and speeding up installation.
  • Refactors PineconeDocumentStore to use metadata instead of namespaces for distinguishing document types; adds type_metadata parameter to get_all_documents() and exposes the DOCUMENT_WITH_EMBEDDING constant from haystack.document_stores.pinecone.
  • Adds AnswerBuilder component (Haystack 2.0 preview) that creates Answer objects from the string output of Generator components.
  • Adds LinkContentFetcher component (Haystack 2.0 preview) that fetches content from a URL and converts it into a Document object for use in pipelines.
+14 moreshow less
  • Adds MetadataRouter component (Haystack 2.0 preview) that routes documents to different pipeline edges based on the content of their metadata fields.
  • Adds PDF file support to the Haystack 2.0 Document converter via the pypdf library.
  • Adds SerperDevWebSearch component (Haystack 2.0 preview) to retrieve URLs from the web using the Serper.dev API.
  • Adds TikaDocumentConverter component (Haystack 2.0 preview) to convert files of multiple types into Document objects.
  • Adds ExtractiveReader component (Haystack 2.0 preview) as a replacement for FARMReader for inference, with per-span binary classification confidence scoring.
  • Introduces GPTGenerator class (Haystack 2.0 preview) for generating completions using OpenAI Chat models such as GPT-3.5 and GPT-4.
  • Adds GPT4Generator component (Haystack 2.0 preview) as an LLM component based on GPT35Generator.
  • Adds embedding_retrieval method to MemoryDocumentStore (Haystack 2.0 preview), exposed as MemoryEmbeddingRetriever, which retrieves relevant documents given a query embedding.
  • Renames MemoryRetriever to MemoryBM25Retriever and adds MemoryEmbeddingRetriever (Haystack 2.0 preview) for embedding-based retrieval from MemoryDocumentStore.
  • Adds OpenAI Text Embedder component (Haystack 2.0 preview) that uses OpenAI models to embed strings into vectors.
  • Adds PromptBuilder component (Haystack 2.0 preview) to render prompts from template strings.
  • Adds prefix and suffix attributes to SentenceTransformersDocumentEmbedder (Haystack 2.0 preview) for prepending/appending text to documents before embedding, enabling full use of models such as E5.
  • Adds support for date values in document store filters (Haystack 2.0 preview).
  • Adds UrlCacheChecker component (Haystack 2.0 preview) that checks whether documents from given URLs are already present in the store, returning cached documents and unmatched URLs on a separate connection.
└──▷ BREAKING ON UPGRADE
  • !SklearnQueryClassifier is removed; users must migrate to TransformersQueryClassifier.
  • !PineconeDocumentStore now uses metadata instead of namespaces to distinguish document types — the namespace parameter to get_all_documents() no longer works; callers must switch to the type_metadata parameter (e.g. type_metadata=DOCUMENT_WITH_EMBEDDING or type_metadata='no-vector').
1 more release in this issue · 2023-09-04 → 2023-09-27
v1.20.0 NOTES STABLE

Haystack v1.20.0 adds LostInTheMiddleRanker, DiversityRanker, allowed_domains for WebRetriever, and dynamic filter support in custom OpenSearch/Elasticsearch queries.

└──▷ GET THIS VERSION
$ git clone --branch v1.20.0 https://github.com/deepset-ai/haystack.git
# already have the repo? check out this version:
$ git checkout v1.20.0
└──▷ USE IT
Build a RAG pipeline that diversifies retrieved documents and then reorders them with the Lost-in-the-Middle strategy before generation.
python
from haystack.nodes import WebRetriever, TopPSampler, DiversityRanker, LostInTheMiddleRanker
from haystack.pipelines import Pipeline

web_retriever = WebRetriever(api_key=search_key, top_search_results=5, mode="preprocessed_documents", top_k=50)
sampler = TopPSampler(top_p=0.97)
diversity_ranker = DiversityRanker()
litm_ranker = LostInTheMiddleRanker(word_count_threshold=1024)

pipeline = Pipeline()
pipeline.add_node(component=web_retriever, name="Retriever", inputs=["Query"])
pipeline.add_node(component=sampler, name="Sampler", inputs=["Retriever"])
pipeline.add_node(component=diversity_ranker, name="DiversityRanker", inputs=["Sampler"])
pipeline.add_node(component=litm_ranker, name="LostInTheMiddleRanker", inputs=["DiversityRanker"])
pipeline.add_node(component=prompt_node, name="PromptNode", inputs=["LostInTheMiddleRanker"])
Pass dynamic filters at query-time to a BM25Retriever using the new ${filters} placeholder in a custom OpenSearch query, without modifying the stored query template.
python
retriever = BM25Retriever(
    custom_query="""
    {
        "query": {
            "bool": {
                "should": [{"multi_match": {
                    "query": ${query},
                    "type": "most_fields",
                    "fields": ["content", "title"]}}],
                "filter": ${filters}
            }
        }
    }"""
)

retriever.retrieve(
    query="What is the meaning of life?",
    filters={"year": [2019, 2020], "quarter": [1, 2, 3], "date": {"$gte": "2019-03-01"}}
)
Scope a WebRetriever to specific domains to build a 'talk to your docs' pipeline without off-site noise.
python
web_retriever = WebRetriever(
    api_key=search_key,
    allowed_domains=["docs.haystack.deepset.ai", "haystack.deepset.ai"],
    top_search_results=10,
    mode="preprocessed_documents"
)
  • Adds LostInTheMiddleRanker class, which reorders documents so the most relevant appear at the beginning and end of the context window, implementing the 'Lost in the Middle' strategy for RAG pipelines; accepts a word_count_threshold parameter.
  • Adds DiversityRanker class, which uses sentence-transformer models to rank documents so each successive result is maximally semantically dissimilar from already-selected ones; accepts a top_k parameter.
  • Adds ${filters} placeholder support in custom_query for BM25Retriever with OpenSearch and Elasticsearch, enabling dynamic query-time filters without modifying the stored query template.
  • Adds allowed_domains parameter to WebRetriever, enabling domain-scoped searches for 'talk to a website' and 'talk to docs' use cases.
  • Adds search_fields parameter to DeepsetCloudDocumentStore sparse queries, allowing BM25Retriever to search meta fields such as title alongside document content.
+11 moreshow less
  • Adds FileExtensionClassifier to Haystack 2.0 preview components.
  • Adds SentenceTransformersDocumentEmbedder to Haystack 2.0 preview, storing computed embeddings in the embedding field of each Document.
  • Adds SentenceTransformersTextEmbedder to Haystack 2.0 preview for embedding arbitrary strings into vectors.
  • Adds Answer base class, GeneratedAnswer, and ExtractedAnswer types for Haystack v2.
  • Enhances FileTypeClassifier to detect media file types including mp3, mp4, mpeg, and m4a.
  • Adds PDF support and custom User-Agent header to LinkContentFetcher, plus a mechanism to register new content handlers dynamically.
  • Enables setting max_length when running PromptNode with local Hugging Face text2text-generation models.
  • Enables passing trust_remote_code=True to load tokenizers for prompt models not natively supported by Transformers.
  • Allows WebRetriever users to supply a custom LinkContentFetcher instance.
  • Refactors DocumentWriter to accept a generic DocumentStore instead of using DocumentStoreAwareMixin.
  • Refactors MemoryRetriever to require a MemoryDocumentStore directly instead of using DocumentStoreAwareMixin.
└──▷ BREAKING ON UPGRADE
  • !The OpenSearch custom_query old per-field filter placeholders (e.g. ${years}, ${quarters}, ${date}) are no longer supported; replace all filter expressions with the single ${filters} placeholder.
  • !Custom PromptModelInvocationLayer subclasses: invoke() no longer receives prompt template parameters (such as query, documents) as keyword arguments; existing custom layers must be updated accordingly.
Was this useful?

LangChain

Sources Release notes → v0.0.305 23 RELEASES · 2023-09-01 → 2023-09-29 NOTES STABLE

LangChain v0.0.305 ships LangServe, RunnableGenerator, Tools-from-Runnables, input/output schemas, and several new integrations.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.305 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.305
└──▷ USE IT
Inspect the expected input and output types of a Runnable before wiring it into a pipeline.
python
from langchain.prompts import ChatPromptTemplate
from langchain.chat_models import ChatOpenAI

prompt = ChatPromptTemplate.from_template("Summarise this log: {log}")
chain = prompt | ChatOpenAI()

print(chain.input_schema.schema())
print(chain.output_schema.schema())
  • Adds RunnableGenerator class for wrapping generator functions as first-class Runnables in a chain.
  • Adds input_schema and output_schema properties to all Runnables, enabling introspection of expected types at runtime.
  • Enables creating LangChain Tools directly from any Runnable via as_tool().
  • Introduces LangServe — a new package for serving LangChain Runnables as REST APIs.
  • Adds optional client-side encryption support to DynamoDBChatMessageHistory.
+20 moreshow less
  • Adds add_graph_documents support to FalkorDBGraph for ingesting structured graph data.
  • Adds from_existing_graph class method to Neo4j vector store for initialising from an existing graph.
  • Adds add_embeddings and from_embeddings methods to the OpenSearch vector store.
  • Adds Self Query Retriever support to the OpenSearch integration.
  • Adds $vectorSearch MQL stage support for MongoDB Atlas 6.0.11 and 7.0.2.
  • Introduces a SearchApi integration for web search.
  • Introduces a MongoDBLoader document loader.
  • Adds a Trubrics callback handler integration for LLM observability.
  • Adds async support to OpenAIFunctionsAgentOutputParser.
  • Supports async callback handlers with the synchronous callback manager.
  • Adds verbose parameter to LlamaCppEmbeddings, matching the LlamaCpp LLM class.
  • Adds source metadata (source field) to OutlookMessageLoader documents.
  • Adds last_edited_time and created_time properties to NotionDBLoader documents.
  • Adds TypeScript code splitting support to the language-aware text splitter.
  • Adds project_metadata parameter support to run_on_dataset for tagging evaluation runs.
  • Adds synthetic data generation capability via a new Synthetic Data chain.
  • Adds support for multiple Milvus collections in the Milvus vector store integration.
  • Exposes lc_id as a classmethod on LangChain serialisable objects.
  • Improves repr output for all Runnable types for easier debugging.
  • Adds OpenAI gpt-3.5-turbo-instruct token cost information for usage tracking.
└──▷ BREAKING ON UPGRADE
  • !MongoDB Atlas $vectorSearch MQL stage support targets Atlas 6.0.11 and 7.0.2; users on earlier Atlas versions must pin LangChain to <=0.0.304.
22 more releases in this issue · 2023-09-01 → 2023-09-29
v0.0.304 NOTES STABLE

LangChain v0.0.304 adds exact-match and regex evaluators, extra tools for pandas agent, arxiv ID support, and Claude/Bedrock prompt wrapping.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.304 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.304
  • Adds extra_tools argument to the pandas agent toolkit, allowing practitioners to inject additional tools into the agent at construction time.
  • Adds ExactMatchEvaluator and RegexMatchEvaluator evaluators for deterministic, code-based evaluation of LLM outputs without requiring an LLM judge.
  • Adds prompt wrapping for Claude when using the Bedrock integration, ensuring Claude-formatted human/assistant turns are applied automatically.
  • Adds support for arxiv identifier lookups in ArxivAPIWrapper(), enabling direct paper retrieval by arxiv ID in addition to keyword search.
  • Adds support for stop sequences in the Fireworks LLM integration.
+1 moreshow less
  • Adds three additional property types to the Notion DB loader's metadata output.
v0.0.303 NOTES STABLE

LangChain v0.0.303 adds ChatFireworks support, custom bulk args for ElasticsearchStore, and an improved pairwise comparison chain.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.303 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.303
  • Adds ChatFireworks chat model integration and refactors the Fireworks provider.
  • Enables custom bulk arguments on ElasticsearchStore for tuning indexing behavior.
  • Makes the pairwise comparison chain more aligned with the LLM-as-a-judge evaluation pattern.
v0.0.302 NOTES STABLE

LangChain v0.0.302 adds Kay retriever, graph schema filtering for Cypher generation, and batching for HuggingFace pipelines.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.302 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.302
  • Adds Kay retriever for retrieving structured data via the Kay API.
  • Adds schema filtering for graph-based Cypher generation, letting the LLM work with a scoped subset of the graph schema.
  • Adds batching support for hf_pipeline (HuggingFace pipeline) inference.
v0.0.301 NOTES STABLE

LangChain v0.0.301 adds Gradient.ai and LLMRails embeddings and expands OpenSearch vector store capabilities.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.301 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.301
  • Adds from_texts and add_texts support for passing ids and indexname in the OpenSearch vector store integration.
  • Adds Gradient.ai embedding integration.
  • Adds LLMRails embedding integration.
v0.0.300 NOTES STABLE

LangChain v0.0.300 adds async support to multi-query and merger retrievers, plus run naming for non-chain runs.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.300 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.300
  • Adds async support to MultiQueryRetriever, enabling non-blocking parallel query generation and retrieval.
  • MergerRetriever now calls all retrievers concurrently in its async path, reducing latency when combining multiple retrieval sources.
  • Accepts a run_name argument for non-chain runs (tools, retrievers, etc.), surfacing meaningful labels in run traces.
v0.0.299 NOTES STABLE

LangChain v0.0.299 adds Runnable.astream_log() for async streaming with intermediate run state.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.299 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.299
└──▷ USE IT
Stream a chain's final output tokens alongside intermediate step logs in an async context.
python
async for chunk in chain.astream_log(input):
    print(chunk)
  • Adds Runnable.astream_log() method for async streaming that also yields intermediate log entries from a run.
  • Separates base URL from loaded URL in sub-link extraction, enabling finer control over crawl scope.
v0.0.298 NOTES STABLE

LangChain v0.0.298 adds Javelin, Gradient.ai LLM, and Timescale Vector (Postgres) integrations.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.298 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.298
  • Adds Gradient.ai LLM integration, enabling use of Gradient-hosted models as a LangChain LLM provider.
  • Adds Timescale Vector (Postgres) integration as a new vector store backend.
  • Adds Javelin integration as a new provider.
v0.0.297 NOTES STABLE

LangChain v0.0.297 adds streaming for Vertex AI and Amazon Bedrock, plus new agent output parsers.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.297 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.297
  • Adds streaming support for Amazon Bedrock LLMs.
  • Adds streaming support for Vertex AI via stream refactor.
  • Adds agent output parsers for structured agent response handling.
  • Improves criteria parser for evaluation chains.
  • Adds formatting of intermediate steps in agent execution.
v0.0.296 NOTES STABLE

LangChain v0.0.296 adds Remembrall integration, XMLOutputParser, synthetic data generation, Vald/LLMRails/Minimax/Vearch vector stores, and HTTP PUT support in OpenAPI agent.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.296 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.296
└──▷ USE IT
Parse XML-structured LLM output directly into a Python object in a chain.
python
from langchain.output_parsers import XMLOutputParser

parser = XMLOutputParser()
chain = prompt | llm | parser
result = chain.invoke({"input": "List three CVEs in XML format"})
Scope a Pinecone hybrid search to a specific namespace to isolate tenant data.
python
from langchain.retrievers import PineconeHybridSearchRetriever

retriever = PineconeHybridSearchRetriever(
    index=index,
    embeddings=embeddings,
    sparse_encoder=sparse_encoder,
    namespace="tenant-acme"
)
results = retriever.get_relevant_documents("SQL injection techniques")
  • Adds namespace parameter to Pinecone hybrid search, enabling namespace-scoped similarity queries.
  • Adds batch_size parameter to Weaviate vector store for controlling ingestion throughput.
  • Adds XMLOutputParser for parsing LLM outputs structured as XML.
  • Expands WeaviateHybridSearchRetriever to accept additional keyword arguments, enabling finer search control.
  • Adds support for HTTP PUT in the OpenAPI agent prompt, extending the set of REST methods the agent can use.
+11 moreshow less
  • Adds gpt-3.5-turbo-instruct to the model token mapping table.
  • Adds Remembrall integration for memory management.
  • Adds LLMRails as a new vector store integration.
  • Adds Minimax chat model integration.
  • Adds Vald vector store integration.
  • Adds clustered Vearch vector store integration.
  • Adds synthetic data generation capability.
  • Adds substring support for similarity_search_with_score.
  • Azure Cognitive Search integration removes select field restrictions, expands metadata to additional fields, and exposes kwargs to search calls.
  • Makes agent actions serializable, enabling safe persistence and replay of agent state.
  • Updates Neptune graph integration to use boto for authentication.
v0.0.295 NOTES STABLE

LangChain v0.0.295 adds extra-variable support in prompt templates, config metadata merging, and cross-account SageMaker boto3 injection.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.295 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.295
  • Allows extra variables to be passed when invoking prompt templates without raising an error, enabling more flexible template reuse.
  • Merges metadata and tags supplied in config objects, so both sources are preserved rather than one overwriting the other.
  • Adds ability to inject a custom boto3 client into the SageMaker endpoint integration to support cross-account inference scenarios.
v0.0.294 NOTES STABLE

LangChain v0.0.294 adds support for GPT-3.5-turbo-instruct models in the OpenAI LLM class.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.294 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.294
  • Supports gpt-3.5-turbo-instruct models in the OpenAI LLM class, enabling use of instruct-tuned variants alongside existing OpenAI completions models.
v0.0.293 NOTES STABLE

LangChain v0.0.293 adds RunnableBranch, kwargs support in RunnableWithFallbacks, and llm_kwargs for Xinference LLMs

└──▷ GET THIS VERSION
$ git clone --branch v0.0.293 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.293
└──▷ USE IT
Route chain execution conditionally at runtime using RunnableBranch instead of manual if/else logic.
python
from langchain.schema.runnable import RunnableBranch

branch = RunnableBranch(
    (lambda x: x['topic'] == 'sql', sql_chain),
    (lambda x: x['topic'] == 'code', code_chain),
    general_chain
)
branch.invoke({'topic': 'sql', 'question': 'How do I join two tables?'})
  • Adds RunnableBranch class for conditional branching logic within LCEL chains.
  • Adds llm_kwargs parameter to Xinference LLMs for passing additional keyword arguments to the underlying model.
  • Adds kwargs support in RunnableWithFallbacks, enabling fallback chains to receive arbitrary keyword arguments.
  • Adds IO visibility for chain groups, supporting showing inputs and outputs within a chain group.
v0.0.292 NOTES STABLE

LangChain v0.0.292 adds Ollama embeddings support and streaming transform methods for runnable sequences.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.292 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.292
  • Adds transform and atransform support to runnable sequences, enabling streaming/async streaming through RunnableSequence pipelines.
  • Adds embeddings support for Ollama, allowing local model embeddings via the Ollama integration.
v0.0.289 NOTES STABLE

LangChain v0.0.289 adds Baidu Qianfan LLM, Replicate streaming, Neo4j hybrid search, Redis MMR retrieval, and Cassandra metadata filtering.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.289 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.289
  • Adds Baidu Qianfan endpoint as a new LLM integration.
  • Adds streaming support for the Replicate LLM integration.
  • Adds MMR (maximal marginal relevance) support to the Redis retriever.
  • Adds hybrid search to the Neo4j vector index.
  • Adds metadata filtering to the Cassandra Vector Store.
+3 moreshow less
  • Expands CassandraCache and CassandraSemanticCache to handle any Generation type, not just text generations.
  • Adds keyword argument support and improved error handling to ArcGISLoader.
  • Adds HTTP header support to the PDF URL loader for accessing authenticated PDF file URLs.
v0.0.288 NOTES STABLE

LangChain v0.0.288 adds ElevenLabs text-to-speech integration and average feedback aggregation.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.288 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.288
  • Adds ElevenLabs text-to-speech integration, enabling audio synthesis from LangChain pipelines.
  • Adds average feedback aggregation support.
v0.0.287 NOTES STABLE

LangChain v0.0.287 adds a Prompt Injection Identifier, GitLab toolkit, file-like object support in the CSV Agent, and a custom Ernie API base.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.287 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.287
  • Adds support for a custom ernie_api_base configuration in the Ernie LLM integration.
  • Adds a Prompt Injection Identifier to detect prompt injection attempts in inputs.
  • Adds a GitLab toolkit and companion notebook for GitLab-based agent workflows.
  • Adds file-like object support in the CSV Agent Toolkit, enabling in-memory or streamed CSV sources instead of only file paths.
v0.0.286 NOTES STABLE

LangChain v0.0.286 adds KonkoAI chat model, Ctranslate2 LLM, Vearch vectorstore, MMR search for Redis and PGVector, and a Runnable-powered agent.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.286 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.286
  • Adds where_document filter parameter to Chroma vector store queries for document-level filtering.
  • Adds language parameter to the NLTK text splitter to support multilingual tokenization.
  • Adds ernie_api_base custom endpoint support and async methods to ErnieEmbeddings.
  • Adds Maximal Marginal Relevance (MMR) search support to the Redis vector store.
  • Adds Maximal Marginal Relevance (MMR) search support to the PGVector vector store.
+9 moreshow less
  • Adds Redis self-query retriever, enabling natural-language metadata filtering over Redis vector stores.
  • New LLM integration: Ctranslate2, enabling efficient local inference via the CTranslate2 runtime.
  • New chat model integration: KonkoAI (konko chat model), expanding hosted model options.
  • New vector store integration: Vearch, adding support for the Vearch distributed embedding database.
  • New evaluation integration: DeepEval, enabling LLM output evaluation via the DeepEval framework.
  • Adds C# language support to the RecursiveCharacterTextSplitter / code text splitter.
  • Introduces a Runnable-powered agent, enabling agent construction via the LangChain Runnable interface.
  • VertexAI integration now supports fine-tuned Codey model variants.
  • Enables serialization/deserialization (serde) for RetrievalQAWithSourcesChain.
v0.0.285 NOTES STABLE

LangChain v0.0.285 adds self-querying retrievers for Vectara and Supabase, multilingual anonymization, and a boto3_session parameter for cross-account DynamoDB.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.285 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.285
  • Adds boto3_session parameter to the AWS DynamoDB integration to support cross-account use cases.
  • Adds self-querying retriever support for Vectara vector store.
  • Adds self-querying retriever support for Supabase vector store.
  • Adds multilingual anonymization capability to the anonymization module.
  • Adds a progress bar to the evaluation runner.
v0.0.284 NOTES STABLE

LangChain v0.0.284 adds NucliaDB vector store, Diffbot Graph Transformer, data deanonymization, and Hugging Face Inference API embeddings.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.284 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.284
  • Adds NucliaDB vector store integration for storing and querying embeddings via NucliaDB.
  • Adds DiffbotGraphTransformer for extracting knowledge graphs from text and ingesting them into Neo4j graph documents.
  • Adds data deanonymization support, enabling pipelines to reverse anonymization on LLM outputs.
  • Adds Hugging Face Inference API as an embeddings backend, allowing document embedding without a locally downloaded model.
  • Adds sqlite-vss as a supported vector store backend.
+3 moreshow less
  • Enables configurable distance strategies in PGVector rather than hardcoding a single strategy.
  • Adds VectorSearch-enabled SQLChain support for combining vector similarity search with SQL queries.
  • Adds LCEL (LangChain Expression Language) cookbook examples demonstrating new composition patterns.
v0.0.283 NOTES STABLE

LangChain v0.0.283 adds a VLLM download_dir argument, custom SQL Agent tools, and NumberedListOutputParser.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.283 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.283
└──▷ USE IT
Cache VLLM model weights to a specific directory so repeated runs avoid re-downloading large models.
python
from langchain.llms import VLLM

llm = VLLM(
    model="mistralai/Mistral-7B-v0.1",
    download_dir="/mnt/model-cache"
)
  • Adds download_dir argument to the VLLM integration, letting callers specify where model files are stored locally.
  • Exposes NumberedListOutputParser via the output_parser init, making it importable from the top-level parsers module.
  • Supports adding custom tools to the SQL Agent, extending its default toolset with user-defined functions.
  • Allows None as a valid temperature value in the TGI (Text Generation Inference) LLM integration.
v0.0.281 NOTES STABLE

LangChain v0.0.281 adds Bedrock Claude chat, Azure Document Intelligence, Cassandra LLM cache, FalkorDB, and more new integrations.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.281 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.281
└──▷ USE IT
Filter Weaviate vector search results to a specific subset before computing similarity scores.
python
results = db.similarity_search_with_score(query, where_filter={"path": ["category"], "operator": "Equal", "valueText": "finance"})
Use Cassandra as a semantic LLM cache to avoid redundant inference calls for similar prompts.
python
from langchain.cache import CassandraSemanticCache
import langchain
langchain.llm_cache = CassandraSemanticCache(session=session, keyspace="langchain", embedding=embeddings)
  • Adds AzureAIDocumentIntelligenceParser and AzureAIDocumentIntelligenceLoader for parsing and loading documents via Azure Document Intelligence service.
  • Adds where filter parameter to Weaviate similarity search with score, enabling filtered vector queries.
  • Adds ne (not-equal) comparator for self-query retrievers.
  • Adds model_kwargs parameter to HuggingFace TGI (langchain.llms HF text-generation-inference) for passing arbitrary inference parameters.
  • Allows specifying arbitrary keyword arguments in langchain.llms.VLLM.
+21 moreshow less
  • Extends DynamoDBChatMessageHistory to support composite keys.
  • Extends SQLChatMessageHistory with additional configuration support.
  • Adds Cassandra support for LLM cache (both exact-match and semantic caching).
  • Adds FalkorDB graph database integration.
  • Adds ChatBedrock (Bedrock Claude) chat model integration.
  • Adds inference support from Vertex AI Model Garden.
  • Adds Milvus translator for self-querying retriever.
  • Adds DashVector self-query retriever.
  • Adds NumberedListOutputParser parser.
  • Adds Yahoo Finance News tool.
  • Adds logical fallacy removal chain for model output.
  • Adds ChatLiteLLM additional model support.
  • Adds Pinecone upsert parallelization.
  • Adds EdenAI LLM model name option, allowing selection of specific models.
  • Makes hub push public by default.
  • Adds verbosity parameter to create_qa_with_sources_chain.
  • Adds dataview fields and tags to Obsidian document metadata.
  • Adds boto3 configuration support for S3 loaders.
  • Adds Google Drive integration (lite) loader.
  • Renames delete_mode to cleanup in the indexing API.
  • Adds model_kwargs to HuggingFace text-generation LLM for missing params.
└──▷ BREAKING ON UPGRADE
  • !The delete_mode parameter in the indexing API is renamed to cleanup.
v0.0.279 NOTES STABLE

LangChain v0.0.279 adds async tool support, Runnable retry/config methods, ApifyWrapper, EdenAI tools, and sqlite-vss vector store.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.279 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.279
└──▷ USE IT
Tag a specific chain run with a name and ID for tracing or debugging in LangSmith.
python
chain.with_config({"run_name": "my-audit-chain", "run_id": "abc-123"}).invoke({"input": "What are the open CVEs?"})
  • Adds .with_config() method to Runnables, plus run_id and run_name fields to RunnableConfig, enabling per-run identification and configuration.
  • Adds ApifyWrapper class for integrating Apify web-scraping actors into chains.
  • Adds async support for tools, enabling non-blocking tool execution in async chains.
  • Adds EdenAI tools integration for AI-powered third-party services.
  • Adds sqlite-vss as a supported vector store backend.
Was this useful?

Microsoft AutoGen

Sources Release notes → v0.1.4 2 RELEASES · 2023-09-27 → 2023-09-30 NOTES STABLE

AutoGen v0.1.4 adds configurable retry timing for rate-limit handling.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.4 https://github.com/microsoft/autogen.git
# already have the repo? check out this version:
$ git checkout v0.1.4
  • Adds configurable retry wait time to handle API rate-limit errors in multi-agent workflows.
1 more release in this issue · 2023-09-27 → 2023-09-30
v0.1.2 NOTES STABLE

AutoGen v0.1.2 adds single-line code detection and new RetrieveChat controls including customized_answer_prefix and no_update_context.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.2 https://github.com/microsoft/autogen.git
# already have the repo? check out this version:
$ git checkout v0.1.2
  • Adds customized_answer_prefix parameter to RetrieveChat to trigger Update Context when the specified prefix is absent from the answer, enabling custom trigger-word control.
  • Adds no_update_context parameter to RetrieveChat to suppress Update Context entirely.
  • Extends extract_code to detect single-line code blocks.
  • RetrieveChat now upserts to ChromaDB in batches of 40,000 records, improving stability for large corpora.
Was this useful?

Microsoft Semantic Kernel

Sources Release notes → java-0.2.9-alpha 2 RELEASES · 2023-09-06 → 2023-09-26 NOTES STABLE

Semantic Kernel Java adds stepwise planner, JDBC/Postgres memory connectors, and Azure Cognitive Search memory store.

└──▷ GET THIS VERSION
$ git clone --branch java-0.2.9-alpha https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout java-0.2.9-alpha
  • Adds JDBC and Postgres memory connectors for persistent vector storage in Java.
  • Adds stepwise planner to the Java SDK, enabling multi-step autonomous task execution.
  • Implements MemoryStore interface on AzureCognitiveSearchMemory in Java, making it a first-class memory backend.
  • Changes minRelevanceScore on the memory API from double to float in Java.
└──▷ BREAKING ON UPGRADE
  • !Removes the default NullMemory from the DefaultSKContext builder — code that relied on an implicit no-op memory store will now receive no memory instance by default and must supply one explicitly.
1 more release in this issue · 2023-09-06 → 2023-09-26
python-0.3.11.dev NOTES STABLE

Semantic Kernel Python gains a Redis memory connector and chat system message support in completion settings.

└──▷ GET THIS VERSION
$ git clone --branch python-0.3.11.dev https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:
$ git checkout python-0.3.11.dev
  • Adds Redis memory connector, enabling Redis as a vector/memory backend for Semantic Kernel Python applications.
  • Adds chat_system_message to completion settings, allowing a system prompt to be set for chat-based LLM calls.
  • Adds a settings function to load configuration directly into the constructor, streamlining kernel initialization.
Was this useful?
◆  Local LLM Runtimes

KoboldCpp

Sources Release notes → v1.44.2 2 RELEASES · 2023-09-07 → 2023-09-20 NOTES STABLE

KoboldCpp v1.44.2 adds multi-user queuing, --onready hooks, Grammar Sampling, a new context-length API endpoint, and a major Kobold Lite UI overhaul.

└──▷ GET THIS VERSION
$ git clone --branch v1.44.2 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.44.2
└──▷ TRY IT
Run a shared KoboldCpp instance that queues up to 5 users and auto-starts a Cloudflare tunnel once the model is loaded.
$ koboldcpp.exe --model my_model.gguf --multiuser --onready "cloudflared tunnel run my-tunnel"
Fetch the true maximum context length supported by the loaded model, independent of horde-reported limits.
$ curl http://localhost:5001/api/extra/true_max_context_length
  • Adds --multiuser flag enabling up to 5 concurrent incoming /generate requests to be queued and processed in sequence instead of being rejected while busy.
  • Adds --onready launcher argument to execute a terminal command (e.g. start a Python script or Cloudflare tunnel) as a subprocess after KoboldCpp finishes loading.
  • Adds /api/extra/true_max_context_length API endpoint to fetch the true maximum context limit separately from the horde-friendly value.
  • Adds Grammar Sampling for all architectures, including older models, accessible via the web API and Kobold Lite; a BNDF grammar string can be specified in Lite settings.
  • Extends GPU selection to a 4th GPU in both the UI and command line (previously capped at 3).
+9 moreshow less
  • Adds a streaming toggle in the Kobold Lite settings panel to enable streaming without URL manipulation; --stream flag is retained for compatibility.
  • Adds Mirostat UI configuration controls to the Kobold Lite settings panel.
  • Adds Aesthetic UI for chat mode in Kobold Lite, automatically selected when importing Tavern cards, with easy switching between chat and instruct UIs from the settings panel.
  • Adds support for importing characters from Chub.AI in Kobold Lite.
  • Adds Instruct Tag Presets dropdown and instruct placeholder support (e.g. {{[INPUT]}} and {{[OUTPUT]}}) in Kobold Lite for easy format switching, with a toggle for 'Raw Instruct Tags' as an alternative.
  • Adds 'Newline After Memory' and 'Show Rename Save File' toggles in Kobold Lite settings.
  • Adds automatic expansion of the max context size slider limit in Kobold Lite when a larger context is detected.
  • Makes Idle Responses a global setting available in all Kobold Lite modes.
  • Adds smarter group chat behavior in Kobold Lite — mentioning a specific character name directs that character to respond instead of selecting randomly.
1 more release in this issue · 2023-09-07 → 2023-09-20
v1.43 NOTES STABLE

KoboldCpp v1.43 adds automatic RoPE scale calculation, older GGML support, and thread-safe SSE streaming improvements.

└──▷ GET THIS VERSION
$ git clone --branch v1.43 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.43
  • Adds automatic RoPE scale calculation based on a model's training context (n_ctx_train) when --ropeconfig is not explicitly set; --ropeconfig overrides this behavior.
  • Tweaks --unbantokens to push banned token logit values further down, reducing rare appearances while avoiding -inf to preserve sampling compatibility.
  • Adds support for older GGML format (ggjt_v3) for 34B LLaMA 2 models (note: may have issues when n_gqa is not 1; GGUF recommended in that case).
  • Adds mutex for thread-safe polled-streaming, enabling safer concurrent SSE stream consumption.
  • Integrates SSE streaming improvements for more reliable server-sent event delivery.
+3 moreshow less
  • HIP and CUDA visible devices are now scoped to a single GPU when a GPU number is provided and tensor split is not specified.
  • Enables SSE3 flags for failsafe mode, restoring and improving Windows 7 compatibility in noavx2 and failsafe modes.
  • Updates Kobold Lite to use placeholders for instruct tags that are swapped during generation.
Was this useful?

LocalAI

Sources Release notes → v1.30.0 NOTES

LocalAI v1.30.0 adds vllm and vall-e-x backends, speculative sampling, LoRA for diffusers, and new model/job API endpoints.

└──▷ GET THIS VERSION
$ git clone --branch v1.30.0 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v1.30.0
└──▷ TRY IT
Poll all in-progress model download/load jobs to monitor async model operations via the API.
$ curl http://localhost:8080/models/jobs
  • Adds GET /models/jobs endpoint to expose all background model jobs.
  • Adds PYTHON_GRPC_MAX_WORKERS environment variable to control the maximum number of workers for the Python gRPC backend.
  • Adds initial vllm backend implementation, including support for setting quantization.
  • Adds vall-e-x backend for audio generation.
  • Adds speculative sampling support via a draft model field in the model config.
+3 moreshow less
  • Adds LoRA support to the diffusers backend.
  • Adds mutable/refactored Model Gallery endpoints.
  • Allows manually setting the seed for the Stable Diffusion pipeline.
Was this useful?

oobabooga's Text Generation WebUI (textgen)

Sources Release notes → 1.6.1 2 RELEASES · 2023-09-22 → 2023-09-26 NOTES STABLE

Adds a grammar editor to the UI and alternative requirements.txt with AMD and Metal wheels.

└──▷ GET THIS VERSION
$ git clone --branch 1.6.1 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout 1.6.1
  • Adds a grammar editor to the UI for direct grammar authoring during inference.
  • Adds an alternative requirements.txt with AMD and Metal wheels for broader hardware support.
1 more release in this issue · 2023-09-22 → 2023-09-26
v1.6 NOTES STABLE

oobabooga textgen v1.6 adds GGUF support, ExLlamaV2 loaders, CFG sampling, SSL, named Cloudflare tunnels, and a logit viewer.

└──▷ GET THIS VERSION
$ git clone --branch v1.6 https://github.com/oobabooga/textgen.git
# already have the repo? check out this version:
$ git checkout v1.6
  • Adds --cpu option for llama.cpp to force CPU-only inference and prevent CUDA from being used.
  • Adds --disable_exllama option for AutoGPTQ to bypass ExLlama kernels.
  • Adds auto_max_new_tokens parameter to automatically size the maximum new tokens based on context.
  • Adds max_tokens_second parameter to rate-limit token generation speed.
  • Adds SSL certificate support for securing the web UI endpoint.
+25 moreshow less
  • Adds option for named Cloudflare tunnels, enabling persistent public URLs.
  • Adds ExLlamaV2 and ExLlamaV2_HF loaders for next-generation ExLlama inference.
  • Adds GGUF format support, including reading GGUF metadata fields such as scale_linear and freq_base.
  • Adds Classifier Free Guidance (CFG) sampling for Transformers, ExLlama, ExLlama_HF, and llamacpp_HF loaders.
  • Adds new RoPE settings for ExLlama, with NTK (alpha) and RoPE scaling also supported for ExLlamaV2 and ExLlamaV2_HF.
  • Adds mlock and no-mmap options to ctransformers loader.
  • Adds GGUF support to ctransformers loader.
  • Adds array (batched) input support to the openai extension API.
  • Handles Chunked Transfer Encoding in the openai extension for streaming requests.
  • Adds chat_instruct_command support in the API.
  • Adds save defaults to settings.yaml button so current UI parameters persist across sessions.
  • Adds Show controls button to the chat UI to toggle the parameter panel.
  • Adds a simple logit viewer to inspect per-token probability distributions.
  • Adds probability dropdown to the perplexity_colors extension.
  • Adds language option to the silero_tts extension.
  • Adds silero TTS audio preview back to the UI.
  • Unifies the three interface modes (chat, notebook, default) into a single cohesive UI.
  • Adds support for downloading a single file from a model repository via the UI and download-model.py.
  • Merges one-click-installers into the main repository, reducing installation size by several GB with a more reliable update procedure.
  • Adds a standalone Dockerfile for NVIDIA Jetson devices.
  • Adds ffmpeg to the Docker image.
  • Adds chat instruction configuration for BaiChuan-chat, starchat, Vicuna-v1.5, pygmalion-2, mythalion, and StableBeluga2 model series.
  • Adds scrollbar to notebook/default textboxes and enables scrolling during token streaming.
  • Refactors the training tab UI for improved usability.
  • Uses separate llama-cpp-python packages to maintain GGML support alongside GGUF.
Was this useful?

vLLM

Sources Release notes → v0.2.0 3 RELEASES · 2023-09-07 → 2023-09-28 NOTES STABLE

vLLM v0.2.0 adds AWQ quantization, Mistral-7B and LongChat support, RoPE scaling, and up to 60% faster inference.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.0 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.2.0
  • Makes max_model_len configurable, allowing users to override the default maximum model context length.
  • Adds gpu_memory_utilization and swap_space parameters to the LLM class for fine-grained memory control.
  • Adds stop_token_ids sampling parameter to halt generation at specific token IDs.
  • Adds float16 and float32 as explicit --dtype choices for model loading.
  • Enables TORCH_CUDA_ARCH_LIST environment variable to select target GPU architectures at build time.
+6 moreshow less
  • Adds model revision support, allowing a specific model commit or revision to be pinned.
  • Supports AWQ (Activation-aware Weight Quantization) for LLaMA models, including safetensors format for quantized models.
  • Adds support for Mistral-7B-v0.1.
  • Adds support for LongChat and RoPE scaling (reads rope_theta and max_position_embeddings from model config).
  • Automatically sets max_num_batched_tokens based on available resources, removing the need for manual tuning.
  • Delivers up to 60% performance improvement through optimized de-tokenization (TGI-style incremental detokenization) and vectorized sampler.
2 more releases in this issue · 2023-09-07 → 2023-09-28
v0.1.6 NOTES STABLE

vLLM v0.1.6 reverts a breaking API change and delivers faster startup plus background task generation.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.6 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.1.6
  • Reduces vLLM startup time for faster engine initialization.
  • Starts background tasks within AsyncLLMEngine.generate so generation can proceed asynchronously without requiring a separate task launch.
v0.1.5 NOTES STABLE

vLLM v0.1.5 adds CodeLlama support, safetensors loading for all models, and OpenAPI request body specs for OpenAI endpoints.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.5 https://github.com/vllm-project/vllm.git
# already have the repo? check out this version:
$ git checkout v0.1.5
  • Enables safetensors loading for all models, expanding the supported weight formats beyond the previous subset.
  • Adds support for CodeLlama, expanding the roster of served models.
  • Enables request body OpenAPI spec for OpenAI-compatible endpoints, making the API surface formally documented and machine-readable.
  • Stabilizes AsyncLLMEngine with a background engine loop, making async serving more robust for production use.
  • Aligns beam search implementation with HuggingFace hf_model.generate, improving output consistency for beam-search workloads.
+1 moreshow less
  • Accelerates LLaMA model loading, reducing startup time when serving LLaMA-family models.
Was this useful?
◆  AI Model & Data Infrastructure

Microsoft ONNX Runtime

Sources Release notes → v1.16.0 NOTES

ONNX Runtime v1.16.0 adds fp8/4-bit CPU quant, FlashAttention v2, Azure EP on mobile, Swift Package Manager support, and major LLM training optimizations.

└──▷ GET THIS VERSION
$ git clone --branch v1.16.0 https://github.com/microsoft/onnxruntime.git
# already have the repo? check out this version:
$ git checkout v1.16.0
└──▷ USE IT
Prevent silent CPU fallback during inference to ensure a model runs only on the intended EP (e.g., CUDA) and fails fast if an op is unsupported.
python
import onnxruntime as ort

opts = ort.SessionOptions()
opts.add_session_config_entry('session.disable_cpu_ep_fallback', '1')

session = ort.InferenceSession('model.onnx', sess_options=opts, providers=['CUDAExecutionProvider'])
Export a tokenizer processing graph for a LLaMA model as an ONNX model for on-device or pipeline use.
python
from onnxruntime_extensions import gen_processing_models
from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained('huggyllama/llama-7b')
onnx_model = gen_processing_models(tokenizer, pre_kwargs={}, post_kwargs={})
# Save the exported ONNX processing model
with open('llama_tokenizer.onnx', 'wb') as f:
    f.write(onnx_model[0].SerializeToString())
  • Adds session.disable_cpu_ep_fallback session option to prevent automatic fallback to the CPU execution provider.
  • Adds ORTMODULE_ENABLE_EMBEDDING_SPARSE_OPTIMIZER environment variable (disabled by default) for experimental embedding sparsity optimizations, improving Roberta training performance by 20-30%.
  • Adds ORTMODULE_ENABLE_COMPUTE_OPTIMIZER for Label Sparsity compute optimization, now enabled by default.
  • Adds ORTMODULE_CACHE_DIR model cache for exported ONNX models to avoid repeated exports when the model is unchanged.
  • Adds gen_processing_models Python API in onnxruntime-extensions to export ONNX data processing models from Hugging Face tokenizers (LLaMA, CLIP, XLM-Roberta, Falcon, BERT, etc.).
+32 moreshow less
  • Supports serialization of models 2 GB and larger.
  • Java API gains support for fp16 and bf16 tensors as inputs/outputs, with conversion utilities leveraging hardware-accelerated Float.float16ToFloat and Float.floatToFloat16 on JDK 20+.
  • Java API adds support for external initializers, enabling large models to be instantiated without filesystem access.
  • C# API exposes OrtValue as the new preferred inference API, reducing garbage collection overhead and providing direct native memory access via Slice-like interfaces.
  • C# Float16 and BFloat16 types become full-featured interfaces supporting conversion and floating-point properties such as IsNaN and IsInfinity.
  • C++ Float16_t and BFloat16_t types become full-featured interfaces supporting conversion and floating-point properties such as IsNaN and IsInfinity.
  • Adds 4-bit quantization support on CPU.
  • Adds LLM quantization accuracy improvement via smoothquant.
  • Adds FlashAttention v2 support for Attention, MultiHeadAttention, and PackedMultiHeadAttention ops.
  • CUDA EP gains initial fp8 support covering QDQ, Cast, and MatMul operations.
  • CUDA EP relaxes CUDA Graph constraints to allow more models to utilize CUDA Graphs.
  • CUDA EP allows the CUDA allocator to be registered with ONNX Runtime externally.
  • TensorRT EP adds CUDA Graph support and user-provided CUDA compute stream.
  • OpenVINO EP adds support for OpenVINO 2023.1.
  • QNN EP enables context binary cache to reduce initialization time.
  • QNN EP adds support for QNN 2.12 and resize with asymmetric transformation mode on the HTP backend.
  • QNN EP adds op support for Equal, Less, LessOrEqual, Greater, GreaterOrEqual, LayerNorm, Asin, Sign, DepthToSpace, SpaceToDepth, and 1D Conv/ConvTranspose.
  • Mobile gains initial Azure EP support.
  • Mobile adds dynamic shape support for CoreML.
  • Mobile adds Swift Package Manager support for ONNX Runtime inference and extensions via onnxruntime-swift-package-manager.
  • Mobile adds support for CLIPImageProcessor pre-processing and CLIP inference scenarios.
  • React Native performance improved via JSI.
  • WebGPU ops coverage expanded to support SAM, T5, and Whisper models.
  • WebNN ops coverage expanded to support SAM and Stable Diffusion models.
  • ORTModule + OpenAI Triton integration now available for computing ONNX sub-graphs during large model training.
  • On-Device Training adds iOS support.
  • On-Device Training adds a minimal build (~1.5 MB binary) for resource-constrained environments.
  • On-Device Training enables ORT-Extensions custom op support via onnxblock.
  • ORT Extensions adds TrieTokenizer operator for RWKV-like LLM models.
  • ORT Extensions adds new Azure EP operators: AzureAudioToText, AzureTextToText, and AzureTritonInvoker for Python and NuGet packages.
  • LLaMAv2 training achieves ~10% acceleration; OpenAI Whisper training optimizations also included.
  • PythonOp enhancements include bool and tuple[bool] constants, materialize grads, empty inputs, save-in-context, customized shape inference, and full-qualified name export.
Was this useful?

Ollama

Sources Release notes → v0.1.0 4 RELEASES · 2023-09-06 → 2023-09-23 NOTES STABLE

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

Ollama v0.1.0 adds Linux support with out-of-the-box Nvidia GPU acceleration and multi-GPU server compatibility.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.0 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.1.0
└──▷ TRY IT
Install Ollama on a Linux server or WSL 2 environment to run models with automatic GPU acceleration.
$ curl https://ollama.ai/install.sh | sh
  • Adds Linux support with Nvidia GPU acceleration enabled out-of-the-box, installable via curl https://ollama.ai/install.sh | sh.
  • Supports multi-GPU cloud servers, automatically offloading as many model layers as the GPU(s) can handle for maximum performance.
  • Supports WSL 2 with GPU acceleration.
  • Runs on CPU-only systems as well as a wide range of GPUs, from hobby gaming cards to workstation-class hardware such as the H100.
3 more releases in this issue · 2023-09-06 → 2023-09-23
v0.0.20 NOTES STABLE

Ollama v0.0.20 adds IPv6 support, auto-pull on remote, faster model loading, and a Python client library.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.20 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.0.20
└──▷ TRY IT
Pre-warm a model on a remote Ollama instance so the first real prompt returns immediately.
$ curl http://<host>:11434/api/generate -d '{"model": "llama2", "prompt": ""}'
  • Adds api/client.py, a Python client library for accessing Ollama programmatically.
  • OLLAMA_HOST now accepts IPv6 hostnames.
  • Sending an empty prompt field to /api/generate pre-loads the model so the next request is faster.
  • ollama run now loads models immediately on startup, reducing latency even on the first prompt.
  • ollama run automatically pulls models that don't exist when connected to a remote Ollama instance.
+2 moreshow less
  • ollama run gains hint text display and terminal-width word-wrapping for improved readability.
  • Progress reporting improved for ollama pull and ollama push.
v0.0.19 NOTES STABLE

Ollama v0.0.19 adds GGUF model import support and automatic local data cleanup.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.19 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.0.19
  • Supports importing and running GGUF file type models locally.
  • Automatically cleans up unused local model data.
  • Updated Docker image available via docker pull ollama/ollama.
v0.0.18 NOTES STABLE

Ollama v0.0.18 adds ollama show command to inspect model system prompts, parameters, templates, and Modelfiles.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.18 https://github.com/ollama/ollama.git
# already have the repo? check out this version:
$ git checkout v0.0.18
└──▷ TRY IT
Inspect a model's system prompt, parameters, template, or full Modelfile before deploying it in a pipeline.
$ ollama show --system orca-mini
ollama show --parameters codellama
ollama show --template llama2
ollama show --modelfile llama2
  • New ollama show command with --system, --parameters, --template, and --modelfile flags to inspect a model's system prompt, parameters, default prompt template, and Modelfile respectively.
  • Adds a new sentiments example contributed by @technovangelist.
  • Building from source now requires running go generate ./... to generate dependencies, with cmake as a new build prerequisite.
└──▷ BREAKING ON UPGRADE
  • !Building from source now requires running go generate ./... before go build ., and cmake must be installed — existing build workflows that skip this step will fail.
Was this useful?

NVIDIA Triton Inference Server

Sources Release notes → v2.38.0 NOTES

Triton v2.38.0 adds Python C API bindings, ensemble request parameter forwarding, queue-depth metrics, and TensorRT version compatibility.

└──▷ GET THIS VERSION
$ git clone --branch v2.38.0 https://github.com/triton-inference-server/server.git
# already have the repo? check out this version:
$ git checkout v2.38.0
└──▷ TRY IT
Enable TensorRT version compatibility so models built with any TensorRT 8.x release can run on a TensorRT 8.x server without rebuilding.
$ tritonserver --model-repository=/models --backend-config=tensorrt,version-compatible=true
  • Enables TensorRT version compatibility across models built with the same major TensorRT version via the --backend-config=tensorrt,version-compatible=true flag.
  • Adds pending-request queue size per model to the metrics API.
  • New Python bindings for the Triton C API.
  • Forwards request parameters to each composing model in an ensemble pipeline.
  • Filesystem API now supports named temporary cache directories when downloading models via the repository agent.
+3 moreshow less
  • Backend API adds access to inference response outputs by name or by index.
  • Python backend models can now return structured error codes in addition to error messages.
  • Python backend gains experimental (Beta) support for loading PyTorch models directly.
Was this useful?
Other / Uncategorized
◆  AI OBSERVABILITY

Arize Phoenix

Sources Release notes → v0.0.42 7 RELEASES · 2023-09-15 → 2023-09-29 NOTES STABLE

Phoenix v0.0.42 adds prompt template UI, latency percentiles, token methods, and broader eval input types.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.42 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout v0.0.42
  • Adds token methods to OpenAIModel via a new processing functions file.
  • Displays latency P50 and P99 percentiles in the tracing page header.
  • Enhances input types accepted by run_relevance_eval for greater flexibility.
  • Shows the model name in the LLM span info within the trace UI.
  • Adds a prompt template UI to the trace span details view.
6 more releases in this issue · 2023-09-15 → 2023-09-29
v0.0.41 NOTES STABLE

Phoenix v0.0.41 adds document metadata visibility in the trace view.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.41 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout v0.0.41
  • Displays document metadata in the trace UI, giving practitioners direct visibility into retrieval context during trace inspection.
v0.0.40 NOTES STABLE

Phoenix v0.0.40 adds templating semantic conventions for LLM spans and a LangChainInstrumentor for nested chains.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.40 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout v0.0.40
└──▷ USE IT
Instrument a nested LangChain pipeline to capture structured traces in Phoenix.
python
from phoenix.trace.langchain import LangChainInstrumentor

LangChainInstrumentor().instrument()
  • Adds LangChainInstrumentor for tracing nested LangChain chains as structured spans.
  • Adds templating semantic conventions to LLM spans, enabling structured capture of prompt template metadata.
v0.0.39 NOTES STABLE

Phoenix v0.0.39 adds VertexAI model support, new LLM message attributes, and error handling for llama-index traces.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.39 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout v0.0.39
  • Adds LLM_OUTPUT_MESSAGES attribute and renames LLM_MESSAGES to LLM_INPUT_MESSAGES to distinguish input and output message spans.
  • Adds VertexAI model implementation for use as an evaluation model.
  • Adds error handling attributes for llama-index instrumentation.
  • Displays total token count in the trace page header.
└──▷ BREAKING ON UPGRADE
  • !The LLM_MESSAGES attribute is renamed to LLM_INPUT_MESSAGES; any code or downstream processing referencing LLM_MESSAGES will stop matching spans after this upgrade.
v0.0.38 NOTES STABLE

Phoenix v0.0.38 adds LangChain LLM message attributes, agent span kind for LangChain, and slow-span highlighting in the tracing UI.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.38 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout v0.0.38
  • Adds agent span kind classification for LangChain traces, surfacing agent-type spans distinctly in the tracing view.
  • Captures LangChain LLM message attributes in trace spans, giving practitioners visibility into the full message structure exchanged with LLMs.
  • Highlights slow spans in the tracing UI to make latency outliers immediately visible during trace inspection.
  • Makes trace rows clickable in the tracing UI for faster drill-down into individual span details.
v0.0.37 NOTES STABLE

Phoenix v0.0.37 adds LangChain prompt semantic conventions, a tool details UI panel, and a prompts list view, plus moves tracing out of experimental.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.37 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout v0.0.37
  • Adds LangChain LLM prompts semantic convention support for richer span attribution in LangChain traces.
  • New tool details UI panel surfaces tool call information directly in the tracing interface.
  • New prompts list view in the UI lets practitioners browse and inspect captured prompts.
  • Tracing is promoted out of experimental status, signaling production readiness.
v0.0.33 NOTES STABLE

Phoenix v0.0.33 ships full LLM tracing with LangChain/LlamaIndex callbacks, binary evals, hallucination detection, and a rich spans/traces UI.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.33 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout v0.0.33
└──▷ USE IT
Convert raw spans collected during an LLM run into a TraceDataset for analysis or export.
python
from phoenix.trace.trace_dataset import TraceDataset

dataset = TraceDataset.from_spans(spans)
  • Adds host parameter to launch_app for controlling the bind address when starting the Phoenix server.
  • Adds TraceDataset.from_spans class method to construct a dataset directly from collected spans.
  • Adds run_eval function for running evaluations against a dataset.
  • Adds llm_eval_binary function for binary (pass/fail) LLM evaluations using an OpenAI model.
  • Adds hallucination eval capability via a new dedicated eval type.
+23 moreshow less
  • Adds launch_app support for launching with traces pre-loaded.
  • Adds experimental LangChain tracer callback for capturing LangChain chain/LLM/tool spans into Phoenix tracing.
  • Adds LlamaIndex callback skeleton and agent function-call callback support for tracing LlamaIndex pipelines including agent spans.
  • Adds semantic conventions for input/output span attributes, prompt templates, token counts, retrieval documents, tool attributes, and embedding attributes — covering both LangChain and LlamaIndex implementations.
  • Adds agent span kind to the tracing span-kind enum.
  • Adds span streaming, filtering, and exporting via the GraphQL API.
  • Adds GraphQL query to filter spans by trace ID.
  • Adds GraphQL fields for span attributes as JSON string, span input/output, token counts, cumulative token counts, descendant spans list, span count, and timestamp bookends.
  • Adds tracing overview stats panel to the UI.
  • Adds exception event capture and highlighting in span details.
  • Adds attributes to span events in the tracing data model.
  • Adds nested attributes support in the GraphQL tracing schema.
  • Adds a spans table UI with sorting and pagination.
  • Adds a traces table UI.
  • Adds trace detail and tree-view UI for visualising parent/child span relationships.
  • Adds span status display in the GraphQL API and spans table UI.
  • Adds LLM messages view in span details UI.
  • Adds LLM message attributes to the LangChain and LlamaIndex callbacks.
  • Adds LLM invocation parameter and token-count attributes to the LangChain tracer.
  • Adds token count tracking to the LlamaIndex callback.
  • Adds latency column to the spans table UI.
  • Adds a dataset download function for pulling evaluation datasets.
  • Adds GraphQL time bookend and sorting for spans.
Was this useful?
◆  VECTOR DB RAG

Chroma

Sources Release notes → 0.4.13 3 RELEASES · 2023-09-06 → 2023-09-25 NOTES STABLE

Chroma 0.4.13 adds $in/$nin metadata filters, Pulsar messaging support, and exports IncludeEnum for query/get calls.

└──▷ GET THIS VERSION
$ git clone --branch 0.4.13 https://github.com/chroma-core/chroma.git
# already have the repo? check out this version:
$ git checkout 0.4.13
└──▷ USE IT
Filter collection results to only documents whose metadata field matches one of several values — or explicitly excludes them.
python
collection.query(
    query_texts=["my query"],
    where={"category": {"$in": ["security", "networking", "cloud"]}}
)
  • Adds $in and $nin operators to metadata filters, enabling set-membership queries on collection metadata in #get and #query calls.
  • Exports IncludeEnum from the client library, which is required when specifying include parameters for #get and #query.
  • Adds Apache Pulsar producer and consumer support as a messaging backend.
2 more releases in this issue · 2023-09-06 → 2023-09-25
0.4.10 NOTES STABLE

Chroma 0.4.10 adds auth and external volume support for GCP deployments.

└──▷ GET THIS VERSION
$ git clone --branch 0.4.10 https://github.com/chroma-core/chroma.git
# already have the repo? check out this version:
$ git checkout 0.4.10
  • Adds authentication and external volume support for GCP deployments.
  • Publishes official Docker images to DockerHub at chromadb/chroma:0.4.10 in addition to the existing GitHub Container Registry image.
0.4.9 NOTES STABLE

Chroma 0.4.9 adds collection filtering, $in/$nin metadata operators, JS auth, and AWS deployment support.

└──▷ GET THIS VERSION
$ git clone --branch 0.4.9 https://github.com/chroma-core/chroma.git
# already have the repo? check out this version:
$ git checkout 0.4.9
└──▷ USE IT
Filter query results to only documents whose 'category' field matches one of several values — useful for multi-tenant or tagged collections.
python
collection.query(
    query_texts=["security vulnerabilities"],
    where={"category": {"$in": ["cve", "advisory", "patch"]}},
    n_results=10
)
Exclude documents from specific sources in a query — useful for suppressing noisy or untrusted data from results.
python
collection.query(
    query_texts=["malware behavior"],
    where={"source": {"$nin": ["unverified", "draft"]}},
    n_results=10
)
  • Adds $in and $nin metadata filter operators (CIP-4) so queries can match documents where a field's value is in or not in a given list.
  • Adds collection-level filtering (CIP-1), allowing clients to filter the list of collections returned.
  • Adds authentication support to the JavaScript client, bringing JS client auth parity with the Python client.
  • Adds ONNX runtime session providers, enabling hardware-accelerated inference backends for embedding functions.
  • Adds AWS deployment support for self-hosting Chroma on AWS infrastructure.
+2 moreshow less
  • Improves HttpClient URL handling to accept a broader range of URL formats.
  • Publishes multi-platform Docker release builds (e.g. ghcr.io/chroma-core/chroma:0.4.9), supporting multiple CPU architectures.
└──▷ BREAKING ON UPGRADE
  • !The JavaScript client upgrades to OpenAI npm package v4, which contains breaking changes — existing JS code using the OpenAI embedding function may require updates.
Was this useful?

LanceDB

Sources Release notes → python-v0.2.5 4 RELEASES · 2023-09-10 → 2023-09-19 NOTES STABLE

LanceDB v0.2.5 adds OpenCLIP multi-modal embeddings and a lancedb.__version__ attribute.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.2.5 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.2.5
└──▷ TRY IT
Generate text-to-image embeddings using the new OpenCLIP integration when building a multi-modal search table.
$ pip install lancedb[clip]
  • Adds lancedb.__version__ for programmatic version introspection.
  • Adds OpenCLIP-backed multi-modal embedding function for text-to-image embeddings, installable via pip install lancedb[clip] (requires torch, pillow, and open-clip).
3 more releases in this issue · 2023-09-10 → 2023-09-19
v0.2.6 NOTES STABLE

LanceDB v0.2.6 adds multi-modal embedding functions and a lancedb.__version__ attribute.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.6 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.2.6
└──▷ USE IT
Check the installed LanceDB version at runtime, useful in diagnostics or CI pipelines.
python
import lancedb
print(lancedb.__version__)
  • Adds lancedb.__version__ attribute for programmatic version introspection.
  • Introduces multi-modal embedding function support, enabling embedding pipelines that handle more than one data modality.
  • Improves Pydantic 1.x compatibility for schema definitions.
python-v0.2.4 NOTES STABLE

LanceDB python-v0.2.4 adds pydantic-backed embedding function persistence, temporary table updates, and URI query string propagation to Lance.

└──▷ GET THIS VERSION
$ git clone --branch python-v0.2.4 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout python-v0.2.4
  • Adds pydantic-based persistence for embedding functions, enabling embedding configurations to be saved and restored reliably.
  • Supports default values on pydantic vector fields, allowing model definitions to omit explicit vector initialization.
  • Adds temporary update feature for Python tables, enabling in-place modifications without committing a permanent write.
  • Propagates URI query string parameters through to the underlying Lance storage layer, unlocking AWS-specific storage options via connection strings.
v0.2.5 NOTES STABLE

LanceDB v0.2.5 adds schema evolution, temporary updates, and pydantic embedding persistence for local Python tables.

└──▷ GET THIS VERSION
$ git clone --branch v0.2.5 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.2.5
  • Supports schema evolution in local LanceDB Python tables, allowing columns to be added or changed without recreating the table.
  • Adds temporary update feature for Python, enabling in-place row modifications that can be staged before committing.
  • Uses Pydantic for embedding function persistence, allowing embedding configurations to be serialized and reloaded reliably.
  • Supports Pydantic vector fields with default values, reducing boilerplate when defining vector schemas.
  • Propagates URI query strings through to Lance, enabling AWS-specific connection parameters to be passed via the connection URI.
+2 moreshow less
  • Adds schema coerce and vector column inference in the Rust client, reducing manual schema specification when working with vector data.
  • Upgrades the underlying Lance dependency to v0.7.3.
Was this useful?

Milvus

Sources Release notes → v2.3.1 NOTES

Milvus 2.3.1 restores SUBSTRUCTURE/SUPERSTRUCTURE binary metric support and surfaces index info in GetSegmentInfo.

└──▷ GET THIS VERSION
$ git clone --branch v2.3.1 https://github.com/milvus-io/milvus.git
# already have the repo? check out this version:
$ git checkout v2.3.1
  • Restores support for SUBSTRUCTURE and SUPERSTRUCTURE binary metric types, previously unavailable.
  • Exposes index information in GetSegmentInfo responses, giving operators visibility into per-segment index state.
  • Improves Flush, FlushAll, and GetFlushAllState API operations for more reliable data syncing with object storage.
  • Adds delayed connection reset for Canceled or DeadlineExceeded gRPC codes, reducing unnecessary reconnects under transient errors.
  • Enhances RPC client with a retry mechanism for improved resilience against transient failures.
+3 moreshow less
  • Significantly improves VARCHAR bulk insert throughput via batch processing reads.
  • Improves MMap efficiency and capacity, enabling larger in-memory datasets without additional hardware.
  • Reduces unnecessary data copies during segment loading, improving overall load performance.
Was this useful?

Qdrant

Sources Release notes → v1.5.1 2 RELEASES · 2023-09-07 → 2023-09-12 NOTES STABLE

Qdrant v1.5.1 adds an unprivileged Docker image for hardened deployments.

└──▷ GET THIS VERSION
$ git clone --branch v1.5.1 https://github.com/qdrant/qdrant.git
# already have the repo? check out this version:
$ git checkout v1.5.1
  • Adds an unprivileged Docker image better suited for secure, least-privilege container environments.
1 more release in this issue · 2023-09-07 → 2023-09-12
v1.5.0 NOTES STABLE

Qdrant v1.5.0 adds binary quantization, batch point updates, shard snapshot API, and Kubernetes health endpoints.

└──▷ GET THIS VERSION
$ git clone --branch v1.5.0 https://github.com/qdrant/qdrant.git
# already have the repo? check out this version:
$ git checkout v1.5.0
└──▷ TRY IT
Speed up ANN search in a collection where some segments are not yet indexed by skipping unindexed segments entirely — useful during bulk ingestion when freshness matters less than latency.
$ curl -X POST 'http://localhost:6333/collections/my_collection/points/search' \
  -H 'Content-Type: application/json' \
  -d '{
    "vector": [0.1, 0.2, 0.3],
    "limit": 10,
    "params": {
      "indexed_only": true
    }
  }'
Create a snapshot of a single shard for targeted backup or migration without snapshotting the entire collection.
$ curl -X POST 'http://localhost:6333/collections/my_collection/shards/0/snapshots'
Probe the readiness endpoint in a Kubernetes readinessProbe to gate traffic until Qdrant has fully loaded its data.
$ curl -f http://localhost:6333/readyz
  • Adds indexed_only parameter to search requests to skip unindexed segments, speeding up search over large collections.
  • Adds a batch update endpoint for the points API, enabling multiple point operations in a single request.
  • Adds binary quantization support as a new quantization method for vector compression.
  • Adds shard snapshot API for creating and managing per-shard snapshots in distributed deployments.
  • Adds healthz, livez, and readyz HTTP endpoints for standard Kubernetes liveness and readiness health checking.
+7 moreshow less
  • Adds a stack trace API endpoint to expose the current state of all threads for runtime debugging.
  • Adds a recovery mode flag surfaced in metrics.
  • Adds optimizer status and history to telemetry output to aid in debugging optimizer failures.
  • Adds gRPC reflection server, enabling gRPC tooling to discover and introspect the service schema at runtime.
  • Adds a collection info tab to the web UI dashboard.
  • Web UI dashboard now supports downloading and uploading snapshots with an API key.
  • The qdrant-client Python library now integrates with the FastEmbed package for lightweight retrieval embedding generation, enabling document upsert and search without manual encoding.
Was this useful?

Weaviate

Sources Release notes → v1.21.3 NOTES

Weaviate v1.21.3 expands gRPC support with near-text/image/audio/video search, generative search, sorting, consistency, and vectorizer auth.

└──▷ GET THIS VERSION
$ git clone --branch v1.21.3 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.21.3
  • Adds nearText search to the gRPC protocol, enabling vector similarity queries over gRPC alongside the existing REST/GraphQL path.
  • Adds near image, audio, and video search operators to the gRPC protocol.
  • Adds generative search to the gRPC protocol, bringing RAG-style queries to the gRPC surface.
  • Adds consistency-level control to gRPC requests, matching the consistency options available over REST.
  • Adds vectorizer authentication support via gRPC, so module-backed vectorizers can be authorized over the gRPC path.
+3 moreshow less
  • Adds result sorting to the gRPC protocol.
  • Adds Java options to the gRPC protobuf definition, improving first-class Java client support.
  • Supports new Google PaLM modules via the generative-palm integration.
Was this useful?
my-toolchain — 0 tools
paste an install list to detect your tools

A brew list, a Brewfile, requirements.txt, a Dockerfile — or just the product names, free-form. Nothing leaves your browser.

    browse all tools →