Heads up This site is currently under heavy development.
Subscribe Get it delivered — the daily firehose, filtered to the tools you run, plus the documentation changes vendors never announce. Compare plans →

The AI Toolchain — issue -390, May 31, 2023

THE AI TOOLCHAIN NO. -390
Tail
THE DAILY RELEASE FIREHOSE
PUBLISHED MAY 31, 2023 · EVERY WEEKDAY
EDITIONS tail grep head diff uniq

The daily firehose — everything the toolchain shipped today, already filtered.

// HOW THIS ISSUE IS MADE

We read every release from the 174 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.

VIEW
ISSUE VIEW full issue
Do you prefer this view?
$ tct list   # 13 tools matched
AI & LLM Tooling
◆  AI Agent Frameworks

AutoGPT

Sources Release notes → v0.3.1 2 RELEASES · 2023-05-02 → 2023-05-15 NOTES STABLE

AutoGPT v0.3.1 adds command disabling via .env, plugin denylist handling, Edge browser support, and user-input logging.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.1 https://github.com/Significant-Gravitas/AutoGPT.git
# already have the repo? check out this version:
$ git checkout v0.3.1
  • Enables disabling specific commands via the .env file, giving operators control over which capabilities the agent can invoke.
  • Adds denylist handling for plugins, allowing operators to block specific plugins from loading.
  • Logs user input to the logs/Debug folder for audit and review.
  • Adds Edge browser support using EdgeChromiumDriverManager.
  • Adds --install-plugin-deps flag to the Docker entrypoint for automatic plugin dependency installation.
1 more release in this issue · 2023-05-02 → 2023-05-15
v0.3.0 NOTES STABLE

AutoGPT v0.3.0 adds a plugin system, automatic prompt generation, self-feedback mode, running-cost awareness, and authenticated Milvus memory backends.

└──▷ GET THIS VERSION
$ git clone --branch v0.3.0 https://github.com/Significant-Gravitas/AutoGPT.git
# already have the repo? check out this version:
$ git checkout v0.3.0
└──▷ HOW TO FIND IT
Trigger self-feedback to let the agent critique and refine its own plan mid-run.
📍When AutoGPT prompts for input, press: S
  • Adds <reason> argument to the do_nothing command, allowing the agent to record why it chose to take no action.
  • Supports secure and authenticated Milvus memory backends for production deployments.
  • Introduces a third-party plugin system so developers can extend AutoGPT with new commands and integrations (note: plugin interface is marked unstable and may change in v0.3.1 and v0.4.0).
  • Adds automatic initial prompt generation — describe a goal in plain language and AutoGPT generates its own structured prompt.
  • Adds self-feedback mode: pressing S at the input prompt triggers the AI to reflect on and revise its own reasoning and plans.
+6 moreshow less
  • Adds running-cost awareness so AutoGPT tracks and surfaces its accumulated API spend during a session.
  • Adds a workspace abstraction to isolate and manage the agent's file operations.
  • Adds OS info into the initial prompt so the agent is aware of the host environment.
  • Includes memory challenge benchmarks (levels 1–10) in the test suite to objectively measure memory system improvements.
  • Maintains a running summary of prior interactions after each step to improve long-session memory management.
  • Handles API timeouts gracefully instead of crashing.
└──▷ BREAKING ON UPGRADE
  • !The blacklist and whitelist configuration terms are renamed to denylist and allowlist respectively; existing configs using the old terms will need to be updated.
Was this useful?

deepset Haystack

Sources Release notes → v1.17.0 NOTES

Haystack v1.17 adds ConversationalAgent with memory, Anthropic and Cohere LLM support, Weaviate auth, and streaming for HF Inference Endpoints.

└──▷ GET THIS VERSION
$ git clone --branch v1.17.0 https://github.com/deepset-ai/haystack.git
# already have the repo? check out this version:
$ git checkout v1.17.0
└──▷ USE IT
Build a chat application with summarized memory to stay within token limits.
python
from haystack.agents.memory import ConversationalSummaryMemory
from haystack.agents import ConversationalAgent

summary_memory = ConversationalSummaryMemory(prompt_node=prompt_node)
agent = ConversationalAgent(prompt_node=prompt_node, memory=summary_memory)
response = agent.run(user_input="What are the main causes of climate change?")
Override generation parameters per pipeline run without changing the PromptNode definition.
python
pipeline.run(
    query="Summarize this document",
    params={
        "PromptNode": {
            "generation_kwargs": {"max_new_tokens": 200, "temperature": 0.7}
        }
    }
)
  • Adds ConversationalAgent class for building chat applications, accepting a PromptNode and an optional memory argument for conversation history injection.
  • Adds ConversationSummaryMemory (also referenced as ConversationalSummaryMemory) to condense chat history before injecting into the prompt, keeping usage within model token limits.
  • Adds AnthropicInvocationLayer to support claude models from Anthropic as a PromptNode backend.
  • Adds CohereInvocationLayer to support command models from Cohere as a PromptNode backend.
  • Adds AuthBearerToken and AuthClientCredentials authentication options to WeaviateDocumentStore.
+7 moreshow less
  • Adds max_tokens parameter to BaseGenerator params, exposing token-limit control across generator implementations.
  • Adds streaming support to HFInferenceEndpointInvocationLayer for token-by-token output from Hugging Face Inference Endpoints.
  • Adds streaming support to the HF local runtime invocation layer.
  • Enables passing generation_kwargs to PromptNode at pipeline.run() time, allowing per-run overrides of generation parameters.
  • Adds BLIP model support to TransformersImageToText component.
  • Adds Google API as a search engine provider option.
  • Introduces generalimport to defer missing-dependency errors from import time to actual usage time, reducing mandatory dependencies for a base pip install farm-haystack.
└──▷ BREAKING ON UPGRADE
  • !MilvusDocumentStore is removed from core Haystack; it must now be installed separately from the haystack-extras repo.
  • !BaseKnowledgeGraph is removed from the library.
  • !The PDFToTextOCRConverter node is removed.
  • !Schema objects' to_dict, from_dict, to_json, and from_json methods have been updated to handle Dataframes, which may change serialization behavior for existing code.
Was this useful?

LangChain

Sources Release notes → v0.0.187 31 RELEASES · 2023-05-01 → 2023-05-31 NOTES STABLE

LangChain v0.0.187 adds AWS Bedrock LLM/embeddings, SQLite entity memory, HTML splitter, Qdrant filters, and Vertex AI Matching Engine vector store.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.187 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.187
  • Adds encoding_kwargs parameter to InstructEmbeddings for controlling tokenizer encoding behavior.
  • Adds n_threads parameter to GPT4All integration for controlling thread count during inference.
  • Adds batching support to the Qdrant vector store integration.
  • Adds Qdrant filter support, enabling filtered similarity searches against Qdrant collections.
  • Adds ElasticsearchEmbeddings support for initializing a connection via an existing ES Client object.
+7 moreshow less
  • Adds new SQLiteEntityStore-backed Entity Memory, persisting entity context to a SQLite database.
  • Adds an HTML text splitter (Harrison/html splitter) for chunking HTML documents.
  • Adds AWS Bedrock LLM and embeddings integration (Bedrock LLM and embeddings classes).
  • Adds Google Vertex AI Matching Engine as a vector store backend.
  • Adds maximal marginal relevance (MMR) search to SKLearnVectorStore.
  • Adds credential-specification support when using Google BigQuery as a data loader.
  • Adds async support (_acall) to SelfAskWithSearchChain.
30 more releases in this issue · 2023-05-01 → 2023-05-31
v0.0.185 NOTES STABLE

LangChain v0.0.185 adds GitHub and Trello document loaders, MongoDB Atlas vector search, Spark reader, and 10 new code splitter languages.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.185 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.185
└──▷ USE IT
Split C++ or Rust source files into semantically meaningful chunks using the new language-aware code splitters.
python
from langchain.text_splitter import Language, RecursiveCharacterTextSplitter

splitter = RecursiveCharacterTextSplitter.from_language(
    language=Language.RUST,
    chunk_size=400,
    chunk_overlap=40
)
chunks = splitter.create_documents([rust_source_code])
  • Adds MongoDBAtlasVectorSearch vector store integration for MongoDB Atlas.
  • Adds ToolException class that a tool can raise to signal errors within the tool execution lifecycle.
  • Adds DocumentLoader for GitHub to load repository content as documents.
  • Adds a Trello document loader for ingesting Trello board data.
  • Adds a Spark reader for loading data from Apache Spark.
+2 moreshow less
  • Extends code text splitters with support for Go, RST, JavaScript, Java, C++, Scala, Ruby, PHP, Swift, and Rust.
  • Adds support for a configurable condense_question_llm to the conversational retrieval chain, enabling a separate LLM for question condensation.
v0.0.184 NOTES STABLE

LangChain v0.0.184 adds async routing chains, DeepInfra integration, datetime output parser, and Vertex AI embedding pagination

└──▷ GET THIS VERSION
$ git clone --branch v0.0.184 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.184
  • Adds async support to routing chains, enabling non-blocking chain dispatch in async Python applications.
  • Adds pagination support for Vertex AI embeddings, allowing large embedding batches to be processed without hitting API limits.
  • Adds a new datetime output parser (Harrison/datetime parser) for structured date/time extraction from LLM responses.
  • Adds DeepInfra as a new LLM integration.
  • Adds updated llama.cpp integration (Harrison/llamacpp) with demonstration notebook updates.
+3 moreshow less
  • Adds updated PredictionGuard integration.
  • Adds path validation to DirectoryLoader to prevent loading from invalid paths.
  • Enables appending arbitrary messages to chat history.
└──▷ BREAKING ON UPGRADE
  • !The deprecated llm attribute has been removed from load_chain.
v0.0.182 NOTES STABLE

LangChain v0.0.182 adds an enum output parser, SKLearnVectorStore, and shopping search support in SerpApi

└──▷ GET THIS VERSION
$ git clone --branch v0.0.182 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.182
  • Adds SKLearnVectorStore vector store backed by scikit-learn for lightweight, dependency-minimal vector search.
  • Adds enum output parser for constraining LLM outputs to a defined set of enumerated values.
  • Adds shopping search support to the SerpApi integration, expanding retrieval beyond web results.
  • Adds cosmos kwargs option to the Cosmos DB integration, allowing pass-through of additional client arguments.
  • Adds DynamoDB Chat Message History support with a sample notebook demonstrating persistent conversation storage.
v0.0.181 NOTES STABLE

LangChain v0.0.181 adds C Transformers (GGML), Momento cache, Databricks LLM, Twilio tool, BigQuery SQL dialect, and multi-CSV/DataFrame support.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.181 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.181
└──▷ USE IT
Cache LLM responses in Momento to reduce latency and cost across distributed services.
python
from langchain.cache import MomentoCache
import langchain

langchain.llm_cache = MomentoCache.from_client_params(
    cache_name='langchain-cache',
    ttl=300
)
Analyse multiple CSV files at once using the updated multi-CSV agent toolkit.
python
from langchain.agents import create_csv_agent
from langchain.llms import OpenAI

agent = create_csv_agent(
    OpenAI(temperature=0),
    ['users.csv', 'events.csv'],
    verbose=True
)
agent.run('Which user triggered the most events?')
  • Adds visible_only and strict_mode options to ClickTool for finer control over browser automation interactions.
  • Adds pipeline_kwargs support to HuggingFacePipeline.from_model_id for passing arbitrary pipeline arguments at construction time.
  • Adds support for the BigQuery SQL dialect in the SQL database integration.
  • Adds C Transformers integration for running GGML-format local models via a new LLM wrapper.
  • Adds Momento as both a standard LLM cache provider and a chat message history backend.
+4 moreshow less
  • Adds a Twilio tool, enabling agents to send messages via Twilio.
  • Adds an LLM wrapper for Databricks, enabling LangChain chains and agents to call Databricks-hosted models.
  • Adds a proxy configuration option for the OpenAI API client.
  • Adds multi-CSV and multi-DataFrame support to the CSV and DataFrame agent toolkits.
v0.0.180 NOTES STABLE

LangChain v0.0.180 adds ModelScope and Vertex AI integrations, TF-IDF retriever, BibTeX loader, MiniMax embeddings, and more new loaders and capabilities.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.180 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.180
└──▷ USE IT
Quickly build a sparse retriever from a set of documents when you have no vector DB available.
python
from langchain.retrievers import TFIDFRetriever

retriever = TFIDFRetriever.from_documents(docs)
results = retriever.get_relevant_documents('what is the capital of France?')
  • Adds TFIDFRetriever for sparse retrieval over document collections without a vector database.
  • Adds BibtexLoader and a BibTeX-backed retriever for loading and retrieving academic references from .bib files.
  • Adds MiniMaxEmbeddings for generating embeddings via the MiniMax API.
  • Adds IuguLoader document loader for ingesting Iugu financial data.
  • Adds JoplinLoader document loader for loading notes from a Joplin instance.
+9 moreshow less
  • Adds ModelScope LLM integration (Harrison/modelscope) for accessing ModelScope-hosted models.
  • Adds Google Vertex AI LLM integration (Harrison/vertex) for accessing Vertex AI language models.
  • Adds async from_text() method to GraphIndexCreator for non-blocking knowledge graph construction.
  • Adds status subcommand to the langchain plus CLI to check LangChain Plus server status.
  • Adds Delete Session method to conversation session management.
  • Adds option to pass an OpenAI API key directly to the langchain plus CLI command.
  • Allows specifying a custom ID when adding documents to a FAISS vectorstore.
  • Allows ReadTheDocsLoader to accept a custom HTML tag for more flexible documentation ingestion.
  • Changes default GoogleDriveLoader behavior to skip trashed files.
└──▷ BREAKING ON UPGRADE
  • !The default behavior of GoogleDriveLoader changes: trashed files are no longer loaded. Pipelines relying on trashed-file ingestion will silently stop receiving those documents.
v0.0.179 NOTES STABLE

LangChain v0.0.179 adds ElasticsearchEmbeddings, Typesense and Vectara vector stores, MosaicML and Beam LLM integrations, a Weather loader, and async predict methods.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.179 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.179
└──▷ USE IT
Run LLM inference asynchronously inside an async event loop to avoid blocking an application thread.
python
import asyncio
from langchain.chat_models import ChatOpenAI
from langchain.schema import HumanMessage

chat = ChatOpenAI()

async def run():
    response = await chat.apredict_messages([HumanMessage(content="Summarize this CVE report:")])
    print(response)

asyncio.run(run())
  • Adds ElasticsearchEmbeddings class for generating embeddings directly using Elasticsearch-hosted models.
  • Adds Typesense vector store integration for similarity search backed by Typesense.
  • Adds Vectara vector store integration.
  • Adds MosaicML inference endpoint integration for hosted LLM inference.
  • Adds Beam integration as a new LLM backend.
+2 moreshow less
  • Adds async versions of predict() and predict_messages() on chat/LLM classes for non-blocking inference.
  • Adds a Weather document loader for ingesting weather data into LangChain pipelines.
v0.0.178 NOTES STABLE

LangChain v0.0.178 adds Mastodon loader, OpenLM multi-provider LLM, WhyLabs callback, AzureCognitiveServicesToolkit, and Pinecone metadata support.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.178 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.178
└──▷ USE IT
Equip an agent with Azure Cognitive Services tools (image analysis, speech, form recognition) in one step.
python
from langchain.agents.agent_toolkits import AzureCognitiveServicesToolkit

toolkit = AzureCognitiveServicesToolkit()
tools = toolkit.get_tools()
Load a user's public Mastodon toots as LangChain documents for downstream analysis or RAG pipelines.
python
from langchain.document_loaders import MastodonTootsLoader

loader = MastodonTootsLoader(
    mastodon_accounts=['@[email protected]'],
    number_toots=50
)
docs = loader.load()
Route LLM calls across multiple providers (OpenAI, Cohere, etc.) using OpenLM without changing downstream code.
python
from langchain.llms import OpenLM

llm = OpenLM(model_name='cohere/command-xlarge-nightly')
llm('Summarize recent CVEs in Apache HTTP Server.')
  • Adds AzureCognitiveServicesToolkit to call Azure Cognitive Services APIs from LangChain agents.
  • Adds get_top_k_cosine_similarity method to retrieve max top-k cosine similarity scores and indices.
  • Adds WhyLabsCallbackHandler integration for LLM observability and data quality monitoring via WhyLabs.
  • Adds OpenLM LLM class enabling multi-provider LLM access through a single OpenAI-compatible interface.
  • Adds MastodonTootsLoader document loader to ingest Mastodon toots.
+5 moreshow less
  • Adds SSL certificate support and username/password authentication for the Elasticsearch integration.
  • Extends Pinecone hybrid search retriever with metadata filtering support.
  • Improves resilience of the MRKL agent when handling unexpected outputs.
  • Improves efficiency of TextSplitter.split_documents by reducing iteration to a single pass.
  • Adds additional Weaviate vector store capabilities including expanded query support.
v0.0.177 NOTES STABLE

LangChain v0.0.177 adds Cypher chain support, batch Unstructured API file uploads, and a new get_token_ids method.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.177 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.177
└──▷ USE IT
Retrieve token IDs for a prompt using the new get_token_ids method — useful for token-level analysis or building custom truncation logic.
python
from langchain.chat_models import ChatOpenAI

llm = ChatOpenAI()
token_ids = llm.get_token_ids("Explain zero-trust networking.")
print(token_ids)
  • Adds get_token_ids method to retrieve token IDs from language models.
  • Supports batching multiple files in a single Unstructured API request, reducing round-trips for document ingestion.
  • Adds a Cypher chain (Harrison/cypher) for querying graph databases via natural-language-to-Cypher translation.
  • Preserves conversation language in conversation retrieval chains.
  • Separates runner functions from the client in the LangChain runner, enabling independent use of each.
v0.0.176 NOTES STABLE

LangChain v0.0.176 adds Psychic integration and Databricks documentation.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.176 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.176
  • Adds Psychic integration as a new data source connector.
v0.0.175 NOTES STABLE

LangChain v0.0.175 adds async similarity search with scores, pgvector 'IN' filter, Weaviate self-query translator, and agent streaming.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.175 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.175
  • Adds IN metadata filter for pgvector vectorstore, enabling set-membership checks in structured queries.
  • Adds async search with relevance score support for vectorstores.
  • Adds self-query retriever translator for the Weaviate vectorstore.
  • Adds logs command to the LangChain CLI.
  • Streaming now emits only the final output of an agent, rather than intermediate steps.
+1 moreshow less
  • Improves the Evernote document loader with expanded capabilities.
v0.0.174 NOTES STABLE

LangChain v0.0.174 adds Zep vector search over chat history, Spark SQL, Databricks SQL support, and Google Drive file-type filtering.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.174 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.174
  • Adds TextLoader auto-detection of character encoding, reducing manual configuration when loading text files.
  • Adds Zep Retriever for vector search over chat history, enabling semantic retrieval across past conversation memory.
  • Adds Spark SQL support via SQLDatabase, extending chain-based SQL querying to Spark environments.
  • Adds Databricks support in SQLDatabase, allowing SQL chains to query Databricks databases.
  • Adds file-type filtering when loading documents from Google Drive, so loaders can target specific MIME types rather than all files.
+2 moreshow less
  • Adds human message as an input variable to chat agent prompt creation, giving more control over prompt construction in conversational agents.
  • Updates GPT4ALL integration with improvements to the underlying model interface.
v0.0.173 NOTES STABLE

LangChain v0.0.173 adds Zep memory, generic document loader, HTML parsers, FAISS no-AVX2 support, and customizable ConversationalChatAgent templates.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.173 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.173
  • Allows customizing TEMPLATE_TOOL_RESPONSE in ConversationalChatAgent to override the default tool-response prompt template.
  • Adds lazy load support to the Hugging Face document loader.
  • Adds a generic document loader for flexible document ingestion.
  • Adds HTML parsers for parsing HTML content in document pipelines.
  • Adds Zep memory integration for persistent conversational memory via Zep.
+3 moreshow less
  • Adds a FAISS build variant without AVX2 requirement, enabling use on CPUs that lack AVX2 instruction support.
  • Adds a FastAPI + Vercel deployment option for serving LangChain applications.
  • Adds Python tool sanitization to improve safety of the Python REPL tool.
v0.0.172 NOTES STABLE

LangChain v0.0.172 adds a 2markdown loader, Weaviate text search, a from_file method for message prompt templates, and flexible LLM input formats.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.172 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.172
  • Adds from_file method to message prompt template classes, enabling prompt templates to be loaded directly from files.
  • Adds uuids kwargs support to Weaviate vector store for caller-controlled document UUIDs.
  • Adds by_text search method to the Weaviate integration.
  • Adds a 2markdown document loader.
  • Adds support for flexible input formats for LLM and Chat Model runs.
v0.0.171 NOTES STABLE

LangChain v0.0.171 adds GraphQL tool, Cassandra/MongoDB chat history, Milvus/Zilliz retrievers, Wikipedia loader, and llama-cpp GPU layers.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.171 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.171
  • Adds gpu_layers parameter to the llama-cpp integration, enabling GPU-accelerated inference.
  • Adds summarization task type support for HuggingFace APIs.
  • Adds source field to document metadata.
  • Adds a GraphQL Query Tool for executing GraphQL queries as an agent tool.
  • Adds Milvus and Zilliz retriever integrations.
+5 moreshow less
  • Adds Cassandra support for chat message history storage.
  • Adds a Wikipedia document loader.
  • Adds MongoDB chat message history example via Jupyter Notebook.
  • Adds exponential back-off support for the Google PaLM API.
  • Makes the headless argument optional in the browser utility.
v0.0.170 NOTES STABLE

LangChain v0.0.170 adds RELLM decoding, Rebuff prompt injection defense, Telegram/Docugami/pdfplumber loaders, and streaming HuggingFace inference.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.170 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.170
└──▷ USE IT
Load and parse a Telegram chat export into LangChain documents for downstream RAG or analysis.
python
from langchain.document_loaders import TelegramChatLoader

loader = TelegramChatLoader(path='./telegram_chat.json')
docs = loader.load()
Extract text from a PDF using pdfplumber for richer layout-aware parsing compared to the default PDF loaders.
python
from langchain.document_loaders import PDFPlumberLoader

loader = PDFPlumberLoader('report.pdf')
docs = loader.load()
  • Adds OpenWeatherMapAPIWrapper tool to the public API, making it available for direct import and use in agents.
  • Adds RELLM experimental LLM decoding, enabling regex-enforced structured output during generation.
  • Adds Rebuff integration for prompt injection detection and defense in LLM pipelines.
  • Adds TelegramChatLoader for loading Telegram chat history as documents.
  • Adds DocugamiLoader for loading documents from Docugami.
+5 moreshow less
  • Adds PDFPlumberLoader (using BaseBlobParser) for PDF ingestion via the pdfplumber library.
  • Adds streaming output support to HuggingFaceTextgenInference LLM class.
  • Adds support for loading sitemaps from local files in the sitemap loader.
  • Improves YoutubeLoader video ID extraction using built-in URL parsing instead of regex, broadening supported URL formats.
  • Adds environment info to LangChain runs for better observability and debugging context.
└──▷ BREAKING ON UPGRADE
  • !The openai_api_version parameter is no longer set by default in the OpenAI integration; setups relying on a default value must now supply it explicitly.
v0.0.169 NOTES STABLE

LangChain v0.0.169 adds Metaphor search, embedding router, agent serialization, Azure content filter handling, and multithreaded directory loading.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.169 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.169
  • Adds Metaphor search integration as a new retrieval tool.
  • Adds an embedding router to route queries across multiple embeddings.
  • Adds agent serialization, enabling agents to be saved and loaded.
  • Adds Azure content filter awareness for OpenAI-on-Azure calls.
  • Adds multithreading support to the directory loader for faster document ingestion.
+10 moreshow less
  • Adds custom base-path support for ChatOpenAI, enabling use with OpenAI-compatible endpoints.
  • Adds custom HTTP headers support for OpenAI API calls.
  • Adds from_keys constructor for Redis vector store.
  • Adds memory support for the structured chat agent.
  • Adds summary memory with conversation history tracking.
  • Adds Spark Connect integration example for loading data from Spark.
  • Allows partial variables in from_template for prompt templates.
  • Adds custom base prompt support for the Zapier tool integration.
  • Adds support for newline-delimited JSON output format.
  • Supports passing a list of messages directly in chat interactions.
└──▷ BREAKING ON UPGRADE
  • !Tracers have been refactored; existing tracer integrations or subclasses may break on upgrade.
v0.0.168 NOTES STABLE

LangChain v0.0.168 adds Steamship image generation, a FLARE-inspired chain, and new prompt constructor methods.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.168 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.168
  • Adds Steamship Image Generation Tool for generating images within LangChain agent workflows.
  • Introduces a FLARE-inspired chain (Forward-Looking Active REtrieval) for improved retrieval-augmented generation.
  • Adds prompt constructor methods via a new standard prompt construction interface.
  • Adds a standard LLM interface to normalize interactions across LLM providers.
  • Adds option for the CSV agent to exclude the dataframe from the prompt, reducing token usage.
+1 moreshow less
  • Converts Chain to a Chain Factory pattern, enabling dynamic chain instantiation.
v0.0.167 NOTES STABLE

LangChain v0.0.167 adds an arXiv retriever, HuggingFace TGI server support, chat-start callbacks, and invocation params in LLM callbacks.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.167 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.167
└──▷ USE IT
Retrieve academic papers from arXiv and use them as context in a QA chain.
python
from langchain.retrievers import ArxivRetriever

retriever = ArxivRetriever()
docs = retriever.get_relevant_documents("attention is all you need")
  • Adds arxiv retriever for fetching and searching arXiv papers directly within retrieval chains.
  • Adds on_chat_message_start callback event to the callback system, enabling hooks at the start of individual chat messages.
  • Adds invocation params as extra params in LLM callbacks, giving callback handlers access to the full set of parameters used at inference time.
  • Adds a new class to support the HuggingFace text generation inference (TGI) server as an LLM backend.
  • Adds constitutional principles sourced from the Constitutional AI paper to the built-in principle library.
+3 moreshow less
  • Adds a PrestoDB SQL prompt for use with SQL-based chains and agents.
  • Makes BaseStringMessagePromptTemplate.from_template return type generic, improving type inference for subclasses.
  • Improves the Vespa interface with enhanced integration capabilities.
v0.0.166 NOTES STABLE

LangChain v0.0.166 adds Azure Cognitive Search retriever, MLflow callback handler, Anyscale LLM support, and HuggingFace tool loading.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.166 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.166
  • Adds Azure Cognitive Search retriever integration for document retrieval pipelines.
  • Adds MLflow callback handler, enabling experiment tracking and run logging through LangChain's callback system.
  • Adds LLM support for Anyscale Service, allowing hosted Anyscale endpoints to be used as LLM backends.
  • Adds load support for HuggingFace Tools, enabling HuggingFace-hosted tools to be loaded directly into agents.
  • Adds aleph_alpha_api_key attribute to the Aleph Alpha integration for explicit API key configuration.
+2 moreshow less
  • Adds parameterized distance metrics support (vector store distance configuration).
  • Adds _type identifier to all output parsers, enabling consistent parser serialization and deserialization.
v0.0.165 NOTES STABLE

LangChain v0.0.165 adds DocArray vector stores and a new tracing v2 environment variable.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.165 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.165
  • Adds LANGCHAIN_TRACING_V2 environment variable to enable tracing v2.
  • Adds DocArray vector stores integration.
v0.0.164 NOTES STABLE

LangChain v0.0.164 adds a Wikipedia retriever, ODT file loader, Qdrant nested filters, and Plan-and-Solve agent support.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.164 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.164
└──▷ USE IT
Retrieve Wikipedia passages as context for a QA chain without managing your own vector store.
python
from langchain.retrievers import WikipediaRetriever

retriever = WikipediaRetriever()
docs = retriever.get_relevant_documents("Large language models")
  • Adds Wikipedia retriever for querying Wikipedia as a retrieval source.
  • Adds loader for OpenOffice ODT files via the new ODT document loader.
  • Adds support for Qdrant nested filters in vector store queries.
  • Adds Plan-and-Solve agent, moved to the experimental module.
  • Adds request timeout support for OpenAI embedding calls.
+2 moreshow less
  • Adds ClickHouse prompt support for SQL chain interactions.
  • Extends web crawler metadata extraction with an option to pull additional metadata from crawled websites.
v0.0.163 NOTES STABLE

LangChain v0.0.163 adds MimeType-based parsing, PDF parser implementations, OpenSearch similarity search with score, and a two-agent debate example.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.163 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.163
  • Adds MimeType based parser for routing document parsing by MIME type.
  • Adds PDF parser implementations for extracting text from PDF documents.
  • Adds similarity search with score to the OpenSearch vector store integration.
  • Updates the Writer LLM integration with new capabilities.
  • Adds a new example notebook demonstrating two-agent debate with tools.
v0.0.162 NOTES STABLE

LangChain v0.0.162 adds YouTube tools, MongoDB chat history, GPT4All-J support, and SeleniumURLLoader binary path control.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.162 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.162
└──▷ USE IT
Point SeleniumURLLoader at a non-default Chrome binary, e.g. a Chromium install in CI.
python
from langchain.document_loaders import SeleniumURLLoader

loader = SeleniumURLLoader(
    urls=["https://example.com"],
    browser="chrome",
    binary_location="/usr/bin/chromium-browser"
)
docs = loader.load()
  • Adds binary_location parameter to SeleniumURLLoader for specifying a custom Chrome or Firefox WebDriver binary path.
  • Adds YouTube tools via add youtube tools integration for agent use.
  • Adds MongoDB support for chat history persistence.
  • Adds streaming API support and GPT4All_J model support to the GPT4All LLM integration.
  • Enables callbacks to be passed through load_tools for consistent observability across dynamically loaded tools.
v0.0.161 NOTES STABLE

LangChain v0.0.161 adds BlobParser abstraction, Wikipedia loader, HumanInputLLM, and PyPDFium2 support

└──▷ GET THIS VERSION
$ git clone --branch v0.0.161 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.161
  • Adds BlobParser abstraction for parsing blobs of data into documents, enabling more flexible document ingestion pipelines.
  • Adds Wikipedia document loader for loading content directly from Wikipedia into LangChain pipelines.
  • Adds HumanInputLLM, a new LLM class that prompts a human for input, useful for testing and human-in-the-loop workflows.
  • Adds PyPDFium2 support as a new PDF loading backend.
  • Simplifies router chain constructor signatures to reduce boilerplate when building routing chains.
+1 moreshow less
  • Extends the NotionDB document loader to extract and expose page URLs.
v0.0.160 NOTES STABLE

LangChain v0.0.160 adds a JSON loader, WebDriver argument passthrough, and an updated Qdrant interface.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.160 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.160
└──▷ USE IT
Load structured data from a JSON file into LangChain documents for downstream retrieval or QA chains.
python
from langchain.document_loaders import JSONLoader

loader = JSONLoader(file_path='data.json', jq_schema='.messages[].content')
docs = loader.load()
  • Adds JSONLoader for loading and parsing JSON files as LangChain documents.
  • Allows users to pass additional arguments to the WebDriver via the Selenium document loader.
  • Updates the Qdrant vector store interface with a revised API.
  • Adds LCP (LangChain Plus) client for tracing and observability integration.
  • Updates the V2 Tracer with improvements to run tracking.
v0.0.159 NOTES STABLE

LangChain v0.0.159 adds Chroma self-query support, Tenant ID to V2 Tracer, and an updated Cohere Reranker.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.159 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.159
  • Adds Tenant ID support to the V2 Tracer for multi-tenant tracing scenarios.
  • Adds self-query retriever support for Chroma vector store.
  • Updates the Cohere Reranker integration.
v0.0.158 NOTES STABLE

LangChain v0.0.158 adds router chains, KNN retriever, OneDrive/MediaWiki/TOML loaders, Firestore memory, and async Google Serper with Images/Places/News support.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.158 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.158
  • Adds FileChatMessageHistory to the public export surface, making file-backed chat history directly importable.
  • Adds router chains (Router chains) enabling dynamic routing of inputs across multiple sub-chains.
  • Adds a KNN retriever for similarity-based document retrieval without a vector store.
  • Adds a OneDrive document loader for ingesting files from Microsoft OneDrive.
  • Adds a MediaWiki XML document loader for ingesting MediaWiki XML dumps.
+7 moreshow less
  • Adds a TOML document loader for parsing TOML-formatted files.
  • Adds Firestore memory backend for persistent conversation history stored in Google Cloud Firestore.
  • Adds a Spark Agent for interacting with Apache Spark environments.
  • Extends google-serper integration with async support, full JSON results, and support for Google Images, Places, and News result types.
  • Adds option to fetch all tokens in a single call via the Blockchain document loader.
  • Adds summary buffer pruning capability to the summary buffer memory class.
  • Extends the shell tool to accept either a str or list[str] as input.
v0.0.156 NOTES STABLE

LangChain v0.0.156 consolidates tracing to a single runs endpoint with the v2 tracer.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.156 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.156
  • Introduces v2 tracer that routes all trace data through a single runs endpoint.
v0.0.155 NOTES STABLE

LangChain v0.0.155 adds Google PaLM models, ConstitutionalChain, Cohere reranker, SQLite chat history, Unstructured API loaders, and a Structured Chat Agent.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.155 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.155
└──▷ USE IT
Use Google PaLM as a drop-in LLM backend for any LangChain chain.
python
from langchain.llms import GooglePalm

llm = GooglePalm(google_api_key='<your-api-key>')
print(llm('Explain zero-trust architecture in one sentence.'))
Persist conversation history to SQLite so it survives process restarts.
python
from langchain.memory import SQLiteChatMessageHistory

history = SQLiteChatMessageHistory(session_id='user-123', connection_string='sqlite:///chat.db')
Wrap a chain in ConstitutionalChain to automatically critique and revise unsafe or low-quality outputs.
python
from langchain.chains import ConstitutionalChain, LLMChain
from langchain.chains.constitutional_ai.models import ConstitutionalPrinciple
from langchain.llms import OpenAI

llm = OpenAI()
base_chain = LLMChain(llm=llm, prompt=my_prompt)
constitutional_chain = ConstitutionalChain.from_llm(
    llm=llm,
    chain=base_chain,
    constitutional_principles=[
        ConstitutionalPrinciple(
            critique_request='Does the response contain harmful content?',
            revision_request='Rewrite it to be safe and helpful.'
        )
    ]
)
print(constitutional_chain.run('How do I pick a lock?'))
  • Exports StructuredTool at the /tools module path for easier importing.
  • Adds SQLiteChatMessageHistory for persistent SQLite-backed conversation memory.
  • Adds ChatModel, LLM, and Embeddings classes for Google's PaLM APIs.
  • Adds encode_kwargs support to HuggingFace embeddings for finer control over encoding.
  • Adds Unstructured API loaders for document ingestion via the Unstructured API.
+16 moreshow less
  • Adds ConstitutionalChain for self-critique and revision of LLM outputs.
  • Adds CombinedMemory to compose multiple memory backends together.
  • Adds a Structured Chat Agent capable of handling structured tool inputs.
  • Adds a Cohere reranker for relevance-based document reordering in retrieval pipelines.
  • Adds a minimal file system blob loader for loading files as blobs.
  • Adds blockwise sitemap loader for large sitemap processing.
  • Adds async support to LLMChainExtractor.
  • Adds connection string authentication support to the Cosmos DB integration.
  • Adds a Modern Treasury API integration.
  • Adds Spreedly API integration.
  • Adds from_documents class method for constructing vectorstores directly from documents.
  • Adds agent_executor_kwargs to allow passing additional keyword arguments to AgentExecutor.
  • Adds relevancy score support to similarity search results.
  • Adds multi-agent simulation with environment example using GymnasiumAgent.
  • Counts tokens instead of characters in AutoGPT prompt construction for more accurate context management.
  • Makes ddg-search available via __init__ for simpler tool loading.
└──▷ BREAKING ON UPGRADE
  • !GPT4All integration now requires PyGPT4All instead of the previous backend — existing GPT4All setups will break on upgrade without migrating to PyGPT4All.
v0.0.154 NOTES STABLE

LangChain v0.0.154 adds a Lambda Tool and a major Callbacks refactor.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.154 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:
$ git checkout v0.0.154
  • Adds Lambda Tool, enabling arbitrary Python callables to be wrapped as LangChain tools without subclassing.
  • Refactors the Callbacks base layer, overhauling how callbacks are registered and dispatched across chains and agents.
Was this useful?
◆  Local LLM Runtimes

KoboldCpp

Sources Release notes → v1.26b 8 RELEASES · 2023-05-01 → 2023-05-27 NOTES STABLE

KoboldCpp v1.26b adds token probability inspection via --debugmode, a new Top-A sampler, and Starcoder model support.

└──▷ GET THIS VERSION
$ git clone --branch v1.26b https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.26b
└──▷ TRY IT
Inspect per-token probabilities and context contents during generation to evaluate sampler settings or diagnose model overconfidence.
$ koboldcpp.exe --model my_model.bin --debugmode
Re-enable EOS stop tokens (previously blocked by default) so generation halts correctly on end-of-sequence across all model architectures.
$ koboldcpp.exe --model my_model.bin --unbantokens
  • Adds token probability display to --debugmode: for every generated token, the console shows probabilities of up to 4 alternative tokens after all samplers are applied, enabling sampler configuration testing and model confidence analysis.
  • Adds --debugmode display of input/context contents and their token IDs (note: slight performance hit; off by default).
  • Adds --unbantokens flag to enable EOS stop tokens across all model types; the [ token is also no longer banned by default.
  • Adds the Top-A sampler, a Kobold-exclusive implementation not present in upstream llama.cpp, which reduces randomness proportionally to the squared softmax probability of the most probable token (set to 0 to disable).
  • Adds support for Starcoder and Starcoder Chat models.
7 more releases in this issue · 2023-05-01 → 2023-05-27
v1.25.1 NOTES STABLE

KoboldCpp v1.25.1 adds Failsafe mode for AVX-less hardware, sampler_seed API support, and streaming length control in Lite UI.

└──▷ GET THIS VERSION
$ git clone --branch v1.25.1 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.25.1
└──▷ TRY IT
Run KoboldCpp on a legacy CPU with no AVX/SSE support (including Windows 7) using Failsafe mode.
$ koboldcpp.exe --noavx2 --noblas --nommap --model <path-to-model>
Set a fixed sampler seed via the KoboldAI /generate API for reproducible outputs.
$ curl -X POST http://localhost:5001/api/v1/generate -H 'Content-Type: application/json' -d '{"prompt": "Once upon a time", "sampler_seed": 42}'
  • Adds Failsafe mode via --noavx2 --noblas --nommap flags, disabling all CPU intrinsics (AVX, SSE) to run on ancient hardware including Windows 7.
  • Adds sampler_seed parameter support to the /generate API endpoint for reproducible generation.
  • Adds ?streamamount=[value] URL parameter to Kobold Lite UI for controlling variable streaming lengths (default: 8 tokens) when launched with --stream.
  • Expands --debugmode console logging to display context token contents.
  • Adds drag-and-drop file load functionality to Kobold Lite UI.
+2 moreshow less
  • Greatly improved markdown rendering support in Kobold Lite UI.
  • Upgrades CLBlast to version 1.6.
v1.24 NOTES STABLE

KoboldCpp v1.24 adds GGJT v3 quantization support (q4_0, q4_1, q8_0) and new Kobold Lite UI toggles.

└──▷ GET THIS VERSION
$ git clone --branch v1.24 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.24
  • Supports the new GGJT v3 quantization format, including q4_0, q4_1, and q8_0 quantization types, while retaining backwards compatibility with all historical GGML formats (GGML, GGHF, GGJT v1, v2, v3).
  • Adds a toggle in Kobold Lite to avoid inserting newlines in Instruct mode, useful for Pygmalion and OpenAssistant based instruct models.
  • Adds a toggle in Kobold Lite to enable basic markdown rendering in Instruct mode (off by default).
  • Provides an alternative CUDA build (via Henky) for this version, enabling access to the latest GGJT v3 quantizations for CUDA users on LLAMA-based models.
v1.23.1 NOTES STABLE

KoboldCpp v1.23.1 adds GPT-2/J/NeoX quantization support and experimental OpenCL GPU offloading via CLBlast.

└──▷ GET THIS VERSION
$ git clone --branch v1.23.1 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.23.1
└──▷ TRY IT
Offload a fixed number of LLAMA model layers to a GPU using OpenCL/CLBlast to accelerate inference on any OpenCL-capable GPU.
$ koboldcpp.exe --useclblast --gpulayers 20 <path-to-model.ggml>
  • Adds experimental OpenCL GPU offloading via CLBlast using --useclblast combined with --gpulayers <n> to select the number of layers to offload; works on all GPUs for new quantization formats of LLAMA models.
  • Extends GPU offloading support to q8 quantization formats after pulling the q8 dequant kernel fix.
  • Adds support for new quantization formats for GPT-2, GPT-J, and GPT-NeoX models.
v1.20 NOTES STABLE

KoboldCpp v1.20 adds --contextsize flag for large contexts and --forceversion for RedPajama/GPT-NeoX model support.

└──▷ GET THIS VERSION
$ git clone --branch v1.20 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.20
└──▷ TRY IT
Run a large-context model that exceeds the default 2048-token limit.
$ koboldcpp.exe --contextsize 4096 my_model.bin
  • Adds --contextsize flag to allocate additional RAM and support context sizes beyond 2048 tokens.
  • Adds --forceversion flag to manually override model version detection when automatic RedPajama identification fails.
  • Adds experimental support for RedPajama variants of GPT-NeoX models.
v1.19 NOTES STABLE

KoboldCpp v1.19 adds mirostat sampling, force-version override, CLBlast thread control, and expanded RWKV quantization support.

└──▷ GET THIS VERSION
$ git clone --branch v1.19 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.19
└──▷ TRY IT
Enable mirostat type 2 sampling to get more coherent output from a large model without manual temperature/top-p tuning.
$ koboldcpp.exe --model mymodel.bin --usemirostat 2 5.0 0.1
Load a modified or misdetected model by forcing the format version, bypassing failed auto-detection.
$ koboldcpp.exe --model rogue_model.bin --forceversion 401
Tune CLBlast throughput independently from CPU threads when GPU-accelerated inference is active.
$ koboldcpp.exe --model mymodel.bin --threads 4 --blasthreads 8
  • Adds --usemirostat [type] [tau] [eta] flag to enable mirostat sampling on all model types, replacing normal stochastic samplers; e.g. --usemirostat 2 5.0 0.1 for mirostat type 2.
  • Adds --forceversion [ver] flag to override automatic model file format detection when it fails, e.g. 401 for GPTNeoX-Type2.
  • Adds --blasthreads flag to set a separate thread count when CLBlast is active, defaulting to the value of --threads if not specified.
  • Expands RWKV support to include all new RWKV quantizations, with q5_1 delivering significantly faster inference than fp16 at similar quality.
  • Includes an experimental Windows 7-compatible .exe build for this release.
└──▷ BREAKING ON UPGRADE
  • !RWKV Q4_1_O quantization is no longer supported following the upstream change.
v1.18 NOTES STABLE

KoboldCpp v1.18 adds group chat conversations, --highpriority CPU boost flag, and --usemlock RAM-pinning for Apple M1.

└──▷ GET THIS VERSION
$ git clone --branch v1.18 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.18
└──▷ TRY IT
Speed up token generation on a CPU-bound machine by elevating KoboldCpp's process priority.
$ koboldcpp.exe --model mymodel.bin --highpriority
Keep a large model pinned in RAM on Apple M1 to avoid swapping and reduce generation latency.
$ koboldcpp.exe --model mymodel.bin --usemlock
  • Adds --highpriority CLI flag to raise the process CPU priority, potentially reducing generation latency.
  • Adds --usemlock CLI parameter to pin the model in RAM, targeting Apple M1 users.
  • Adds Group Conversations to Kobold Lite chat mode: specify multiple chat opponents delimited with ||$|| (up to 10 custom stopping sequences) so the AI replies as different participants; works best with Multiline Replies disabled and on LLAMA-based models.
  • Adds a new built-in scenario Class Reunion in Kobold Lite to demonstrate group chat functionality.
v1.17 NOTES STABLE

KoboldCpp v1.17 adds --unbantokens flag to unban tokens including EOS, required for newer Pygmalion models.

└──▷ GET THIS VERSION
$ git clone --branch v1.17 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:
$ git checkout v1.17
└──▷ TRY IT
Run KoboldCpp with token unbanning enabled to support newer Pygmalion models that require EOS suppression.
$ koboldcpp.exe --unbantokens
  • Adds --unbantokens CLI flag to unban tokens during generation, including prevention of EOS token generation, enabling compatibility with newer Pygmalion models.
  • Exposes Token Unbanning in the UI, allowing it to be configured without CLI flags.
Was this useful?

LocalAI

Sources Release notes → v1.17.1 3 RELEASES · 2023-05-27 → 2023-05-30 NOTES STABLE

LocalAI v1.17.1 adds CuBLAS support to Docker images for GPU-accelerated inference.

└──▷ GET THIS VERSION
$ git clone --branch v1.17.1 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v1.17.1
  • Adds CuBLAS support to Docker images, enabling GPU-accelerated model inference without a separate build.
2 more releases in this issue · 2023-05-27 → 2023-05-30
v1.17.0 NOTES STABLE

LocalAI v1.17.0 adds CLBlast GPU acceleration support and bumps the RWKV backend.

└──▷ GET THIS VERSION
$ git clone --branch v1.17.0 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v1.17.0
  • Adds CLBlast support, enabling OpenCL-based GPU acceleration for inference.
  • Bumps the RWKV backend to a newer revision.
└──▷ BREAKING ON UPGRADE
  • !The RWKV backend has been bumped to a new version, which may break existing RWKV model configurations or bindings.
v1.16.0 NOTES STABLE

LocalAI v1.16.0 adds Kubernetes health endpoints, static builds, model preloading via env var, and prompt cache path support.

└──▷ GET THIS VERSION
$ git clone --branch v1.16.0 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:
$ git checkout v1.16.0
└──▷ TRY IT
Probe LocalAI readiness in a Kubernetes deployment without waiting for a model to be loaded.
$ curl http://localhost:8080/readyz
  • Adds /healthz and /readyz HTTP endpoints for Kubernetes liveness and readiness probes.
  • Allows preloading models before startup via environment variable or config files.
  • Adds support for setting a prompt cache path and enabling state saving.
  • Adds static builds of LocalAI.
  • Adds Docker image HEALTHCHECK support.
Was this useful?
◆  AI Model & Data Infrastructure

Microsoft ONNX Runtime

Sources Release notes → v1.15.0 NOTES

ONNX Runtime v1.15.0 adds JS and QNN execution providers, on-device training, WebGPU preview, and multi-GPU collective support.

└──▷ GET THIS VERSION
$ git clone --branch v1.15.0 https://github.com/microsoft/onnxruntime.git
# already have the repo? check out this version:
$ git checkout v1.15.0
└──▷ TRY IT
Build ONNX Runtime on a POSIX system as root (e.g., inside a Docker container running as root) — required now that root builds are disallowed by default.
$ ./build.sh --config Release --allow_running_as_root
  • Adds --allow_running_as_root flag to the build command to permit building as root on POSIX systems (default now disallows it).
  • Adds ONNX Optional type support in the C# API.
  • Adds collective operations to support multi-GPU inferencing.
  • Adds Python 3.11 support across onnxruntime CPU, onnxruntime-gpu, onnxruntime-directml, and onnxruntime-training packages (drops 3.7).
  • Introduces two new execution providers: JS EP (JavaScript) and QNN EP (Qualcomm Neural Network).
+23 moreshow less
  • Adds initial public preview of QNN EP, available as a NuGet package (Microsoft.ML.OnnxRuntime.QNN).
  • Adds official support for TensorRT 8.6, including explicit shape profile overrides, TensorRT plugin support via ORT custom ops, and timing cache.
  • Adds support for TensorRT options: heuristics, sparsity, optimization level, auxiliary stream, and tactic source selection.
  • Adds support for OpenVINO 2023.0 and dynamic shapes for iGPU in OpenVINO EP.
  • Adds OpenAI Whisper model support in Azure EP, now also available as a NuGet package.
  • Adds DirectML 1.12 support with opset 16–17 coverage in DirectML EP.
  • Adds Swift Package Manager package for onnxruntime on mobile.
  • Adds NuGet package for onnxruntime-extensions with Android/iOS support for MAUI/Xamarin.
  • Adds React Native package for onnxruntime with optional onnxruntime-extensions inclusion.
  • Adds built-in pre/post processing for NLP scenarios (classification, question-answering, text-prediction) on mobile.
  • Adds built-in pre/post processing for Speech Recognition (Whisper) on mobile.
  • Adds built-in post processing for Object Detection (YOLO) including non-max suppression and bounding box drawing on mobile.
  • Adds NNAPI kernels for BatchNormalization and LRN; CoreML kernels for Div, Flatten, LeakyRelu, LRN, Mul, Pad, Pow, and Sub.
  • Adds [preview] WebGPU support in the Web build.
  • Adds official On-Device Training package with APIs and language bindings for C, C++, Python, C#, and Java; packages available for Desktop and Android.
  • Adds graph optimizations leveraging label-data sparsity for ORT Training, yielding 4%–15% performance gains on popular Hugging Face models.
  • Adds native Windows ARM64 build support using Visual Studio 2022.
  • Updates to CUDA 11.8 (source remains compatible with CUDA 11.4 and 12.x).
  • Adds a lock-free queue build option for threadpool to improve CPU utilization.
  • Adds fused decoder multi-head attention kernel improving GPT and decoder model (T5, Whisper) performance.
  • Adds packing mode to improve encoder model performance with inputs of large padding ratio.
  • Upgrades DNNL from 2.7.1 to 3.0.
  • Adds cutlass as a new dependency for CUDA/TensorRT packages.
└──▷ BREAKING ON UPGRADE
  • !The onnxruntime_ENABLE_EAGER_MODE CMake option and eager mode code are deleted — builds using this option will fail.
  • !Dropped support for Windows 8.1 and below.
  • !In v1.16.0 (announced here): support for iOS 11 and below will be dropped; iOS 12 will be the minimum.
  • !In v1.16.0 (announced here): support for CentOS 7, Ubuntu 18.04, and Linux distros without glibc >= 2.28 will be dropped.
  • !In v1.16.0 (announced here): support for GCC <= 9 and Visual Studio 2019 will be dropped.
  • !In v1.16.0 (announced here): the onnxruntime_DISABLE_ABSEIL build option will be removed.
Was this useful?

NVIDIA Triton Inference Server

Sources Release notes → v2.34.0 NOTES

Triton 2.34.0 adds custom metrics in Python backend, a client plugin API, dynamic instance scaling, and a new --metrics-address flag.

└──▷ GET THIS VERSION
$ git clone --branch v2.34.0 https://github.com/triton-inference-server/server.git
# already have the repo? check out this version:
$ git checkout v2.34.0
└──▷ TRY IT
Bind the Prometheus metrics endpoint to a specific internal interface instead of the default 0.0.0.0, useful when you need to restrict metrics exposure on a multi-homed host.
$ tritonserver --model-repository=/models --metrics-address=127.0.0.1
On a high-core-count host where the old default caused resource exhaustion, pin model load parallelism to a safe value while keeping the new lower default as a baseline.
$ tritonserver --model-repository=/models --model-load-thread-count=8
  • Adds --metrics-address=<address> CLI option to bind the metrics server to a different address than the default 0.0.0.0.
  • Reduces the default number of model load threads from 2*(number of CPU cores) to 4; the --model-load-thread-count CLI option overrides this default.
  • Python backend now supports Custom Metrics, letting users define and report counters and gauges via the same interface as the C API.
  • Python Triton Client introduces the Triton Client Plugin API (beta) for registering custom plugins that add or modify request headers.
  • Adds DLPack Python specification support in the Python backend via pb_utils.Tensor.from_dlpack().
+1 moreshow less
  • Improves model instance scaling: when only the instance group changes in a model config, Triton updates instance counts in-place without a full model reload (non-sequence models only).
└──▷ BREAKING ON UPGRADE
  • !The default model load thread count is reduced from 2*(number of CPU cores) to 4; deployments on large-core systems that relied on the previous default parallelism will need to set --model-load-thread-count explicitly to restore prior behavior.
Was this useful?
◆  AI Coding Agents

Zed

Sources Release notes → v0.88.3 5 RELEASES · 2023-05-03 → 2023-05-31 NOTES STABLE

Zed v0.88.3 adds GPT-4 in-buffer AI assist, a new panel system, and git status toggle.

└──▷ GET THIS VERSION
$ git clone --branch v0.88.3 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.88.3
└──▷ USE IT
Enable git status indicators in the project panel via settings.
json
{
  "project_panel": {
    "git_status": true
  }
}
  • Adds project_panel: { git_status: bool } setting to control whether git status information appears in the project panel.
  • Introduces ai: assist command to pass the current buffer to GPT-4 when OPENAI_API_KEY is set in the environment; .zmd files also support cmd-enter to invoke the model.
  • Adds MoveToStartOfParagraph and MoveToEndOfParagraph movement commands for paragraph-based vertical navigation.
  • Introduces a more flexible and customizable panel system.
  • Adds a recently opened file list to the search file dialogue.
4 more releases in this issue · 2023-05-03 → 2023-05-31
v0.87.6 NOTES STABLE

Zed v0.87.6 adds git status colors, scrollbar diff markers, and line:column jump navigation

└──▷ GET THIS VERSION
$ git clone --branch v0.87.6 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.87.6
└──▷ TRY IT
Open a file at a specific line and column directly from the terminal — useful when following a stack trace or log output.
$ zed src/main.rs:42:15
Always show the scrollbar and enable git diff markers so diff hunks are visible at a glance in long files.
json
{
  "scrollbar": {
    "show": "always",
    "git_diff": true
  }
}
  • Adds scrollbar.show setting (values: auto, system, always, never) and scrollbar.git_diff boolean to control scrollbar visibility and git diff markers in the scrollbar.
  • Adds git diff locations as visual markers in the editor scrollbar.
  • Adds git status colors to files and directories in the project panel.
  • Enables jumping to a specific line and optional column from the file finder and zed CLI by appending :<line>:<column> after a filename.
  • Enables jumping to a specific column from the go-to-line modal by typing :<column> after the line number.
v0.86.1 NOTES STABLE

Zed v0.86.1 adds branch name in title bar, whitespace rendering settings, and project search directory filters.

└──▷ GET THIS VERSION
$ git clone --branch v0.86.1 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.86.1
  • Adds settings to render whitespace characters in the editor.
  • Adds support for including or excluding certain directories from project search.
  • Adds support for using key bindings in macOS modals with buttons.
  • Displays the active Git branch name alongside the project name in the title bar.
v0.85.3 NOTES STABLE

Zed v0.85.3 adds ESLint diagnostics support and per-path Copilot suppression via glob patterns.

└──▷ GET THIS VERSION
$ git clone --branch v0.85.3 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.85.3
  • Adds 'Hide Suggestions for This Path' option in the Copilot menu to populate a glob-pattern setting that disables Copilot suggestions for specific file paths.
  • Adds support for displaying ESLint diagnostics in JavaScript/TypeScript projects that have an ESLint configuration.
  • Improves Markdown rendering in editor hover popovers.
v0.84.3 NOTES STABLE

Zed v0.84.3 adds a language server log view and a terminal line-height setting.

└──▷ GET THIS VERSION
$ git clone --branch v0.84.3 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:
$ git checkout v0.84.3
  • Adds a terminal line height setting to adjust spacing in the integrated terminal.
  • Adds a language server log view, accessible via the log: open language server logs command.
Was this useful?

shell-gpt

Sources Release notes → 0.9.1 NOTES

shell-gpt 0.9.1 adds --describe-shell flag, in-prompt describe option, and DEFAULT_EXECUTE_SHELL_CMD config key

└──▷ GET THIS VERSION
$ git clone --branch 0.9.1 https://github.com/TheR1D/shell_gpt.git
# already have the repo? check out this version:
$ git checkout 0.9.1
└──▷ USE IT
Auto-execute shell suggestions on Enter in CI or scripting workflows without typing 'e' each time.
ini
DEFAULT_EXECUTE_SHELL_CMD=true
Inspect a suggested command interactively before running it during a shell REPL session.
$ sgpt -s --repl temp
# >>> list running containers
# docker ps
# >>> d
# Lists all currently running Docker containers.
# >>> e
  • Adds --describe-shell (or -d) CLI flag to generate a natural-language explanation of any shell command, e.g. sgpt -d "ls -la".
  • Adds DEFAULT_EXECUTE_SHELL_CMD config parameter to .sgptrc (default false); set to true to auto-execute --shell suggestions on Enter without typing e.
  • Adds [D]escribe option to the --shell execution prompt, letting users get an inline explanation of a suggested command before deciding to execute or abort.
  • Adds [d] describe shortcut inside --repl shell mode, printing an explanation of the last suggested command before execution.
  • Raises the maximum allowed value of --temperature to 2.
+1 moreshow less
  • Excludes comment lines (lines starting with #) when parsing .sgptrc, enabling inline documentation in the config file.
Was this useful?
Other / Uncategorized
◆  AI OBSERVABILITY

Arize Phoenix

Sources Release notes → v0.0.20 2 RELEASES · 2023-05-10 → 2023-05-24 NOTES STABLE

Phoenix v0.0.20 adds Dimension Details for tabular data with drift, histogram, and quantile charts via new GraphQL endpoints.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.20 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout v0.0.20
  • Adds GraphQL endpoint for histogram data to support dimension-level distribution analysis.
  • Adds quantile metrics to GraphQL endpoints for data quality inspection of tabular features and tags.
  • Adds GraphQL endpoint for HDBSCAN clustering results.
  • New dimension segments bar chart in the UI for visualizing how data splits across categories within a dimension.
  • New drift breakdown chart in the UI to isolate differences in dimension segment distributions between datasets.
+3 moreshow less
  • New quantiles stream chart in the UI for tracking quantile metrics over time per dimension.
  • Shows reference dataset data quality stats alongside primary dataset in dimension details view.
  • Supports ISO 8601 formatted strings in the timestamp column, broadening accepted input formats.
1 more release in this issue · 2023-05-10 → 2023-05-24
v0.0.19 NOTES STABLE

Phoenix v0.0.19 raises embedding dataset sample size to 10,000 and adds dataset role to GraphQL data quality metric endpoints.

└──▷ GET THIS VERSION
$ git clone --branch v0.0.19 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:
$ git checkout v0.0.19
  • Adds dataset role parameter to GraphQL endpoints for data quality metrics, enabling per-dataset filtering in queries.
  • Raises the embedding dataset sample size maximum to 10,000 (up from the previous limit).
  • Adds a dimension details route to the UI for inspecting individual dimension data.
  • Distinguishes discrete vs. continuous data in GraphQL responses, enabling appropriate rendering of each data type.
  • Introduces a basic segment interface in GraphQL for segmented data queries.
+1 moreshow less
  • Adds time formatting on the x-axis of charts, with a move to a time-based axis for temporal data visualization.
Was this useful?
◆  VECTOR DB RAG

LanceDB

Sources Release notes → v0.1.3 2 RELEASES · 2023-05-05 → 2023-05-25 NOTES STABLE

LanceDB v0.1.3 ships a JavaScript/Node.js library with full CRUD, indexing, and basic full-text search for Python.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.3 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.1.3
└──▷ USE IT
Create a table and run a vector similarity search from Node.js in a new project.
javascript
const lancedb = require('vectordb');
const db = await lancedb.connect('/tmp/mydb');
const table = await db.createTable('embeddings', [
  { vector: [0.1, 0.2, 0.3], text: 'hello world' }
]);
const results = await table.search([0.1, 0.2, 0.3]).limit(5).execute();
  • Adds a JavaScript/Node.js library for LanceDB, exposing connect, openTable, createTable, and vector search APIs for Node.js and TypeScript consumers.
  • Adds create_index to the Node.js client, enabling ANN index creation directly from JavaScript.
  • Adds append records API to the Node.js client for incrementally adding rows to an existing table.
  • Adds query parameters (e.g. limit) to the Node.js client's vector search interface via the exposed limit parameter.
  • Adds basic full-text search capabilities to the Python library (backed by tantivy-py, installed separately from the wheel).
+2 moreshow less
  • Adds Linux support for the JavaScript client native binary.
  • Adds a TypeScript example demonstrating typed usage of the Node.js library.
└──▷ BREAKING ON UPGRADE
  • !tantivy-py is no longer bundled in the Python wheel and must be installed separately to use full-text search.
1 more release in this issue · 2023-05-05 → 2023-05-25
v0.1.2 NOTES STABLE

LanceDB v0.1.2 adds cloud storage support for S3 and GCS buckets and begins a Rust core implementation.

└──▷ GET THIS VERSION
$ git clone --branch v0.1.2 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:
$ git checkout v0.1.2
  • Adds cloud storage support, enabling LanceDB tables to be stored directly on S3 or GCS buckets.
  • Introduces a Rust core implementation for improved performance.
Was this useful?

Qdrant

Sources Release notes → v1.2.0 NOTES

Qdrant v1.2.0 adds API key auth, Product Quantization, Group-By API, optional vectors, recovery mode, and nested object filters.

└──▷ GET THIS VERSION
$ git clone --branch v1.2.0 https://github.com/qdrant/qdrant.git
# already have the repo? check out this version:
$ git checkout v1.2.0
└──▷ TRY IT
Group search results by a payload field (e.g. 'document_id') to retrieve the top-k matches per group — useful for document-level RAG retrieval.
$ curl -X POST 'http://localhost:6333/collections/{collection_name}/points/search/groups' \
  -H 'Content-Type: application/json' \
  -H 'api-key: <your-api-key>' \
  -d '{
    "vector": [0.1, 0.2, 0.3],
    "group_by": "document_id",
    "group_size": 3,
    "limit": 10
  }'
Filter on individual objects inside a payload array using nested object filter — e.g. match only array entries where both 'key' and 'value' align.
$ curl -X POST 'http://localhost:6333/collections/{collection_name}/points/search' \
  -H 'Content-Type: application/json' \
  -d '{
    "vector": [0.1, 0.2, 0.3],
    "filter": {
      "must": [
        {
          "nested": {
            "key": "attributes",
            "filter": {
              "must": [
                { "key": "name", "match": { "value": "color" } },
                { "key": "value", "match": { "value": "red" } }
              ]
            }
          }
        }
      ]
    },
    "limit": 5
  }'
  • Adds built-in API key authentication support for securing Qdrant endpoints.
  • Enables Product Quantization (PQ) for vectors, providing a new vector compression strategy alongside existing quantization options.
  • Adds Group-By API, allowing search results to be grouped by a payload field for top-results-per-group retrieval.
  • Adds optional vectors, allowing points to be created with only a subset of named vectors defined — two new APIs manage vectors independently from payload.
  • Adds recovery mode for handling Out-of-Disk and Out-of-Memory errors, enabling the node to recover rather than crash.
+5 moreshow less
  • Adds nested object filter, enabling filtering by individual objects inside payload arrays.
  • Adds dynamic mmap vector storage, allowing vectors to be stored in mmap files immediately on insert without requiring a separate optimization step.
  • Adds Cluster management API in gRPC, bringing cluster operations to the gRPC interface.
  • Adds support for TLS certificate rotation without requiring a full restart.
  • Releases pre-built binaries for multiple platforms alongside Docker images.
Was this useful?

Weaviate

Sources Release notes → v1.19.1 2 RELEASES · 2023-05-04 → 2023-05-10 NOTES STABLE

Weaviate v1.19.1 adds Google PaLM support via new text2vec-palm and generative-palm modules.

└──▷ GET THIS VERSION
$ git clone --branch v1.19.1 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.19.1
  • Adds text2vec-palm module to enable Google PaLM-based text vectorization.
  • Adds generative-palm module to enable Google PaLM-based generative search.
1 more release in this issue · 2023-05-04 → 2023-05-10
v1.19.0 NOTES STABLE

Weaviate v1.19 adds a gRPC search API, Cohere generative module, tunable consistency, uuid prop types, and group-by queries.

└──▷ GET THIS VERSION
$ git clone --branch v1.19.0 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.19.0
  • Adds a minimal gRPC API (experimental) with support for a Search endpoint, enabling lower-latency programmatic access.
  • Adds generative-cohere module, enabling Retrieval-Augmented Generation with Cohere's generative models.
  • Adds tunable consistency to GraphQL Get queries, letting callers control read consistency level per search request.
  • Adds uuid and uuid[] property types, indexed with roaring bitmaps for efficient UUID-based filtering.
  • Adds group-by arbitrary property (including reference props) in GraphQL queries, returning top-k results per group.
+2 moreshow less
  • Enriches text and text[] tokenization with new options via IndexFilterable and IndexSearchable property settings, replacing the deprecated string and string[] data types.
  • Migrates the IndexInverted property field to separate IndexFilterable and IndexSearchable fields for finer control over inverted index behavior.
└──▷ BREAKING ON UPGRADE
  • !Downgrading from v1.19 to v1.18 is not supported after upgrading; a backup must be created before upgrading if a downgrade may be needed.
  • !The string and string[] data types are deprecated in favor of text and text[] with explicit tokenization options.
Was this useful?
my-toolchain — 0 tools
paste an install list to detect your tools

A brew list, a Brewfile, requirements.txt, a Dockerfile — or just the product names, free-form. Nothing leaves your browser.

    browse all tools →