The daily firehose — everything the toolchain shipped today, already filtered.
// HOW THIS ISSUE IS MADE
We read every release from the 174 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.
›Adds add_tool(tool) convenience method to Agent and Team to append new tools after initialisation.
›Streaming with response_model now stays in streaming mode: calling run(..., stream=True) or arun(..., stream=True) with a response_model set returns Iterator[RunResponseEvent] / AsyncIterator[RunResponseEvent] instead of switching off streaming; the structured output appears on RunResponseContentEvent and the final RunResponseCompletedEvent.
›Adds a Linear tool to retrieve the list of teams (get_team_details).
└──▷ BREAKING ON UPGRADE
!Calling run(..., stream=True) or arun(..., stream=True) on Agent or Team with a response_model set no longer returns a single RunResponse object — it now returns Iterator[RunResponseEvent] / AsyncIterator[RunResponseEvent]. Code that consumed the old single-object response must be updated to iterate over events instead.
7 more releases in this issue
· 2025-06-03 → 2025-06-26
Agno v1.6.3 adds store_events to RunResponse, metadata filtering for CSV knowledge bases, and user control flows on the Playground.
└──▷ GET THIS VERSION
$ git clone --branch v1.6.3 https://github.com/agno-agi/agno.git
# already have the repo? check out this version:$ git checkout v1.6.3
›Adds store_events parameter to RunResponse/TeamRunResponse to optionally persist all events that occurred during an agent or team run.
›Adds metadata filtering support for csv and csv_url knowledge base types.
›Adds user control flows support on the Agno Platform Playground.
›Shows team member responses during team runs on the Agno Platform Playground.
›Shows behind-the-scenes activity during agent and team runs on the Agno Platform Playground.
└──▷ BREAKING ON UPGRADE
!Async knowledge-base function names (e.g. asearch_knowledge_base) are renamed to match their sync counterparts — any model function-calling configuration referencing the old a-prefixed names will stop working.
Agno v1.6.0 overhauls streaming events for agents, teams, and workflows with granular typed events and member-event propagation.
└──▷ GET THIS VERSION
$ git clone --branch v1.6.0 https://github.com/agno-agi/agno.git
# already have the repo? check out this version:$ git checkout v1.6.0
└──▷ USE IT
Inspect a non-streaming run response status to detect paused or cancelled runs.
python
response = agent.run('Analyze the logs')
if response.status == 'CANCELLED':
print('Run was cancelled before completion')
elif response.status == 'PAUSED':
print('Run is awaiting input')
›Adds RunResponseContent, RunError, RunCancelled, ToolCallStarted, and ToolCallCompleted event types to agent streaming runs via agent.run(..., stream=True) or agent.arun(..., stream=True).
›Adds RunStarted, RunCompleted, ReasoningStarted, ReasoningStep, ReasoningCompleted, MemoryUpdateStarted, and MemoryUpdateCompleted intermediate event types for agents when stream_intermediate_steps=True.
›Adds RunResponse.status attribute indicating whether a run response is RUNNING, PAUSED, or CANCELLED.
›Teams now propagate and yield streaming events from individual team members as they execute, surfacing member-level activity in the top-level event stream.
+1 moreshow less
›Workflows now support WorkflowRunResponseStartedEvent and WorkflowRunResponseCompletedEvent events for structured run lifecycle signalling.
└──▷ BREAKING ON UPGRADE
!RunResponse no longer has an event attribute; code reading RunResponse.event will break.
!Streaming run events are reformulated — existing code consuming the old event shapes from agent.run(..., stream=True) or agent.arun(..., stream=True) must be updated to the new typed event types.
!Team streaming events are reformulated with new Team-prefixed event types; existing code consuming team stream events must be updated.
!Workflows must now yield WorkflowRunResponseStartedEvent and WorkflowRunResponseCompletedEvent; workflows that do not yield these events will be missing lifecycle signals.
Make an agent location-aware so its instructions automatically include where it is running — useful for geo-sensitive tasks.
python
from agno.agent import Agent
from agno.models.openai import OpenAIChat
agent = Agent(
model=OpenAIChat(id='gpt-4o'),
add_location_to_instructions=True,
)
agent.print_response('What businesses near me are open right now?')
Give an agent access to Google search results via Serper for real-time web lookups.
python
from agno.agent import Agent
from agno.models.openai import OpenAIChat
from agno.tools.serper import SerperTools
agent = Agent(
model=OpenAIChat(id='gpt-4o'),
tools=[SerperTools()],
)
agent.print_response('What are the latest CVEs disclosed this week?')
›Adds SerperTools toolkit to enable agents to search Google via Serper.
›Adds DaytonaTools toolkit to let agents execute code remotely on Daytona sandboxes.
›Adds AWSSESTools toolkit to send emails via AWS SES.
›Adds PDFBytesKnowledgeBase class to ingest in-memory PDF content via bytes or IO streams instead of file paths.
›Adds add_location_to_instructions parameter to automatically detect and inject the agent's current location into the system message.
+10 moreshow less
›Adds search_posts method to XTools for searching posts on X.
›Adds GmailTools attachment support for sending emails with attachments.
›Updates FastAPIApp to replace agent with agents and team with teams, and adds workflows support; agents/teams/workflows are now selected via query param (e.g. ?agent_id=my-agent).
›Adds AG-UI compatible FastAPI app to expose Agno agents and teams to AG-UI clients.
›Adds vLLM model support for running self-hosted vLLM inference via Agno.
›Adds LangDB AI Gateway integration as a model provider.
›Adds LightRAG server support, providing a graph-based RAG system for document retrieval and knowledge querying.
›Adds Parser Model capability to apply structured output to a model response using an external model.
›Adds URL expansion to the Crawl4ai toolkit so shortened URLs are resolved to their final destination before crawling.
›Adds MCP support for Qdrant via the Qdrant MCP server cookbook integration.
└──▷ BREAKING ON UPGRADE
!FastAPIApp now requires agents instead of agent and teams instead of team; callers must also explicitly specify which agent, team, or workflow to run (e.g. ?agent_id=my-agent), so existing single-agent setups will break without updating both field names and the request URL.
$ git clone --branch v1.5.8 https://github.com/agno-agi/agno.git
# already have the repo? check out this version:$ git checkout v1.5.8
└──▷ USE IT
Give an agent the ability to produce matplotlib charts on demand during a run.
python
from agno.agent import Agent
from agno.tools.visualization import VisualizationTools
agent = Agent(
name="ChartAgent",
tools=[VisualizationTools()],
)
agent.print_response("Plot a bar chart of monthly sales: Jan=120, Feb=95, Mar=140")
Enable Brave web search for an agent using the new BraveSearch toolkit.
python
from agno.agent import Agent
from agno.tools.brave_search import BraveSearch
agent = Agent(
name="WebSearchAgent",
tools=[BraveSearch()],
)
agent.print_response("What are the latest CVEs disclosed this week?")
›Adds SlackApp class to build Slack-connected agents that respond to direct messages, group chats, and automatically create threads for replies.
›Adds VisualizationTools toolkit (backed by matplotlib) giving agents the ability to generate graphs.
›Adds BraveSearch toolkit so agents can search the web via the Brave Search API.
›Adds infer as a parameter to Mem0Tools, exposing inference control in the memory toolkit.
›Passes knowledge_filters through when self.add_references=True (traditional RAG path), keeping filter behavior consistent with Agentic RAG.
+2 moreshow less
›FastAPIApp now exposes a .serve() method on the instance, replacing the standalone serve_fastapi_app function, and the run endpoint moves from /run to /runs.
›WhatsappAPI now exposes a .serve() method on the instance, replacing the standalone serve_whatsapp_app function.
└──▷ BREAKING ON UPGRADE
!FastAPIApp no longer has a default prefix, and the run endpoint is renamed from /run to /runs — any client or integration hitting <domain>/run will break.
!serve_fastapi_app is replaced by .serve() on the FastAPIApp instance — call sites using the standalone function will break.
!serve_whatsapp_app is replaced by .serve() on the WhatsappAPI instance — call sites using the standalone function will break.
AutoGPT Platform adds triggered-agent support, ClamAV file-upload scanning, and cache control headers in v0.6.14
└──▷ GET THIS VERSION
$ git clone --branch autogpt-platform-beta-v0.6.14 https://github.com/Significant-Gravitas/AutoGPT.git
# already have the repo? check out this version:$ git checkout autogpt-platform-beta-v0.6.14
›Adds ClamAV anti-virus scanning on file upload, bringing malware detection to the platform's file-handling pipeline.
›Adds triggered-agent support to the platform and library, enabling agents to be launched by external events.
›Adds cache control headers to platform responses.
›Adds a custom OpenAPI generator for automated client generation.
›Enables auto type conversion on block input schema mismatch for nested inputs, reducing manual wiring errors.
+2 moreshow less
›Enables cloud Apollo integration cost tracking.
›Improves SmartDecisionBlock and AIStructuredResponseGeneratorBlock capabilities.
2 more releases in this issue
· 2025-06-05 → 2025-06-25
AutoGPT Platform v0.6.13 adds Google Sign-in, AI/ML API for LLM blocks, VEO3 video generation, and async-first execution.
└──▷ GET THIS VERSION
$ git clone --branch autogpt-platform-beta-v0.6.13 https://github.com/Significant-Gravitas/AutoGPT.git
# already have the repo? check out this version:$ git checkout autogpt-platform-beta-v0.6.13
›Adds AI/ML API as a supported provider in LLM blocks, expanding model access beyond existing integrations.
›Adds VEO3 as a supported model in the AI video generator block.
›Adds Google Sign-in support for user authentication.
›Makes the execution engine async-first, enabling deeper concurrency for agent graph runs.
›Adds depth-first execution ordering to the execution engine, changing how node dependencies are traversed.
+2 moreshow less
›Adds automatic request retry on block execution and RPC calls, improving resilience for transient failures.
AutoGPT Platform v0.6.12 adds an AI Image Editor block, file multipart uploads in web requests, and nested dynamic pin-name support.
└──▷ GET THIS VERSION
$ git clone --branch autogpt-platform-beta-v0.6.12 https://github.com/Significant-Gravitas/AutoGPT.git
# already have the repo? check out this version:$ git checkout autogpt-platform-beta-v0.6.12
›Adds file multipart upload support to SendWebRequestBlock, enabling blocks to send binary file payloads in web requests.
›Adds a new AI Image Editor block powered by Flux Kontext for in-platform image editing.
›Adds nested dynamic pin-name support, allowing more flexible dynamic wiring of block inputs and outputs.
›Enforces a minimum password length of 12 characters for platform accounts.
Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
CrewAI 0.134.0 adds MCP multi-tool agent support, Tool-attribute initialization, and Oxylabs web scraping tools.
└──▷ GET THIS VERSION
$ git clone --branch 0.134.0 https://github.com/crewAIInc/crewAI.git
# already have the repo? check out this version:$ git checkout 0.134.0
›Supports initializing a tool directly from defined Tool attributes, enabling programmatic tool construction.
›Adds an official way to use MCP Tools within a CrewBase class.
›Enhances MCP tools support to allow selecting multiple tools per agent inside CrewBase.
›Adds Oxylabs Web Scraping tools as a built-in integration.
2 more releases in this issue
· 2025-06-05 → 2025-06-25
DSPy 3.0.0b1 adds a global max_errors setting, an XML adapter, expanded PythonInterpreter permissions, and async-to-sync tool conversion.
└──▷ GET THIS VERSION
$ git clone --branch 3.0.0b1 https://github.com/stanfordnlp/dspy.git
# already have the repo? check out this version:$ git checkout 3.0.0b1
└──▷ USE IT
Cap how many LM call errors a DSPy program tolerates before aborting, useful for guarding expensive optimization runs.
python
import dspy
dspy.settings.configure(max_errors=5)
# Now any program or optimizer that triggers more than 5 errors will stop early.
›Adds global max_errors setting (via dspy.settings) to cap the number of errors tolerated across a DSPy program run.
›Adds xml adapter as a new prompt/response adapter alongside the existing JSON adapter.
›Expands permission capabilities in PythonInterpreter to support broader sandboxed code execution scenarios.
›Supports automatic async-to-sync conversion for tools used in dspy.ReAct and similar modules, enabling async tool functions to be called in synchronous contexts.
›Merges async settings changes into main, broadening asynchronous execution configuration.
└──▷ BREAKING ON UPGRADE
!Community retriever integrations have been removed (PR #8073); programs using unmaintained retriever integrations must migrate to custom retriever code.
2 more releases in this issue
· 2025-06-02 → 2025-06-11
DSPy 2.6.26 adds dspy.Tool as an input field type and dspy.ToolCall as an output field type.
└──▷ GET THIS VERSION
$ git clone --branch 2.6.26 https://github.com/stanfordnlp/dspy.git
# already have the repo? check out this version:$ git checkout 2.6.26
└──▷ USE IT
Define a typed DSPy signature where a module receives a tool and emits a structured tool call — useful for building agent steps that invoke tools in a verifiable, type-safe way.
DSPy 2.6.25 adds CodeAct module, dspy.Audio type, LangChain tool support, and per-module LM history tracking.
└──▷ GET THIS VERSION
$ git clone --branch 2.6.25 https://github.com/stanfordnlp/dspy.git
# already have the repo? check out this version:$ git checkout 2.6.25
└──▷ USE IT
Pass audio data as a typed Signature field to a DSPy module for multimodal LM tasks.
python
import dspy
class TranscribeAudio(dspy.Signature):
audio: dspy.Audio = dspy.InputField()
transcript: str = dspy.OutputField()
predictor = dspy.Predict(TranscribeAudio)
result = predictor(audio=dspy.Audio.from_url("https://example.com/sample.wav"))
print(result.transcript)
Inspect per-module LM history to debug or audit exactly which calls a specific module made.
python
import dspy
lm = dspy.LM("openai/gpt-4o")
dspy.configure(lm=lm)
classify = dspy.Predict("text -> label")
classify(text="Suspicious login from unknown IP")
# Inspect history scoped to this module only
print(classify.history)
›Adds dspy.Audio as a new built-in field type for passing audio inputs through Signatures.
$ git clone --branch v2.15.0 https://github.com/deepset-ai/haystack.git
# already have the repo? check out this version:$ git checkout v2.15.0
└──▷ USE IT
Route user messages through Llama Guard for content moderation before passing safe messages downstream.
python
from haystack.components.generators.chat import HuggingFaceAPIChatGenerator
from haystack.components.routers.llm_messages_router import LLMMessagesRouter
from haystack.dataclasses import ChatMessage
chat_generator = HuggingFaceAPIChatGenerator(
api_type="serverless_inference_api",
api_params={"model": "meta-llama/Llama-Guard-4-12B", "provider": "groq"},
)
router = LLMMessagesRouter(
chat_generator=chat_generator,
output_names=["unsafe", "safe"],
output_patterns=["unsafe", "safe"],
)
print(router.run([ChatMessage.from_user("How to rob a bank?")]))
›Adds max_workers parameter to ToolInvoker.__init__ to configure the internal ThreadPoolExecutor used for parallel tool calling, replacing the deprecated async_executor parameter.
›Adds enable_streaming_callback_passthrough parameter to ToolInvoker.init, ToolInvoker.run, and ToolInvoker.run_async; when True, passes the streaming_callback function to a tool's invoke method if the method accepts streaming_callback in its signature.
›Adds raise_on_failure boolean parameter to OpenAIDocumentEmbedder and AzureOpenAIDocumentEmbedder; when True, raises an exception on API errors instead of logging and continuing (default is False).
›Adds require_tool_call_ids parameter to ChatMessage.to_openai_dict_format; set to False to suppress errors when the id field is missing in a Tool Call, for compatibility with shallow OpenAI-compatible APIs (default is True).
›Adds trust_remote_code parameter to SentenceTransformersSimilarityRanker; when True, enables execution of custom models and scripts hosted on the Hugging Face Hub.
+10 moreshow less
›Adds finish_reason field to StreamingChunk using a FinishReason type alias with values 'stop', 'length', 'tool_calls', 'content_filter', and Haystack-specific 'tool_call_results'; ToolInvoker sets finish_reason='tool_call_results' in the final chunk when tool execution completes.
›Adds tool_calls, tool_call_result, index, and start fields to StreamingChunk, plus a new ToolCallDelta dataclass for StreamingChunk.tool_calls to represent argument string deltas.
›Adds new ComponentInfo dataclass passed through StreamingChunk so streaming callbacks can identify which component produced each chunk; wired into OpenAIChatGenerator, AzureOpenAIChatGenerator, HuggingFaceAPIChatGenerator, HuggingFaceAPIGenerator, HuggingFaceLocalGenerator, and HuggingFaceLocalChatGenerator.
›Introduces LLMMessagesRouter component (haystack.components.routers.llm_messages_router) that classifies and routes ChatMessage objects to named output connections using a generative LLM, supporting general-purpose and moderation-focused models like Llama Guard.
›Introduces HuggingFaceTEIRanker component for end-to-end reranking via the Text Embeddings Inference (TEI) API, supporting both self-hosted TEI services and Hugging Face Inference Endpoints.
›Adds AsyncHFTokenStreamingHandler for async streaming support in HuggingFaceLocalChatGenerator.
›Makes PipelineBase.validate_input a public method so callers can validate pipeline connections before runtime without waiting for Pipeline.run.
›Adds deserialize_component_inplace function for generic component deserialization that works with any component type.
›All additional key-value pairs passed via api_params in HuggingFaceAPIGenerator and HuggingFaceAPIChatGenerator are now forwarded to the underlying Inference Client constructors, enabling parameters like timeout, headers, and provider (e.g., api_params={'provider': 'groq'} to route to a different inference provider).
›Haystack's core modules now carry a py.typed marker and are fully type-annotated, enabling accurate static analysis in mypy and Pylance.
1 more release in this issue
· 2025-06-04 → 2025-06-26
Haystack v2.14.2 adds raise_on_failure to OpenAI document embedders for stricter API error handling.
└──▷ GET THIS VERSION
$ git clone --branch v2.14.2 https://github.com/deepset-ai/haystack.git
# already have the repo? check out this version:$ git checkout v2.14.2
└──▷ USE IT
Fail fast during indexing pipelines when an OpenAI embedding API error occurs, so bad batches are never silently skipped.
python
from haystack.components.embedders import OpenAIDocumentEmbedder
embedder = OpenAIDocumentEmbedder(raise_on_failure=True)
›Adds raise_on_failure boolean parameter to OpenAIDocumentEmbedder and AzureOpenAIDocumentEmbedder: when set to True, the component raises an exception on API errors instead of silently logging and continuing; defaults to False to preserve existing behavior.
LangChain Core 0.3.67 adds stronger hashing options to the indexing API and warns on SHA-1 usage.
└──▷ GET THIS VERSION
$ git clone --branch langchain-core==0.3.67 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:$ git checkout langchain-core==0.3.67
›Adds additional hashing options to the indexing API and emits a warning when SHA-1 is selected, nudging users toward stronger algorithms.
›Exposes tool message recognized block types in langchain-core, making structured tool message content more accessible to library consumers.
›Improves RunnableWithMessageHistory init arg types for stricter type checking when constructing history-aware runnables.
8 more releases in this issue
· 2025-06-02 → 2025-06-30
langchain-openai 0.3.26 adds output format control and automatic response chaining for the Responses API.
└──▷ GET THIS VERSION
$ git clone --branch langchain-openai==0.3.26 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:$ git checkout langchain-openai==0.3.26
›Adds support for specifying the output format for the Responses API, giving callers control over structured response shapes.
›Adds an attribute to always use previous_response_id, enabling automatic response chaining across Responses API calls.
langchain-groq 0.3.3 adds access to reasoning output from Groq models
└──▷ GET THIS VERSION
$ git clone --branch langchain-groq==0.3.3 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:$ git checkout langchain-groq==0.3.3
›Adds support for accessing reasoning output from Groq models via the langchain-groq integration.
›Removes the Python upper bound version constraint for langchain and related libraries, enabling use with newer Python releases.
LangChain 0.3.26 adds pluggable hashing functions for embeddings and Anthropic code execution, MCP connector, and files API support.
└──▷ GET THIS VERSION
$ git clone --branch langchain==0.3.26 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:$ git checkout langchain==0.3.26
›Adds Anthropic support for code execution, MCP connector, and files API features.
langchain-openai adds Responses API support to BaseChatOpenAI and AzureChatOpenAI, including streaming.
└──▷ GET THIS VERSION
$ git clone --branch langchain-openai==0.3.24 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:$ git checkout langchain-openai==0.3.24
›Adds Responses API attributes to BaseChatOpenAI, enabling opt-in routing to the OpenAI Responses API when those attributes are set.
›Supports Responses API streaming in AzureChatOpenAI, bringing parity with the standard OpenAI client.
langchain-huggingface 0.3.0 cuts package disk footprint by 95% by making large dependencies optional
└──▷ GET THIS VERSION
$ git clone --branch langchain-huggingface==0.3.0 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:$ git checkout langchain-huggingface==0.3.0
›Reduces package disk footprint by 95% by making large dependencies (such as transformers) optional — install only what your use case requires.
└──▷ BREAKING ON UPGRADE
!Large dependencies (e.g. transformers) are now optional and no longer installed by default; existing code that relies on them being present will break unless the relevant extras are explicitly installed.
langchain-tests 0.3.20 adds PDF and audio input support in Chat Completions format and removes Python version upper bound.
└──▷ GET THIS VERSION
$ git clone --branch langchain-tests==0.3.20 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:$ git checkout langchain-tests==0.3.20
›Supports PDF and audio input in the Chat Completions format for chat model standard tests.
›Removes the Python upper bound constraint from langchain and related libraries, enabling use with future Python releases.
›Adds benchmark tests to the standard test suite.
›Adds a condition gate for the image tool message test to prevent false failures in environments that lack image support.
langchain-anthropic now stores cache TTL details on usage metadata for Anthropic API calls.
└──▷ GET THIS VERSION
$ git clone --branch langchain-anthropic==0.3.15 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:$ git checkout langchain-anthropic==0.3.15
›Adds cache TTL details to usage metadata returned from Anthropic API calls.
langchain-openai 0.3.19 adds image generation support to the Responses API and caches the httpx client for performance.
└──▷ GET THIS VERSION
$ git clone --branch langchain-openai==0.3.19 https://github.com/langchain-ai/langchain.git
# already have the repo? check out this version:$ git checkout langchain-openai==0.3.19
›Adds image generation capability to the OpenAI Responses API integration.
›Caches the httpx client to reduce connection overhead across repeated calls.
›New NodeBuilder utility provides a declarative way to create nodes and attach them to channels, replacing Channel.subscribe_to.
›Introduces stream_mode="tasks" and stream_mode="checkpoints" as individually selectable streaming modes (and "debug" becomes an alias for both).
›Adds print_mode= argument to invoke/stream for controlling output printing.
›StateGraph now accepts input_schema and output_schema parameters (replacing input/output).
›JsonPlusSerializer now natively handles NumPy arrays (including Fortran-ordered) without pickle fallback.
+3 moreshow less
›Checkpoints are leaner: redundant keys dropped, per-task writes stored directly, and legacy pending_sends data is auto-migrated on first load.
›Allows same-name channels and nodes in StateGraph.
›Task masquerading with update_state is now supported.
└──▷ BREAKING ON UPGRADE
!state_schema is now required in StateGraph.__init__; graphs constructed without it will error.
!The input and output keyword arguments to StateGraph are deprecated and renamed to input_schema and output_schema; the old names raise a deprecation warning.
!Subclassing both PregelNode and Runnable is no longer supported; drop the Runnable base class.
!add_conditional_edge(..., then=) has been removed.
!Checkpoint.writes and Checkpoint.pending_sends fields have been removed.
!The postgres shallow checkpointer has been removed.
!Context channel/managed value and SharedValue have been removed.
!Support for a node reading a single managed value has been removed.
!The retry parameter is renamed to retry_policy.
!Dict subclasses used for values/updates stream chunks have been removed.
!The default for checkpoint_during has been flipped.
!Channel.subscribe_to (the Channel node builder) has been removed.
4 more releases in this issue
· 2025-06-02 → 2025-06-26
langgraph-checkpoint 2.1.0 adds NumPy array and pandas serialization support to JsonPlusSerializer
└──▷ GET THIS VERSION
$ git clone --branch checkpoint==2.1.0 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:$ git checkout checkpoint==2.1.0
›Supports NumPy array serialization in JsonPlusSerializer, enabling checkpoint storage of array-heavy state.
›Adds pickle fallback for pandas serialization, allowing DataFrames and Series to round-trip through the checkpoint layer.
LangGraph CLI 0.2.11 adds image_distro config support and warns when distro is not set to Wolfi.
└──▷ GET THIS VERSION
$ git clone --branch cli==0.2.11 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:$ git checkout cli==0.2.11
›Supports image_distro setting in the LangGraph config file for controlling the base image distribution used in Dockerfile generation.
›Adds a warning when the image distro is not configured as Wolfi, nudging users toward the recommended distro.
LangGraph 0.4.8 adds NodeBuilder to replace Channel.subscribe_to and flips the default for checkpoint_during.
└──▷ GET THIS VERSION
$ git clone --branch 0.4.8 https://github.com/langchain-ai/langgraph.git
# already have the repo? check out this version:$ git checkout 0.4.8
›Adds NodeBuilder class as the new way to define node subscriptions, replacing Channel.subscribe_to.
›Flips the default value for checkpoint_during, changing checkpoint behavior out of the box.
›Stream modes messages and custom now respect subgraphs=False, giving finer control over subgraph output filtering.
›Requires state_schema in StateGraph.__init__, enforcing explicit schema declaration at graph construction.
└──▷ BREAKING ON UPGRADE
!MessageGraph has been removed; graphs using MessageGraph will break on upgrade.
!add_conditional_edge(..., then=) argument has been removed; any call using the then= parameter will break.
!Checkpoint.writes has been removed; code reading or writing this field will break.
!Checkpoint.pending_sends has been removed; code reading or writing this field will break.
!The postgres shallow checkpointer has been removed; setups using it must migrate to another checkpointer.
!UntrackedValue channel has been removed; any code referencing it will break.
!Context channel/managed value and SharedValue have been removed; code relying on them will break.
!ChannelsManager has been removed; managed values are now static classes and can no longer be instantiated.
!SchemaCoercionMapper has been removed; code referencing it will break.
!Dict subclasses used for values/updates stream chunks have been removed; code that relied on the specific types of those chunks may break.
!The non-state Graph base class has been removed; code subclassing it directly will break.
!The Channel node builder has been removed; use the new NodeBuilder class instead.
!state_schema is now required in StateGraph.__init__; existing code that omits it will raise an error.
!The default for checkpoint_during has been flipped; existing graphs that relied on the previous default behavior will behave differently without an explicit override.
Letta 0.8.8 adds Feedback APIs for rating agent steps positive or negative.
└──▷ GET THIS VERSION
$ git clone --branch 0.8.8 https://github.com/letta-ai/letta.git
# already have the repo? check out this version:$ git checkout 0.8.8
›Adds Feedback APIs to submit positive/negative ratings on individual agent steps and list existing step feedback, accessible via the /steps endpoint family (see add-feedback reference).
1 more release in this issue
· 2025-06-01 → 2025-06-29
LlamaIndex v0.12.44 adds IBM Db2 vector store, OpenAI Realtime Conversation, CachePoint chat blocks, and Pinecone v7 support.
└──▷ GET THIS VERSION
$ git clone --branch v0.12.44 https://github.com/run-llama/llama_index.git
# already have the repo? check out this version:$ git checkout v0.12.44
└──▷ USE IT
Cache an expensive system or user message turn to avoid recomputing token context on repeated LLM calls.
python
from llama_index.core.llms import ChatMessage
from llama_index.core.base.llms.types import CachePoint
messages = [
ChatMessage(role="user", content=[
{"type": "text", "text": "You are a helpful assistant with a large knowledge base."},
CachePoint(),
])
]
Pass advanced cross-encoder options (e.g. a custom device or batch size) when reranking with SBERT.
LlamaIndex v0.12.42 adds reasoning support for Mistral/Magistral, OpenAI o3-pro, a multimodal OpenAI-like LLM package, figure retrieval, and an ArtifactEditorToolSpec.
└──▷ GET THIS VERSION
$ git clone --branch v0.12.42 https://github.com/run-llama/llama_index.git
# already have the repo? check out this version:$ git checkout v0.12.42
›New llama-index-tools-artifact-editor [0.1.0] package introduces ArtifactEditorToolSpec for editing Pydantic objects as a tool.
›New llama-index-multi-modal-llms-openai-like [0.1.0] package adds an OpenAI-compatible multi-modal LLM integration.
›Adds reasoning support (including Magistral) to llama-index-llms-mistralai [0.6.0].
›Adds day-0 support for OpenAI o3-pro in llama-index-llms-openai [0.4.5].
›Adds figure retrieval SDK integration to llama-index-indices-managed-llama-cloud [0.7.7].
+3 moreshow less
›Adds the ability to exclude source fields from query responses in llama-index-vector-stores-opensearch [0.5.6].
›Adds label truncation to workflow visualization in llama-index-utils-workflow [0.3.3].
›llama-index-postprocessor-bedrock-rerank [0.3.3] prefers BedrockRerank as the canonical class name over AWSBedrockRerank.
AutoGen 0.6.1 adds function call and result listings to ToolCallSummaryMessage.
└──▷ GET THIS VERSION
$ git clone --branch python-v0.6.1 https://github.com/microsoft/autogen.git
# already have the repo? check out this version:$ git checkout python-v0.6.1
›Adds list of function calls and their results to ToolCallSummaryMessage, making tool execution summaries more detailed and inspectable.
AutoGen v0.6.0 adds concurrent GraphFlow agents, a new OpenAIAgent, callable edge conditions, Streamable HTTP MCP, and broader model support.
└──▷ GET THIS VERSION
$ git clone --branch python-v0.6.0 https://github.com/microsoft/autogen.git
# already have the repo? check out this version:$ git checkout python-v0.6.0
└──▷ USE IT
Run two translation agents concurrently after a writer agent using GraphFlow's fan-out pattern.
python
import asyncio
from autogen_agentchat.agents import AssistantAgent
from autogen_agentchat.conditions import MaxMessageTermination
from autogen_agentchat.teams import DiGraphBuilder, GraphFlow
from autogen_ext.models.openai import OpenAIChatCompletionClient
async def main():
model_client = OpenAIChatCompletionClient(model="gpt-4.1-nano")
agent_a = AssistantAgent("A", model_client=model_client, system_message="You are a helpful assistant.")
agent_b = AssistantAgent("B", model_client=model_client, system_message="Translate input to Chinese.")
agent_c = AssistantAgent("C", model_client=model_client, system_message="Translate input to Japanese.")
builder = DiGraphBuilder()
builder.add_node(agent_a).add_node(agent_b).add_node(agent_c)
builder.add_edge(agent_a, agent_b).add_edge(agent_a, agent_c)
graph = builder.build()
team = GraphFlow(
participants=[agent_a, agent_b, agent_c],
graph=graph,
termination_condition=MaxMessageTermination(5),
)
async for event in team.run_stream(task="Write a short story about a cat."):
print(event)
asyncio.run(main())
›Enables concurrent agent execution in GraphFlow via fan-out-fan-in patterns — select_speaker now returns List[str] | str.
›New OpenAIAgent backed by the OpenAI Responses API.
›Supports Streamable HTTP transport for MCP.
›Adds tool_call_summary_msg_format_fct parameter to AssistantAgent for custom tool-call summary formatting.
+10 moreshow less
›Supports multiple workbenches in AssistantAgent.
›Adds auto_delete option for temporary files in LocalCommandLineCodeExecutor.
›Adds language filtering for code blocks parsed from CodeExecutorAgent responses.
›Enables default usage statistics collection for streaming responses in OpenAIChatCompletionClient.
›Adds Llama API OAI-compatible endpoint support to OpenAIChatCompletionClient.
›Adds Qwen3 model support to OllamaChatCompletionClient.
›Allows implicit AWS credential resolution in AnthropicBedrockChatCompletionClient.
›Adds Claude Sonnet 4 and Claude Opus 4 to supported Anthropic models.
›Adds created_at field to BaseChatMessage and BaseAgentEvent.
›Uses structured output for the MagenticOne orchestrator.
└──▷ BREAKING ON UPGRADE
!The return type of BaseGroupChatManager.select_speaker changed from str to List[str] | str — subclasses that override this method with a strict str return type annotation may need to be updated.
›Adds is_enabled to handoffs, allowing conditional enabling/disabling of agent handoff targets at runtime.
›Adds MCP tool filtering support, enabling agents to restrict which tools are exposed from an MCP server.
›Adds safety check handling for ComputerTool, surfacing safety blocks during computer-use actions.
›Adds reasoning content output, making reasoning model intermediate thoughts accessible in responses.
└──▷ BREAKING ON UPGRADE
!MCP server interface includes a breaking change in this release; see https://openai.github.io/openai-agents-python/release/ for the specific migration details.
3 more releases in this issue
· 2025-06-04 → 2025-06-27
OpenAI Agents SDK v0.0.18 adds REPL support, dynamic prompt templates, and tool_call_id access in tool context.
└──▷ GET THIS VERSION
$ git clone --branch v0.0.18 https://github.com/openai/openai-agents-python.git
# already have the repo? check out this version:$ git checkout v0.0.18
└──▷ USE IT
Spin up an interactive REPL to manually test an agent's responses during development.
python
from agents import Agent, run_demo_loop
agent = Agent(name='Assistant', instructions='You are a helpful assistant.')
import asyncio
asyncio.run(run_demo_loop(agent))
Access the current tool call ID inside a tool function to correlate responses or build stateful workflows.
python
from agents import Agent, RunContextWrapper, function_tool
@function_tool
def my_tool(ctx: RunContextWrapper, query: str) -> str:
call_id = ctx.tool_call_id
# use call_id for logging or stateful tracking
return f'Handled call {call_id}: {query}'
›Adds run_demo_loop REPL helper for interactive agent testing sessions.
›Adds tool_call_id access via RunContextWrapper so tool functions can read the ID of the current tool call.
›Supports dynamic prompt templates through the OpenAI Prompts feature, enabling centrally managed, versioned agent instructions.
›Allows arbitrary keyword arguments to be passed through to the underlying model, enabling access to provider-specific parameters not yet explicitly supported.
└──▷ BREAKING ON UPGRADE
!Timeout parameters now accept float (seconds) instead of timedelta objects — any code passing timedelta values to timeout parameters will break.
v0.0.17 adds Portkey AI tracing, RunErrorDetails for max-turns exceptions, and is_enabled on FunctionTool.
└──▷ GET THIS VERSION
$ git clone --branch v0.0.17 https://github.com/openai/openai-agents-python.git
# already have the repo? check out this version:$ git checkout v0.0.17
└──▷ USE IT
Conditionally disable a FunctionTool at runtime — useful when a tool should only be available based on dynamic state (e.g. user permissions or environment).
python
from agents import FunctionTool
def lookup_order(order_id: str) -> str:
return f"Order {order_id}: shipped"
tool = FunctionTool(
name="lookup_order",
description="Look up an order by ID",
params_json_schema={"type": "object", "properties": {"order_id": {"type": "string"}}, "required": ["order_id"]},
on_invoke_tool=lookup_order,
is_enabled=False # disable until user is authenticated
)
›Adds is_enabled field to FunctionTool, allowing tools to be conditionally activated or deactivated at runtime.
›Adds RunErrorDetails object to the MaxTurnsExceeded exception, giving callers structured context when an agent run hits its turn limit.
›Adds Portkey AI as a tracing provider, enabling traces to be sent to the Portkey observability platform.
PydanticAI v0.3.5 lets tools return ToolReturn for richer model content and adds strict mode to NativeOutput.
└──▷ GET THIS VERSION
$ git clone --branch v0.3.5 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:$ git checkout v0.3.5
›Supports strict mode in NativeOutput, enabling stricter schema validation for native model outputs.
›Allows tools to return a ToolReturn object to pass additional content to the model or attach metadata that is not forwarded to the model.
›Sets 'us-central1' as the default region on GoogleProvider, removing the need to configure it explicitly.
›Moves ThinkingPart to precede TextPart in OpenAIResponsesModel, aligning reasoning output ordering.
›Adds a progress bar during evaluation runs.
└──▷ BREAKING ON UPGRADE
!The default region for GoogleProvider is now 'us-central1'; existing setups that relied on no default region being set may route requests differently after upgrading.
9 more releases in this issue
· 2025-06-03 → 2025-06-30
PydanticAI v0.3.3 adds NativeOutput and PromptedOutput modes and captures more OpenAI-compatible usage fields.
└──▷ GET THIS VERSION
$ git clone --branch v0.3.3 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:$ git checkout v0.3.3
›Adds NativeOutput and PromptedOutput output modes alongside the existing ToolOutput mode, giving agents more control over how structured results are produced.
›Captures additional usage fields returned by OpenAI-compatible APIs, surfacing richer token and cost details in Usage objects.
›Makes Edge hashable, enabling graph edges to be stored in sets and used as dict keys.
PydanticAI v0.3.0 adds ThinkingPart support, parsing provider thinking blocks into a dedicated message part type.
└──▷ GET THIS VERSION
$ git clone --branch v0.3.0 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:$ git checkout v0.3.0
›Adds ThinkingPart as a new message part type: provider-specific <think>...</think> blocks in text responses are now parsed and surfaced as structured ThinkingPart objects rather than raw text.
└──▷ BREAKING ON UPGRADE
!ThinkingParts are not sent back to the provider in subsequent turns — existing agents that relied on thinking content being echoed back in the message history will no longer include it, reducing costs but changing round-trip behavior.
PydanticAI v0.2.20 adds a process_tool_call hook for MCP servers and RunContext support in history processors.
└──▷ GET THIS VERSION
$ git clone --branch v0.2.20 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:$ git checkout v0.2.20
›Adds process_tool_call hook to MCP servers, enabling interception and modification of tool arguments, metadata, and return values before and after MCP tool execution.
›Adds RunContext support to history processors, giving them access to the full run context when processing conversation history.
›Adds ModelSettings.timeout enforcement in GoogleModel, so timeout settings are now respected when calling Google models.
PydanticAI v0.2.19 adds history_processors to Agent and surfaces events for unknown tool calls
└──▷ GET THIS VERSION
$ git clone --branch v0.2.19 https://github.com/pydantic/pydantic-ai.git
# already have the repo? check out this version:$ git checkout v0.2.19
└──▷ USE IT
Filter or redact sensitive messages from history before every model call, e.g. to strip PII in a compliance-sensitive pipeline.
python
from pydantic_ai import Agent
from pydantic_ai.messages import ModelMessage
def redact_secrets(messages: list[ModelMessage]) -> list[ModelMessage]:
# drop any message whose text contains an API key pattern
return [m for m in messages if 'sk-' not in str(m)]
agent = Agent('openai:gpt-4o', history_processors=[redact_secrets])
result = agent.run_sync('What did we discuss earlier?')
›Adds history_processors parameter to Agent for programmatic pre-processing of message history before each model call.
›Yields streaming events for unknown tool calls instead of silently dropping them, enabling downstream handling of unrecognised tool responses.
›Makes infer_provider more flexible, accepting a broader range of inputs when resolving provider from a model string.
›Ignores dynamic instructions that return an empty string, preventing blank system-prompt entries from being appended to the message list.
└──▷ BREAKING ON UPGRADE
!Anthropic max_tokens is now set to 4096 by default; any agent relying on the previous default behaviour may produce truncated responses or incur different token usage.
$ git clone --branch dotnet-1.58.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:$ git checkout dotnet-1.58.0
›Adds AzureClientCore support for response modalities and audio options, enabling multimodal (including audio) responses from Azure OpenAI.
›Adds ONNX ChatClient extensions for local on-device inference via the ONNX runtime.
›Introduces initial A2A (Agent-to-Agent) agent implementation for multi-agent interoperability.
›Adds AIContext support to OpenAIResponseAgent, enriching agent context handling.
›Adds streaming support to agent orchestrations, allowing intermediate results to surface in real time.
+4 moreshow less
›Allows Kernel to be mutable by AgentChatCompletions, enabling dynamic kernel configuration during agent chat sessions.
›Changes ChatCompletionAgent to emit intermediate messages as soon as they are available, reducing latency in streaming scenarios.
›Makes MaxTokens optional for Gemini models when not provided, removing a previously required parameter.
›Updates CosmosNoSql vector store to the latest SDK with updated FullTextScore syntax.
7 more releases in this issue
· 2025-06-03 → 2025-06-25
$ git clone --branch python-1.34.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:$ git checkout python-1.34.0
└──▷ USE IT
Merge two sets of kernel arguments using the new | operator instead of manually copying keys.
python
from semantic_kernel.kernel_arguments import KernelArguments
base = KernelArguments(city='Seattle', unit='metric')
overrides = KernelArguments(unit='imperial', verbose=True)
merged = base | overrides
# merged: {city: 'Seattle', unit: 'imperial', verbose: True}
›Supports | and |= merge operators for KernelArgument, enabling dict-style merging of kernel arguments.
›Adds structured output support for Ollama chat completion.
›Introduces vector stores preview for Python.
›Adds agent response callbacks that provide full context to callers.
›Adds pseudo-streaming support via invoke_stream for Copilot-style agents.
+2 moreshow less
›Adds operationId validation when parsing OpenAPI specs.
›Adds an Azure AI Foundry local sample demonstrating local model usage.
Semantic Kernel vectordata-dotnet-9.6.0 adds Ollama ChatClient extensions, AIContextProvider, CopilotStudioAgent, OpenAI Response Agent, hybrid search, and more.
└──▷ GET THIS VERSION
$ git clone --branch vectordata-dotnet-9.6.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:$ git checkout vectordata-dotnet-9.6.0
›Adds AIContextProvider support to Semantic Kernel (.NET), enabling dynamic context injection into chat completions via AIContextProvider implementations, with logging now included.
›Introduces CopilotStudioAgent (.NET) for agent interactions with Microsoft Copilot Studio.
›Adds new OpenAIResponseAgent (.NET) backed by the OpenAI Responses API.
›Implements OnnxRuntimeGenAIChatCompletionService on top of OnnxRuntimeGenAIChatClient (.NET), enabling local ONNX model chat completions.
›Adds Ollama ChatClient extension methods for the .NET KernelBuilder.
+23 moreshow less
›Adds usage metadata reporting to the ChatClientChatCompletionService adapter (.NET).
›Adds ChatHistoryAgentThread to multi-agent orchestration (.NET), enabling shared thread history across agents.
›Adds hybrid search support to the text search store (.NET).
›Adds Summary property to the OpenApiOperation model class (.NET).
›Adds Labels field to Gemini API requests (.NET).
›Adds token usage reporting to responses for the Bedrock connector (.NET).
›Adds contextual function selection to Semantic Kernel (.NET).
›Exposes ToJson() method on FoundryProcessBuilder (.NET).
›Adds audio and binary tag support to the chat prompt parser (.NET).
›Adds Foundry workflow management client (.NET).
›Supports Declarative Spec for OpenAIAssistantAgent and OpenAIResponsesAgent (Python).
›Adds BingGroundingTool parameter configuration support (Python), allowing customization of Bing search parameters.
›Includes Bing Grounding Tool call results in invoke_stream responses (Python).
›Adds file handling support to BinaryContent for the OpenAI Responses API (Python).
›Adds Bing custom search tool content support (Python).
›Adds streaming agent response callback in agent orchestrations (Python).
›Emits token usage with streaming chat completion agent responses (Python).
›Adds WebRTC support for Azure OpenAI Realtime (Python).
›Supports structured outputs with Azure AI inference chat completion (Python).
›Normalizes MCP function names to allowed tool-calling values (Python).
›Removes Kusto and DuckDB vector store providers (.NET).
›Removes planner-related code and samples (.NET and Python).
›Switches all .NET Agents instances of SendMessage to PublishMessage.
└──▷ BREAKING ON UPGRADE
!All .NET Agents usages of SendMessage are renamed to PublishMessage; existing code calling SendMessage on agent instances will break.
!The Kusto and DuckDB vector store providers are removed from .NET; projects depending on these packages must migrate to an alternative provider.
!Python planner-related code and samples are removed; any code referencing planner APIs will break.
$ git clone --branch dotnet-1.56.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:$ git checkout dotnet-1.56.0
›Introduces CopilotStudioAgent for .NET Agents, enabling integration with Microsoft Copilot Studio.
›Adds OpenAIResponseAgent — a new agent type backed by the OpenAI Responses API.
›Implements OnnxRuntimeGenAIChatCompletionService on top of OnnxRuntimeGenAIChatClient, bringing local ONNX Runtime GenAI models into the chat completion abstraction.
›Adds usage metadata support for ChatClientChatCompletionService adapter, surfacing token/usage telemetry when using IChatClient-backed completions.
›Adds support for audio and binary tags in the chat prompt parser, enabling multimodal prompt construction.
+5 moreshow less
›Removes obsoleted planner classes, cleaning up the planners that were previously marked obsolete.
Semantic Kernel Python 1.33.0 adds Bing custom search, BinaryContent file handling for OpenAI Responses API, and streaming token usage emission.
└──▷ GET THIS VERSION
$ git clone --branch python-1.33.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:$ git checkout python-1.33.0
›Adds file handling support to BinaryContent for the OpenAI Responses API.
›Adds Bing custom search tool content support.
›Emits token usage data with streaming chat completion agents.
›Normalizes MCP function names to allowed tool-calling values for compatibility.
›Removes the model info check in Bedrock connectors, broadening model compatibility.
+1 moreshow less
›Adds a chat completion agent code interpreter sample.
└──▷ BREAKING ON UPGRADE
!All planner-related code and samples have been fully removed from the package; any code relying on Semantic Kernel planners will break on upgrade.
$ git clone --branch python-1.32.2 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:$ git checkout python-1.32.2
›Supports custom httpx client timeout when not using a custom client, allowing fine-grained control over request timing.
›Adds streaming agent response callback support in agent orchestrations.
Semantic Kernel dotnet-1.55.0 adds Foundry workflow management, ChatHistoryAgentThread, contextual function selection, hybrid search, and MCP SDK update.
└──▷ GET THIS VERSION
$ git clone --branch dotnet-1.55.0 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:$ git checkout dotnet-1.55.0
›Adds ChatHistoryAgentThread to multi-agent support, enabling agents to share and reference a common chat history thread.
›Adds Labels field to Gemini request payloads for annotating inference calls.
›Adds hybrid search support to the text search store, combining vector and keyword search.
›Adds token usage reporting to responses from the Bedrock connector.
›Adds logging to AIContextProvider implementations for observability.
+4 moreshow less
›Adds Foundry workflow management client for orchestrating AI Foundry workflows.
›Adds contextual function selection capability to Semantic Kernel.
›Updates to the latest MCP (Model Context Protocol) SDK.
AzureAIAgent dependencies now bundled in the base semantic-kernel package
└──▷ GET THIS VERSION
$ git clone --branch python-1.32.1 https://github.com/microsoft/semantic-kernel.git
# already have the repo? check out this version:$ git checkout python-1.32.1
›Bundles AzureAIAgent required dependencies into the base pip install semantic-kernel package, eliminating the need for a separate extras install.
›Adds BrowserSession(stealth=True) and BrowserProfile(stealth=True) as a shortcut to run sessions through patchright for bot-detection evasion.
›Adds BrowserSession.kill() to force-close a session even when keep_alive=True is set.
›Adds --cdp-url, --user-data-dir, and --profile-directory options to the browser-use CLI.
›Auto-applies storage_state.json (cookies/localStorage) even when connecting to an already-running browser via CDP.
›Every Agent, BrowserSession, and BrowserProfile instance now carries a unique UUID, making them straightforward to persist to a database.
+3 moreshow less
›CLI now uses stealth mode by default.
›Major async performance improvements for page-to-markdown extraction and LLM calls in multi-agent scenarios.
›Major stability improvements for multithreading, multiple asyncio run loops, and serial/parallel BrowserSession and Agent use.
└──▷ BREAKING ON UPGRADE
!BrowserSession instances with keep_alive=True must now be started manually before being passed to Agent() — previously the agent could start them automatically.
smolagents v1.19.0 adds managed-agent support in ToolCallingAgent, context-manager cleanup, GradioUI memory reset, and CodeAgent output tracking.
└──▷ GET THIS VERSION
$ git clone --branch v1.19.0 https://github.com/huggingface/smolagents.git
# already have the repo? check out this version:$ git checkout v1.19.0
└──▷ USE IT
Clean up agent resources deterministically at the end of a task using a context manager.
python
from smolagents import CodeAgent, HfApiModel
model = HfApiModel()
with CodeAgent(tools=[], model=model) as agent:
result = agent.run('Compute 2 + 2')
# agent resources are released automatically on exit
Inspect intermediate code execution results stored in each step after a CodeAgent run.
python
from smolagents import CodeAgent, HfApiModel
model = HfApiModel()
agent = CodeAgent(tools=[], model=model)
agent.run('Print the first 5 Fibonacci numbers')
for step in agent.memory.steps:
if hasattr(step, 'code_output'):
print(step.code_output)
›Supports reset_agent_memory in GradioUI, letting users clear conversation history from the UI between sessions.
›Stores CodeAgent code outputs in ActionStep, making intermediate code execution results available for downstream inspection.
›Supports managed agents in ToolCallingAgent, enabling multi-agent orchestration through the tool-calling interface.
›Supports context managers for agent cleanup, allowing with blocks to reliably tear down agent resources.
›Transfers streaming event aggregation off the Model class, enabling more flexible streaming architectures.
1 more release in this issue
· 2025-06-10 → 2025-06-24
›Adds support for gemini-2.5-pro, gemini-2.5-flash, and gemini-2.5-pro-preview-06-05 with thinking tokens; flash and gemini aliases updated accordingly.
›Adds support for OpenAI o3-pro and o1-pro via the Responses API across multiple providers.
›Enables disabling thinking tokens by setting them to 0, with improved help text and examples.
›New --add-gitignore-files flag allows adding .gitignore-listed files to Aider's editing scope.
›New --commit-language option lets users specify the language for generated commit messages.
+6 moreshow less
›Co-authored-by attribution is now enabled by default in commit messages.
›New --analytics-posthog-host and --analytics-posthog-project-api-key flags enable custom PostHog analytics configuration.
›Adds MATLAB language support for repository maps.
›Adds Clojure language support for repository maps.
›Increases max tokens for Deepseek models to 65,536.
›Skips expensive file tracking operations when --skip-sanity-check-repo is set, improving performance.
Continue v1.0.14 adds requestRule tool, streamable-http MCP support, per-model autocomplete config, next-edit prediction, and a Fetch URL Content tool.
└──▷ GET THIS VERSION
$ git clone --branch v1.0.14-vscode https://github.com/continuedev/continue.git
# already have the repo? check out this version:$ git checkout v1.0.14-vscode
└──▷ USE IT
Tune autocomplete aggressiveness differently per model — e.g. a faster model gets a shorter debounce.
Continue v1.0.12 adds MCP Streamable HTTP, new YAML config keys, OS-aware terminal, and automatic current-file chat context.
└──▷ GET THIS VERSION
$ git clone --branch v1.0.12-vscode https://github.com/continuedev/continue.git
# already have the repo? check out this version:$ git checkout v1.0.12-vscode
└──▷ USE IT
Cap stop words and enable streaming explicitly for a model in your YAML config to control generation behavior.
Force a rule to always apply to every chat and agent session by setting alwaysApply in your rules config.
yaml
rules:
- name: coding-standards
description: Enforce team coding standards in every session
alwaysApply: true
content: Always use snake_case for variable names.
›Adds maxStopWords to model config in YAML, letting users cap the number of stop words sent to a model.
›Adds stream to defaultCompletionOptions in YAML config, enabling explicit control over streaming behavior per completion.
›Adds description field support in markdown YAML front-matter for rules/prompts.
›Adds alwaysApply property to rules config for unconditional rule application regardless of context.
›Adds MCP Streamable HTTP transport support, expanding how Model Context Protocol servers can be connected.
+5 moreshow less
›Surfaces stderr output in error messages for failed MCP servers, making misconfiguration easier to diagnose.
›Automatically adds the current file as context in chat without requiring manual @file attachment.
›Makes the terminal command tool aware of the OS, platform, and shell it is running in for more accurate command generation.
›Removes 'Edit' as a distinct mode, consolidating the interaction surface.
›Adds MCP resource templates support.
└──▷ BREAKING ON UPGRADE
!The 'Edit' mode has been removed; workflows that relied on Edit as a separate mode will need to migrate to the remaining modes.
Continue v1.0.22 adds Next Edit prediction, proxy-aware completions, verbose fetch logging, and Claude 4 Sonnet/Opus model support.
└──▷ GET THIS VERSION
$ git clone --branch v1.0.22-jetbrains https://github.com/continuedev/continue.git
# already have the repo? check out this version:$ git checkout v1.0.22-jetbrains
└──▷ TRY IT
Prioritize workspace-specific API keys or secrets over repo-root defaults in a shared project.
$ # Place your secrets in the workspace-scoped location so they take precedence
mkdir -p <workspace>/.continue
echo 'ANTHROPIC_API_KEY=sk-ant-...' > <workspace>/.continue/.env
›Secrets are now fetched from <workspace>/.continue/.env before falling back to <workspace>/.env, giving workspace-scoped credentials priority.
›Supports caBundlePath as a data URI, enabling inline CA bundle configuration without a file on disk.
›Adds verbose logging option for the custom fetch layer to aid in diagnosing network and proxy issues.
›Supports completions through a proxy, extending LLM reachability in firewalled or enterprise environments.
›Adds claude-4-sonnet and claude-opus (Opus) to the built-in LLM info registry.
+3 moreshow less
›Introduces Next Edit prediction, a new autocomplete-adjacent capability that anticipates the developer's next code edit.
›Adds a 'call alongside autocomplete' feature that allows additional calls to fire in parallel with autocomplete requests.
›Adds the JCEF out-of-process VM setting for the JetBrains plugin, improving rendering stability.
└──▷ BREAKING ON UPGRADE
!The free trial provider has been removed; setups relying on it will no longer function after upgrade.
OpenCode v0.1.61 restructures custom provider config with a new npm field for package loading.
└──▷ GET THIS VERSION
$ git clone --branch v0.1.61 https://github.com/sst/opencode.git
# already have the repo? check out this version:$ git checkout v0.1.61
›Adds npm field to custom provider config entries to explicitly specify which npm package to load.
›Adds validation on provider ID and improved error messages in opencode auth login.
└──▷ BREAKING ON UPGRADE
!The config structure has changed: custom providers now require an npm field to specify which npm package to load — existing custom provider configs will break without this update.
!Windows builds have been removed — Windows users can no longer install or run OpenCode from official release artifacts.
OpenHands 0.47 adds GitLab microagent config directory support and smarter terminal output truncation.
└──▷ GET THIS VERSION
$ git clone --branch 0.47.0 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:$ git checkout 0.47.0
└──▷ HOW TO FIND IT
Store org-level microagents in a GitLab repo using the supported alternative directory path so OpenHands can discover them.
📍In your GitLab group, create a repository named openhands-config and place your microagent .md files under the microagents/ folder — OpenHands will automatically load them per the updated org microagent discovery logic.
›Adds new feedback options for users within the UI.
›Supports openhands-config as an alternative GitLab directory for hosting org-level microagents.
›Changes terminal truncation to trim the middle of long outputs instead of the suffix, preserving both start and end context.
7 more releases in this issue
· 2025-06-01 → 2025-06-27
OpenHands 0.45 adds Kubernetes runtime, Bitbucket integration, file/image uploads, per-conversation budgets, and Japanese UI.
└──▷ GET THIS VERSION
$ git clone --branch 0.45.0 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:$ git checkout 0.45.0
›Adds Kubernetes Runtime support as a new sandbox execution backend.
›Supports file and image uploads directly within conversations.
›Adds Bitbucket integration for local usage alongside existing GitHub support.
›Enables per-conversation budget configuration to cap LLM spending.
›Adds Japanese language support to the UI.
+1 moreshow less
›Increases max iterations per task from 250 to 500, enabling more complex autonomous workflows.
└──▷ BREAKING ON UPGRADE
!The local configuration directory has moved from ~/.openhands-state to ~/.openhands; existing state stored in the old path will not be picked up automatically after upgrading.
OpenHands 0.43 adds Slack integration (beta), a Microagents UI, GitLab lower-scoped token support, and a code review microagent example.
└──▷ GET THIS VERSION
$ git clone --branch 0.43.0 https://github.com/All-Hands-AI/OpenHands.git
# already have the repo? check out this version:$ git checkout 0.43.0
└──▷ HOW TO FIND IT
Browse available microagents mid-conversation to understand what specialized knowledge is loaded before asking a domain-specific question.
📍In the conversation UI, open the context menu and select 'Microagents' to view the list of active specialized microagents for the current session.
›New Slack integration (beta) with Cloud OpenHands for triggering and interacting with agents via Slack.
›New Microagents UI in the conversation context menu lets users see what specialized knowledge microagents are available in their current conversation.
›New example code review microagent provides a ready-made template for automated code review workflows.
›Supports lower-scoped GitLab tokens, enabling more granular permission control when connecting GitLab repositories.
›Adds JSON serialization for array and object parameters when converting tools, broadening tool-call compatibility.
└──▷ BREAKING ON UPGRADE
!The CLI default provider is changed from openai to anthropic; existing CLI users relying on the default will now target Anthropic instead of OpenAI.
!CLI settings are now saved directly under ~/.openhands instead of the previous location; existing CLI config files stored elsewhere will no longer be read automatically.
Zed v0.190.4 adds Vim mode in the agent panel, OpenRouter support, Python venv auto-config, a Cursor keymap, and FreeBSD SSH remotes.
└──▷ GET THIS VERSION
$ git clone --branch v0.190.4 https://github.com/zed-industries/zed.git
# already have the repo? check out this version:$ git checkout v0.190.4
└──▷ USE IT
Close an open editor tab automatically when its file is deleted from disk, useful for keeping the workspace clean during refactors.
json
// In Zed settings (settings.json)
{
"close_on_file_delete": true
}
Reference the current file's directory (relative to worktree root) in a custom task — handy for running tools scoped to the file's folder.
json
// In .zed/tasks.json
[
{
"label": "Run tests in file directory",
"command": "pytest",
"args": ["$ZED_RELATIVE_DIR"],
"cwd": "$ZED_WORKTREE_ROOT"
}
]
›Adds close_on_file_delete setting (off by default) to automatically close open editor tabs when the underlying file is deleted from disk.
›Adds ZED_RELATIVE_DIR task variable providing the path to the current file's directory relative to the worktree root.
›Adds AGENT.md and AGENTS.md as recognized rules file names for the agent panel.
›Adds thinking mode for custom Google models in the agent panel, with configurable token budget.
›Adds disabled_globs setting path expansion to handle ~ in Edit Prediction glob patterns.
+30 moreshow less
›Adds :e[dit] {file} Vim command to open files within the current project.
›Adds :delm[arks] {marks} Vim command to delete named marks.
›Adds ArgumentRequired Vim action for commands that require arguments.
›Adds vim::PushFindForward and vim::PushFindBackward text selection support in Helix mode.
›Adds Cursor compatibility keymap for users migrating from Cursor.
›Adds Vim mode support in the agent panel's editor.
›Adds ability to accept or reject all agent-proposed changes at once from the agent panel.
›Adds OpenRouter as a language model provider for the agent.
›Adds image support for Ollama vision models in the agent.
›Adds thinking support when using Ollama models in the agent.
›Adds a keybinding to toggle Burn Mode on and off in the agent.
›Adds toast and/or sound notifications when the consecutive tool call limit is reached.
›Adds full terminal output display and collapsible terminal output in the agent panel.
›Adds AWS Bedrock support for Meta Llama 4 Scout and Maverick models.
›Adds AWS Bedrock ability to pick between Thinking and Non-Thinking model variants.
›Adds sorbet and steep to the list of available Ruby language servers.
›Adds default latexindent formatter settings for LaTeX without requiring texlab, and allows prettier as a LaTeX formatter.
›Adds subword navigation and selection to the Sublime keymap.
›Adds option to create a new file directly from the project search panel.
›Adds initial SSH remote support for FreeBSD x86_64 hosts.
›Migrates agent thread storage to SQLite with compression, improving persistence and efficiency.
›Extends custom git hosting provider configuration to cover project-level settings in addition to global settings.
›Python toolchain selector now uses the closest pyproject.toml as the basis for virtual environment selection, enabling multiple disjoint virtual environments within a single project.
KoboldCpp v1.95.1 adds Flux Kontext image editing, multi-reference Photomaker, and Gemma3n/ERNIE model support.
└──▷ GET THIS VERSION
$ git clone --branch v1.95.1 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:$ git checkout v1.95.1
└──▷ HOW TO FIND IT
After loading Flux Kontext, open StableUI in a browser, supply a prompt and reference image, and generate the edited result.
📍In StableUI at http://localhost:5001/sdui: upload a reference image, enter your editing prompt (e.g. 'replace the background with a sunset'), then click Generate.
›Adds support for Flux Kontext, a natural-language image editing model (background replacement, text editing, object insertion) loadable via a .kcppt template; accessible through StableUI at http://localhost:5001/sdui with prompt and reference image inputs.
›Photomaker now accepts up to 4 reference images, matching the multi-image input capability added for Flux Kontext.
›Adds AutoGuess template support for Gemma3n (text-only) and ERNIE models.
›Further grammar sampling speedups via caching.
2 more releases in this issue
· 2025-06-07 → 2025-06-29
›Adds --sdphotomaker flag to load PhotoMaker for face cloning alongside any SDXL-based model, available in text2img, img2img, and inpaint modes via the SDUI at http://localhost:5001/sdui.
›Adds --sdclampedsoft flag for soft total resolution clamping (e.g. a value of 640 allows 640x640, 512x768, and 768x512 images), combinable with the existing --sdclamped hard-clamp flag.
›Adds --sdtiledvae flag to specify a resolution threshold beyond which VAE tiling is applied, replacing the previous --sdnotile.
›Adds --embeddingsmaxctx flag to cap the max context length for embedding models, reducing memory usage.
›Adds --embeddingsgpu flag to offload embedding model layers to GPU.
+8 moreshow less
›Adds --maingpu flag to select which GPU is treated as the main GPU in multi-GPU setups.
›Adds Chroma image generation support — a new architecture based on Flux Schnell requiring a T5-XXL encoder and Flux VAE loaded alongside the Chroma GGUF model.
›ComfyUI emulation now covers the /upload/image endpoint, enabling img2img ComfyUI workflows with files stored temporarily in memory.
›Adds a mini 5 MB PyInstaller launcher generated alongside an unpacked KoboldCpp directory, allowing launch without Python or other dependencies installed.
›Kobold Lite gains Word Frequency Search, webcam image import, WebSearch for corpo mode, ComfyUI img2img support, custom OpenAI endpoint for TextDB embedding model, and the ability to load usermods and CSS from file.
›Improves GNBF grammar performance by attempting culled grammar search first.
›Displays available RAM on startup and shows the version number in the terminal window title.
›Adds more performance stats for token speeds and timings.
└──▷ BREAKING ON UPGRADE
!--sdnotile is replaced by --sdtiledvae; setups using --sdnotile must switch to the new flag.
KoboldCpp v1.93.2 adds Windows Shell integration for .gguf files, in-memory save/load session states, model unloading via admin API, and a new --embeddingsmaxctx flag.
└──▷ GET THIS VERSION
$ git clone --branch v1.93.2 https://github.com/LostRuins/koboldcpp.git
# already have the repo? check out this version:$ git checkout v1.93.2
└──▷ TRY IT
Cap embeddings context to avoid OOM when running large embedding batches alongside a generation model.
Enable single-instance mode so double-clicking a .gguf in Windows Explorer replaces the running session via /api/extra/shutdown.
$ koboldcpp --model mymodel.gguf --singleinstance
›Adds --embeddingsmaxctx CLI option to control the maximum context size for the embeddings endpoint.
›Adds --singleinstance flag awareness for Windows Shell integration: only instances started with this flag are replaced when a .gguf file is double-clicked to open in KoboldCpp.
›Adds add_sd_step_limit adapter flag to cap the maximum number of steps in image generation.
›Adds /api/extra/shutdown API endpoint (localhost-only) to power Windows Shell integration, allowing a running instance to be replaced when a new .gguf is launched.
›Adds Windows Shell integration allowing .gguf files to be associated with KoboldCpp; double-clicking a .gguf opens it directly, replacing any existing local instance on the same port. Installable/uninstallable from the 'Extras' tab.
+11 moreshow less
›Adds Save and Load States (session snapshots) via the admin API, storing context snapshots entirely in memory across 3 available slots (4 including the current session), enabling seamless swap between chats with no reprocessing.
›Adds model unload option to the admin API, freeing memory while keeping the server running so a different model can be loaded via the admin panel in Lite.
›Raises the maximum allowed temperature for Function/Tool calling to 1.0.
›Adds more Ollama compatibility endpoints.
›Adds support for embeddings models in Kobold Lite's TextDB.
›Adds 'Smart' Image Autogeneration mode in Kobold Lite, letting the AI decide when to generate images and create image prompts automatically.
›Adds support for saving and loading world info files independently in Kobold Lite.
›Adds support for importing character cards from character-tavern.com in Kobold Lite.
›Adds a toggle to make a usermod permanent in Kobold Lite.
›Adds support for welcome messages in corpo mode in Kobold Lite.
›Adds a text LoRA scale option (the previously available text LoRA base option is removed; if provided it will be silently ignored).
└──▷ BREAKING ON UPGRADE
!Linux binary koboldcpp-linux-x64-cuda1210 is renamed to koboldcpp-linux-x64; automated scripts using the old name will break when the old filename is removed.
!Linux binary koboldcpp-linux-x64-cuda1150 is renamed to koboldcpp-linux-x64-oldpc; automated scripts using the old name will break when the old filename is removed.
!Windows binary koboldcpp_cu12.exe is renamed to koboldcpp.exe; automated scripts using the old name will break when the old filename is removed.
!Windows binary koboldcpp_oldcpu.exe is renamed to koboldcpp-oldpc.exe; automated scripts using the old name will break when the old filename is removed.
!Windows binary koboldcpp_nocuda.exe is renamed to koboldcpp-nocuda.exe; automated scripts using the old name will break when the old filename is removed.
!The text LoRA base option has been removed; any scripts or configs passing it will have the value silently ignored rather than applied.
LocalAI v3.1.1 automatically installs missing backends when a model from the gallery requires them.
└──▷ GET THIS VERSION
$ git clone --branch v3.1.1 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:$ git checkout v3.1.1
›Automatically installs missing backends alongside models when installing from the gallery, removing the need to manually pre-install backend dependencies.
2 more releases in this issue
· 2025-06-19 → 2025-06-27
LocalAI v3.1 adds Gemma 3n support, GPU-aware meta-packages in the backend gallery, and a leaner container image layout.
└──▷ GET THIS VERSION
$ git clone --branch v3.1.0 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:$ git checkout v3.1.0
└──▷ TRY IT
Run the Gemma 3n E4B instruction-tuned model locally for text generation in a single command.
$ local-ai run gemma-3n-e4b-it
›Adds local-ai run gemma-3n-e2b-it and local-ai run gemma-3n-e4b-it commands to run Google Gemma 3n models (text generation) locally.
›Introduces meta-packages to the backend gallery so installing a backend (e.g. vllm) automatically selects the correct GPU variant without manual version picking.
›Moves default model and backend paths in container images to /models/ and /backends/ respectively.
└──▷ BREAKING ON UPGRADE
!Default model path in container images changed from /build/models to /models/; mounts or scripts referencing the old path will break.
!Default backend path in container images changed from /build/backends to /backends/; mounts or scripts referencing the old path will break.
!Container image tag cublas-cuda11 is renamed to gpu-nvidia-cuda11 and cublas-cuda12 to gpu-nvidia-cuda12; pipelines pinned to the old tag names will stop pulling the intended image.
!Container image tag sycl-f16 is renamed to gpu-intel-f16 and sycl-f32 to gpu-intel-f32; pipelines pinned to the old tag names will stop pulling the intended image.
!Sources are no longer bundled in the container images; workflows that relied on in-container source access must build from scratch instead.
LocalAI 3.0 ships a Backend Gallery (OCI-based, API-driven), Realtime WebSocket API, audio/PDF upload in the UI, llama.cpp reranking, and 50+ new models.
└──▷ GET THIS VERSION
$ git clone --branch v3.0.0 https://github.com/mudler/LocalAI.git
# already have the repo? check out this version:$ git checkout v3.0.0
└──▷ TRY IT
Run LocalAI on an NVIDIA CUDA 12 GPU without needing extras images — additional backends can be added at runtime via the gallery.
$ docker run -ti--name local-ai -p 8080:8080 --gpus all localai/localai:latest-gpu-nvidia-cuda-12
Run the CPU-only AIO image with models pre-downloaded, ready to use immediately with no manual gallery steps.
$ docker run -ti--name local-ai -p 8080:8080 localai/localai:latest-aio-cpu
›Adds a Backend Gallery that lets you install and remove backends at runtime or startup via API or the WebUI, backed by standard OCI images — replaces the old -extra image approach.
›Adds Backend Gallery download progress display in the WebUI so you can track backend installations in real time.
›Adds Realtime WebSocket API with OpenAI-compatible streaming, suitable for chat apps and agents.
›Adds llama.cpp reranking support.
›Adds enhanced multimodal support to llama.cpp via libmtmd.
+9 moreshow less
›Adds audio input support to llama.cpp, enabling audio understanding models such as Qwen Omni and Ultravox.
›Adds an audio upload button in the chat UI, letting users send audio files directly to supported models.
›Adds PDF and text file upload in the chat UI, with support for multiple input files simultaneously.
›Adds visual 'thinking' tags in the chat UI for reasoning models, showing inference progress in real time.
›Adds dynamic VRAM estimation and automatic layer offloading based on GPU capabilities, improving GPU utilization without manual tuning.
›Adds an error page in the UI to surface backend errors more clearly.
›Adds 50+ new models to the model gallery, including skywork-or1-32b, rivermind-lux-12b, qwen3-embedding-*, llama3-24b-mullein, and ultravox-v0_5.
›Adds new GPU-specific Docker image tags: latest-gpu-nvidia-cuda-12, latest-gpu-nvidia-cuda-11, latest-nvidia-l4t-arm64, latest-gpu-hipblas, latest-gpu-intel-f16, latest-gpu-intel-f32, and latest-gpu-vulkan, replacing the former extras-image model.
!The -extra Docker images containing Python backends (e.g. localai/localai:*-extra) are no longer published; switch to standard GPU-specific images (latest-gpu-nvidia-cuda-12, latest-gpu-hipblas, etc.) and install additional backends via the Backend Gallery.
!bark-cpp is removed from the bundled image and moved to the Backend Gallery — installations relying on the built-in bark-cpp backend must reinstall it via the Backend Gallery after upgrading.
SGLang v0.4.8 adds DeepSeek R1 FP4 on Blackwell GPUs, reranking support, logit bias, hidden states API, and VILA model support.
└──▷ GET THIS VERSION
$ git clone --branch v0.4.8 https://github.com/sgl-project/sglang.git
# already have the repo? check out this version:$ git checkout v0.4.8
└──▷ USE IT
Update an existing import after the OpenAI API module was relocated to sglang/srt/entrypoints/openai.
python
# Before (v0.4.7 and earlier)
from sglang.srt.openai_api.protocol import Tool
# After (v0.4.8+)
from sglang.srt.entrypoints.openai.protocol import Tool
›Moves the OpenAI-compatible API module from sglang/srt/openai_api to sglang/srt/entrypoints/openai; update imports such as from sglang.srt.entrypoints.openai.protocol import Tool.
›Adds support for DeepSeek R1 with FP4 quantization and MTP on NVIDIA Blackwell GPUs, integrating FlashInfer NVFP4 MoE with TP, EP, and DP; achieves up to 90 tokens/sec per user on B200 at isl/osl/bs = 1k/1k/16.
›Adds support for reranking via the OpenAI-compatible server (feat/support rerank).
›Adds logit bias support to sampling parameters.
›Adds hidden states exposure through the OpenAI-compatible API.
+7 moreshow less
›Adds support for VILA vision-language models.
›Adds support for Phi-4-mm as a supported VLM.
›Adds gfx950 GPU support to sgl-kernel.
›Adds support for the new DeepGEMM input format in per-token group quantization, including silu_and_mul_masked_post_quant_fwd.
›Supports 2-stream shared expert execution for DeepSeek MoE models on Blackwell.
›Adds support for separate reasoning in the frontend language (frontend reasoning API).
›Refactors the OpenAI-compatible server with consistent metrics, unified error handling, and improved request tracking for production and enterprise environments.
└──▷ BREAKING ON UPGRADE
!The sglang/srt/openai_api directory has been removed and replaced with sglang/srt/entrypoints/openai; any import such as from sglang.srt.openai_api.protocol import Tool must be updated to from sglang.srt.entrypoints.openai.protocol import Tool.
1 more release in this issue
· 2025-06-11 → 2025-06-24
SGLang v0.4.7 adds pipeline parallelism, PD disaggregation with NIXL backend, Qwen3/Kimi-VL/InternVL3/MiMo model support, CUDA graph for LoRA, and full Blackwell GPU support.
└──▷ GET THIS VERSION
$ git clone --branch v0.4.7 https://github.com/sgl-project/sglang.git
# already have the repo? check out this version:$ git checkout v0.4.7
└──▷ TRY IT
Enable thinking mode for a Qwen3 or DeepSeek R1 model at request time, useful for reasoning or chain-of-thought workflows.
Cap output length on a Chat Completions request using the OpenAI-compatible max_completion_tokens field, useful for controlling cost and latency in production.
›Adds chat_template_kwargs.enable_thinking to enable thinking mode via the chat template, allowing reasoning/tool-call workflows to be toggled per request.
›Supports max_completion_tokens parameter for OpenAI Chat Completions API, aligning with the OpenAI spec.
Ollama v0.9.3 adds support for Google's Gemma 3n models, optimized for laptops, tablets, and phones.
└──▷ GET THIS VERSION
$ git clone --branch v0.9.3 https://github.com/ollama/ollama.git
# already have the repo? check out this version:$ git checkout v0.9.3
└──▷ TRY IT
Run the Effective 2B Gemma 3n model locally for lightweight, multilingual inference on everyday hardware.
$ ollama run gemma3n:e2b
Run the Effective 4B Gemma 3n model for higher-quality multilingual responses while remaining efficient on consumer devices.
$ ollama run gemma3n:e4b
›Supports Gemma 3n models (e2b and e4b variants), designed for efficient on-device execution across laptops, tablets, and phones with training data covering 140+ spoken languages.
Triton Inference Server v2.59.0 improves ensemble model throughput and latency for out-of-order response scenarios.
└──▷ GET THIS VERSION
$ git clone --branch v2.59.0 https://github.com/triton-inference-server/server.git
# already have the repo? check out this version:$ git checkout v2.59.0
›Improves ensemble model performance in out-of-order response scenarios, increasing maximum throughput and reducing latency.
Phoenix v11.2.0 adds cost sorting on the traces table, paginated session details, and OpenTelemetry ID redirects.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v11.2.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-v11.2.0
›Enables sorting by cost on the traces table.
›Adds pagination to the session details view for large session histories.
›Supports redirect navigation from OpenTelemetry IDs to the corresponding trace or span view.
15 more releases in this issue
· 2025-06-03 → 2025-06-30
Arize Phoenix v11.1.0 adds imagePullSecrets support to the Helm chart.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v11.1.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-v11.1.0
›Adds imagePullSecrets support to the Helm chart, enabling deployments that pull images from private registries.
Phoenix v11 ships cost tracking for LLM spans, including model cost calculations and updated OpenAI reasoning model support.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v11.0.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-v11.0.0
›Adds model cost tracking to LLM spans, calculating token-level costs across supported models.
›Adds updated cost definitions for OpenAI reasoning models.
└──▷ BREAKING ON UPGRADE
!The cost feature release introduces breaking changes — see the published migration guide for required changes when upgrading from v10.
arize-phoenix-otel 0.12.0 adds support for passing tracer provider arguments.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-otel-v0.12.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-otel-v0.12.0
›Supports passing tracer provider arguments when initializing the OpenTelemetry integration in arize-phoenix-otel.
Arize Phoenix 10.15.0 adds a Bedrock playground client for interactive model testing.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v10.15.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-v10.15.0
›Adds a Bedrock playground client, enabling interactive testing of Amazon Bedrock models directly within the Phoenix UI.
Phoenix now falls back to OTEL_EXPORTER_OTLP_ENDPOINT when PHOENIX_COLLECTOR_ENDPOINT is not set.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v10.14.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-v10.14.0
└──▷ TRY IT
Use a standard OTel collector endpoint without setting a Phoenix-specific env var — useful in shared OTel environments where OTEL_EXPORTER_OTLP_ENDPOINT is already configured.
$ export OTEL_EXPORTER_OTLP_ENDPOINT=http://localhost:4317
# PHOENIX_COLLECTOR_ENDPOINT is not set; Phoenix now picks up the OTel standard var automatically
›Reads OTEL_EXPORTER_OTLP_ENDPOINT as a fallback endpoint when PHOENIX_COLLECTOR_ENDPOINT is not defined, enabling standard OpenTelemetry environment variable conventions to work without Phoenix-specific configuration.
$ git clone --branch arize-phoenix-client-v1.11.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-client-v1.11.0
›Adds log_spans to the Phoenix client and REST API, enabling programmatic span ingestion.
›Adds dataset methods to the Phoenix client for managing datasets directly via the library.
›Adds logout support to the auth layer of the Phoenix client.
›Falls back to reading OTEL_EXPORTER_OTLP_ENDPOINT when PHOENIX_COLLECTOR_ENDPOINT is not set, easing OTEL-standard deployments.
arize-phoenix-otel v0.11.0 adds logout support, Phoenix Cloud spaces, and fallback to OTEL_EXPORTER_OTLP_ENDPOINT.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-otel-v0.11.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-otel-v0.11.0
└──▷ TRY IT
Point traces at a standard OTLP endpoint without setting a Phoenix-specific variable — useful when reusing an existing OpenTelemetry environment.
Phoenix v10.13.0 adds FullStory integration and enhanced Helm service configurability.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v10.13.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-v10.13.0
›Adds FullStory session-replay integration to the Phoenix UI.
›Enhances Helm chart service configurability with improved configuration options and documentation.
Phoenix v10.12.0 adds log_spans to the client and REST API, session filtering by ID, and zero-downtime Helm rollouts.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v10.12.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-v10.12.0
›Adds log_spans to the Python client and REST API, enabling programmatic span ingestion directly via the client or HTTP.
›Adds filtering of sessions by session_id in the sessions API.
›Enables zero-downtime rollouts in the Helm chart deployment.
$ git clone --branch arize-phoenix-v10.11.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-v10.11.0
›Adds dataset-filter support, enabling practitioners to filter datasets within Phoenix.
Phoenix 10.9.0 adds an experiment progress chart and a composable ModalOverlay UI component.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v10.9.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-v10.9.0
›Adds an experiment progress chart to the experiments view, giving practitioners a visual timeline of experiment run status.
›Introduces a composable ModalOverlay UI component for building layered dialog interfaces within Phoenix.
Phoenix client gains dataset methods; experiments table is now resizable.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v10.8.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-v10.8.0
›Adds dataset methods to the Phoenix client library, enabling programmatic dataset management.
›Experiments table columns are now resizable in the UI.
Arize Phoenix 10.7.0 adds Ollama support and server-side playground credential management.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v10.7.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-v10.7.0
›Adds server-side playground credentials, enabling credential key-value pairs to be stored and applied on the backend for playground LLM calls.
›Adds support for multiple credential key-value pairs in the playground UI frontend.
Phoenix client gains get_spans retrieval and Ollama model support in v1.10.0
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-client-v1.10.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-client-v1.10.0
└──▷ USE IT
Retrieve spans from a Phoenix project programmatically to analyze traces in code.
python
from phoenix.client import Client
client = Client()
spans = client.get_spans()
›Adds get_spans method to the Phoenix client library for programmatic span retrieval.
Phoenix v10.6.0 adds get_spans to the client, new integrations, and a credentials field in the UI.
└──▷ GET THIS VERSION
$ git clone --branch arize-phoenix-v10.6.0 https://github.com/Arize-ai/phoenix.git
# already have the repo? check out this version:$ git checkout arize-phoenix-v10.6.0
└──▷ USE IT
Pull spans from a Phoenix project programmatically to inspect or export trace data outside the UI.
Weave v0.51.52 adds end-to-end online monitoring, Anthropic SDK support, OpenAI API endpoint tracking, and an updated LLMStructuredCompletionModel.
└──▷ GET THIS VERSION
$ git clone --branch v0.51.52 https://github.com/wandb/weave.git
# already have the repo? check out this version:$ git checkout v0.51.52
›Adds end-to-end online monitoring capability for tracking live model behavior in production.
›Adds support for the Anthropic SDK, enabling tracing and logging of Anthropic model calls.
›Adds OpenAI API endpoint tracking to capture and observe requests made through the OpenAI API.
›Updates LLMStructuredCompletionModel to inherit from Model and adds a predict function, enabling it to participate in Weave's standard model evaluation and tracing workflows.
›Adds model catalog and inference service UI on the Weave side, surfacing inference service metadata in the interface.
LanceDB python-v0.24.0 switches to native lance FTS by default and adds prefix matching, must_not clauses, and nprobes bounds.
└──▷ GET THIS VERSION
$ git clone --branch python-v0.24.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:$ git checkout python-v0.24.0
›Adds maximum and minimum nprobes properties to control ANN search probe bounds.
›Supports prefix matching and must_not clause in full-text search queries.
›Expands native FTS feature support in the Python SDK.
›Expands native FTS feature support in the JavaScript SDK.
└──▷ BREAKING ON UPGRADE
!The default full-text search engine is now native lance FTS; setups relying on the previous default FTS backend may behave differently on upgrade.
3 more releases in this issue
· 2025-06-16 → 2025-06-20
LanceDB v0.20.1-beta.0 adds new Full-Text Search capabilities to Python and JS SDKs and exposes minimum_nprobes/maximum_nprobes ANN index properties.
└──▷ GET THIS VERSION
$ git clone --branch v0.20.1-beta.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:$ git checkout v0.20.1-beta.0
›Adds minimum_nprobes and maximum_nprobes properties to control ANN search probe bounds.
›Expands Full-Text Search (FTS) feature support in the Python SDK.
›Expands Full-Text Search (FTS) feature support in the JavaScript SDK.
LanceDB python-v0.23.1-beta.0 adds new FTS search capabilities and maximum/minimum nprobes properties for ANN index tuning.
└──▷ GET THIS VERSION
$ git clone --branch python-v0.23.1-beta.0 https://github.com/lancedb/lancedb.git
# already have the repo? check out this version:$ git checkout python-v0.23.1-beta.0
›Adds maximum and minimum nprobes properties for controlling ANN index probe bounds.
›Expands full-text search (FTS) feature support in the Python SDK.
›Expands full-text search (FTS) feature support in the JavaScript SDK.
Milvus client v2.5.4 exports milvusclient.annRequest and removes the default replica count.
└──▷ GET THIS VERSION
$ git clone --branch client/v2.5.4 https://github.com/milvus-io/milvus.git
# already have the repo? check out this version:$ git checkout client/v2.5.4
›Exports milvusclient.annRequest, making the ANN request type part of the public API surface for downstream Go clients.
›Removes the default value for replicaNum on load, allowing callers to omit the field without an implicit replica count being applied.
1 more release in this issue
· 2025-06-09 → 2025-06-16