KoboldCpp v1.106.2 adds MCP server/client bridge, a Kobold Lite UI overhaul, and new GPU device override controls.
$ git clone --branch v1.106.2 https://github.com/LostRuins/koboldcpp.git # already have the repo? check out this version: $ git checkout v1.106.2
$ ./koboldcpp-linux-x64 --model mymodel.gguf --device Vulkan0,Vulkan1
- ›Adds
--deviceflag (e.g.--device Vulkan0,Vulkan1) to directly override selected GPU devices from the command line. - ›Adds
GGML_VK_VISIBLE_DEVICESenvironment variable support that always overrides any Vulkan device settings configured inside KoboldCpp. - ›Adds MCP (Model Context Protocol) bridge: KoboldCpp can now act as a drop-in replacement for Claude Desktop, connecting to any HTTP or STDIO MCP server using a
mcp.jsonconfig format compatible with Claude Desktop. - ›Supports multiple simultaneous MCP servers, automatically combining their tools and dispatching requests appropriately.
- ›Enables the
continue_assistant_turnAPI field by default in all chat completions (assistant prefill).
+6 moreshow less
- ›Increases logprobs limit from 5 to 10.
- ›Flash Attention is now enabled by default when launching via the GUI launcher.
- ›Increases the maximum length for interrogate image inputs.
- ›New full settings UI overhaul in Kobold Lite (by @Rose22), with a cleaner and more organized settings menu.
- ›Adds 4 new OLED themes to Kobold Lite.
- ›Adds browser-side MCP client implementation to Kobold Lite.