Backfill issue -412 — The AI Toolchain

EDITIONS tail grep head diff uniq

The daily firehose — everything the toolchain shipped today, already filtered.

// HOW THIS ISSUE IS MADE

We read every release from the 174 tools on our watchlist at the source — GitHub and GitLab release notes, vendor release pages and changelogs, project blogs and feeds, vendor press releases, and the source code behind the tag. Bug-fix-only releases and non-product newsroom noise are dropped; what's left is summarized down to the new capability, how to try it, and any screenshots or videos the release itself published. Every entry links to the sources it was built from.

VIEW

ISSUE VIEW full issue

Do you prefer this view?

$ tct list   # 3 tools matched

AI & LLM Tooling

◆ AI Model & Data Infrastructure

Microsoft ONNX Runtime

v1.8.1 NOTES

ONNX Runtime v1.8.1 adds CoreML EP on iOS, React Native package, and ROCm 4.2 preview for training.

└──▷ GET THIS VERSION

$ git clone --branch v1.8.1 https://github.com/microsoft/onnxruntime.git
# already have the repo? check out this version:
$ git checkout v1.8.1

›Enables CoreML Execution Provider in the iOS mobile package, bringing hardware-accelerated inference to Apple devices.
›Publishes the onnxruntime-react-native package on npm, enabling ONNX Runtime inference in React Native applications.
›Adds support for PyTorch 1.8.1 and 1.9 in ONNX Runtime for PyTorch training acceleration.
›Adds support for CUDA 10.2 and 11.1 in the training acceleration stack.
›Releases preview packages for ROCm 4.2, enabling AMD GPU training acceleration.

+2 moreshow less

›Extends training acceleration coverage to GPT-Neo, Microsoft TNLG, and TNLU models in addition to popular Hugging Face models.
›Adds additional operators to the ORT Mobile package.

Was this useful?

NVIDIA Triton Inference Server

v2.12.0 NOTES

Triton v2.12.0 adds CPU support for RAPIDS FIL, multi-copy C API inputs, TensorRT precision/workspace config for ONNX, and Model Analyzer offline mode.

└──▷ GET THIS VERSION

$ git clone --branch v2.12.0 https://github.com/triton-inference-server/server.git
# already have the repo? check out this version:
$ git checkout v2.12.0

›The tensorrt_accelerator option in the ONNX model configuration can now specify precision and workspace size for TensorRT-accelerated ONNX models.
›Adds CPU support to the RAPIDS FIL Backend, extending inference beyond GPU-only deployments.
›C API inference requests can now supply multiple copies of an input tensor in different memory locations; Triton selects the most performant copy based on execution context.
›Model Analyzer gains an offline mode that prioritizes throughput over latency, with a new set of reports and graphs tailored to offline inferencing use cases.

Was this useful?

Other / Uncategorized

◆ VECTOR DB RAG

Weaviate

v1.5.0 NOTES

Weaviate v1.5.0 rewrites storage with a custom LSM-tree engine and adds Auto-Schema for schema-free imports.

└──▷ GET THIS VERSION

$ git clone --branch v1.5.0 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout v1.5.0

›Adds Auto-Schema feature: import data objects without a pre-defined schema — Weaviate infers property types on first use, is enabled by default, and defaults are configurable via environment variables.
›Replaces B+Tree storage with a custom LSM-tree storage engine, delivering import speeds more than 100% faster than previous versions at scale.

└──▷ BREAKING ON UPGRADE

!The entire storage mechanism has been replaced with an LSM-tree implementation: in-place upgrades from previous versions are not possible. A new Weaviate setup must be created and all data reimported. Prior backups are not compatible with v1.5.0.

Was this useful?

// END OF TRANSMISSION

The AI Toolchain · curated daily · July 27, 2021
Releases & features from the open-source and commercial AI tools that practitioners actually run.

The AI Toolchain — issue -412, July 27, 2021

Microsoft ONNX Runtime

NVIDIA Triton Inference Server

Weaviate