https://aitoolchain.io/tools/promptfoo New releases and features in Promptfoo, tracked by The AI Toolchain. en Sun, 23 Aug 2026 09:42:15 GMT https://www.promptfoo.dev/docs/releases/ https://www.promptfoo.dev/docs/releases/ Sun, 23 Aug 2026 09:42:15 GMT Promptfoo snapshot-20260823 adds adaptive rate limiting, Transformers.js local inference, telecom red team plugins, and multi-input red team scanning. • Adds `promptfoo logs` command for viewing log files directly from the CLI. • Adds `-d`/`--description` flag to `redteam generate` commands for labeling generated scans. • Adds `--share` and `--no-share` flags to Model Audit for controlling cloud sharing. • Adds `$VAR` syntax support in file paths for referencing environment variables in configuration. • Supports multiple `--env-file` flags to load several environment files in a single invocation. • Adds `--extension` CLI flag to load extensions via command line. • Adds `numTests` config key to cap the number of test cases generated per red team strategy. • Adds `metadata.sessionId` as a surfaced variable column in eval result tables and exports. • Adds `word-count` assertion type for validating response word counts. • Adds `__count` variable for use in derived metrics to compute averages. • Adds test-level prompts filter, providers filter, and per-test structured output configuration at the individual test case level. • Adds adaptive rate limit scheduler that automatically adjusts concurrency based on provider rate limits and response headers. • New Transformers.js provider to run Hugging Face models locally in Node.js or the browser. • New Vercel AI Gateway and Cloudflare AI Gateway providers for routing requests. • New AWS Bedrock Video provider supporting Nova Reel and Luma Ray 2 video generation. • New Azure AI Foundry Video provider for Sora video generation. • New Telecom red team plugin for industry-specific testing of telecommunications AI systems. • New RAG Source Attribution plugin to test whether RAG systems properly attribute sources in responses. • Red team scans now support multiple input variables for testing systems with complex input structures. • Adds `apiBaseUrl` and `websocketUrl` override config and function call support to the xAI Voice provider. • Adds `collaboration_mode` support and integrated tracing to the OpenAI Codex provider. • HTTP provider gains native session endpoint support for stateful conversations. • Code scanning adds support for fork pull requests and comment-triggered scans. • Automatic retries for transient 5xx errors in Enterprise environments. • User-rated filter in the UI to show only manually rated eval results. • Provider config hover in eval results UI to view provider configuration details inline. https://www.promptfoo.dev/docs/releases/ https://www.promptfoo.dev/docs/releases/ Sun, 23 Aug 2026 09:42:15 GMT Promptfoo snapshot-20260823 adds adaptive rate limiting, Transformers.js local inference, telecom red team plugins, and multi-input red team scanning. • Adds `promptfoo logs` command for viewing log files directly from the CLI. • Adds `-d`/`--description` flag to `redteam generate` commands for labeling generated scans. • Adds `--share` and `--no-share` flags to Model Audit for controlling cloud sharing. • Adds `$VAR` syntax support in file paths for referencing environment variables in configuration. • Supports multiple `--env-file` flags to load several environment files in a single invocation. • Adds `--extension` CLI flag to load extensions via command line. • Adds `numTests` config key to cap the number of test cases generated per red team strategy. • Adds `metadata.sessionId` as a surfaced variable column in eval result tables and exports. • Adds `word-count` assertion type for validating response word counts. • Adds `__count` variable for use in derived metrics to compute averages. • Adds test-level prompts filter, providers filter, and per-test structured output configuration at the individual test case level. • Adds adaptive rate limit scheduler that automatically adjusts concurrency based on provider rate limits and response headers. • New Transformers.js provider to run Hugging Face models locally in Node.js or the browser. • New Vercel AI Gateway and Cloudflare AI Gateway providers for routing requests. • New AWS Bedrock Video provider supporting Nova Reel and Luma Ray 2 video generation. • New Azure AI Foundry Video provider for Sora video generation. • New Telecom red team plugin for industry-specific testing of telecommunications AI systems. • New RAG Source Attribution plugin to test whether RAG systems properly attribute sources in responses. • Red team scans now support multiple input variables for testing systems with complex input structures. • Adds `apiBaseUrl` and `websocketUrl` override config and function call support to the xAI Voice provider. • Adds `collaboration_mode` support and integrated tracing to the OpenAI Codex provider. • HTTP provider gains native session endpoint support for stateful conversations. • Code scanning adds support for fork pull requests and comment-triggered scans. • Automatic retries for transient 5xx errors in Enterprise environments. • User-rated filter in the UI to show only manually rated eval results. • Provider config hover in eval results UI to view provider configuration details inline.