Together AI — The AI Toolchain

Together AI changelog-20260831-07a75e81

Mon, 31 Aug 2026 08:38:20 GMT

• Adds `tg batches` command group to the Together CLI with subcommands `tg batches submit` (upload a local JSONL file or pass an existing file ID to create a batch job), `tg batches list`, `tg batches get` (alias `ls`), `tg batches cancel`, and `tg batches download` (streams results to stdout or writes output/error files to disk with `--output`). • API key expiration is now configurable at creation time in the console: choose `1 hour`, `1 day`, `7 days`, `30 days`, or a custom date via `Set an expiration date`. • Connecting a Vercel project via Integrations settings now creates a dedicated API key per linked Vercel project, automatically set as the `TOGETHER_API_KEY` environment variable in that Vercel project. • Project collaborators can now leave a project themselves from `Settings > Project > Collaborators` or the Projects list (organization members cannot leave the default project; last admin must promote another before leaving).

Together AI changelog-20260830-07a75e81

Sun, 30 Aug 2026 08:37:09 GMT

Together AI adds a `tg batches` CLI command group, API key expiration controls, ACH payments, and new GLM-5.3 models with 1M-token context. • Adds `tg batches` command group to the Together CLI with subcommands `tg batches submit` (upload a JSONL file or pass an existing file ID to create a batch job), `tg batches list`, `tg batches cancel`, `tg batches download` (stream results to stdout or write files to disk with `--output`); `ls` and `get` are supported as aliases. • Fine-tuning training quality improved for `Qwen/Qwen3.5-0.8B`, `Qwen3.5-2B`, `Qwen3.5-4B`, `Qwen3.5-27B`, `Qwen3.5-35B-A3B`, `Qwen3.5-35B-A3B-Base`, `Qwen3.5-122B-A10B`, `nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16`, and `nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16` — start a new job with existing data and settings to pick up the improvement.

Together AI changelog-20260829-07a75e81

Sat, 29 Aug 2026 14:02:37 GMT

Together CLI gains `tg batches` command group; new GLM-5.3 models, API key expiration, multi-project GA, and ACH payments launch • Adds `tg batches` CLI command group for batch inference, with subcommands `tg batches submit` (upload a local JSONL file or existing file ID), `tg batches list`, `tg batches cancel`, `tg batches download` (streams to stdout or writes to disk with `--output`), and aliases `ls` and `get` for job lifecycle management. • Adds new model `zai-org/GLM-5.3` with 1,000,000-token context, FP4 quantization, function calling, and structured outputs; priced at $1.40 input / $4.40 output / $0.26 cached input per 1M tokens. • Adds new model `zai-org/GLM-5.3-Flash` with 1,000,000-token context, FP8 quantization, function calling, and structured outputs; priced at $0.15 input / $0.50 output / $0.03 cached input per 1M tokens. • Adds `Cancel expiration` action (via the three-dot menu) to remove a scheduled expiration from an existing project API key. • Multi-project isolation is now generally available for all organizations — clusters, fine-tuned models, endpoints, evaluations, files, and API keys are fully scoped to projects with no early-access limitations. • ACH bank transfers are now available to all customers (previously enterprise-only); link a U.S. bank account via billing settings with instant verification and purchase credits directly. • Fine-tuning quality improved for `Qwen/Qwen3.5-0.8B`, `Qwen/Qwen3.5-2B`, `Qwen/Qwen3.5-4B`, `Qwen/Qwen3.5-27B`, `Qwen/Qwen3.5-35B-A3B`, `Qwen/Qwen3.5-35B-A3B-Base`, `Qwen/Qwen3.5-122B-A10B`, `nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16`, and `nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16` — no setting changes required; start a new job to pick it up.

Together AI 2.0.0

Fri, 28 Aug 2026 18:29:41 GMT

API surface changed: +2 endpoints, 8 modified • New endpoint GET /billing/usage • New endpoint GET /rl/checkpoints/{id} • GET /rl/model-resources/{model_resources_id}: response schema changed • POST /projects/{projectId}/endpoints/{endpointId}/rollouts: request body changed • POST /projects/{projectId}/endpoints/{endpointId}/rollouts/preview-defaults: request body changed • POST /rl/model-resources: response schema changed • POST /rl/model-resources/{model_resources_id}/stop: response schema changed • POST /rl/training-sessions/{session_id}/operations/custom-forward-backward: request body changed • POST /rl/training-sessions/{session_id}/operations/forward: request body changed • POST /rl/training-sessions/{session_id}/operations/forward-backward: request body changed

Together AI Batch jobs in the CLI

Wed, 26 Aug 2026 00:00:00 GMT

Together CLI gains `tg batches` command group for submitting and managing batch inference jobs. • Adds `tg batches submit` to upload a local JSONL file (or reference an existing file ID) and create a batch inference job against `chat.completions`, `audio.transcriptions`, or `audio.translations`. • Adds `tg batches list` (alias `ls`), `tg batches retrieve` (alias `get`), and `tg batches cancel` to manage the full batch job lifecycle. • Adds `tg batches download` to stream results to stdout or write output and error files to disk via `--output`.

Together AI 2.0.0

Mon, 24 Aug 2026 15:03:38 GMT

API surface changed: 8 modified • GET /compute/clusters/{cluster_id}/instances/{instance_id}/remediations/{remediation_id}: response schema changed • GET /compute/passive_health_check_alerts: response schema changed • POST /compute/clusters/{cluster_id}/instances/{instance_id}/remediations: request body changed; response schema changed • POST /compute/clusters/{cluster_id}/instances/{instance_id}/remediations/{remediation_id}/approve: response schema changed • POST /compute/clusters/{cluster_id}/instances/{instance_id}/remediations/{remediation_id}/cancel: response schema changed • POST /compute/clusters/{cluster_id}/instances/{instance_id}/remediations/{remediation_id}/reject: response schema changed • POST /rl/training-sessions: request body changed • POST /rl/training-sessions/{session_id}/operations/sample: request body changed

Together AI 2.0.0

Thu, 20 Aug 2026 10:00:41 GMT

Together AI now publishes an API — 197 endpoints across 42 areas: Rl, Fine Tuning, Volumeservice, … • Rl (28 endpoints) — create, read, update • Fine Tuning (14 endpoints) — create, read, delete • Volumeservice (13 endpoints) — create, read, update, delete • Deploymentservice (10 endpoints) — create, read, update, delete • Rolloutservice (10 endpoints) — create, read, delete • Shadowexperimentservice (10 endpoints) — create, read, update, delete • Endpointservice (9 endpoints) — create, read, update, delete • Endpoints (8 endpoints) — create, read, update, delete • 34 more areas: Deployments, Remediationservice, Abexperimentservice, Audio, Files, Gpuclusterservice, Instanceclusteraddonservice, Queue, Secrets, Sharedvolumeservice, Evaluation, Batches, Volumes, Code Interpreter, Configservice, Deploymentsstorage, Deploymentsvolumes, Instancetypeservice, Jobs, Models, Placementprofileservice, Supportedmodelsservice, Video, Account, Chat, Completion, Embeddings, Hardware, Healthcheckservice, Images, Regionservice, Rerank, Voices, Endpoints

Together AI ACH bank transfers generally available

Wed, 19 Aug 2026 00:00:00 GMT

Together AI opens ACH bank transfers to all customers for direct credit purchases from U.S. bank accounts. • Supports ACH bank transfers as a payment method for all customers (previously enterprise-only): link a U.S. bank account with instant verification in billing settings, set it as default, and purchase credits directly — credits deposit after ACH clears (typically 1–3 business days).

Together AI Fully automatic confirmation policy for node auto repair

Tue, 18 Aug 2026 00:00:00 GMT

Together AI adds fully automatic node repair policy with per-fault scoping and job interruption controls • New `Fully automatic` confirmation policy option under `Auto-remediation policy` on the `Repairs` tab lets auto node repair execute end-to-end without manual approval steps. • Per-fault scoping via `Repair actions` lets operators select which fault groups — `Migrate to new host`, `Reprovision`, `VM reboot` — run unattended under `Fully automatic`, keeping destructive repairs gated while transient ones self-clear.

Together AI Project visibility

Mon, 17 Aug 2026 00:00:00 GMT

Together AI projects gain three visibility levels and full multi-resource scoping across clusters, models, endpoints, and API keys. • Adds three project visibility levels — Open (any org member can join), Closed (discoverable but join requires admin approval), and Private (visible only to existing collaborators and org admins) — configurable at creation time or later via Project Settings. • Clusters, fine-tuned models, endpoints, evaluations, files, and API keys are now fully scoped to projects, removing early-access limitations on project isolation.

Together AI New models available for fine-tuning

Thu, 13 Aug 2026 00:00:00 GMT

Together AI adds fine-tuning model limits CLI, tokenized dataset download, endpoint events, and multi-project resource scoping • Adds `tg fine-tuning model-limits` (alias `tg ft model-limits `) subcommand, which queries `GET /fine-tunes/models/limits` to return a base model's capability flags and hyperparameter bounds including sequence-length, batch-size, and LoRA rank limits; supports `--json` for the full response body. • Adds `tg ft download-tokenized-dataset ` subcommand to download the tokenized dataset archive a fine-tuning job trained on, enabling audit of exactly what the model saw; the CLI command also surfaces in the `tokenized_dataset_upload_complete` event message. • The `tokenized_dataset_upload_complete` event message — visible in the console Events tab and in `GET /fine-tunes/{id}/events` — now includes the ready-to-run `tg ft download-tokenized-dataset ` command when a fine-tuning job finishes uploading its tokenized dataset archive. • Adds `tg beta endpoints events` subcommand to list a dedicated endpoint's audit and lifecycle events from the terminal, including replica scaling, traffic shifts, status changes, and pauses across every deployment under the endpoint. • Projects now support three visibility levels — Open, Closed, and Private — configurable at creation time or changed later from Project Settings. • Clusters, fine-tuned models, endpoints, evaluations, files, and API keys are now fully scoped to projects, removing early-access limitations on project isolation. • Adds `zai-org/GLM-5.2` as a new supported model for fine-tuning. • Adds `deepseek-ai/DeepSeek-V4-Flash-0731` as a new model available for deployment on dedicated endpoints.

Together AI Leave a project from the console

Wed, 12 Aug 2026 00:00:00 GMT

Together AI adds self-serve project leaving, dedicated Vercel API keys via TOGETHER_API_KEY, and new serverless/dedicated models. • Connecting a Vercel project via Integrations settings now creates a dedicated API key per linked Vercel project, automatically set as the `TOGETHER_API_KEY` environment variable in that Vercel project. • Project collaborators can now leave a project themselves from 'Settings > Project > Collaborators' or from the Projects list in Organization Settings — with a guard preventing the last admin from leaving before promoting another collaborator. • Adds `Qwen/Qwen3.8-2.4T-A95B` (FP4 quantization) to serverless, priced at $2.50 input / $6.25 output / $0.50 cached input per 1M tokens. • Adds `nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-FP8` as a new model available for deployment on dedicated endpoints. Breaking changes: • `nvidia/Nemotron-3-ultra-550b-a55b`, `pearl-ai/gemma-4-31b-it`, `deepseek-ai/DeepSeek-V4-Pro`, and `moonshotai/Kimi-K2.7-Code` have been deprecated and are no longer available on serverless; use `deepseek-ai/DeepSeek-V4-Pro-0813` in place of `deepseek-ai/DeepSeek-V4-Pro`.

Together AI Tokenized dataset download in the fine-tuning console

Mon, 10 Aug 2026 00:00:00 GMT

Together AI adds tokenized dataset download, non-interactive fine-tune deletion, and project visibility controls • Adds tokenized dataset archive download via the fine-tuning jobs dashboard: when a job has a tokenized dataset, a 'Tokenized dataset' row with a 'Download' button appears in job details, opening a presigned archive URL; the same archive is also available via the API and CLI. • `tg fine-tuning delete` now honors global non-interactive mode — `--non-interactive`, `--json`, and non-TTY sessions skip the confirmation prompt, removing the need for `--force` in CI/scripts. • Projects now support three visibility levels — 'Open' (any org member can discover and join), 'Closed' (discoverable, join requires admin grant), and 'Private' (visible only to existing collaborators and org admins) — settable at creation or via Project Settings. • Clusters, fine-tuned models, endpoints, evaluations, files, and API keys are now fully scoped to projects, lifting the earlier early-access limitations on project isolation.

Together AI Longer context for GLM-5.2

Sat, 08 Aug 2026 00:00:00 GMT

GLM-5.2 context doubles to 512K tokens; projects gain three visibility levels and full multi-resource scoping. • Extends `zai-org/GLM-5.2` serverless context length to 512,000 tokens, up from 262,144, at unchanged pricing. • Adds three project visibility levels — Open (any org member can discover and join), Closed (discoverable but join requires admin approval), and Private (visible only to existing collaborators and org admins) — configurable at creation or any time via Project Settings. • Fully scopes clusters, fine-tuned models, endpoints, evaluations, files, and API keys to projects, removing early-access limitations on project isolation.

Together AI Fine-tune tokenized dataset download

Thu, 06 Aug 2026 00:00:00 GMT

Together AI adds tokenized dataset download, three-tier project visibility, and full multi-project resource scoping. • New `GET /fine-tunes/{id}/download-tokenized-dataset` endpoint returns a presigned URL to download the tokenized dataset archive generated for a fine-tuning job. • New `tg fine-tuning download-tokenized-dataset [FT_ID] --output-dir` CLI subcommand downloads the tokenized dataset archive to a local directory. • Projects now support three visibility levels — Open (any org member can discover and join), Closed (discoverable but join requires admin approval), and Private (visible only to existing collaborators and org admins) — selectable at creation or changed anytime via Project Settings. • Clusters, fine-tuned models, endpoints, evaluations, files, and API keys are now fully scoped to projects, removing early-access limitations on project isolation.

Together AI Models page visibility filter

Wed, 29 Jul 2026 00:00:00 GMT

Together AI console gains project visibility levels, cross-project model filtering, and full multi-project resource scoping. • Adds a Visibility filter on the Models page to show `Internal` models, `Private` models, or both, now pulling Internal-visibility models from every project in your organization under 'My models' — not just the selected project. • Brings Fine-tuning, Files, and Evaluations into the Projects UI in the console, allowing creation and management of these resources within a project without relying solely on project-scoped API keys. • Introduces three project visibility levels — `Open` (any org member can discover and join), `Closed` (discoverable but join requires admin approval), and `Private` (visible only to existing collaborators and org admins) — configurable at creation time or later via Project Settings. • Extends full project scoping to clusters, fine-tuned models, endpoints, evaluations, files, and API keys, removing the previous early-access limitations on project isolation.

Together AI A/B variant percent updates in the CLI

Tue, 28 Jul 2026 00:00:00 GMT

Together AI CLI gains A/B traffic control, smart replica inference, upgrade notices, and projects get full multi-resource scoping. • Adds `--ab-percent` flag to `tg beta endpoints update` to change a variant's traffic percentage in an existing A/B experiment; control must stay at least 1%, and `--percent` on `tg beta endpoints ab` is capped at 1–99. • Adds smart replica-bound inference to `tg beta endpoints deploy`: `--min-replicas` alone mirrors into the max (including `0` to create a stopped deployment), and `--max-replicas 0` alone lowers the min to 0. • Adds upgrade-availability detection to the Together CLI, printing a notice at most once per day and offering to run the matching install command (`uv`, `pipx`, or `pip`) in interactive sessions; set `TOGETHER_DISABLE_VERSION_CHECK=1` to disable. • Live dedicated model inference endpoints now appear under 'My Endpoints' in the evaluations console model picker; legacy dedicated endpoints appear under 'My Legacy Endpoints'. • Projects now support three visibility levels — Open, Closed, and Private — configurable at creation or any time from Project Settings. • Clusters, fine-tuned models, endpoints, evaluations, files, and API keys are now fully scoped to projects, lifting all early-access isolation limitations. Breaking changes: • On `tg beta endpoints update`, stopping a deployment requires both `--min-replicas 0` and `--max-replicas 0`; passing a single zero bound is now an error.

Together AI New serverless models

Mon, 27 Jul 2026 00:00:00 GMT

Together AI adds Kimi-K3 serverless model with 1M context, Qwen3.6-27B fine-tuning, and project visibility controls. • Adds `moonshotai/Kimi-K3` as a serverless model with 1,000,000-token context length, priced at $3.00 input / $15.00 output / $0.30 cached input per 1M tokens, with support for function calling, structured outputs, and vision inputs. • Adds `Qwen/Qwen3.6-27B` as a supported model for fine-tuning. • Adds three project visibility levels — Open (any org member can discover and join), Closed (discoverable but join requires admin approval), and Private (visible only to existing collaborators and org admins) — configurable at project creation or via Project Settings. • Clusters, fine-tuned models, endpoints, evaluations, files, and API keys are now fully scoped to projects, removing early-access limitations on project isolation.