Triton v1.3.0 adds ONNX Runtime integration and an independent --http-health-port flag.
$ git clone --branch v1.3.0 https://github.com/triton-inference-server/server.git # already have the repo? check out this version: $ git checkout v1.3.0
$ trtserver --http-health-port=8080 --http-port=8000 --grpc-port=8001 --model-store=/models
- ›Adds
--http-health-portflag to specify the HTTP health endpoint port independently from the inference and status HTTP port. - ›Integrates the ONNX Runtime, enabling ONNX models to be used directly in a model repository without conversion.