Triton v2.2.0 adds TensorFlow 2.x support, per-request inference timeouts, and API versioning
$ git clone --branch v2.2.0 https://github.com/triton-inference-server/server.git # already have the repo? check out this version: $ git checkout v2.2.0
$ tritonserver --backend-config=tensorflow,version=2 --model-repository=/models
- ›Adds TensorFlow 2.x support alongside TensorFlow 1.x, selectable at launch via
--backend-config=tensorflow,version=<version>(set<version>to1or2; default is1). - ›Adds
TRITON_CLIENT_SKIP_EXAMPLESCMake option to disable building client examples. - ›Adds inference request timeout option to Python and C++ client libraries.
- ›Adds explicit major/minor versioning to
TRITONSERVERandTRITONBACKENDAPIs.