The AI Toolchain — issue -429, February 28, 2020

Triton v1.11.0 adds ragged batching for custom backends, local S3 endpoint support, and TensorRT boolean/shape tensor types.

$ git clone --branch v1.11.0 https://github.com/triton-inference-server/server.git
# already have the repo? check out this version:
$ git checkout v1.11.0

• ›Adds support for local S3 storage endpoints in model repositories, specified as s3://host:port/path/to/repository.
• ›New model configuration option enables the dynamic batcher to create 'ragged' batches for custom backend models, where input/output tensors may have different shapes across batch entries.
• ›Removes LD_LIBRARY_PATH from the inference server container in favor of RUNPATH for shared library resolution.
• ›Adds support for boolean data-type and shape tensors in TensorRT models.
• ›Significantly improves TensorRT backend performance by reducing thread contention, using pinned memory for faster CPU<->GPU transfers, and increasing compute/memory copy overlap.

Weaviate 0.22.2 adds a phoneNumber primitive data type with automatic international parsing and normalization.

$ git clone --branch 0.22.2 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout 0.22.2

• ›Adds phoneNumber primitive data type with two user-settable sub-fields — input (required, type string) and defaultCountry (optional, ISO 3166-1 alpha-2 string) — for storing and normalizing phone numbers.
• ›Returns seven read-only parsed sub-fields on phoneNumber objects: internationalFormatted (string), national (unsigned integer), nationalFormatted (string), countryCode (unsigned integer), valid (boolean), input (string), and defaultCountry (string).
• ›Full phoneNumber type definition available in the openapi-specs/schema.json Swagger specification.

$ git clone --branch 0.22.1 https://github.com/weaviate/weaviate.git
# already have the repo? check out this version:
$ git checkout 0.22.1

$ curl -X POST http://localhost:8080/v1/things \
  -H 'Content-Type: application/json' \
  -d '{
    "class": "Glasses",
    "schema": {
      "description": "These glasses are meant for far-sighted people"
    },
    "vectorWeights": {
      "far": "5 * w",
      "near": "5 * w"
    }
  }'