mirror of
https://github.com/clearml/clearml-docs
synced 2025-06-26 18:17:44 +00:00
Add ClearML Serving 1.1 release notes (#323)
This commit is contained in:
@@ -2,6 +2,49 @@
|
||||
title: Version 1.1
|
||||
---
|
||||
|
||||
### ClearML Serving 1.1.0
|
||||
|
||||
:::warning Backwards Compatibility
|
||||
This release is not backwards compatible - see notes below on upgrading
|
||||
:::
|
||||
|
||||
**Breaking Changes**
|
||||
* Triton engine size supports variable request size (-1)
|
||||
|
||||
**Features & Bug Fixes**
|
||||
|
||||
* Add version number of serving session task
|
||||
* Triton engine support for variable request (matrix) sizes
|
||||
* Triton support, fix `--aux-config` to support more configurations elements
|
||||
* Huggingface Transformer support
|
||||
* `Preprocess` class as module (see note below)
|
||||
|
||||
:::important Preprocess Class
|
||||
To add a `Preprocess` class from a module (the entire module folder will be packaged)
|
||||
|
||||
```
|
||||
preprocess_folder
|
||||
├── __init__.py # from .sub.some_file import Preprocess
|
||||
└── sub
|
||||
└── some_file.py
|
||||
```
|
||||
Pass the top folder as a path for --preprocess, for example:
|
||||
|
||||
```bash
|
||||
clearml-serving module --id <serving_session_id> add --preprocess /path/to/preprocess_folder ...
|
||||
```
|
||||
:::
|
||||
|
||||
**Upgrading from v1.0**
|
||||
|
||||
1. Take down the serving containers (`docker-compose` or k8s)
|
||||
1. Update the `clearml-serving` CLI `pip3 install -U clearml-serving`
|
||||
1. Re-add a single existing endpoint with `clearml-serving module add ... ` (press yes when asked). It will upgrade the
|
||||
`clearml-serving` session definitions
|
||||
1. Pull the latest serving containers (`docker-compose pull ...` or k8s)
|
||||
1. Re-spin serving containers (`docker-compose` or k8s)
|
||||
|
||||
|
||||
### ClearML Agent 1.1.2
|
||||
|
||||
**Bug Fixes**
|
||||
|
||||
Reference in New Issue
Block a user