ClearML/clearml-docs
1
0
Fork 0
mirror of https://github.com/clearml/clearml-docs synced 2025-01-31 06:27:22 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Add boto3 multipart config options (#618)

Browse Source
This commit is contained in:
pollfly 2023-07-20 15:24:05 +03:00 committed by GitHub
parent bc55b15a57
commit 7f9a148285
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 7 additions and 14 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

21
docs/configs/clearml_conf.md
View File

@ -762,20 +762,13 @@ metrics, network, AWS S3 buckets and credentials, Google Cloud Storage, Azure St
**`sdk.aws.boto3`** (*dict*)
* Dictionary of AWS Storage, Boto3 options.
---
**`sdk.aws.boto3.pool_connections`** (*integer*)
* For AWS Boto3, The maximum number of Boto3 pool connections.
---
**`sdk.aws.boto3.max_multipart_concurrency`** (*integer*)
* For AWS Boto3, the maximum number of threads making requests for a transfer.
* Dictionary of AWS Storage, Boto3 options. The keys include:
* `max_multipart_concurrency` (*integer*) - The maximum number of threads making requests for a transfer.
* `multipart_threshold` (*integer*) - The transfer size threshold. If size above threshold, Boto3 will automatically use multipart uploads, downloads, and copies (in bytes)
* `multipart_chunksize` (*integer*) - The size of each part of a multipart transfer (in bytes).
* `pool_connections` (*integer*) - The maximum number of Boto3 pool connections.
<br/>
##### sdk.aws.s3