mirror of
https://github.com/clearml/clearml-docs
synced 2025-06-26 18:17:44 +00:00
Small edits (#784)
This commit is contained in:
@@ -103,9 +103,9 @@ clearml-data remove [-h] [--id ID] [--files [FILES [FILES ...]]]
|
||||
|
||||
## upload
|
||||
|
||||
Upload the local dataset changes to the server. By default, it's uploaded to the [ClearML Server](../deploying_clearml/clearml_server.md). You can specify a different storage
|
||||
Upload the local dataset changes to the server. By default, it's uploaded to the ClearML file server. You can specify a different storage
|
||||
medium by entering an upload destination. For example:
|
||||
* A shared folder: `:/mnt/shared/folder`
|
||||
* A shared folder: `/mnt/shared/folder`
|
||||
* S3: `s3://bucket/folder`
|
||||
* Non-AWS S3-like services (e.g. MinIO): `s3://host_addr:port/bucket`
|
||||
* Google Cloud Storage: `gs://bucket-name/folder`
|
||||
|
||||
@@ -69,8 +69,8 @@ Use the `output_uri` parameter to specify a network storage target to upload the
|
||||
* Google Cloud Storage: `gs://bucket-name/folder`
|
||||
* Azure Storage: `azure://<account name>.blob.core.windows.net/path/to/file`
|
||||
|
||||
By default, the dataset uploads to ClearML's file server. The `output_uri` parameter of the [`Dataset.upload`](#uploading-files)
|
||||
method overrides this parameter's value.
|
||||
By default, the dataset uploads to ClearML's file server. The `output_uri` parameter of [`Dataset.upload()`](#uploading-files)
|
||||
overrides this parameter's value.
|
||||
|
||||
The created dataset inherits the content of the `parent_datasets`. When multiple dataset parents are listed,
|
||||
they are merged in order of specification. Each parent overrides any overlapping files from a previous parent dataset.
|
||||
@@ -98,8 +98,8 @@ squashed_dataset_2 = Dataset.squash(
|
||||
)
|
||||
```
|
||||
|
||||
In addition, the target storage location for the squashed dataset can be specified using the `output_uri` parameter of the
|
||||
[`Dataset.squash`](../references/sdk/dataset.md#datasetsquash) method.
|
||||
In addition, the target storage location for the squashed dataset can be specified using the `output_uri` parameter of
|
||||
[`Dataset.squash()`](../references/sdk/dataset.md#datasetsquash).
|
||||
|
||||
## Accessing Datasets
|
||||
Once a dataset has been created and uploaded to a server, the dataset can be accessed programmatically from anywhere.
|
||||
|
||||
@@ -62,7 +62,7 @@ Upload the dataset:
|
||||
dataset.upload()
|
||||
```
|
||||
|
||||
By default, the dataset is uploaded to the ClearML File Server. The dataset's destination can be changed by specifying the
|
||||
By default, the dataset is uploaded to the ClearML file server. The dataset's destination can be changed by specifying the
|
||||
target storage with the `output_url` parameter of the [`upload`](../../references/sdk/dataset.md#upload) method.
|
||||
|
||||
### Finalizing the Dataset
|
||||
|
||||
Reference in New Issue
Block a user