mirror of
https://github.com/clearml/clearml-docs
synced 2025-06-26 18:17:44 +00:00
This commit is contained in:
@@ -36,14 +36,14 @@ lineage and content information. See [dataset UI](../webapp/datasets/webapp_data
|
||||
|
||||
## Setup
|
||||
|
||||
`clearml-data` comes built-in with the `clearml` python package! Check out the [Getting Started](../getting_started/ds/ds_first_steps.md)
|
||||
`clearml-data` comes built-in with the `clearml` Python package! Check out the [Getting Started](../getting_started/ds/ds_first_steps.md)
|
||||
guide for more info!
|
||||
|
||||
## Using ClearML Data
|
||||
|
||||
ClearML Data supports two interfaces:
|
||||
- `clearml-data` - A CLI utility for creating, uploading, and managing datasets. See [CLI](clearml_data_cli.md) for a reference of `clearml-data` commands.
|
||||
- `clearml.Dataset` - A python interface for creating, retrieving, managing, and using datasets. See [SDK](clearml_data_sdk.md) for an overview of the basic methods of the `Dataset` module.
|
||||
- `clearml.Dataset` - A Python interface for creating, retrieving, managing, and using datasets. See [SDK](clearml_data_sdk.md) for an overview of the basic methods of the `Dataset` module.
|
||||
|
||||
For an overview of recommendations for ClearML Data workflows and practices, see [Best Practices](best_practices.md).
|
||||
|
||||
|
||||
@@ -7,7 +7,7 @@ This page covers `clearml-data`, ClearML's file-based data management solution.
|
||||
See [Hyper-Datasets](../hyperdatasets/overview.md) for ClearML's advanced queryable dataset management solution.
|
||||
:::
|
||||
|
||||
`clearml-data` is a data management CLI tool that comes as part of the `clearml` python package. Use `clearml-data` to
|
||||
`clearml-data` is a data management CLI tool that comes as part of the `clearml` Python package. Use `clearml-data` to
|
||||
create, modify, and manage your datasets. You can upload your dataset to any storage service of your choice (S3 / GS /
|
||||
Azure / Network Storage) by setting the dataset's upload destination (see [`--storage`](#upload)). Once you have uploaded
|
||||
your dataset, you can access it from any machine.
|
||||
|
||||
@@ -7,7 +7,7 @@ This page covers `clearml-data`, ClearML's file-based data management solution.
|
||||
See [Hyper-Datasets](../hyperdatasets/overview.md) for ClearML's advanced queryable dataset management solution.
|
||||
:::
|
||||
|
||||
Datasets can be created, modified, and managed with ClearML Data's python interface. You can upload your dataset to any
|
||||
Datasets can be created, modified, and managed with ClearML Data's Python interface. You can upload your dataset to any
|
||||
storage service of your choice (S3 / GS / Azure / Network Storage) by setting the dataset's upload destination (see
|
||||
[`output_url`](#uploading-files) parameter of `Dataset.upload()`). Once you have uploaded your dataset, you can access
|
||||
it from any machine.
|
||||
|
||||
@@ -10,7 +10,7 @@ class to ingest the data.
|
||||
### Downloading the Data
|
||||
Before registering the CIFAR dataset with `clearml-data`, you need to obtain a local copy of it.
|
||||
|
||||
Execute this python script to download the data:
|
||||
Execute this Python script to download the data:
|
||||
```python
|
||||
from clearml import StorageManager
|
||||
|
||||
|
||||
Reference in New Issue
Block a user