ClearML/clearml-docs
1
0
Fork 0
mirror of https://github.com/clearml/clearml-docs synced 2025-03-16 10:27:41 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Add dataset creation parameters (#306)

Browse Source
This commit is contained in:
pollfly 2022-08-10 19:37:22 +03:00 committed by GitHub
parent fb1a7d7946
commit 5e95471667
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 4 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
docs/clearml_data/clearml_data_sdk.md
View File

@ -42,7 +42,8 @@ dataset = Dataset.create(
dataset_project='dataset project', dataset_project='dataset project',
parent_datasets=[PARENT_DS_ID_1, PARENT_DS_ID_2], parent_datasets=[PARENT_DS_ID_1, PARENT_DS_ID_2],
dataset_version="1.0", dataset_version="1.0",
output_uri="gs://bucket-name/folder" output_uri="gs://bucket-name/folder",
description='my dataset description'
) )
``` ```
@ -142,7 +143,7 @@ If a file is already in a dataset, but it has been modified, it can be added aga
upload the file diff. upload the file diff.
```python ```python
dataset = Dataset.create() dataset = Dataset.create(dataset_name="my dataset", dataset_project="example project")
dataset.add_files(path="path/to/folder_or_file") dataset.add_files(path="path/to/folder_or_file")
``` ```
@ -166,7 +167,7 @@ method. Input the `source_url` argument, which can be a link from cloud storage
or local / network storage (`file://`). or local / network storage (`file://`).
```python ```python
dataset = Dataset.create() dataset = Dataset.create(dataset_name="my dataset", dataset_project="example project")
dataset.add_external_files( dataset.add_external_files(
source_url="s3://my/bucket/path_to_folder_or_file", source_url="s3://my/bucket/path_to_folder_or_file",
dataset_path="/my_dataset/new_folder/" dataset_path="/my_dataset/new_folder/"