ClearML/clearml-docs
1
0
Fork 0
mirror of https://github.com/clearml/clearml-docs synced 2025-03-03 10:42:51 +00:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Fix pipeline code snippets (#118)

Browse Source
This commit is contained in:
pollfly 2021-11-19 20:52:03 +02:00 committed by GitHub
parent cf108b2ebd
commit 014d7b960a
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 10 additions and 6 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

16
docs/getting_started/mlops/mlops_second_steps.md
View File

@ -29,7 +29,7 @@ and lastly we want to create a new version of the data.
```python ```python
# create a task for the data processing part # create a task for the data processing part
task = Task.init(project_name='data', task_name='ingest', task_type='data_processing') task = Task.init(project_name='data', task_name='create', task_type='data_processing')
# get the v1 dataset # get the v1 dataset
dataset = Dataset.get(dataset_project='data', dataset_name='dataset_v1') dataset = Dataset.get(dataset_project='data', dataset_name='dataset_v1')
@ -86,20 +86,24 @@ It is important to remember that pipelines are Tasks by themselves and can also
```python ```python
pipe = PipelineController( pipe = PipelineController(
always_create_task=True, project='data',
pipeline_project='data', pipeline_name='pipeline demo', name='pipeline demo',
version="1.0"
) )
pipe.add_step( pipe.add_step(
name='step 1 data', name='step 1 data',
base_task_id='cbc84a74288e459c874b54998d650214', # Put the task ID here base_project_name='data',
base_task_name='create'
) )
pipe.add_step( pipe.add_step(
name='step 2 train', name='step 2 train',
parents=['step 1 data', ], parents=['step 1 data', ],
base_task_id='cbc84a74288e459c874b54998d650214', # Put the task ID here base_project_name='data',
base_task_name='ingest'
) )
``` ```
We could also pass the parameters from one step to the other (for example `Task.id`). We could also pass the parameters from one step to the other (for example `Task.id`).
See more in the full pipeline documentation [here](../../fundamentals/pipelines.md). In addition to pipelines made up of Task steps, ClearML also supports pipelines consisting of function steps. See more in the
full pipeline documentation [here](../../fundamentals/pipelines.md).