2023-07-31 16:40:04 +00:00
---
title: TensorFlow
---
:::tip
If you are not already using ClearML, see [Getting Started ](../getting_started/ds/ds_first_steps.md ) for setup
instructions.
:::
ClearML integrates with [TensorFlow ](https://www.tensorflow.org/ ) out-of-the-box, automatically logging its models,
definitions, scalars, as well as TensorBoard outputs.
All you have to do is simply add two lines of code to your TensorFlow script:
```python
from clearml import Task
2024-01-10 12:40:19 +00:00
2023-07-31 16:40:04 +00:00
task = Task.init(task_name="< task_name > ", project_name="< project_name > ")
```
2023-12-03 12:27:46 +00:00
And that's it! This creates a [ClearML Task ](../fundamentals/task.md ) which captures:
2023-07-31 16:40:04 +00:00
* Source code and uncommitted changes
* Installed packages
* TensorFlow definitions
* TensorFlow model files
* [TensorBoard ](https://www.tensorflow.org/tensorboard ) outputs (see example [here ](https://clear.ml/docs/latest/docs/guides/frameworks/tensorflow/tensorboard_toy/ ))
* Scalars (loss, learning rates)
* Console output
* General details such as machine details, runtime, creation date etc.
* And more
You can view all the task details in the [WebApp ](../webapp/webapp_overview.md ).

## Automatic Logging Control
By default, when ClearML is integrated into your TensorFlow script, it captures TensorFlow definitions, models, and
2025-02-06 15:31:11 +00:00
scalars. But, you may want to have more control over what your task logs.
2023-07-31 16:40:04 +00:00
To control a task's framework logging, use the `auto_connect_frameworks` parameter of [`Task.init()` ](../references/sdk/task.md#taskinit ).
Completely disable all automatic logging by setting the parameter to `False` . For finer grained control of logged
frameworks, input a dictionary, with framework-boolean pairs.
For example:
```python
auto_connect_frameworks={
2023-08-01 14:05:53 +00:00
'tensorflow': False, 'matplotlib': True, 'tensorboard': False, 'pytorch': True,
2023-07-31 16:40:04 +00:00
'xgboost': False, 'scikit': True, 'fastai': True, 'lightgbm': False,
'hydra': True, 'detect_repository': True, 'tfdefines': True, 'joblib': True,
2023-11-23 13:05:19 +00:00
'megengine': True, 'catboost': True
2023-07-31 16:40:04 +00:00
}
```
You can also input wildcards as dictionary values, so ClearML will log a model created by a framework only if its local
path matches at least one wildcard.
For example, in the code below, ClearML will log TensorFlow models only if their paths have the `.pt` extension. The
unspecified frameworks' values default to true so all their models are automatically logged.
```python
auto_connect_frameworks={'tensorflow' : '*.pt'}
```
## Manual Logging
To augment its automatic logging, ClearML also provides an explicit logging interface.
See more information about explicitly logging information to a ClearML Task:
* [Models ](../clearml_sdk/model_sdk.md#manually-logging-models )
* [Configuration ](../clearml_sdk/task_sdk.md#configuration ) (e.g. parameters, configuration files)
* [Artifacts ](../clearml_sdk/task_sdk.md#artifacts ) (e.g. output files or python objects created by a task)
* [Scalars ](../clearml_sdk/task_sdk.md#scalars )
* [Text/Plots/Debug Samples ](../fundamentals/logger.md#manual-reporting )
See [Explicit Reporting Tutorial ](../guides/reporting/explicit_reporting.md ).
## Examples
2023-12-03 12:27:46 +00:00
Take a look at ClearML's TensorFlow examples. The examples use TensorFlow and ClearML in different configurations with
2023-07-31 16:40:04 +00:00
additional tools, like Abseil and TensorBoard:
* [TensorFlow MNIST ](../guides/frameworks/tensorflow/tensorflow_mnist.md ) - Demonstrates ClearML's automatic logging of
model checkpoints, TensorFlow definitions, and scalars logged using TensorFlow methods
2023-12-03 12:27:46 +00:00
* [TensorBoard PR Curve ](../guides/frameworks/tensorflow/tensorboard_pr_curve.md ) - Demonstrates ClearML's automatic
2023-07-31 16:40:04 +00:00
logging of TensorBoard output and TensorFlow definitions.
2023-12-03 12:27:46 +00:00
* [TensorBoard Toy ](../guides/frameworks/tensorflow/tensorboard_toy.md ) - Demonstrates ClearML's automatic logging of
2023-07-31 16:40:04 +00:00
TensorBoard scalars, histograms, images, and text, as well as all console output and TensorFlow Definitions.
* [Absl flags ](https://github.com/allegroai/clearml/blob/master/examples/frameworks/tensorflow/absl_flags.py ) - Demonstrates
2023-12-03 12:27:46 +00:00
ClearML's automatic logging of parameters defined using `absl.flags`
2023-07-31 16:40:04 +00:00
## Remote Execution
2025-02-06 15:31:11 +00:00
ClearML logs all the information required to reproduce a task on a different machine (installed packages,
2024-07-15 12:53:41 +00:00
uncommitted changes etc.). The [ClearML Agent ](../clearml_agent.md ) listens to designated queues and when a task is enqueued,
2023-07-31 16:40:04 +00:00
the agent pulls it, recreates its execution environment, and runs it, reporting its scalars, plots, etc. to the
2025-02-06 15:31:11 +00:00
task manager.
2023-07-31 16:40:04 +00:00
Deploy a ClearML Agent onto any machine (e.g. a cloud VM, a local GPU machine, your own laptop) by simply running the
following command on it:
```commandline
clearml-agent daemon --queue < queues_to_listen_to > [--docker]
```
2023-09-11 10:33:30 +00:00
Use the ClearML [Autoscalers ](../cloud_autoscaling/autoscaling_overview.md ) to help you manage cloud workloads in the
2023-07-31 16:40:04 +00:00
cloud of your choice (AWS, GCP, Azure) and automatically deploy ClearML agents: the autoscaler automatically spins up
and shuts down instances as needed, according to a resource budget that you set.
### Cloning, Editing, and Enqueuing

Use ClearML's web interface to edit task details, like configuration parameters or input models, then execute the task
with the new configuration on a remote machine:
2025-02-06 15:31:11 +00:00
* Clone the task
2023-07-31 16:40:04 +00:00
* Edit the hyperparameters and/or other details
* Enqueue the task
2024-07-15 12:53:41 +00:00
The ClearML Agent executing the task will use the new values to [override any hard coded values ](../clearml_agent.md ).
2023-07-31 16:40:04 +00:00
### Executing a Task Remotely
You can set a task to be executed remotely programmatically by adding [`Task.execute_remotely()` ](../references/sdk/task.md#execute_remotely )
to your script. This method stops the current local execution of the task, and then enqueues it to a specified queue to
re-run it on a remote machine.
```python
# If executed locally, process will terminate, and a copy will be executed by an agent instead
task.execute_remotely(queue_name='default', exit_process=True)
```
## Hyperparameter Optimization
2023-12-03 12:27:46 +00:00
Use ClearML's [`HyperParameterOptimizer` ](../references/sdk/hpo_optimization_hyperparameteroptimizer.md ) class to find
2023-07-31 16:40:04 +00:00
the hyperparameter values that yield the best performing models. See [Hyperparameter Optimization ](../fundamentals/hpo.md )
for more information.