Commit Graph

282 Commits

Author SHA1 Message Date
pollfly
f5040b59d7
Add Markdown in pipeline jupyter notebooks (#502)
* Add jupyter notebook to pipeline

* Add markdown explanations to Jupyter Notebook about pipeline
2021-12-01 18:48:14 +02:00
pollfly
8f84c42f5d
Edit pipeline example (#494) 2021-11-21 12:30:05 +02:00
allegroai
6a6cf111be Refactor AutoScaler 2021-11-17 19:15:48 +02:00
allegroai
11f21fcfb6 Fix PyTorch distributed TimeoutSocket issue in Windows 2021-10-25 13:15:05 +03:00
pollfly
23b0c500f1
Add Dataset examples (#485)
* Add data_management example

* split dataset_management into two - dataset creation and data ingerstion examples

* add underscore to project name

* delete space

* black format
2021-10-24 14:31:20 +03:00
Kumar Ashutosh
dae1a1d112
Minor edit when training with a custom dataset (#484)
When we want to train a custom dataset, the code should have the flexibility to accommodate variable number of classes.
2021-10-22 10:27:06 +03:00
pollfly
8ca5346421
Edit TaskScheduler docstrings (#475) 2021-10-15 16:04:44 +03:00
pollfly
8c6119c13e
Fix docstring parameter (#464)
Replace `task_id` with `schedule_task_id` in `TaskScheduler` docstring examples so code works when copied
2021-10-05 19:54:07 +03:00
allegroai
b0a3166a93 Fix example 2021-10-03 03:25:04 +03:00
allegroai
39d8d8f0cb Fix example project name 2021-10-03 02:56:52 +03:00
allegroai
3643446f56 Fix example requirements 2021-10-03 02:16:31 +03:00
allegroai
b38a74c91e Add MegEngine example requirements and set examples project 2021-09-30 22:28:25 +03:00
Feng Wang
8c9c0eacc7
Add support for MegEngine (#455)
* feat(framework): support MegEngine model

* feat(framework): add MegEngine example

* fix(example): change supported suffix to pkl
2021-09-30 00:16:20 +03:00
J Alexander
dd3d4cec94
Add TaskTypes to main namespace (#453)
* add tasktypes to main namespace

* add tasktypes to pipe decorator example

* minor linting

Co-authored-by: Johnathan Alexander <jalexander86@gatech.edu>
2021-09-22 10:34:45 +03:00
allegroai
c9121debc2 Fix typo 2021-09-19 22:20:03 +03:00
pollfly
d138ee984f
Add print statement to example (#454)
* Add print statement to example

* add space
2021-09-19 15:11:32 +03:00
allegroai
edb076c462 Rename pipeline example 2021-09-10 13:08:15 +03:00
allegroai
75dfed6022 Add enhanced pipeline support and examples 2021-09-09 22:01:58 +03:00
allegroai
c85c05ef6a Add pipeline v2 examples 2021-09-05 00:30:53 +03:00
allegroai
6d09ff1518 Add function based Pipeline example 2021-09-03 03:39:30 +03:00
allegroai
3f80829ed7 Add function based Pipeline example 2021-09-03 03:34:41 +03:00
allegroai
e491f4352f Add PipelineController v2 (notice new constructor is not backwards compatible) 2021-09-03 03:27:33 +03:00
allegroai
aff39ae061 Fix documentation and prints 2021-08-25 16:46:44 +03:00
allegroai
8f48d5c884 Add TriggerScheduler example and fix pep8 2021-08-25 16:36:14 +03:00
allegroai
1d0be8c8e1 Add pipeline controller callback example 2021-08-25 16:30:52 +03:00
pollfly
aba130eb1f
Change task_name in tensorboardX example (#432) 2021-08-22 13:44:21 +03:00
allegroai
69a85924b0 Add xgboost auto metric logging (issue #381) 2021-08-13 23:55:57 +03:00
allegroai
ce8f35a232 Add TaskScheduler example 2021-08-13 10:59:02 +03:00
pollfly
c7216a227b
Edit model_config example and add yaml sample (#419) 2021-08-11 14:10:07 +03:00
allegroai
d83f1cd2c1 Add Click examples 2021-08-04 11:30:32 +03:00
allegroai
226c68330e Add Click support (issue #386) 2021-07-04 09:31:47 +03:00
pollfly
a79447bba6
Link to clear.ml docs and fix links (#389)
* switch allegro.ai links to clear.ml
* fix colab links
* add newline
2021-06-29 11:22:12 +03:00
Revital
0325c2f32a rename TrainsTuner to ClearmlTuner 2021-06-20 10:33:07 +03:00
Tim Joseph
4a2099b53c Adds an tensorboardx example for add_video (creates GIFs in tensorboard) 2021-06-02 21:11:51 +03:00
Noam Wasersprung
1ab3710074
Fix colab reference to open the correct notebook (#374)
Fix github account link
2021-06-01 12:20:13 +03:00
pollfly
e3ab9defa1
Add google colab notebook tutorial (#368)
* add csv data sample to data_samples

* add google colab as clearml worker

* edit clearml_colab_agent

* remove outputs from colab file

* Delete clearml_colab.ipynb

* Delete clearml_colab_agent.ipynb

* Rename clearml_colab_agent.ipynb to examples/clearml_agent/clearml_colab_agent.ipynb

* Update clearml_colab_agent.ipynb

correct link to point to google colab

* Update clearml_colab_agent.ipynb

* edit clearml_colab_agent profile link
2021-06-01 09:51:49 +03:00
allegroai
02fa11c845 Use cursor in Slack Alerts example 2021-05-26 18:30:29 +03:00
Erez
652a29650a Remove old model upload examples 2021-05-19 09:58:07 +03:00
allegroai
899ff93a73 Fix import keras from TF 2021-05-14 09:42:12 +03:00
allegroai
ed18949e3f Remove deprecated examples 2021-05-12 15:41:37 +03:00
allegroai
4e4aab56a8 Increase channel result to support max of 1K channels for finding slack channel 2021-05-12 15:40:20 +03:00
allegroai
0e9538d42a Add object-storage support in cleanup-service 2021-05-12 15:39:34 +03:00
Revital
3225715ae3 add csv data sample to data_samples 2021-05-09 09:26:58 +03:00
allegroai
9014f2e680 Update KerasTuner example requirements.txt 2021-04-28 13:13:28 +03:00
pollfly
8658198f8b
Add using_artifacts_example (#334)
* add example for Task, multiple Tasks created in same code

* fixes to clearml-task.md

* add example of  remote_execution

* add using_artifacts_example

* Rename remote_execution_example.py to execute_remotely_example.py

* change name to execute_remotely_example.py

* add header to using_artifacts_example.py

* add newline to using_artifacts_example.py
2021-04-18 13:40:52 +03:00
Revital
30f366f23c add example for Task, multiple Tasks created in same code 2021-04-04 09:55:13 +03:00
allegroai
a5a23510e8 Add Hydra example
Add artifacts retrieval example
Rename LightGBM example
2021-02-21 14:51:07 +02:00
allegroai
4edec4b74a Update example 2021-02-04 10:41:20 +02:00
allegroai
71c45fcdd3 Update Auto Scaler default values and configuration format 2021-02-01 23:44:01 +02:00
allegroai
dd3e50523f Split reporting example 2021-01-18 20:23:19 +02:00
allegroai
794d97ca7c Change HyperParameterOptimizer spawn_task_project to spawn_project
Add HyperParameterOptimizer parallel coordinates (issues #279)
2021-01-12 20:22:05 +02:00
allegroai
f679c80535 Add HyperParameterOptimizer arguments: spawn_task_project, save_top_k_tasks_only 2021-01-10 13:07:57 +02:00
allegroai
ce5541b2d6 Updated jupyter logging example 2021-01-10 13:05:03 +02:00
allegroai
14e38e8a46 Make HPO example more readable 2021-01-10 13:03:17 +02:00
allegroai
4c8a24f1ff Update examples to ClearML 2020-12-30 16:53:19 +02:00
allegroai
a29a655a6e Documentation examples 2020-12-24 00:30:32 +02:00
allegroai
d327f2e2b9 clearml initial version 0.17.0 2020-12-22 23:25:37 +02:00
allegroai
e6b468b9ae PY2 compatibility 2020-12-10 09:41:31 +02:00
allegroai
3898563200 Improve Auto-Scaler: add extra configurations, key name and security group are now optional 2020-12-06 11:20:36 +02:00
allegroai
905dd24b09 Use Task.connect_configuration() 2020-11-25 11:26:24 +02:00
allegroai
849c782a70 Improve comment 2020-11-25 11:26:13 +02:00
allegroai
a6d479ffab Add trains to examples requirements 2020-11-25 11:25:28 +02:00
allegroai
f35e927951 Fix missing plt.show in example 2020-11-17 23:12:11 +02:00
allegroai
2a9a24daac Add reporting text as debug sample example 2020-11-17 23:12:09 +02:00
erezalg
95ba6bab78
Add cifar ignite example and add auto extract of tar.gz files when using storagemanager (#237) 2020-11-11 16:35:23 +02:00
allegroai
4d1582d077 Fix report_table as list of rows 2020-11-02 00:42:05 +02:00
allegroai
471c9da953 Add requirements for matplotlib reporting example 2020-10-30 09:50:16 +02:00
allegroai
912264bfa7 Update examples 2020-10-23 23:45:41 +03:00
allegroai
df395b67ba Add Logger.report_matplotlib_figure() with examples 2020-10-15 23:20:17 +03:00
allegroai
c9fac89bcd Add LightGBM support 2020-10-12 12:34:52 +03:00
allegroai
98ea965e6d Add key pair and security groups to AWS auto-scaler 2020-10-12 11:12:33 +03:00
allegroai
994ed1a5ae Add AWS auto-scaler multi-line support for both extra bash script and extra trains.conf data 2020-10-12 11:07:01 +03:00
allegroai
89034233ed Fix AWS autoscaler typos 2020-10-12 11:01:08 +03:00
allegroai
9a8c531072 Add example notebooks, update example requirements 2020-10-04 17:04:39 +03:00
allegroai
c889105670 Update autokeras requirements according to https://github.com/keras-team/autokeras#installation 2020-10-01 16:16:06 +03:00
allegroai
845dc5cda0 Fix hyper parameter optimization example 2020-09-29 19:16:06 +03:00
allegroai
519677d987 Update tabular example scripts for the ML pipeline blog 2020-09-23 00:06:05 +03:00
allegroai
8ec6bba4d9 Fix Optimizer limits and values, update trains version in examples 2020-09-15 19:14:45 +03:00
allegroai
aa44ba854f Update pytorch example trains version and reduced default number of epochs 2020-09-05 16:31:44 +03:00
allegroai
03e7ebd48c Add pipeline controller tag-per-step option. Pipeline controller parameters can now be any type. 2020-09-05 16:31:01 +03:00
allegroai
c234837ce2 Fix kernels issue in pytorch example. Update trains version. 2020-09-01 18:01:39 +03:00
allegroai
5beecbb078 Add Pipeline Controller automation and example 2020-09-01 18:00:19 +03:00
allegroai
0d533e9013 Fix examples 2020-08-27 15:00:42 +03:00
allegroai
e0ab86a64d Update examples requirements 2020-08-10 17:24:38 +03:00
allegroai
f74c89a25d Update pytorch examples 2020-08-10 08:04:58 +03:00
allegroai
73bd8c2714 Add FastAI example, disable binding if tensorboard is loaded (assume TensorBoradLogger will be used) 2020-08-10 08:01:03 +03:00
allegroai
772fd7f750 Add Keras Tuner CIFAR10 example 2020-08-08 13:13:21 +03:00
allegroai
6c4827cda3 Update examples requirements 2020-08-08 12:59:03 +03:00
allegroai
42148345b4 Change default hyper parameter optimization example to 12 seconds 2020-08-08 12:43:43 +03:00
allegroai
35fa4f010a Add Optimizer min_iteration_per_job for all SearchStrategies 2020-08-08 12:39:56 +03:00
allegroai
87088a8c0f Fix AWS autoscaler wizard to match the autoscaler requirements (queues cannot share the same resource type, so we automatically duplicate them) 2020-07-30 15:17:59 +03:00
allegroai
7de064aaa0 Fix Optuna and HPBandster optimizers to ignore extra kwargs in constructor. Use OptimizerOptuna as default optimizer for hyper-parameter optimization example. 2020-07-30 14:56:15 +03:00
allegroai
29727b80b7 When launching jupyter notebook instance, pass base docker image to the running jupyter 2020-07-30 14:50:24 +03:00
allegroai
e7864e6ba8 Move autoscaler input functions to utilities 2020-07-14 23:40:05 +03:00
allegroai
79799d3efd Add logger.report_confusion_matrix arg yaxis_reversed (when True flip the confusion matrix, default False). Issue #165 2020-07-11 01:37:02 +03:00
allegroai
8d7740ea68 Add AWS EC2 Auto-Scaler service example 2020-07-11 01:32:51 +03:00
allegroai
88d88e914d Fix optimization example 2020-07-11 01:27:31 +03:00
allegroai
6221c6c096 Fix Task type in automation examples 2020-07-04 22:59:24 +03:00
Allegro AI
ae6e417d61
Update hyper_parameter_optimizer.py 2020-06-28 18:16:14 +03:00
Allegro AI
f036213d91
Merge pull request #150 from danmalowany-allegro/master
Update Jupiter notebook example scripts
2020-06-27 14:23:19 +03:00
allegroai
53f46469ce Moved hyper-parameter example optimization into optimization folder 2020-06-23 16:53:51 +03:00
allegroai
562be23ba4 Moved hyper-parameter example optimization into optimization folder 2020-06-22 17:13:03 +03:00
allegroai
1b153e401e Refine subprocess example 2020-06-22 17:12:24 +03:00
danmalowany-allegro
10f11ba038 Added text classification example and updated image and audio examples 2020-06-22 14:13:49 +03:00
danmalowany-allegro
8cb7c8130a Added text classification example and updated image and audio examples 2020-06-22 14:13:03 +03:00
allegroai
53d0da373f Removed old example 2020-06-22 00:07:53 +03:00
allegroai
2c5e2bb849 Add Slack Monitor service 2020-06-21 23:30:07 +03:00
allegroai
efb72d8fc3 Improve 2D scatter example, show 3 different plot styles 2020-06-20 22:41:33 +03:00
stef-ubuntu
6bf448f43b bug: test_loader was using train batch_size instead of test_batch_size 2020-06-19 16:55:15 +09:00
allegroai
661e46c7bc Fix documentation 2020-06-19 00:40:38 +03:00
allegroai
a51a1be320 Add manual model tracking example 2020-06-17 01:01:31 +03:00
allegroai
bfaf9459e0 Add scikit-learn example 2020-06-16 04:04:42 +03:00
allegroai
99368abb1c Refactor examples 2020-06-15 22:48:51 +03:00
allegroai
20a9f0997d Add direct plotly figure reporting (see issue #136) 2020-06-14 00:01:30 +03:00
allegroai
633616d3f2 Update cleanup service example 2020-06-11 15:29:50 +03:00
allegroai
d72585b8e1 Add cleanup service example 2020-06-11 15:09:10 +03:00
allegroai
fba3d70ce8 Add audio/video reporting examples 2020-06-09 23:20:38 +03:00
allegroai
43dac458df Change OptimizerBOHB argument max_job_execution_minutes to time_limit_per_job. Add budget remaining reporting 2020-05-31 13:28:03 +03:00
allegroai
342fac71e2 Improve example documentation 2020-05-24 15:47:52 +03:00
allegroai
9e0a5a36fb Added distributed examples 2020-05-24 15:37:55 +03:00
allegroai
ba4c4c558f Add automation examples 2020-05-24 08:21:21 +03:00
allegroai
95105cbe6a Add automation support including hyper-parameters optimization 2020-05-22 12:00:07 +03:00
allegroai
c1e7742085 Update PyTorch example default epochs 2020-05-08 22:14:58 +03:00
allegroai
824808d38b Remove cast warning in Tensorflow v2 example 2020-04-28 10:45:02 +03:00
Jake Henning
0a3db7186d
Update autokeras_imdb_example.py 2020-04-20 15:48:39 +03:00
Erez Schanider
d0e04b8975 Add autokeras example 2020-04-20 14:55:59 +03:00
allegroai
c06f72ae3a Match Torch TensorboardX example to Tensorboard 2020-04-16 16:47:03 +03:00
allegroai
8f1dd8ba8b Add log text to TF V1 example 2020-04-16 16:44:42 +03:00
allegroai
0211d233d4 Deprecate Task.set_model_config(), Task.get_model_config_text() and Task.get_model_config_dict() 2020-03-23 23:25:16 +02:00
allegroai
e05e41c117 Add table reporting to manual reporting example 2020-03-20 10:13:22 +02:00
allegroai
1043c22d0a Update Jupyter notebook server execution example 2020-03-09 12:20:34 +02:00
allegroai
2bffc24347 Update Jupyter notebook server execution example 2020-03-08 18:56:41 +02:00
allegroai
8acb236b33 Update examples 2020-03-05 19:56:51 +02:00
allegroai
ef73bc258f Add Jupyter notebook server execution example 2020-03-05 12:35:58 +02:00
allegroai
073f4c308d Convert ndarray to histogram for axis to get rid of warning in tensorflow binding 2020-01-10 13:39:31 +02:00
danmalowany-allegro
a3194ff17b
Removed installation output text 2020-01-06 17:34:18 +02:00
danmalowany-allegro
955ac50b6e
Added matplotlib installation 2020-01-05 20:32:16 +02:00
danmalowany-allegro
6799aed78a
bugfix - pip command in comment 2020-01-05 19:59:33 +02:00
danmalowany-allegro
5abd01fa75
Updated to tensorflow 2 and added installation commands 2020-01-05 19:57:50 +02:00
allegroai
865ad925dd Update joblib example to latest release 2019-12-24 18:21:10 +02:00
allegroai
019954828b Add missing package to examples requirements 2019-12-15 15:13:08 +02:00
allegroai
5cae1e8384 Clean hyper-parameter example 2019-11-28 00:47:51 +02:00
allegroai
0a45d2094f Add Task connect_configuration, connect_label_enumeration, and support for nested dictionary with connect
Add Task.get_tasks
2019-11-15 22:00:10 +02:00
allegroai
d8e54b466c Fix Windows support 2019-11-08 22:14:42 +02:00
allegroai
9d7c875d71 Fix Windows support for example code 2019-10-29 22:07:36 +02:00
allegroai
c8737dc266 Fix Windows support in example code 2019-10-28 22:57:53 +02:00
allegroai
327c9f60b6 Add simple AutoML examples 2019-10-27 00:32:23 +03:00
allegroai
00e66b5d63 Add missing x/y/z axis titles to various logger report
Changed report_surface arguments
2019-10-27 00:32:05 +03:00
allegroai
6861aa0113 Add artifacts wildcard example 2019-10-25 15:14:09 +03:00
allegroai
cb3167bdd8 Add x/y/z title for scatter 2d/3d plots 2019-10-25 15:11:26 +03:00