Commit Graph

67 Commits

Author SHA1 Message Date
allegroai
12439b9970 Add pipeline.upload_model() 2021-10-24 17:32:47 +03:00
allegroai
ca70f0a6f6 Improve docstring 2021-10-21 11:59:17 +03:00
allegroai
0bc43a31f4 PEP8 2021-10-19 10:39:55 +03:00
allegroai
94d28ed44f Fix PipelineController start should not kill the process when done
Fix PY3.5 compatibility
2021-10-19 10:33:35 +03:00
pollfly
c29dd1fe06
Fix docstring typos (#476) 2021-10-17 20:19:16 +03:00
allegroai
8e1ff6eed9 Add nested pipeline components missing pipeline tags
Fix nested pipeline component point parent point to pipeline Task
2021-10-16 23:17:14 +03:00
allegroai
8d5d2f2f9e Fix Pipeline stopping all running steps 2021-10-16 23:15:58 +03:00
allegroai
0ade8b0717 Fix LocalClearmlJob setting failed status
Cache ClreamlJob state (refresh every one second)
2021-10-16 23:13:49 +03:00
allegroai
04797d25d1 Add PipelineController.stop() mark_failed and mark_aborted args
Add pipeline decorator run_locally
Add PipelineController.continue_on_fail property
Add PipelineController.__init__() abort_on_failure arg
2021-10-16 23:10:23 +03:00
allegroai
f986c72113 Fix PY3.5 compatibility 2021-10-16 23:03:20 +03:00
allegroai
d0e5713d1c Fix pipeline failing to create Step Task should cause the pipeline to be marked failed 2021-10-16 23:02:38 +03:00
pollfly
8ca5346421
Edit TaskScheduler docstrings (#475) 2021-10-15 16:04:44 +03:00
allegroai
0cb0c234eb Add Optimizer.get_top_experiments_id_metrics_pair() for top performing experiments 2021-10-10 09:05:44 +03:00
diegopereyra99
1f82b0c401
Add LogUnifomParameterRange for hyperparameter optimization with optuna (#462)
* Add LogUnifomParameterRange for hyperparameter optimization with optuna

* Add self.base and changed OptimizerOptuna to correctly create log uniform hyperparams.

* Add docstring to LogUniformParameterRange class.

Co-authored-by: Pereyra, Diego <9011013@ulta.com>
2021-10-06 22:22:24 +03:00
allegroai
2509756ea8 Change pipeline.start_locally() default run_pipeline_steps_locally=False 2021-10-05 23:17:09 +03:00
pollfly
8c6119c13e
Fix docstring parameter (#464)
Replace `task_id` with `schedule_task_id` in `TaskScheduler` docstring examples so code works when copied
2021-10-05 19:54:07 +03:00
allegroai
00efe33896 PEP8 2021-10-04 00:57:31 +03:00
allegroai
56230faa5b Add PipelineController add_step configuration_overrides allowing to override Task configuration objects 2021-10-02 21:44:48 +03:00
allegroai
400c6ec103 Add eager decorated pipeline execution
Support pipeline monitoring for scalers/models/artifacts
2021-09-27 18:53:54 +03:00
allegroai
0dd9ba8adc Fix Python 3.5 compatibility 2021-09-25 23:05:24 +03:00
allegroai
3dad7ccf65 Add PipelineController auto_version_bump, fix PipelineController skipping queued Tasks. 2021-09-13 01:27:40 +03:00
allegroai
75dfed6022 Add enhanced pipeline support and examples 2021-09-09 22:01:58 +03:00
allegroai
23fc9260f8 Add PipelineDecorator.pipeline & PipelineDecorator.component decorators for full custom pipeline logic 2021-09-05 00:30:44 +03:00
allegroai
e491f4352f Add PipelineController v2 (notice new constructor is not backwards compatible) 2021-09-03 03:27:33 +03:00
allegroai
cab63faef3 Fix TaskScheduler weekdays, and change default execute_immediately to False 2021-08-30 17:46:48 +03:00
allegroai
8f48d5c884 Add TriggerScheduler example and fix pep8 2021-08-25 16:36:14 +03:00
allegroai
922e8b5e74 Fix getattr will throw exception (issue #426) 2021-08-20 00:35:13 +03:00
allegroai
8708967a5e Add Task trigger scheduler
Fix TaskScheduler executed instances
2021-08-07 19:39:19 +03:00
allegroai
9a38682f9f Fix ClearMLJob passing project field, add docker args/bash into caching 2021-08-02 23:01:54 +03:00
allegroai
2ba653baf7 Fix de-serializing from aborted state + refactor 2021-08-02 23:01:26 +03:00
allegroai
071caf5302 Task scheduler support combining weekdays and recurring scheduled jobs 2021-08-01 00:10:08 +03:00
allegroai
e78c1e806a Protect against enqueue failing due to permission 2021-07-31 23:53:22 +03:00
allegroai
326f226650 Fix TaskScheduler target project 2021-07-23 16:10:51 +03:00
allegroai
d1f377d5f2 Add task_filter to Objective.get_top_tasks() 2021-07-23 16:03:27 +03:00
allegroai
510c275188 Add TaskScheduler 2021-07-23 16:01:17 +03:00
allegroai
e0096e6978 Fix redundant resource_monitoring from pipeline controller 2021-07-23 15:54:45 +03:00
allegroai
f3d42d0a53 Fix always trying to get a pipeline step cached 2021-07-23 15:50:55 +03:00
allegroai
968305e09d Fix PipelineController callback returning False 2021-06-25 22:39:31 +03:00
allegroai
d769582332 Autoscaler improvements and optimizations
Add customizable boot bash script
Fix custom bash script should be called last before starting agent
Fix auto scaler spins too many instances at onces then killing the idle ones (spin time is longer than poll time)
2021-06-12 23:11:48 +03:00
allegroai
5e6b4ebe5d Fix automation controller overrides nodes clone 2021-05-31 15:40:13 +03:00
allegroai
2e95881c76 PEP8 2021-05-26 18:30:59 +03:00
allegroai
f8a76278bf Fix python2.7 support (issue #366) 2021-05-26 18:28:59 +03:00
allegroai
f46561629f Fix task.execute_remotely from jupyter notebook 2021-05-10 23:52:33 +03:00
allegroai
bd110aed5e Fix docstrings 2021-05-02 09:47:02 +03:00
allegroai
f93c0dddf0 Fix querying class attribute 2021-04-28 18:45:00 +03:00
allegroai
9d108d855f Add Pipeline controller caching, improve pipeline plot reporting 2021-04-25 10:43:39 +03:00
allegroai
f9e555b464 Add pipeline step caching 2021-04-25 10:41:51 +03:00
allegroai
d3cdb0ac42 Fix ClearmlJob docstrings 2021-04-25 10:36:46 +03:00
allegroai
0013c5851e Improve pipeline controller, add callbacks 2021-04-10 22:26:05 +03:00
allegroai
bf9ec770c6 Add ClearmlJob support for Task parameters override (issue #214) 2021-04-10 22:21:17 +03:00