Commit Graph

249 Commits

Author SHA1 Message Date
allegroai
3c5195028e More sub-projects support and fixes 2021-05-03 17:44:54 +03:00
allegroai
0d5174c453 Support iterating over all task metrics in task debug images 2021-05-03 17:43:02 +03:00
allegroai
c034c1a986 Add sub-projects support 2021-05-03 17:42:10 +03:00
allegroai
1b49da8748 Revoke tests account in fixed mode, cleanup 2021-05-03 17:40:41 +03:00
allegroai
26bda01a28 Add missing errors 2021-05-03 17:39:49 +03:00
allegroai
f5008d80ad Optimize and improve tasks/models/projects.delete 2021-05-03 17:39:13 +03:00
allegroai
8b464e7ae6 Return file urls for tasks.delete/reset and models.delete 2021-05-03 17:38:09 +03:00
allegroai
78e4a58c91 Fix API enum fields and add last_iteration to range queries 2021-05-03 17:37:49 +03:00
allegroai
7a4a5eb03e Fix dropping index by name during the migration fails if the index does not exist 2021-05-03 17:36:49 +03:00
allegroai
d029d56508 Support active users in projects 2021-05-03 17:36:04 +03:00
allegroai
6411954002 Improve visibility for distributed lock hanging 2021-05-03 17:35:17 +03:00
allegroai
7f4ad0d1ca Support projects.get_hyperparam_values 2021-05-03 17:34:40 +03:00
allegroai
4cd4b2914d Add range queries
Switch from sematic_version to packaging.version in db migrations
2021-05-03 17:33:47 +03:00
allegroai
1d55710a0b Update max API version 2021-05-03 17:33:12 +03:00
allegroai
8f646043bb Allow enqueueing stopped tasks
More clearml stuff
2021-05-03 17:31:02 +03:00
allegroai
4b11a6efcd Move apiserver to clearml 2021-05-03 17:26:44 +03:00
allegroai
749ff4a44f Fix Tasks.reset does not mark children's parent as deleted 2021-05-03 16:57:06 +03:00
allegroai
7d6918ecb0 Fix large plots comparison 2021-05-03 16:55:59 +03:00
allegroai
47184c2833 Fix querying by task parent 2021-05-03 16:55:03 +03:00
allegroai
59fc98e0c4 Upgrade Jinja2 version (vulnerability found in older versions) 2021-01-05 20:18:09 +02:00
allegroai
a936a210e8 Version bump to 0.17.0 2021-01-05 20:08:19 +02:00
allegroai
be0cf0caa8 Unify v0.17 migrations 2021-01-05 20:07:49 +02:00
allegroai
a8d90887e2 Fix task execution queue is not cleared on clone 2021-01-05 20:07:04 +02:00
allegroai
6f3257fed3 Fix X-ClearML headers to X-Clearml 2021-01-05 20:06:36 +02:00
allegroai
286b8c3df5 Change default company name to "clearml" 2021-01-05 19:05:11 +02:00
allegroai
16430a6636 Support query by task state in projects.get_tasks_parents, return task project names 2021-01-05 19:02:48 +02:00
allegroai
d7ddfde26e Fix tasks.failed error for task that was never started 2021-01-05 19:01:43 +02:00
allegroai
e6c0f1b6d8 Add migration: remove outdated user email index from db 2021-01-05 18:55:10 +02:00
allegroai
641ed1b510 Fix basic config not throwing missing key exception when no default passed 2021-01-05 18:54:13 +02:00
allegroai
3473d2bb02 Update PyJWT requirement (2.0.0 breaks interface) 2021-01-05 18:52:32 +02:00
allegroai
ba03924cb4 Fix archived and development system tags should not be cleaned up 2021-01-05 18:52:12 +02:00
allegroai
6870d8aba9 Refactor service_repo
Code cleanup
2021-01-05 18:50:42 +02:00
allegroai
64c63d2560 Add projects.get_task_parents 2021-01-05 18:49:25 +02:00
allegroai
88836fae66 Allow parent query in tasks.get_all 2021-01-05 18:48:25 +02:00
allegroai
436883148b Improve schema reader 2021-01-05 18:47:32 +02:00
allegroai
f9f2f0ccf0 Add request model detection in endpoint decorator 2021-01-05 18:47:01 +02:00
allegroai
f879f6924f Better exception log 2021-01-05 18:36:25 +02:00
allegroai
b9cb587580 Support docker_init_script in Task 2021-01-05 18:35:32 +02:00
allegroai
370e92c3dd Use sparse index for email addresses 2021-01-05 18:34:46 +02:00
allegroai
03094076c8 Fix tags handling fail reloading datetime-like strings 2021-01-05 18:32:18 +02:00
allegroai
bdf6c353bd Refactor APICall and schema validation 2021-01-05 18:30:59 +02:00
allegroai
23736efbc3 Add support for ClearML headers 2021-01-05 18:29:50 +02:00
allegroai
3c8e27dc94 Unify server request handlers 2021-01-05 18:28:43 +02:00
allegroai
ca890c7ae8 Remove dependency on api_version 2021-01-05 18:27:31 +02:00
allegroai
30909df73f Fix tasks.clone schema
Reintroduce email field uniqueness
2021-01-05 18:26:14 +02:00
allegroai
b97a6084ce Refactor configuration infrastructure
Remove untracked files left from previous commit
2021-01-05 18:25:18 +02:00
allegroai
50438bd931 Refactor apierrors infrastructure and auto-generation 2021-01-05 18:22:39 +02:00
allegroai
28daf49c91 Remove unique company name constraint 2021-01-05 18:21:49 +02:00
allegroai
4707647c92 Use EVENT_TYPE enum instead of string 2021-01-05 18:21:11 +02:00
allegroai
6974aa3a99 Improve internal events implementation 2021-01-05 18:20:38 +02:00
allegroai
e2deff4eef Fix update project time on task changes
Fix project time in non responsive tasks watchdog
2021-01-05 18:19:45 +02:00
allegroai
59994ccf9c Fix task and model last_change handling
Improve db model index
Improve db model infrastructure
2021-01-05 18:17:29 +02:00
allegroai
29c792d459 Fix tasks.clone 2021-01-05 18:15:01 +02:00
allegroai
df334d083e Add error message
Improve error handling
2021-01-05 18:14:29 +02:00
allegroai
b548958c80 Improve login.supported_modes
Fix schema
2021-01-05 18:13:43 +02:00
allegroai
7bdf8fe30d Fix DictField deserialization 2021-01-05 18:12:32 +02:00
allegroai
c71c65be87 Fix crash in auth.get_credentials if any of the credentials is missing last_used 2021-01-05 18:12:13 +02:00
allegroai
1cc6a8f787 Unify API model classes 2021-01-05 18:11:22 +02:00
allegroai
e5b92f4a80 Block users management in Redis 2021-01-05 18:10:32 +02:00
allegroai
3272d0f31f Rename migration script
Support refresh flag in debug image samples
Remove silent_dequeue_fail param to prevent status change in case task wasn't queued
Add organizations.get_user_companies
Fix reset should also reset active_duration
Add api_version to server.info
2021-01-05 18:09:34 +02:00
allegroai
618a0b9473 Do not set Task.last_update when moving or updating (i.e. changing name, comment, tags etc.) 2021-01-05 18:06:04 +02:00
allegroai
bca3a6e556 Set default task active duration to None
Move endpoints to new API version
Support tasks.move and models.move for moving tasks and models into projects
Support new project name in tasks.clone
Improve task active duration migration
2021-01-05 18:05:44 +02:00
allegroai
8b0afd47a6 Set configurable and consistent limits on variants and metrics across different iterators 2021-01-05 18:02:01 +02:00
allegroai
0303c3525f API version bump
Update internal tests
Allow edit/delete task artifacts/hyperparams/configs using force flag
Improve lists query support for get_all calls
2021-01-05 17:57:58 +02:00
allegroai
563c451ac9 Add task active duration migration 2021-01-05 17:53:44 +02:00
allegroai
91b1b34a6b Update configuration for debug images 2021-01-05 17:53:16 +02:00
allegroai
0ad0495733 Add tasks.archive support 2021-01-05 17:49:08 +02:00
allegroai
03ae90c4a6 API version bump 2021-01-05 17:48:07 +02:00
allegroai
be788965e0 Fix using reserved keywords as atrifact/hyperparams/configuration names
Replace events.get_debug_image_event and event.get_debug_image_iterations with events.get_debug_image_sample and events.next_debug_image_sample
2021-01-05 17:47:27 +02:00
allegroai
d198138c5b Support projection for task parent 2021-01-05 17:45:33 +02:00
allegroai
cf441987af Add tasks.get_by_id_ex and models.get_by_id_ex 2021-01-05 17:44:59 +02:00
allegroai
b89de43373 Support sorting by task active duration 2021-01-05 17:44:17 +02:00
allegroai
0ef018c931 More secure auth.create_user and auth.get_token_for_user 2021-01-05 17:43:30 +02:00
allegroai
323b5db07c Add support for debug images history using events.get_debug_image_event and events.get_debug_image_iterations
Remove untracked files
2021-01-05 17:42:05 +02:00
allegroai
f084f6b9e7 Fix get_hyperparams and unique_metric_params handling of public tasks 2021-01-05 17:38:50 +02:00
allegroai
eb4c9f0b13 Fix batch events counting 2021-01-05 17:37:40 +02:00
allegroai
7dcc0f6df2 Improve prepopulate 2021-01-05 17:30:37 +02:00
allegroai
5e0893dd80 Fix Elastic log filter 2021-01-05 17:12:57 +02:00
allegroai
ca81922651 Move login service 2021-01-05 17:11:51 +02:00
allegroai
07cc2fb08b Fix endpoint version 2021-01-05 17:08:46 +02:00
allegroai
842654d3fe Fix error generation 2021-01-05 17:08:05 +02:00
allegroai
00e5e2a0b1 Fix loading services 2021-01-05 17:07:33 +02:00
allegroai
37e5d8a7e0 Fix ParseError import with new luqum version
Fix incorrect strip to task diff and requirements
Add missing property to server.report_stats_option response
Add active_duration parameter for tasks
Move artifacts info dictionary structure
2021-01-05 17:07:14 +02:00
allegroai
5b1f468957 Support distributed lock on db init 2021-01-05 16:59:55 +02:00
allegroai
9103bf7984 Improve utilities 2021-01-05 16:58:57 +02:00
allegroai
e848d05677 Fix PEP8 in errors generator 2021-01-05 16:57:05 +02:00
allegroai
1c7de3a86e Add worker runtime properties support
Refactor login and add guest mode
Support artifacts in prepopulate
2021-01-05 16:56:08 +02:00
allegroai
e12fd8f3df Improve projects order 2021-01-05 16:46:23 +02:00
allegroai
29ef134b79 Resolve database module naming ambiguity 2021-01-05 16:45:22 +02:00
allegroai
e24389fda9 Add configuration loader 2021-01-05 16:44:31 +02:00
allegroai
f4ead86449 Add support for returning only valid plot events 2021-01-05 16:41:55 +02:00
allegroai
171969c5ea Optimize task artifacts 2021-01-05 16:40:35 +02:00
allegroai
89f81bfe5a Refactor app routes registration 2021-01-05 16:32:21 +02:00
allegroai
b8e62f27e2 Refactor database into a separate class 2021-01-05 16:31:25 +02:00
allegroai
c7bbac73d0 Refactor es_factory into a separate class 2021-01-05 16:29:25 +02:00
allegroai
f832ea565a Use apiserver namespace 2021-01-05 16:28:49 +02:00
allegroai
22e9c2b7eb Fix type annotations
Fix obtaining events for tasks moved from private to public
Fix assert_exists() to return company_origin if requested
2021-01-05 16:27:38 +02:00
allegroai
c67a56eb8d Introduce app startup sequence 2021-01-05 16:25:17 +02:00
allegroai
df65e1c7ad Rename server to apiserver 2021-01-05 16:22:34 +02:00