Commit Graph

230 Commits

Author SHA1 Message Date
allegroai
ba77ff11e9 Fix missing custom metric values turn up first in sorting 2021-05-03 18:08:39 +03:00
allegroai
b67aa05d6f Return results per task iterations in debug images request 2021-05-03 18:08:14 +03:00
allegroai
6b0c45a861 Fix batch operations results 2021-05-03 18:07:37 +03:00
allegroai
dc9623e964 Fix docker_cmd projection in backwards compatibility
Fix support to clear input/output models and docker_cmd in backwards compatibility mode
Fix schema
2021-05-03 18:06:39 +03:00
allegroai
3d73d60826 Better handling of invalid iterations on add_batch 2021-05-03 18:05:24 +03:00
allegroai
9f0c9c3690 Fix open ranges 2021-05-03 18:05:03 +03:00
allegroai
1a3d3494ce Fix numeric locale 2021-05-03 18:04:45 +03:00
allegroai
b99f620073 Added unarchive APIs 2021-05-03 18:04:17 +03:00
allegroai
e2f265b4bc Unify batch operations 2021-05-03 18:03:54 +03:00
allegroai
251ee57ffd Fix rapidjson dumps does not support ensure_ascii, only Encoder initialization does
Add task enqueue status
2021-05-03 18:03:17 +03:00
allegroai
7e03104f1c Add Model last_update field 2021-05-03 18:02:25 +03:00
allegroai
f1a258208e Disable backwards compatibility for 2.13 clients 2021-05-03 18:01:59 +03:00
allegroai
66cc49313b Fix schema 2021-05-03 18:01:29 +03:00
allegroai
9ae2943f7d Fix crash in tasks.reset 2021-05-03 17:59:44 +03:00
allegroai
54326f707b Add JSON flags support to APICall 2021-05-03 17:58:57 +03:00
allegroai
3a3b57c15f Support mongodb authentication 2021-05-03 17:57:53 +03:00
allegroai
8ea8ad34e6 Remove collecting task output models from Models collection during migration 2021-05-03 17:57:27 +03:00
allegroai
179661a0d4 Rename default input and output models
Better handling of backwards compatibility in task models
Code cleanup
2021-05-03 17:56:50 +03:00
allegroai
3d22ca1888 Escape task.container and task.execution.model_labels fields in DB 2021-05-03 17:56:17 +03:00
allegroai
fdf6798d0c Don't unset Task's execution.queue on dequeue 2021-05-03 17:54:16 +03:00
allegroai
9d9a44b927 Add skip_empty parameter in get_configuration_names 2021-05-03 17:53:56 +03:00
allegroai
a75534ec34 Add batch operations support 2021-05-03 17:52:54 +03:00
allegroai
eab33de97e Add bcrypt support to fixed user password 2021-05-03 17:52:25 +03:00
allegroai
29de110abb Add support for queue and model metadata 2021-05-03 17:50:25 +03:00
allegroai
2e7f418ee2 Fix Task.container backwards-compatibility
Fix sub-projects
2021-05-03 17:49:48 +03:00
allegroai
dadb996d22 Refactor es_factory to better support override host/port 2021-05-03 17:48:41 +03:00
allegroai
174f692edf Code cleanup 2021-05-03 17:48:24 +03:00
allegroai
f4d5168a20 Add Task.container support 2021-05-03 17:48:01 +03:00
allegroai
5a438e8435 Fix projects.move 2021-05-03 17:47:11 +03:00
allegroai
ce4814dc47 Add field override support in config (using "-" prefix) 2021-05-03 17:46:36 +03:00
allegroai
ef42d0265d Add multi-models support 2021-05-03 17:46:00 +03:00
allegroai
3c5195028e More sub-projects support and fixes 2021-05-03 17:44:54 +03:00
allegroai
0d5174c453 Support iterating over all task metrics in task debug images 2021-05-03 17:43:02 +03:00
allegroai
c034c1a986 Add sub-projects support 2021-05-03 17:42:10 +03:00
allegroai
1b49da8748 Revoke tests account in fixed mode, cleanup 2021-05-03 17:40:41 +03:00
allegroai
26bda01a28 Add missing errors 2021-05-03 17:39:49 +03:00
allegroai
f5008d80ad Optimize and improve tasks/models/projects.delete 2021-05-03 17:39:13 +03:00
allegroai
8b464e7ae6 Return file urls for tasks.delete/reset and models.delete 2021-05-03 17:38:09 +03:00
allegroai
78e4a58c91 Fix API enum fields and add last_iteration to range queries 2021-05-03 17:37:49 +03:00
allegroai
7a4a5eb03e Fix dropping index by name during the migration fails if the index does not exist 2021-05-03 17:36:49 +03:00
allegroai
d029d56508 Support active users in projects 2021-05-03 17:36:04 +03:00
allegroai
6411954002 Improve visibility for distributed lock hanging 2021-05-03 17:35:17 +03:00
allegroai
7f4ad0d1ca Support projects.get_hyperparam_values 2021-05-03 17:34:40 +03:00
allegroai
4cd4b2914d Add range queries
Switch from sematic_version to packaging.version in db migrations
2021-05-03 17:33:47 +03:00
allegroai
1d55710a0b Update max API version 2021-05-03 17:33:12 +03:00
allegroai
8f646043bb Allow enqueueing stopped tasks
More clearml stuff
2021-05-03 17:31:02 +03:00
allegroai
4b11a6efcd Move apiserver to clearml 2021-05-03 17:26:44 +03:00
allegroai
749ff4a44f Fix Tasks.reset does not mark children's parent as deleted 2021-05-03 16:57:06 +03:00
allegroai
7d6918ecb0 Fix large plots comparison 2021-05-03 16:55:59 +03:00
allegroai
47184c2833 Fix querying by task parent 2021-05-03 16:55:03 +03:00
allegroai
59fc98e0c4 Upgrade Jinja2 version (vulnerability found in older versions) 2021-01-05 20:18:09 +02:00
allegroai
a936a210e8 Version bump to 0.17.0 2021-01-05 20:08:19 +02:00
allegroai
be0cf0caa8 Unify v0.17 migrations 2021-01-05 20:07:49 +02:00
allegroai
a8d90887e2 Fix task execution queue is not cleared on clone 2021-01-05 20:07:04 +02:00
allegroai
6f3257fed3 Fix X-ClearML headers to X-Clearml 2021-01-05 20:06:36 +02:00
allegroai
286b8c3df5 Change default company name to "clearml" 2021-01-05 19:05:11 +02:00
allegroai
16430a6636 Support query by task state in projects.get_tasks_parents, return task project names 2021-01-05 19:02:48 +02:00
allegroai
d7ddfde26e Fix tasks.failed error for task that was never started 2021-01-05 19:01:43 +02:00
allegroai
e6c0f1b6d8 Add migration: remove outdated user email index from db 2021-01-05 18:55:10 +02:00
allegroai
641ed1b510 Fix basic config not throwing missing key exception when no default passed 2021-01-05 18:54:13 +02:00
allegroai
3473d2bb02 Update PyJWT requirement (2.0.0 breaks interface) 2021-01-05 18:52:32 +02:00
allegroai
ba03924cb4 Fix archived and development system tags should not be cleaned up 2021-01-05 18:52:12 +02:00
allegroai
6870d8aba9 Refactor service_repo
Code cleanup
2021-01-05 18:50:42 +02:00
allegroai
64c63d2560 Add projects.get_task_parents 2021-01-05 18:49:25 +02:00
allegroai
88836fae66 Allow parent query in tasks.get_all 2021-01-05 18:48:25 +02:00
allegroai
436883148b Improve schema reader 2021-01-05 18:47:32 +02:00
allegroai
f9f2f0ccf0 Add request model detection in endpoint decorator 2021-01-05 18:47:01 +02:00
allegroai
f879f6924f Better exception log 2021-01-05 18:36:25 +02:00
allegroai
b9cb587580 Support docker_init_script in Task 2021-01-05 18:35:32 +02:00
allegroai
370e92c3dd Use sparse index for email addresses 2021-01-05 18:34:46 +02:00
allegroai
03094076c8 Fix tags handling fail reloading datetime-like strings 2021-01-05 18:32:18 +02:00
allegroai
bdf6c353bd Refactor APICall and schema validation 2021-01-05 18:30:59 +02:00
allegroai
23736efbc3 Add support for ClearML headers 2021-01-05 18:29:50 +02:00
allegroai
3c8e27dc94 Unify server request handlers 2021-01-05 18:28:43 +02:00
allegroai
ca890c7ae8 Remove dependency on api_version 2021-01-05 18:27:31 +02:00
allegroai
30909df73f Fix tasks.clone schema
Reintroduce email field uniqueness
2021-01-05 18:26:14 +02:00
allegroai
b97a6084ce Refactor configuration infrastructure
Remove untracked files left from previous commit
2021-01-05 18:25:18 +02:00
allegroai
50438bd931 Refactor apierrors infrastructure and auto-generation 2021-01-05 18:22:39 +02:00
allegroai
28daf49c91 Remove unique company name constraint 2021-01-05 18:21:49 +02:00
allegroai
4707647c92 Use EVENT_TYPE enum instead of string 2021-01-05 18:21:11 +02:00
allegroai
6974aa3a99 Improve internal events implementation 2021-01-05 18:20:38 +02:00
allegroai
e2deff4eef Fix update project time on task changes
Fix project time in non responsive tasks watchdog
2021-01-05 18:19:45 +02:00
allegroai
59994ccf9c Fix task and model last_change handling
Improve db model index
Improve db model infrastructure
2021-01-05 18:17:29 +02:00
allegroai
29c792d459 Fix tasks.clone 2021-01-05 18:15:01 +02:00
allegroai
df334d083e Add error message
Improve error handling
2021-01-05 18:14:29 +02:00
allegroai
b548958c80 Improve login.supported_modes
Fix schema
2021-01-05 18:13:43 +02:00
allegroai
7bdf8fe30d Fix DictField deserialization 2021-01-05 18:12:32 +02:00
allegroai
c71c65be87 Fix crash in auth.get_credentials if any of the credentials is missing last_used 2021-01-05 18:12:13 +02:00
allegroai
1cc6a8f787 Unify API model classes 2021-01-05 18:11:22 +02:00
allegroai
e5b92f4a80 Block users management in Redis 2021-01-05 18:10:32 +02:00
allegroai
3272d0f31f Rename migration script
Support refresh flag in debug image samples
Remove silent_dequeue_fail param to prevent status change in case task wasn't queued
Add organizations.get_user_companies
Fix reset should also reset active_duration
Add api_version to server.info
2021-01-05 18:09:34 +02:00
allegroai
618a0b9473 Do not set Task.last_update when moving or updating (i.e. changing name, comment, tags etc.) 2021-01-05 18:06:04 +02:00
allegroai
bca3a6e556 Set default task active duration to None
Move endpoints to new API version
Support tasks.move and models.move for moving tasks and models into projects
Support new project name in tasks.clone
Improve task active duration migration
2021-01-05 18:05:44 +02:00
allegroai
8b0afd47a6 Set configurable and consistent limits on variants and metrics across different iterators 2021-01-05 18:02:01 +02:00
allegroai
0303c3525f API version bump
Update internal tests
Allow edit/delete task artifacts/hyperparams/configs using force flag
Improve lists query support for get_all calls
2021-01-05 17:57:58 +02:00
allegroai
563c451ac9 Add task active duration migration 2021-01-05 17:53:44 +02:00
allegroai
91b1b34a6b Update configuration for debug images 2021-01-05 17:53:16 +02:00
allegroai
0ad0495733 Add tasks.archive support 2021-01-05 17:49:08 +02:00
allegroai
03ae90c4a6 API version bump 2021-01-05 17:48:07 +02:00
allegroai
be788965e0 Fix using reserved keywords as atrifact/hyperparams/configuration names
Replace events.get_debug_image_event and event.get_debug_image_iterations with events.get_debug_image_sample and events.next_debug_image_sample
2021-01-05 17:47:27 +02:00
allegroai
d198138c5b Support projection for task parent 2021-01-05 17:45:33 +02:00
allegroai
cf441987af Add tasks.get_by_id_ex and models.get_by_id_ex 2021-01-05 17:44:59 +02:00
allegroai
b89de43373 Support sorting by task active duration 2021-01-05 17:44:17 +02:00
allegroai
0ef018c931 More secure auth.create_user and auth.get_token_for_user 2021-01-05 17:43:30 +02:00
allegroai
323b5db07c Add support for debug images history using events.get_debug_image_event and events.get_debug_image_iterations
Remove untracked files
2021-01-05 17:42:05 +02:00
allegroai
f084f6b9e7 Fix get_hyperparams and unique_metric_params handling of public tasks 2021-01-05 17:38:50 +02:00
allegroai
eb4c9f0b13 Fix batch events counting 2021-01-05 17:37:40 +02:00
allegroai
7dcc0f6df2 Improve prepopulate 2021-01-05 17:30:37 +02:00
allegroai
5e0893dd80 Fix Elastic log filter 2021-01-05 17:12:57 +02:00
allegroai
ca81922651 Move login service 2021-01-05 17:11:51 +02:00
allegroai
07cc2fb08b Fix endpoint version 2021-01-05 17:08:46 +02:00
allegroai
842654d3fe Fix error generation 2021-01-05 17:08:05 +02:00
allegroai
00e5e2a0b1 Fix loading services 2021-01-05 17:07:33 +02:00
allegroai
37e5d8a7e0 Fix ParseError import with new luqum version
Fix incorrect strip to task diff and requirements
Add missing property to server.report_stats_option response
Add active_duration parameter for tasks
Move artifacts info dictionary structure
2021-01-05 17:07:14 +02:00
allegroai
5b1f468957 Support distributed lock on db init 2021-01-05 16:59:55 +02:00
allegroai
9103bf7984 Improve utilities 2021-01-05 16:58:57 +02:00
allegroai
e848d05677 Fix PEP8 in errors generator 2021-01-05 16:57:05 +02:00
allegroai
1c7de3a86e Add worker runtime properties support
Refactor login and add guest mode
Support artifacts in prepopulate
2021-01-05 16:56:08 +02:00
allegroai
e12fd8f3df Improve projects order 2021-01-05 16:46:23 +02:00
allegroai
29ef134b79 Resolve database module naming ambiguity 2021-01-05 16:45:22 +02:00
allegroai
e24389fda9 Add configuration loader 2021-01-05 16:44:31 +02:00
allegroai
f4ead86449 Add support for returning only valid plot events 2021-01-05 16:41:55 +02:00
allegroai
171969c5ea Optimize task artifacts 2021-01-05 16:40:35 +02:00
allegroai
89f81bfe5a Refactor app routes registration 2021-01-05 16:32:21 +02:00
allegroai
b8e62f27e2 Refactor database into a separate class 2021-01-05 16:31:25 +02:00
allegroai
c7bbac73d0 Refactor es_factory into a separate class 2021-01-05 16:29:25 +02:00
allegroai
f832ea565a Use apiserver namespace 2021-01-05 16:28:49 +02:00
allegroai
22e9c2b7eb Fix type annotations
Fix obtaining events for tasks moved from private to public
Fix assert_exists() to return company_origin if requested
2021-01-05 16:27:38 +02:00
allegroai
c67a56eb8d Introduce app startup sequence 2021-01-05 16:25:17 +02:00
allegroai
df65e1c7ad Rename server to apiserver 2021-01-05 16:22:34 +02:00