allegroai
|
4ac6f88278
|
Optimize Workers retrieval
Store worker statistics under worker id and not internal redis key
Fix unit tests
|
2023-11-17 09:46:44 +02:00 |
|
allegroai
|
a7865ccbec
|
Turn on async task events deletion in case there are more than 100_000 events
|
2023-11-17 09:45:55 +02:00 |
|
allegroai
|
ec14f327c6
|
Optimize endpoints that do not require authorization by not validating JWT token
|
2023-11-17 09:45:22 +02:00 |
|
allegroai
|
a03b24d6b6
|
Add log info on caller IP if token validation fails
|
2023-11-17 09:43:59 +02:00 |
|
allegroai
|
cb71ef8e47
|
Fix missing scroll_id in events.get_scalar_metric_data
|
2023-11-17 09:43:11 +02:00 |
|
allegroai
|
8678fbc995
|
Fix properly unset Task fields on task reset
|
2023-11-17 09:42:39 +02:00 |
|
allegroai
|
58df8f201a
|
Update API to 2.27
|
2023-11-17 09:40:34 +02:00 |
|
allegroai
|
f4bf16c156
|
Fix schema for swagger compatibility
|
2023-11-17 09:39:52 +02:00 |
|
allegroai
|
c1e7f8f9c1
|
Optimize deletion of projects with many tasks
|
2023-11-17 09:38:32 +02:00 |
|
allegroai
|
274c487b37
|
Add update_tags api to tasks and models
|
2023-11-17 09:37:25 +02:00 |
|
allegroai
|
cc0129a800
|
Add filters parameter for passing user defined list filters for all get_all_ex apis
|
2023-11-17 09:36:58 +02:00 |
|
allegroai
|
388dd1b01f
|
Fix regression issue with archive tasks display
|
2023-11-17 09:35:55 +02:00 |
|
allegroai
|
d62ecb5e6e
|
Add last_change and last_change_by DB Model
|
2023-11-17 09:35:22 +02:00 |
|
allegroai
|
6d507616b3
|
Add pattern parameter to projects.get_hyperparam_values
|
2023-11-17 09:34:13 +02:00 |
|
allegroai
|
d0252a6dd9
|
Make sure that hyperparam/configuration/metadata keys that are contain only empty space are rejected
|
2023-11-17 09:32:22 +02:00 |
|
allegroai
|
2263e7cc1e
|
Fix regression with archive tasks display
|
2023-07-31 14:16:08 +03:00 |
|
allegroai
|
81b93e6811
|
Updated dependency - dnspython is a required dependency of pymongo as of pymongo v4.3 (https://pymongo.readthedocs.io/en/stable/changelog.html#changes-in-version-4-3-4-3-2)
|
2023-07-27 11:49:40 +03:00 |
|
allegroai
|
491e83d0f1
|
Version bump to v1.12.0
|
2023-07-26 18:56:04 +03:00 |
|
allegroai
|
f84cc0a2cb
|
Remove 10 metrics limit in multi-task plot comparison
|
2023-07-26 18:55:49 +03:00 |
|
allegroai
|
6c5f966ed4
|
Add new_status field to tasks.dequeue and dequeue_many endpoints
|
2023-07-26 18:55:05 +03:00 |
|
allegroai
|
4eff657810
|
Fix debug images not returned for tasks in new db
|
2023-07-26 18:54:19 +03:00 |
|
allegroai
|
74acaa31df
|
Add explicit refresh interval to ES mappings
Fix queue tests
|
2023-07-26 18:54:02 +03:00 |
|
allegroai
|
21ed8559bf
|
Fix worker keys not returned in queues.get_all_ex
|
2023-07-26 18:51:20 +03:00 |
|
allegroai
|
3927604648
|
Add task names to events.get_single_value_metrics endpoint response
|
2023-07-26 18:50:53 +03:00 |
|
allegroai
|
f7dcbd96ec
|
Fix deleting model events
Add delete_external_artifacts parameter to projects.delete endpoint
|
2023-07-26 18:49:54 +03:00 |
|
allegroai
|
5950b81f0b
|
Fix child tasks count for top level pipeline and dataset projects
|
2023-07-26 18:49:12 +03:00 |
|
allegroai
|
1e51e2e221
|
Allow projection of more than 500 items
|
2023-07-26 18:46:58 +03:00 |
|
allegroai
|
4c98b87554
|
Fix issues with new dependencies
|
2023-07-26 18:46:28 +03:00 |
|
allegroai
|
c196043d2a
|
Add max_download_items to users.get_current_user endpoint response
|
2023-07-26 18:45:42 +03:00 |
|
allegroai
|
752020c66a
|
Update API version to 2.26
|
2023-07-26 18:44:20 +03:00 |
|
allegroai
|
6885d07462
|
Write UTF-8 BOM into csv download file
|
2023-07-26 18:43:38 +03:00 |
|
allegroai
|
00552da1b0
|
Requests context is not needed any more
|
2023-07-26 18:43:09 +03:00 |
|
allegroai
|
eebe2eeffc
|
Update requirements
|
2023-07-26 18:42:26 +03:00 |
|
allegroai
|
bc2fe28bdd
|
Add field_mappings to organizations download endpoints
|
2023-07-26 18:39:41 +03:00 |
|
allegroai
|
ed86750b24
|
Add scalar field type to jsonmodels
|
2023-07-26 18:39:06 +03:00 |
|
allegroai
|
6df69afb25
|
Support "__$or" condition on projects children filtering
|
2023-07-26 18:38:41 +03:00 |
|
allegroai
|
3f22423c3f
|
Support paging in projects.get_model_metadata_values and get_hyperparam_values endpoints
|
2023-07-26 18:38:11 +03:00 |
|
allegroai
|
3ad636c468
|
Exported csv file name now contains the project name (including non-ascii names)
|
2023-07-26 18:37:20 +03:00 |
|
allegroai
|
5c80336aa9
|
Project delete and validate_delete now analyses and presents info for datasets and pipelines
|
2023-07-26 18:36:45 +03:00 |
|
allegroai
|
5cd59ea6e3
|
Fix csv export handling "," in fields
|
2023-07-26 18:35:31 +03:00 |
|
allegroai
|
5d3ba4fa73
|
Fix events.get_multitask_plots to retrieve last iterations per each task metric separately
|
2023-07-26 18:34:30 +03:00 |
|
allegroai
|
42556c8dbb
|
Pipelines children query now looks for pipeline projects and not tasks
|
2023-07-26 18:33:35 +03:00 |
|
allegroai
|
dbe1c6f00f
|
Allow configuring multi-plots batch size
|
2023-07-26 18:33:10 +03:00 |
|
allegroai
|
a17485b1bd
|
Allow dequeueing a deleted task
|
2023-07-26 18:32:32 +03:00 |
|
allegroai
|
a2b9fed92d
|
Make sure that scroll parameters are ignored when downloading tasks
|
2023-07-26 18:31:56 +03:00 |
|
allegroai
|
ff34da3c88
|
Add organization.download_for_get_all endpoint
|
2023-07-26 18:31:20 +03:00 |
|
allegroai
|
5239755066
|
Support include_subprojects flag in reports.get_all_ex endpoint
|
2023-07-26 18:30:34 +03:00 |
|
allegroai
|
8061dfedbb
|
Fix NewListBucketsHelper backwards compatibility
|
2023-07-26 18:27:51 +03:00 |
|
allegroai
|
011164ce9b
|
Support __$and condition for excluded terms in get_all_ex endpoints list filters
|
2023-07-26 18:26:49 +03:00 |
|
allegroai
|
8135cf5258
|
Add include_subprojects to tasks/models.get_all endpoints
Fix escaping metadata for tasks, models and queues
|
2023-07-26 18:24:49 +03:00 |
|
allegroai
|
a83a932e84
|
Add pipelines.delete_runs endpoint
|
2023-07-26 18:23:05 +03:00 |
|
allegroai
|
db021f2863
|
Add workers.get_count endpoint
|
2023-07-26 18:21:52 +03:00 |
|
allegroai
|
1b650b1689
|
Add projects.get_user_names endpoint
|
2023-07-26 18:21:16 +03:00 |
|
allegroai
|
14d18a7aba
|
Remove obsolete duration field
|
2023-07-26 18:19:41 +03:00 |
|
allegroai
|
452f606889
|
Version bump to v1.11
|
2023-05-25 19:40:07 +03:00 |
|
allegroai
|
fc47ccbf09
|
Add default services agent user
|
2023-05-25 19:39:53 +03:00 |
|
allegroai
|
0206811342
|
Improve empty database check during startup
|
2023-05-25 19:39:17 +03:00 |
|
allegroai
|
a3ac1049a3
|
Update ClearML SDK dependency
|
2023-05-25 19:38:48 +03:00 |
|
allegroai
|
9206a7c57d
|
Schedule external file URLs for deletion on models deletion
|
2023-05-25 19:36:28 +03:00 |
|
allegroai
|
0c37ced2a1
|
Fix model Id handling when deleting models for tasks
|
2023-05-25 19:35:18 +03:00 |
|
allegroai
|
b22f26129e
|
Update requirements
|
2023-05-25 19:34:19 +03:00 |
|
allegroai
|
d8b998ebd8
|
Bump API version to 2.25
|
2023-05-25 19:33:37 +03:00 |
|
allegroai
|
741fa84b52
|
Fix projects own_tasks does not take task state filter into account
|
2023-05-25 19:32:52 +03:00 |
|
allegroai
|
d9579891c8
|
Return only reports from the .reports projects in reports.get_all_ex
|
2023-05-25 19:31:05 +03:00 |
|
allegroai
|
900414d0de
|
Add option to echo ping payload
|
2023-05-25 19:30:13 +03:00 |
|
allegroai
|
5449b332d2
|
Support reports from the root project in reports.get_all_ex
|
2023-05-25 19:29:46 +03:00 |
|
allegroai
|
875f4b9536
|
Fix task dequeue will changes status for un-queued/running tasks
|
2023-05-25 19:28:49 +03:00 |
|
allegroai
|
4058fb9ce5
|
Migrate to python 3.9 bullseye docker images
Update Mongo driver version
|
2023-05-25 19:27:14 +03:00 |
|
allegroai
|
cf8e847ed3
|
Switch to new redis version
|
2023-05-25 19:22:39 +03:00 |
|
allegroai
|
755cc803d9
|
Add remove_from_all_queues parameter to tasks.dequeue/dequeue_many endpoints
|
2023-05-25 19:22:10 +03:00 |
|
allegroai
|
3729afe014
|
Optimize queues.get_next_task to retrieve required task fields only
|
2023-05-25 19:21:24 +03:00 |
|
allegroai
|
dff2ed34e8
|
Support receiving mixed events for both locked and unlocked tasks and models events.add_batch
|
2023-05-25 19:20:35 +03:00 |
|
allegroai
|
de9651d761
|
Allow mixing Model and task events in the same events batch
|
2023-05-25 19:19:45 +03:00 |
|
allegroai
|
818496236b
|
Support filtering by children tags in projects.get_all_ex
|
2023-05-25 19:19:10 +03:00 |
|
allegroai
|
e99817b28b
|
Task reports can now return single value metrics
|
2023-05-25 19:18:24 +03:00 |
|
allegroai
|
58465fbc17
|
Model events are fully supported
|
2023-05-25 19:17:40 +03:00 |
|
allegroai
|
2e4e060a82
|
Task move forward/backwards in queue is now atomic
|
2023-05-25 19:16:33 +03:00 |
|
allegroai
|
5c5d9b6434
|
Fix numeric hyperparam values are not sorted lexicographically with descending sort order
|
2023-05-25 19:15:59 +03:00 |
|
allegroai
|
4291ad682a
|
Support filtering by task name in projects.get_task_parent
|
2023-05-25 19:15:26 +03:00 |
|
allegroai
|
4c22757002
|
Fix task that is not in queue but has 'queued' status can't be dequeued
|
2023-05-25 19:14:25 +03:00 |
|
allegroai
|
6e777e80b8
|
Cleaned up unit tests
|
2023-05-25 19:13:10 +03:00 |
|
dependabot[bot]
|
b51aa5c29b
|
Bump redis from 3.5.3 to 4.4.4 in /apiserver (#190)
Bumps [redis](https://github.com/redis/redis-py) from 3.5.3 to 4.4.4.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](https://github.com/redis/redis-py/compare/3.5.3...v4.4.4)
---
updated-dependencies:
- dependency-name: redis
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
|
2023-04-01 08:59:02 +03:00 |
|
allegroai
|
e7c9daa42b
|
Fix get_task_events to correctly use last_iters for model events
|
2023-03-28 16:45:44 +03:00 |
|
allegroai
|
7357654249
|
Version bump to v1.10
|
2023-03-23 19:17:00 +02:00 |
|
allegroai
|
17a8b440bd
|
Fix only last event of each type is stored per model (all should be stored)
|
2023-03-23 19:16:30 +02:00 |
|
allegroai
|
eb2b9cbd9a
|
Fix project count for datasets and pipelines
|
2023-03-23 19:15:42 +02:00 |
|
allegroai
|
30cfdac8f2
|
Fix project preview completed_tasks_24h should not count tasks that are marked as failed or running
|
2023-03-23 19:13:52 +02:00 |
|
allegroai
|
24bb87aaee
|
Turn on mongo sorting using disk usage by default for sorting in *.get_all* apis
|
2023-03-23 19:12:52 +02:00 |
|
allegroai
|
dd49ba180a
|
Improve statistics on projects children
|
2023-03-23 19:11:45 +02:00 |
|
allegroai
|
bda903d0d8
|
Set API version to 2.24
|
2023-03-23 19:11:13 +02:00 |
|
allegroai
|
9739eb2d5a
|
Add report_assets field to report tasks
|
2023-03-23 19:09:03 +02:00 |
|
allegroai
|
cfbb37238f
|
Add default workers timeout to the server's configuration
|
2023-03-23 19:08:11 +02:00 |
|
allegroai
|
6664c6237e
|
Support querying by children_type in projects.get_all_ex
|
2023-03-23 19:07:42 +02:00 |
|
allegroai
|
74200a24bd
|
Add filtering on child projects in projects.get_all_ex
|
2023-03-23 19:06:49 +02:00 |
|
allegroai
|
3a2675abe1
|
Version bump to v1.9.2
|
2023-01-24 16:11:21 +02:00 |
|
allegroai
|
f0d68b1ce9
|
Make sure model label values are integer
|
2023-01-24 16:11:12 +02:00 |
|
allegroai
|
15db9cdaef
|
Allow updating comments on published reports
|
2023-01-24 14:40:32 +02:00 |
|
allegroai
|
b1a50c1370
|
Version bump to v1.9.1
|
2023-01-03 12:16:07 +02:00 |
|
allegroai
|
22a2a02760
|
Allow renaming published reports
|
2023-01-03 12:15:44 +02:00 |
|
allegroai
|
ab798e4170
|
Allow updating tags on published reports
|
2023-01-03 12:15:02 +02:00 |
|
allegroai
|
f09ac672d2
|
Add pipeline test
|
2023-01-03 12:14:12 +02:00 |
|
allegroai
|
2149b76f63
|
Fix crash when starting pipeline
|
2023-01-03 12:13:48 +02:00 |
|
allegroai
|
d96420aa67
|
Version bump to v1.9
|
2022-12-21 18:47:03 +02:00 |
|
allegroai
|
ed6c7b7bcb
|
Fix Project time is not updated when moved or merged
|
2022-12-21 18:46:53 +02:00 |
|
allegroai
|
a392bc0bd7
|
Bump API version to 2.23
|
2022-12-21 18:46:12 +02:00 |
|
allegroai
|
7e97ec5555
|
Fix events.get_task_plots endpoint
|
2022-12-21 18:45:17 +02:00 |
|
allegroai
|
9c41124b81
|
Add support for moving objects to projects root
|
2022-12-21 18:43:45 +02:00 |
|
allegroai
|
14ff639bb0
|
Removed limit on event comparison for the same company tasks only
|
2022-12-21 18:42:40 +02:00 |
|
allegroai
|
e66257761a
|
Add support for server-side delete for AWS S3, Google Storage and Azure Blob Storage
|
2022-12-21 18:41:16 +02:00 |
|
allegroai
|
0ffde24dc2
|
Add min and max value iteration to last metrics
|
2022-12-21 18:36:50 +02:00 |
|
allegroai
|
d4fdcd9b32
|
Upgrade mongoengine version
|
2022-12-21 18:35:23 +02:00 |
|
allegroai
|
18570bfccb
|
Add project_id response field to reports.create endpoint
|
2022-12-21 18:35:14 +02:00 |
|
allegroai
|
54ce6c34c6
|
Fix bad field values might cause ugly server exception to be returned
|
2022-12-21 18:33:28 +02:00 |
|
allegroai
|
ae4c33fa0e
|
Add support for allow_public flag in get_all_ex endpoint
Add `last_changed_by` field on task updates
Fix reports support
|
2022-12-21 18:32:56 +02:00 |
|
allegroai
|
c7cd949fd0
|
Add reports support
Fix schema
|
2022-12-21 18:30:54 +02:00 |
|
allegroai
|
1ce4058157
|
Change tasks comparison limit to 100
|
2022-12-21 18:29:49 +02:00 |
|
allegroai
|
7b6f24b24d
|
Version bump to 1.8.0
|
2022-11-29 17:50:32 +02:00 |
|
allegroai
|
d03a931d84
|
Remove buggy debug code
|
2022-11-29 17:50:17 +02:00 |
|
allegroai
|
5cc7199661
|
Fix clearing ES scroll
|
2022-11-29 17:44:31 +02:00 |
|
allegroai
|
6537e9ef69
|
Add active_users and search_hidden options to get_entities_count endpoint
|
2022-11-29 17:44:19 +02:00 |
|
allegroai
|
930aaff791
|
Fix test
|
2022-11-29 17:43:43 +02:00 |
|
allegroai
|
9db14cc31d
|
Update endpoint API versions
|
2022-11-29 17:42:19 +02:00 |
|
allegroai
|
e3cc689528
|
Enhance async_urls_delete feature with max_async_deleted_events_per_sec setting and fileserver timeout and prefixes
|
2022-11-29 17:41:49 +02:00 |
|
allegroai
|
9e0adc77dd
|
Make sure id field is included in ordering
|
2022-11-29 17:40:09 +02:00 |
|
allegroai
|
58d9a64537
|
Fix endpoint name in schema
|
2022-11-29 17:39:35 +02:00 |
|
allegroai
|
d397d2ae20
|
Support optional async events deletion when deleting tasks
|
2022-11-29 17:38:41 +02:00 |
|
allegroai
|
2d711e1500
|
Collect model event URLs during task and project cleanup
|
2022-11-29 17:38:03 +02:00 |
|
allegroai
|
97992b0d9e
|
Support returning multiple plots during history navigation
|
2022-11-29 17:37:30 +02:00 |
|
allegroai
|
bc23f1b0cf
|
Add "queue watched" indication for tasks.enqueue and tasks.enqueue_many
|
2022-11-29 17:36:41 +02:00 |
|
allegroai
|
6b3eff1426
|
Support workers system tags
|
2022-11-29 17:35:25 +02:00 |
|
allegroai
|
caaf801cd0
|
Support plots navigation by iteration
|
2022-11-29 17:34:57 +02:00 |
|
allegroai
|
c23e8a90d0
|
Support model events
|
2022-11-29 17:34:06 +02:00 |
|
allegroai
|
fa5b28ca0e
|
Support HTTP URLs when deleting fileserver files
|
2022-11-29 17:33:18 +02:00 |
|
allegroai
|
bfb55a9463
|
Support deleting external artifacts when deleting projects
|
2022-11-29 17:32:41 +02:00 |
|
allegroai
|
37e485e1f2
|
Upgrade API version to 2.22
|
2022-11-29 17:29:57 +02:00 |
|
allegroai
|
3451ff441f
|
Fix projects.get_all_ex with active_users filtering did not work if the project id was passed as a string and not list
|
2022-11-29 17:27:54 +02:00 |
|
allegroai
|
53c9b5525e
|
Add preliminary support for datasets under projects
|
2022-11-29 17:27:02 +02:00 |
|
PSL
|
e5230edac3
|
Add mongo username and password authentication (#162)
Co-authored-by: pangshaoliang <pangshaoliang@megvii.com>
|
2022-10-08 15:56:02 +03:00 |
|
allegroai
|
482a5c34bc
|
Version bump to 1.7.0
|
2022-09-29 19:40:20 +03:00 |
|
allegroai
|
ee2a72c70f
|
Add company/uri index
|
2022-09-29 19:40:05 +03:00 |
|
allegroai
|
de1f823213
|
Removed stub timing context
|
2022-09-29 19:37:15 +03:00 |
|
allegroai
|
0c9e2f92ee
|
Add server-side support for deleting files from fileserver on task delete
|
2022-09-29 19:34:24 +03:00 |
|
allegroai
|
6c49e96ff0
|
Update API version to 2.21
|
2022-09-29 19:31:42 +03:00 |
|
allegroai
|
81e3fc6577
|
Improve utilities
|
2022-09-29 19:30:57 +03:00 |
|
allegroai
|
e6dc4b7557
|
Set cloned task parent to original task if original task has no parent
|
2022-09-29 19:30:13 +03:00 |
|
allegroai
|
238a47a197
|
Add created field to backend.user
|
2022-09-29 19:29:36 +03:00 |
|
allegroai
|
04e7076628
|
Add support for specifying a specific task ID in queues.get_next_task
|
2022-09-29 19:27:42 +03:00 |
|
allegroai
|
0531612bf4
|
Fix deleting a queue should dequeue all enqueued tasks
|
2022-09-29 19:27:09 +03:00 |
|
allegroai
|
3ae410a1e9
|
Remove the ThreadsManager.terminating flag
|
2022-09-29 19:23:26 +03:00 |
|
allegroai
|
98ed3075dd
|
Added exclude support when converting mongo objects to dictionary
|
2022-09-29 19:21:28 +03:00 |
|