allegroai
14655f19a0
Fix conda PYTHONPATH (point only to code, not to venv)
2020-10-15 23:26:58 +03:00
allegroai
47092c47db
Fix apply git diff from submodule only
2020-10-15 23:26:52 +03:00
allegroai
8e6fce8d63
Add conda support for read-only pre-built environment (pass conda folder as docker_cmd on Task).
...
Fix conda restore prebuild tar.gz file, fix conda prefix by call conda-unpack from unzipped conda env.
2020-10-15 23:25:57 +03:00
allegroai
3c514e3418
Make sure TRAINS_AGENT_K8S_HOST_MOUNT is used only once per mount
2020-10-15 23:24:51 +03:00
allegroai
8a425b100b
Fix k8s glue script to trains-agent default docker script
2020-10-15 23:24:21 +03:00
allegroai
eb942cfedd
Add agent.package_manager.conda_env_as_base_docker allowing "docker_cmd" to contain link to a full pre-packaged conda environment (conda-pack outputs a tar.gz). Use TRAINS_CONDA_ENV_PACKAGE to specify conda tar.gz file.
2020-10-15 23:23:46 +03:00
allegroai
a2156e73bf
Fix conda pip freeze to be consistent with trains 0.16.3
2020-10-11 11:25:35 +03:00
allegroai
9fe77f3c28
Fix conda environment support for trains 0.16.3 full env. Add agent.package_manager.conda_full_env_update to allow conda to update back the requirements (default is false, to preserve previous behavior)
2020-10-11 11:24:52 +03:00
allegroai
6f078afafd
Add Requirement.clone()
2020-10-11 11:21:49 +03:00
allegroai
15f4aa613e
Suppress "\r" when reading a current chunk of a file. Add agent.suppress_carriage_return (default True) to support previous behavior.
2020-10-11 11:21:08 +03:00
allegroai
7cd9fa6c41
Version bump to v0.16.1
2020-10-05 18:27:07 +03:00
allegroai
234d5fac2c
When using force ssh protocol, only enforce on git_host if provided, otherwise apply everywhere
2020-10-05 18:26:21 +03:00
allegroai
6cbfb96ff8
Rename git_domain to git_host
2020-10-05 11:25:03 +03:00
allegroai
6e54e55c31
Add agent.force_git_ssh_port to control https to ssh link conversion for non standard ssh port
2020-10-04 19:42:44 +03:00
allegroai
3ff85b7b85
Replace back package version on conda and pip
2020-10-04 19:41:26 +03:00
allegroai
5640489f57
Replace torch version on pre-installed local file
2020-10-04 19:40:39 +03:00
allegroai
8135a6facf
Add agent.git_domain setting for limiting git credential usage for a specific domain (env var TRAINS_AGENT_GIT_DOMAIN is also supported)
2020-10-04 19:40:04 +03:00
allegroai
b6ae4f211d
Fix "package @ " should processed by us (pip will not test pre-installed version of the package compared with the link)
2020-10-04 19:38:33 +03:00
allegroai
a56f032ec4
Fix torch support to not change back the same link
2020-10-04 19:37:12 +03:00
allegroai
075736de20
Translate downloaded URL back to original link when new pip version is installed (otherwise we end up with file:///... links)
2020-10-04 19:36:14 +03:00
allegroai
d8543c892e
When new pip version is installed, no need to install git packages twice (pip freeze will detect the correct git link version)
2020-10-04 19:35:26 +03:00
allegroai
ca0870b048
Allow parsing of "package @ scheme://link" lines in requirements
2020-10-04 19:34:32 +03:00
allegroai
c7a739fafa
Add support for detecting new pip version (20+) supporting @ in requirements
2020-10-04 19:33:52 +03:00
allegroai
7170296162
Remove warning on '.' (same as an empty working directory)
2020-10-04 19:32:48 +03:00
allegroai
3bed0ef33c
Add protection against bad file name parsing in git diff apply
2020-10-04 19:31:48 +03:00
allegroai
d419fa1e4f
Update torch version after using system pre-installed version
2020-10-04 19:29:47 +03:00
allegroai
31a56c71bd
Add preliminary agent uptime/downtime support
2020-09-29 19:34:51 +03:00
allegroai
28f47419b0
Fix incorrect check for spaces in current execution folder (only check in cache folders)
2020-09-15 20:26:02 +03:00
allegroai
6a24da2849
Add post_packages post_optional_packages to control packages installed after all the rest (e.g. horovod)
...
Rename CythonReq to PriorityPackageRequirement and HorovodReq to PostRequirement
2020-09-15 20:20:55 +03:00
allegroai
782668fd21
Add sdk.metrics.plot_max_num_digits to reduce plot storage size
2020-09-05 16:37:17 +03:00
allegroai
aaf8d802e7
Update documentation
2020-09-05 16:37:17 +03:00
allegroai
ca89a1e322
Fix pre-installed packages are ignored when installing a git package wheel. Reinstalling a git+http link is enough to make sure all requirements are met/installed (trains issue #196 )
2020-09-05 16:37:17 +03:00
allegroai
121dec2a62
Version bump to v0.16.0
2020-08-10 17:28:00 +03:00
allegroai
4aacf9005e
Fix GPU Windows monitoring support (Trains Issue #177 )
2020-08-10 08:07:51 +03:00
allegroai
6b333202e9
Sync generated conf file with latest Trains
2020-08-08 14:44:45 +03:00
allegroai
ce6831368f
Fix GPU monitoring on Windows machines
2020-08-08 14:43:25 +03:00
allegroai
e4111c830b
Fix GIT user/pass in requirements and support for '-e git+http' lines
2020-07-30 14:30:23 +03:00
allegroai
52c1772b04
Add requirement_parser into trains-agent instead as a dependency. Fix requirement_parser to support 'package @ git+http' lines
2020-07-30 14:29:37 +03:00
allegroai
699d13bbb3
Fix task status change to queued should also never happen during Task runtime
2020-07-14 23:42:11 +03:00
allegroai
2c8d7d3d9a
Fix --debug to set all specified loggers to DEBUG
...
Add set_urllib_log_level, in debug set urllib log level to DEBUG
2020-07-11 01:45:46 +03:00
allegroai
b13cc1e8e7
Add error message when Trains API Server is not accessible on startup
2020-07-11 01:44:45 +03:00
allegroai
17d2bf2a3e
Change daemon --stop without any specific flag to terminate the agents by worker id lexicographic order
2020-07-11 01:43:54 +03:00
allegroai
94997f9c88
Add daemon --order-fairness for round-robin queue pulling
...
Add daemon --stop to terminate running agent (assume all the rest of the arguments are the same)
Clean up all log files on termination unless executed with --debug
2020-07-11 01:42:56 +03:00
allegroai
c6d998c4df
Add terminate process and rmtree utilities
2020-07-11 01:40:50 +03:00
allegroai
712efa208b
version bump
2020-07-06 21:09:21 +03:00
allegroai
09b6b6a9de
Fix non-root docker image usage
...
Fix broken trains-agent build
Improve support for dockers with preinstalled conda env
Improve trains-agent-docker spinning
2020-07-06 21:09:11 +03:00
allegroai
98ff9a50e6
Changed agent.docker_init_bash_script default value in comment
2020-07-06 21:05:55 +03:00
allegroai
1f4d358316
Changed default docker image from nvidia/cuda to "nvidia/cuda:10.1-runtime-ubuntu18.04" to support cudnn frameworks (TF)
2020-07-02 01:35:57 +03:00
allegroai
f693fa165c
Fix .git-credentials and .gitconfig mapping into docker
...
Add agent.docker_init_bash_script allow finer control over docker startup script
2020-07-02 01:33:13 +03:00
allegroai
c43084825c
Version bump to v0.15.1
2020-06-21 23:23:44 +03:00