allegroai
8e6fce8d63
Add conda support for read-only pre-built environment (pass conda folder as docker_cmd on Task).
...
Fix conda restore prebuild tar.gz file, fix conda prefix by call conda-unpack from unzipped conda env.
2020-10-15 23:25:57 +03:00
allegroai
eb942cfedd
Add agent.package_manager.conda_env_as_base_docker allowing "docker_cmd" to contain link to a full pre-packaged conda environment (conda-pack outputs a tar.gz). Use TRAINS_CONDA_ENV_PACKAGE to specify conda tar.gz file.
2020-10-15 23:23:46 +03:00
allegroai
a2156e73bf
Fix conda pip freeze to be consistent with trains 0.16.3
2020-10-11 11:25:35 +03:00
allegroai
9fe77f3c28
Fix conda environment support for trains 0.16.3 full env. Add agent.package_manager.conda_full_env_update to allow conda to update back the requirements (default is false, to preserve previous behavior)
2020-10-11 11:24:52 +03:00
allegroai
6f078afafd
Add Requirement.clone()
2020-10-11 11:21:49 +03:00
allegroai
15f4aa613e
Suppress "\r" when reading a current chunk of a file. Add agent.suppress_carriage_return (default True) to support previous behavior.
2020-10-11 11:21:08 +03:00
allegroai
234d5fac2c
When using force ssh protocol, only enforce on git_host if provided, otherwise apply everywhere
2020-10-05 18:26:21 +03:00
allegroai
6cbfb96ff8
Rename git_domain to git_host
2020-10-05 11:25:03 +03:00
allegroai
6e54e55c31
Add agent.force_git_ssh_port to control https to ssh link conversion for non standard ssh port
2020-10-04 19:42:44 +03:00
allegroai
3ff85b7b85
Replace back package version on conda and pip
2020-10-04 19:41:26 +03:00
allegroai
5640489f57
Replace torch version on pre-installed local file
2020-10-04 19:40:39 +03:00
allegroai
8135a6facf
Add agent.git_domain setting for limiting git credential usage for a specific domain (env var TRAINS_AGENT_GIT_DOMAIN is also supported)
2020-10-04 19:40:04 +03:00
allegroai
b6ae4f211d
Fix "package @ " should processed by us (pip will not test pre-installed version of the package compared with the link)
2020-10-04 19:38:33 +03:00
allegroai
a56f032ec4
Fix torch support to not change back the same link
2020-10-04 19:37:12 +03:00
allegroai
075736de20
Translate downloaded URL back to original link when new pip version is installed (otherwise we end up with file:///... links)
2020-10-04 19:36:14 +03:00
allegroai
d8543c892e
When new pip version is installed, no need to install git packages twice (pip freeze will detect the correct git link version)
2020-10-04 19:35:26 +03:00
allegroai
c7a739fafa
Add support for detecting new pip version (20+) supporting @ in requirements
2020-10-04 19:33:52 +03:00
allegroai
3bed0ef33c
Add protection against bad file name parsing in git diff apply
2020-10-04 19:31:48 +03:00
allegroai
d419fa1e4f
Update torch version after using system pre-installed version
2020-10-04 19:29:47 +03:00
allegroai
31a56c71bd
Add preliminary agent uptime/downtime support
2020-09-29 19:34:51 +03:00
allegroai
28f47419b0
Fix incorrect check for spaces in current execution folder (only check in cache folders)
2020-09-15 20:26:02 +03:00
allegroai
6a24da2849
Add post_packages post_optional_packages to control packages installed after all the rest (e.g. horovod)
...
Rename CythonReq to PriorityPackageRequirement and HorovodReq to PostRequirement
2020-09-15 20:20:55 +03:00
allegroai
aaf8d802e7
Update documentation
2020-09-05 16:37:17 +03:00
allegroai
ca89a1e322
Fix pre-installed packages are ignored when installing a git package wheel. Reinstalling a git+http link is enough to make sure all requirements are met/installed (trains issue #196 )
2020-09-05 16:37:17 +03:00
allegroai
4aacf9005e
Fix GPU Windows monitoring support (Trains Issue #177 )
2020-08-10 08:07:51 +03:00
allegroai
ce6831368f
Fix GPU monitoring on Windows machines
2020-08-08 14:43:25 +03:00
allegroai
e4111c830b
Fix GIT user/pass in requirements and support for '-e git+http' lines
2020-07-30 14:30:23 +03:00
allegroai
52c1772b04
Add requirement_parser into trains-agent instead as a dependency. Fix requirement_parser to support 'package @ git+http' lines
2020-07-30 14:29:37 +03:00
allegroai
17d2bf2a3e
Change daemon --stop without any specific flag to terminate the agents by worker id lexicographic order
2020-07-11 01:43:54 +03:00
allegroai
94997f9c88
Add daemon --order-fairness for round-robin queue pulling
...
Add daemon --stop to terminate running agent (assume all the rest of the arguments are the same)
Clean up all log files on termination unless executed with --debug
2020-07-11 01:42:56 +03:00
allegroai
c6d998c4df
Add terminate process and rmtree utilities
2020-07-11 01:40:50 +03:00
allegroai
1f53a06299
Add agent.force_git_ssh_protocol option to force all git links to ssh:// (issue #16 )
...
Add git user/pass credentials for pip git packages (git+http and git+ssh) (issue #22 )
2020-06-18 01:55:14 +03:00
allegroai
54d9d77294
Allow services mode to re-register (docker can kill it and not exit gracefully)
2020-06-01 16:34:33 +03:00
allegroai
566427d550
Fix build failing due to missing session
2020-05-31 14:02:42 +03:00
allegroai
cc99077c92
Do not monitor GPU when running with --cpu-only
2020-05-31 14:01:14 +03:00
allegroai
22c5f043aa
Fix detached mode to correctly use cache folder slots
2020-05-31 14:00:14 +03:00
allegroai
f6be64a4b5
Print conda install output if running in debug mode, turn on debugging if --debug flag is used
2020-05-09 20:11:01 +03:00
allegroai
21f6a73f66
Include CUDA version in the pytorch package fail error
2020-05-09 20:09:18 +03:00
allegroai
77c4c79a2f
Support pip 20.1 local/http package reference in pip freeze
2020-05-09 20:08:17 +03:00
allegroai
2ad929fa00
Add torch_nightly flag support (if torch wheel is not found on stable try the nightly builds), improve support for torch in freeze (add actually used HTTP link as comment to the original package)
2020-05-09 20:08:05 +03:00
allegroai
53f511f536
Improve docker host-mount support, use TRAINS_AGENT_DOCKER_HOST_MOUNT env var
2020-05-09 20:02:46 +03:00
allegroai
272fa07c29
Fix and enhance "build --docker"
...
- Fix standalone docker execution
- Add --install-globally option to install required packages in the docker's system python
- Add --entry-point option to allow automatic task cloning when running the docker
2020-05-09 19:57:25 +03:00
allegroai
6ce9cf7c2a
Fix version control links in requirements when using conda
2020-05-09 19:52:51 +03:00
allegroai
fce8eb6782
Add OS environment configuration for git user/pass using TRAINS_AGENT_GIT_USER/TRAINS_AGENT_GIT_PASS
2020-05-09 19:46:46 +03:00
allegroai
61232d05dd
Fix run as user support in Windows and add fall-back for created user folders
2020-03-22 19:16:11 +02:00
allegroai
b3418e4496
Add daemon detached mode (--detached, -d) that runs agent in the background and returns immediately
2020-03-22 19:00:29 +02:00
allegroai
5ef627165c
Fix PyTorch support to ignore minor versions when looking for package to install or to download
2020-03-20 10:48:48 +02:00
allegroai
98a983d9a2
Add TRAINS_AGENT_EXTRA_PYTHON_PATH to allow adding additional python path for task execution (helpful when using extra untracked modules)
2020-03-20 10:46:56 +02:00
allegroai
94bb11a81a
Change message when using local torch
2020-03-20 10:37:42 +02:00
allegroai
389600b91e
Fix git checkout with submodules
2020-03-12 18:39:47 +02:00
