allegroai
259113c989
Add PackageCollectorRequirement to allow multiple entries of the same package
2020-12-06 12:16:56 +02:00
allegroai
1afa3a3914
Add torchcsprng and torchtext to PyTorch resolving. Improve debug prints on auto cuda version resolving.
2020-12-06 12:15:12 +02:00
allegroai
448e23825c
Fix requirements dict with null entry in pip should be considered None and we should install from requirements.txt
2020-12-06 12:14:22 +02:00
allegroai
b0c0f41f62
Allow zero context diffs (useful when blind patching repository)
2020-12-06 12:13:28 +02:00
allegroai
b89cf4ec23
version bump
2020-11-29 23:17:50 +02:00
allegroai
74b646af9e
Add pass TRAINS_DOCKER_IMAGE into docker for interactive sessions
2020-11-29 23:16:40 +02:00
allegroai
0cf485f7a9
Improve k8s nvidia container integration
2020-11-26 01:15:49 +02:00
allegroai
58eb5fbd5f
Fix torch CUDA 11.1 support
2020-11-26 01:14:36 +02:00
allegroai
a8c543ef7b
Fix nvidia pytorch dockers support
2020-11-25 16:45:09 +02:00
allegroai
64e198a57a
Fix nvidia docker support on some linux distros (SUSE)
2020-11-25 16:44:37 +02:00
allegroai
60eeff292d
version bump
2020-11-11 17:11:51 +02:00
allegroai
52f30b306a
Fix git diff with empty line at the end of the git diff will cause corrupt diff apply message
2020-11-11 17:11:28 +02:00
allegroai
6df0f81ca0
Fix uid is None causes ValueError in str.startswith(). Fix str.split (should be on the filename itself, not the path).
2020-11-11 16:32:47 +02:00
allegroai
40b3c1502d
Add extra_bash_init_script to k8s glue. Default config is the raw config file (not created at runtime)
2020-11-11 16:31:25 +02:00
allegroai
a61265effe
Improve trying to find conda executable
2020-11-11 16:29:50 +02:00
allegroai
92efea6b76
Add agent.package_manager.force_repo_requirements_txt. If True, "Installed Packages" on Task are ignored, and only repo requirements.txt is used
2020-11-11 16:29:00 +02:00
allegroai
216b3e2179
Allow to specifying cudatoolkit version in "installed packages" when using Conda as package manager (trains issue #229 )
2020-10-30 10:06:02 +02:00
allegroai
293a92f486
Improve k8s glue add --template-yaml
2020-10-23 01:28:22 +03:00
allegroai
6bad2b5352
Fix support non-ascii git diff
2020-10-23 01:27:59 +03:00
allegroai
a09a638b9c
Improve k8s glue layer
2020-10-22 18:09:56 +03:00
allegroai
24f57270ed
version bump
2020-10-22 18:09:23 +03:00
allegroai
1b7964ce98
Add k8s select external trains.conf file for the pod itself
2020-10-21 19:04:38 +03:00
allegroai
5a510882b8
Ignore environment SSH_AUTH_SOCK. Only check if git_user/pass are configured, if they are not, leave the links as they are
2020-10-21 19:02:29 +03:00
allegroai
601ed03198
Add support for k8s pod custom user properties
2020-10-20 23:48:02 +03:00
allegroai
90fe4570b9
Show k8s pod number in task's User Properties configuration section
2020-10-20 23:27:04 +03:00
allegroai
92fc8e838f
Add K8s glue support for limited number of services exposing ports
2020-10-20 14:17:30 +03:00
allegroai
89a3020c5e
Fix ubuntu/debian support by making sure not to ask for input (fix tzdata install)
2020-10-15 23:32:17 +03:00
allegroai
fc3e47b67e
Add suppress_carriage_return to documentation
...
Add docker_preprocess_bash_script to allow preprocessing bash to be added
Fix multiple python versions installed in the same docker by finding the highest installed python inside the docker
Fix conda_env_as_base_docker not set to False in docker mode
2020-10-15 23:31:01 +03:00
allegroai
14655f19a0
Fix conda PYTHONPATH (point only to code, not to venv)
2020-10-15 23:26:58 +03:00
allegroai
47092c47db
Fix apply git diff from submodule only
2020-10-15 23:26:52 +03:00
allegroai
8e6fce8d63
Add conda support for read-only pre-built environment (pass conda folder as docker_cmd on Task).
...
Fix conda restore prebuild tar.gz file, fix conda prefix by call conda-unpack from unzipped conda env.
2020-10-15 23:25:57 +03:00
allegroai
3c514e3418
Make sure TRAINS_AGENT_K8S_HOST_MOUNT is used only once per mount
2020-10-15 23:24:51 +03:00
allegroai
8a425b100b
Fix k8s glue script to trains-agent default docker script
2020-10-15 23:24:21 +03:00
allegroai
eb942cfedd
Add agent.package_manager.conda_env_as_base_docker allowing "docker_cmd" to contain link to a full pre-packaged conda environment (conda-pack outputs a tar.gz). Use TRAINS_CONDA_ENV_PACKAGE to specify conda tar.gz file.
2020-10-15 23:23:46 +03:00
allegroai
a2156e73bf
Fix conda pip freeze to be consistent with trains 0.16.3
2020-10-11 11:25:35 +03:00
allegroai
9fe77f3c28
Fix conda environment support for trains 0.16.3 full env. Add agent.package_manager.conda_full_env_update to allow conda to update back the requirements (default is false, to preserve previous behavior)
2020-10-11 11:24:52 +03:00
allegroai
6f078afafd
Add Requirement.clone()
2020-10-11 11:21:49 +03:00
allegroai
15f4aa613e
Suppress "\r" when reading a current chunk of a file. Add agent.suppress_carriage_return (default True) to support previous behavior.
2020-10-11 11:21:08 +03:00
allegroai
7cd9fa6c41
Version bump to v0.16.1
2020-10-05 18:27:07 +03:00
allegroai
234d5fac2c
When using force ssh protocol, only enforce on git_host if provided, otherwise apply everywhere
2020-10-05 18:26:21 +03:00
allegroai
6cbfb96ff8
Rename git_domain to git_host
2020-10-05 11:25:03 +03:00
allegroai
6e54e55c31
Add agent.force_git_ssh_port to control https to ssh link conversion for non standard ssh port
2020-10-04 19:42:44 +03:00
allegroai
3ff85b7b85
Replace back package version on conda and pip
2020-10-04 19:41:26 +03:00
allegroai
5640489f57
Replace torch version on pre-installed local file
2020-10-04 19:40:39 +03:00
allegroai
8135a6facf
Add agent.git_domain setting for limiting git credential usage for a specific domain (env var TRAINS_AGENT_GIT_DOMAIN is also supported)
2020-10-04 19:40:04 +03:00
allegroai
b6ae4f211d
Fix "package @ " should processed by us (pip will not test pre-installed version of the package compared with the link)
2020-10-04 19:38:33 +03:00
allegroai
a56f032ec4
Fix torch support to not change back the same link
2020-10-04 19:37:12 +03:00
allegroai
075736de20
Translate downloaded URL back to original link when new pip version is installed (otherwise we end up with file:///... links)
2020-10-04 19:36:14 +03:00
allegroai
d8543c892e
When new pip version is installed, no need to install git packages twice (pip freeze will detect the correct git link version)
2020-10-04 19:35:26 +03:00
allegroai
ca0870b048
Allow parsing of "package @ scheme://link" lines in requirements
2020-10-04 19:34:32 +03:00
