ClearML/clearml-agent
1
0
Fork 0
mirror of https://github.com/clearml/clearml-agent synced 2025-02-07 05:19:17 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity

Update README

Browse Source
This commit is contained in:
allegroai 2024-01-25 11:27:56 +02:00
parent c9fc092f4e
commit 95dde6ca0c
1 changed files with 10 additions and 17 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

15
README.md
View File

@ -78,20 +78,13 @@ Find Dockerfiles in the [docker](./docker) dir and a helm Chart in https://githu
- Seamless integration with ML/DL experiment manager - Seamless integration with ML/DL experiment manager
- Web UI for customization, scheduling & prioritization of jobs - Web UI for customization, scheduling & prioritization of jobs
**Two K8s integration flavours** **Run the agent in Kubernetes Glue mode an map ClearML jobs directly to K8s jobs:**
- Use the [ClearML Agent Helm Chart](https://github.com/allegroai/clearml-helm-charts/tree/main/charts/clearml-agent) to spin an agent pod acting as a controller
- Spin ClearML-Agent as a long-lasting service pod: - Alternatively (less recommended) run the [clearml-k8s glue](https://github.com/allegroai/clearml-agent/blob/master/examples/k8s_glue_example.py) on
- Use [clearml-agent](https://hub.docker.com/r/allegroai/clearml-agent) docker image
- map docker socket into the pod (soon replaced by [podman](https://github.com/containers/podman))
- Allow the clearml-agent to manage sibling dockers
- Benefits: full use of the ClearML scheduling, no need to worry about wrong container images / lost pods etc.
- Downside: sibling containers
- Kubernetes Glue, map ClearML jobs directly to K8s jobs:
- Run the [clearml-k8s glue](https://github.com/allegroai/clearml-agent/blob/master/examples/k8s_glue_example.py) on
a K8s cpu node a K8s cpu node
- The clearml-k8s glue pulls jobs from the ClearML job execution queue and prepares a K8s job (based on provided - The clearml-k8s glue pulls jobs from the ClearML job execution queue and prepares a K8s job (based on provided
yaml template) yaml template)
- Inside the pod itself the clearml-agent will install the job (experiment) environment and spin and monitor the - Inside each task pod itself the clearml-agent will install the job (experiment) environment and spin and monitor the
experiment's process experiment's process
- Benefits: Kubernetes full view of all running jobs in the system - Benefits: Kubernetes full view of all running jobs in the system
- Downside: No real scheduling (k8s scheduler), no docker image verification (post-mortem only) - Downside: No real scheduling (k8s scheduler), no docker image verification (post-mortem only)