clearml-docs/docs/deploying_clearml/enterprise_deploy/appgw.md

title
AI Application Gateway

:::important Enterprise Feature This feature is available under the ClearML Enterprise plan. :::

Services running through a cluster orchestrator such as Kubernetes or cloud hyperscaler require meticulous configuration to make them available as these environments do not expose their networks to external users.

The ClearML AI Application Gateway facilitates setting up secure, authenticated access to jobs running on your compute nodes from external networks.

Using the AI Application Gateway, services are allocated externally accessible, SSL secure network routes which provide access in adherence to ClearML RBAC privileges. The AI Application Gateway supports HTTP/S as well as raw TCP routing.

The following ClearML UI applications make use of the AI Application Gateway to provide authenticated HTTPS access to their instances:

• GPUaaS
  • JupyterLab
  • VScode
  • SSH Session
• UI Dev
  • Gradio launcher
  • Streamlit launcher
• Deploy
  • vLLM Deployment
  • Embedding Model Deployment
  • Llama.cpp Model Deployment

The AI Application Gateway is provided through an additional component to the ClearML Server deployment: The ClearML Task Traffic Router.
If your ClearML Deployment does not have the Task Traffic Router properly installed, these application instances may not be accessible.

Installation

The Task Traffic Router supports two deployment options:

• Docker Compose
• Kubernetes

The deployment configuration specifies the external and internal address and port mappings for routing requests.