Update env-configuration.md

This commit is contained in:
Timothy Jaeryang Baek 2025-04-08 13:53:03 -07:00
parent 6f00a3fb8e
commit 4e85efc52a

View File

@ -245,8 +245,13 @@ allowing the client to wait indefinitely.
#### `AIOHTTP_CLIENT_TIMEOUT_MODEL_LIST` #### `AIOHTTP_CLIENT_TIMEOUT_MODEL_LIST`
- Type: `int` - Type: `int`
- Default: `10`
- Description: Sets the timeout in seconds for fetching the model list. This can be useful in cases where network latency requires a longer timeout duration to successfully retrieve the model list. - Description: Sets the timeout in seconds for fetching the model list. This can be useful in cases where network latency requires a longer timeout duration to successfully retrieve the model list.
:::note
The AIOHTTP_CLIENT_TIMEOUT_MODEL_LIST is set to 10 seconds by default to help ensure that all necessary connections are available when opening the web UI. This duration allows enough time for retrieving the model list even in cases of higher network latency. You can lower this value if quicker timeouts are preferred, but keep in mind that doing so may lead to some connections being dropped depending on your network conditions.
:::
#### `AIOHTTP_CLIENT_TIMEOUT_OPENAI_MODEL_LIST` #### `AIOHTTP_CLIENT_TIMEOUT_OPENAI_MODEL_LIST`
- Type: `int` - Type: `int`