Commit Graph

46 Commits

Author SHA1 Message Date
John Karabudak
958fe9639a fix: ComfyUI generation no longer causes FastAPI to stall for all users
as the get_images() function involves a `while True` loop while waiting for a response from ComfyUI and is not async, when image generation is running the entire UI becomes unresponsive for all users.

furthermore, when image generation takes too long, the Docker health check starts failing.

this is certainly a bad fix as it does not convert everything to async, but rather just puts the blocking loop in a separate thread. however, it works and it at least fixes the problem for now.
2024-08-07 22:24:55 -02:30
Timothy J. Baek
8062866973 chore: format 2024-08-02 22:35:02 +02:00
John Karabudak
ad6e8edcd3 added support for the new Flux image gen model using ComfyUI
this commit adds three environment variables:

- COMFYUI_FLUX: determines whether Flux is used, the workflow is completely different so this is necessary.
- COMFYUI_FLUX_WEIGHT_DTYPE: sets the weight precision for Flux. you will probably want to set this to "fp8_e4m3fn" as the fp16 weights take up about 24GB of VRAM. optional, defaults to "default".
- COMFYUI_FLUX_FP8_CLIP: Flux requires two CLIP models downloaded, one of which is available in fp8 and fp16. set to true if you are using the fp8 CLIP weights.
2024-08-02 13:23:20 -02:30
Timothy J. Baek
40075f69f9 refac 2024-07-15 16:25:00 +02:00
Jun Siang Cheah
17c684369e refac: lazily load faster_whisper to reduce start up memory usage 2024-07-01 08:13:02 +08:00
Timothy J. Baek
3f5f410453 refac 2024-06-27 11:29:59 -07:00
Timothy J. Baek
36e88d479b chore: format 2024-06-25 08:01:05 -07:00
sihuangwlp
e16ae92edc complate missing field AUTOMATIC1111_API_AUTH 2024-06-20 14:53:38 +08:00
sihuangwlp
bec04279aa Add AUTOMATIC1111_API_AUTH support 2024-06-20 14:15:49 +08:00
Timothy J. Baek
e183b0e5ff chore: format 2024-06-16 15:34:15 -07:00
John Karabudak
ea074fa9bf added Stable Diffusion 3 support alongside ComfyUI configuration
this commit adds four environment variables:

- COMFYUI_CFG_SCALE
- COMFYUI_SAMPLER
- COMFYUI_SCHEDULER
- COMFYUI_SD3 (merely setting this at all will enable SD3 mode)
2024-06-16 15:30:52 -02:30
Jun Siang Cheah
51a41c8db4 fix: image generation broken by config persistence 2024-05-17 13:52:48 +08:00
Jun Siang Cheah
298e6848b3 feat: switch to config proxy, remove config_get/set 2024-05-10 15:03:24 +08:00
Jun Siang Cheah
058eb76568 feat: save UI config changes to config.json 2024-05-10 13:51:50 +08:00
Timothy J. Baek
683e6ca337 fix 2024-05-02 15:59:45 -07:00
Timothy J. Baek
989a4d3165 fix 2024-05-02 15:55:42 -07:00
Timothy J. Baek
482f010d22 fix: image gen 2024-05-02 15:54:31 -07:00
Timothy J. Baek
80413a7628 refac 2024-04-30 11:52:08 -07:00
Yanyutin753
3321a1b922 expend the image format type after the file is downloaded 2024-04-28 12:00:52 +08:00
Yanyutin753
849a0b973d recompose the name of environment variables 2024-04-28 07:21:01 +08:00
Yanyutin753
b0245a7eff feat added environment variables and sync.yml 2024-04-28 06:54:26 +08:00
Timothy J. Baek
25d09363df feat: editable openai url for images 2024-04-23 07:14:31 -04:00
Timothy J. Baek
e3d253b040 feat: image env var 2024-04-23 06:53:04 -04:00
dyamagishi
489c45ffdf fix: Update websocket protocol based on the original schema. 2024-04-22 01:19:34 +09:00
Timothy J. Baek
710850e442 refac: audio 2024-04-20 15:15:59 -05:00
Self Denial
067c94810a Fix open-webui/open-webui#1500
Looks like the convention update per commit 0981fae161 missed `config.py`.
2024-04-13 19:55:43 -06:00
Self Denial
ff01398812 Format fix 2024-04-10 23:39:11 -06:00
Self Denial
3b8ea55bc8 Add IMAGE_GENERATION_ENABLED env var
With default of `False`.
2024-04-10 23:21:12 -06:00
Self Denial
144c9059a3 Improve logging. Move print() statements to appropiate log().
Add COMFYUI and WEBHOOK logging and associated environment variable
control. Add WEBHOOK payload & request debug logs.
2024-03-31 13:17:29 -06:00
Timothy Jaeryang Baek
371dfc1143
Merge branch 'dev' into debug_print 2024-03-24 18:04:03 -05:00
Timothy J. Baek
98624a406f feat: comfyui integration 2024-03-23 17:01:13 -07:00
Timothy J. Baek
862c96fcef feat: comfyui support 2024-03-23 15:38:59 -07:00
Self Denial
e6dd0bfbe0 Migrate to python logging module with env var control. 2024-03-20 17:11:36 -06:00
Timothy J. Baek
7f78e58488 refac: image generation error handling 2024-03-12 13:35:30 -07:00
Timothy J. Baek
6ba62cf25d fix: dalle3 issue 2024-03-08 19:54:47 -08:00
Timothy J. Baek
0221acd163 feat: dall-e integration 2024-03-08 17:38:10 -08:00
Timothy Jaeryang Baek
271e5bf44d
Merge branch 'dev' into feature/img-gen-steps-setting 2024-02-24 21:09:06 -05:00
Timothy J. Baek
393531c9b0 fix 2024-02-24 18:08:35 -08:00
Timothy J. Baek
ec6f53e298 feat: litellm proxy frontend integration 2024-02-24 17:56:53 -08:00
Timothy J. Baek
e15e015db1 fix: images 2024-02-24 15:48:14 -08:00
Justin Firth
3fa79e59bf Allow configuration of steps, default to a1111 default 2024-02-24 10:44:08 -05:00
Timothy J. Baek
7ec4c07bf9 feat: image size param 2024-02-22 19:32:36 -08:00
Timothy J. Baek
dc705c4984 refac: settings 2024-02-21 19:06:27 -08:00
Timothy J. Baek
797ed9ac7f feat: allow enabling after url is provided 2024-02-21 18:57:53 -08:00
Timothy J. Baek
cc50cc10e6 feat: sd frontend integration 2024-02-21 18:36:40 -08:00
Timothy J. Baek
733e963c44 feat: sd backend integration 2024-02-21 18:12:01 -08:00