google-labs-jules[bot]
71fabc1579
feat: Implement AI-Powered Design Generation via Chat
...
This feature allows you to generate and iteratively refine visual designs
(like posters, logos, etc.) directly through the chat interface.
Key changes include:
1. **Backend - Intent Detection & Processing:**
* I've introduced an `ImageGenerationIntentDetector` in `backend/open_webui/utils/intent_processors.py`. This function:
* Uses keyword-based intent detection for new designs and refinements.
* Extracts prompts from your messages.
* Modifies previous prompts for iterative refinements.
* Calls the existing `/api/v1/images/generations` endpoint using `httpx`.
* Formats the response (image URL or error) as a chat message, including metadata like `is_generated_design`, `original_prompt`, and `engine_used`.
* I've integrated this detector into the main chat processing logic in `backend/open_webui/utils/chat.py`. Design generation requests are now handled by the detector, bypassing the LLM if intent is recognized.
2. **Frontend - Image Display:**
* My analysis confirmed that existing Svelte components (`MarkdownInlineTokens.svelte` using `Image.svelte`) are capable of rendering Markdown-formatted image URLs (``) sent by the backend.
* The `Image.svelte` component also provides an image preview feature.
3. **Design Management (MVP Approach):**
* For the MVP, generated images are saved via the existing file upload mechanism.
* The chat history, with messages containing image URLs and generation metadata, serves as the primary way for you to access and track their designs and refinements. No new database models for explicit design management were added.
4. **Dependencies:**
* I've added `httpx>=0.25.0` to `backend/requirements.txt` to ensure the HTTP client for the intent detector is explicitly listed.
5. **Documentation:**
* I've drafted updates for `README.md` to highlight the new "AI-Powered Design Generation" feature, replacing the previous, more basic "Image Generation Integration" description.
**Testing Plan:**
* I've prepared detailed manual end-to-end test cases, unit test cases for the `ImageGenerationIntentDetector`, and a frontend visual review checklist to guide developer testing.
This set of changes provides the core functionality for you to conversationally create and refine designs within Open WebUI.
2025-05-25 08:39:03 +00:00
Timothy Jaeryang Baek
2ab5aa4d34
refac: azure openai
2025-05-19 04:31:04 +04:00
Timothy Jaeryang Baek
2e56b1f13d
refac
2025-05-19 03:55:56 +04:00
Timothy Jaeryang Baek
caeb822cdc
feat: azure openai support
2025-05-19 03:40:32 +04:00
Timothy Jaeryang Baek
73e64fe7fb
refac: audio upload handling
2025-05-19 02:52:48 +04:00
Athanasios Oikonomou
eabdd4a140
feat: read max_tokens from model config with fallback to 1000 for title and tag generation
...
Improves title and tag generation by using the max_tokens value from the model configuration when available, with a fallback to the previous default of 1000.
This change is necessary for models like Gemini Pro that generate longer responses and require a higher token limit to successfully generate titles or tags.
2025-05-18 22:45:33 +03:00
Tim Jaeryang Baek
fbcc80485b
Merge pull request #13972 from jarrod-lowe/otel-attrs
...
Deploy to HuggingFace Spaces / check-secret (push) Waiting to run
Deploy to HuggingFace Spaces / deploy (push) Blocked by required conditions
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / merge-main-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-cuda-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-ollama-images (push) Blocked by required conditions
Python CI / Format Backend (3.11.x) (push) Has been cancelled
Python CI / Format Backend (3.12.x) (push) Has been cancelled
feat: Add user details to opentelemetry spans
2025-05-17 21:54:56 +04:00
Timothy Jaeryang Baek
b280f828b0
enh: very long audio transcription
2025-05-17 02:51:28 +04:00
Timothy Jaeryang Baek
08e4c163ea
feat: local/external connections
2025-05-17 01:47:48 +04:00
Jarrod Lowe
df853246f3
Add user details to otel span
2025-05-17 09:11:26 +12:00
Timothy Jaeryang Baek
6692fb2181
chore: format
2025-05-17 01:00:37 +04:00
Timothy Jaeryang Baek
7df6d7f325
refac/fix: signout redirect flow
2025-05-17 00:38:39 +04:00
Timothy Jaeryang Baek
359bcb837d
refac
2025-05-17 00:08:03 +04:00
Timothy Jaeryang Baek
ecae944fd0
refac
2025-05-16 23:59:24 +04:00
Timothy Jaeryang Baek
ea723374c7
refac
2025-05-16 23:36:33 +04:00
Timothy Jaeryang Baek
1f38350128
feat: toggle filter middleware
2025-05-16 23:33:02 +04:00
Timothy Jaeryang Baek
b61efcf54a
feat: toggle filter
2025-05-16 22:59:02 +04:00
Timothy Jaeryang Baek
7bbeaec93b
revert
2025-05-16 22:43:42 +04:00
Timothy Jaeryang Baek
363ac35c09
refac
2025-05-16 22:17:47 +04:00
Tim Jaeryang Baek
50bc6d9b12
Merge pull request #13919 from dongfangzan/main
...
feat: add switching thinking/non-thinking modes to models
2025-05-16 22:08:04 +04:00
Timothy Jaeryang Baek
07b5e84221
refac
2025-05-16 21:29:50 +04:00
Timothy Jaeryang Baek
2bd7db12a2
enh: ALLOWED_FILE_EXTENSIONS ui
2025-05-16 21:05:52 +04:00
Timothy Jaeryang Baek
528a2cf96a
refac
2025-05-16 18:19:28 +04:00
Timothy Jaeryang Baek
2aa5e73728
refac: filter details
2025-05-16 18:01:55 +04:00
Timothy Jaeryang Baek
dec9dd1ac0
refac: web search queries
2025-05-16 17:11:42 +04:00
dongfangzan
9b93b81f84
feat: add switching thinking/non-thinking modes to models
2025-05-15 19:56:10 +08:00
Tim Jaeryang Baek
ca2cfb5bad
Merge pull request #13899 from loitragg/apply-multitenant-for-qdrant
...
Deploy to HuggingFace Spaces / check-secret (push) Waiting to run
Deploy to HuggingFace Spaces / deploy (push) Blocked by required conditions
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / merge-main-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-cuda-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-ollama-images (push) Blocked by required conditions
Frontend Build / Format & Build Frontend (push) Waiting to run
Frontend Build / Frontend Unit Tests (push) Waiting to run
Python CI / Format Backend (3.11.x) (push) Has been cancelled
Python CI / Format Backend (3.12.x) (push) Has been cancelled
perf: implement multi-tenancy for Qdrant vector store client
2025-05-15 13:37:36 +04:00
Kiet Trinh
418ac1a8da
refac: Rename Qdrant multi-tenancy variable for improved clarity and consistency
2025-05-15 09:09:24 +00:00
Timothy Jaeryang Baek
72b2555953
refac
2025-05-15 12:58:44 +04:00
Kiet Trinh
485bd7666c
fix: Update Qdrant multi-tenancy variable name for consistency in configuration
2025-05-15 08:02:58 +00:00
LoiTra
184d8dfd7e
feat: Implement Qdrant multi-tenancy support with collection management and tenant isolation
2025-05-15 11:28:06 +07:00
Timothy Jaeryang Baek
0a8cecfbfa
feat: response watermark
Deploy to HuggingFace Spaces / check-secret (push) Waiting to run
Deploy to HuggingFace Spaces / deploy (push) Blocked by required conditions
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / merge-main-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-cuda-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-ollama-images (push) Blocked by required conditions
Python CI / Format Backend (3.11.x) (push) Waiting to run
Python CI / Format Backend (3.12.x) (push) Waiting to run
Frontend Build / Format & Build Frontend (push) Waiting to run
Frontend Build / Frontend Unit Tests (push) Waiting to run
2025-05-14 23:53:28 +04:00
Timothy Jaeryang Baek
b143c71da2
refac: AIOHTTP_CLIENT_SESSION_SSL
2025-05-14 23:33:52 +04:00
Timothy Jaeryang Baek
04287eb6d6
refac
2025-05-14 23:27:34 +04:00
Timothy Jaeryang Baek
39b06dc3b6
refac
2025-05-14 23:13:06 +04:00
Tim Jaeryang Baek
e358a66fb1
Merge pull request #13852 from fizyr-forks/self-signed-cert
...
feat: Add option to disable certificate validation for LDAP certificates.
2025-05-14 23:12:24 +04:00
Timothy Jaeryang Baek
a6624a4b16
feat: RAG_ALLOWED_FILE_EXTENSIONS
2025-05-14 23:06:33 +04:00
Timothy Jaeryang Baek
42382b5167
fix
2025-05-14 22:46:01 +04:00
Timothy Jaeryang Baek
8732b64b6b
feat: external document loader support
Deploy to HuggingFace Spaces / check-secret (push) Waiting to run
Deploy to HuggingFace Spaces / deploy (push) Blocked by required conditions
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Waiting to run
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Waiting to run
Create and publish Docker images with specific build args / merge-main-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-cuda-images (push) Blocked by required conditions
Create and publish Docker images with specific build args / merge-ollama-images (push) Blocked by required conditions
Python CI / Format Backend (3.11.x) (push) Waiting to run
Python CI / Format Backend (3.12.x) (push) Waiting to run
Frontend Build / Format & Build Frontend (push) Waiting to run
Frontend Build / Frontend Unit Tests (push) Waiting to run
2025-05-14 22:28:40 +04:00
Timothy Jaeryang Baek
32ea31144e
refac: file upload handling behaviour
2025-05-14 22:00:42 +04:00
Timothy Jaeryang Baek
b80f0751f6
refac
2025-05-14 21:59:17 +04:00
Timothy Jaeryang Baek
8fe4f789d4
fix
2025-05-14 21:53:46 +04:00
Timothy Jaeryang Baek
74ccec2812
refac
2025-05-14 21:39:17 +04:00
Tim Jaeryang Baek
29ae231ee0
Merge pull request #13889 from Classic298/pendingtext
...
feat: Custom Title and Text for Account Activation Screen for pending users
2025-05-14 21:28:16 +04:00
Timothy Jaeryang Baek
de70d0cb64
feat: docling do picture description support
2025-05-14 21:26:49 +04:00
DrMelone
e9eb661b83
fix + i18n
2025-05-14 18:58:54 +02:00
DrMelone
bdb3778f8b
fix
2025-05-14 18:10:23 +02:00
Timothy Jaeryang Baek
6e8481e157
fix: evaluation feedback endpoints
2025-05-14 20:08:49 +04:00
DrMelone
143cb4cc34
feat custom text and title
2025-05-14 17:58:20 +02:00
Tim Jaeryang Baek
8029bf0dca
Merge pull request #13881 from hwzhuhao/feat/vector-db
...
feat: Add vector type and vector factory class for vector database integration
2025-05-14 17:41:39 +04:00