Commit Graph

33 Commits

Author SHA1 Message Date
google-labs-jules[bot]
71fabc1579 feat: Implement AI-Powered Design Generation via Chat
This feature allows you to generate and iteratively refine visual designs
(like posters, logos, etc.) directly through the chat interface.

Key changes include:

1.  **Backend - Intent Detection & Processing:**
    *   I've introduced an `ImageGenerationIntentDetector` in `backend/open_webui/utils/intent_processors.py`. This function:
        *   Uses keyword-based intent detection for new designs and refinements.
        *   Extracts prompts from your messages.
        *   Modifies previous prompts for iterative refinements.
        *   Calls the existing `/api/v1/images/generations` endpoint using `httpx`.
        *   Formats the response (image URL or error) as a chat message, including metadata like `is_generated_design`, `original_prompt`, and `engine_used`.
    *   I've integrated this detector into the main chat processing logic in `backend/open_webui/utils/chat.py`. Design generation requests are now handled by the detector, bypassing the LLM if intent is recognized.

2.  **Frontend - Image Display:**
    *   My analysis confirmed that existing Svelte components (`MarkdownInlineTokens.svelte` using `Image.svelte`) are capable of rendering Markdown-formatted image URLs (`![alt text](url)`) sent by the backend.
    *   The `Image.svelte` component also provides an image preview feature.

3.  **Design Management (MVP Approach):**
    *   For the MVP, generated images are saved via the existing file upload mechanism.
    *   The chat history, with messages containing image URLs and generation metadata, serves as the primary way for you to access and track their designs and refinements. No new database models for explicit design management were added.

4.  **Dependencies:**
    *   I've added `httpx>=0.25.0` to `backend/requirements.txt` to ensure the HTTP client for the intent detector is explicitly listed.

5.  **Documentation:**
    *   I've drafted updates for `README.md` to highlight the new "AI-Powered Design Generation" feature, replacing the previous, more basic "Image Generation Integration" description.

**Testing Plan:**
*   I've prepared detailed manual end-to-end test cases, unit test cases for the `ImageGenerationIntentDetector`, and a frontend visual review checklist to guide developer testing.

This set of changes provides the core functionality for you to conversationally create and refine designs within Open WebUI.
2025-05-25 08:39:03 +00:00
Timothy Jaeryang Baek
359bcb837d refac 2025-05-17 00:08:03 +04:00
Timothy Jaeryang Baek
1f38350128 feat: toggle filter middleware 2025-05-16 23:33:02 +04:00
Timothy Jaeryang Baek
3b74431ea3 refac: filters 2025-03-04 18:04:55 -08:00
MeteorSky
a01ef6cfa0 fix: allow error returns None 2025-03-04 00:08:49 +08:00
Timothy Jaeryang Baek
3be5e3129b
Merge pull request #10752 from NovoNordisk-OpenSource/yvedeng/standardize-logging
refactor: replace print statements with logging
2025-02-25 10:53:02 -08:00
Yifang Deng
0e5d5ecb81
refactor: replace print statements with logging for better error tracking 2025-02-25 15:53:55 +01:00
Timothy Jaeryang Baek
d8bc3098db
Merge pull request #9918 from df-cgdm/main
feat: Add  X-OpenWebUI when forwarding to ollama servers
2025-02-24 11:55:04 -08:00
Timothy Jaeryang Baek
a5fa1cd835
Merge pull request #10209 from i-infra/iinf/fix-for-openrouter
[fix] no unambiguous indexing on "owned_by" - fix OpenRouter.ai
2025-02-17 15:24:21 -08:00
Timothy Jaeryang Baek
19c340d3fb refac: pipelines 2025-02-15 22:25:18 -08:00
i-infra
fb12ee3f52 fix exception where openrouter doesn't populate - no longer index without fallback 2025-02-15 19:41:41 -05:00
Timothy Jaeryang Baek
da757069de refac 2025-02-13 17:06:55 -08:00
Timothy Jaeryang Baek
e1435501aa fix 2025-02-13 15:17:41 -08:00
Timothy Jaeryang Baek
f20b7c2f33 fix: user direct connections 2025-02-13 14:21:34 -08:00
Didier FOURNOUT
6d62e71c34 Add x-Open-Webui headers for ollama + more for openai 2025-02-13 15:29:26 +00:00
Timothy Jaeryang Baek
6d899b80d0 refac: direct connections 2025-02-13 00:34:45 -08:00
Timothy Jaeryang Baek
a1dc2664c2 refac 2025-02-12 23:49:00 -08:00
Timothy Jaeryang Baek
83e5db7be7 refac 2025-02-12 23:26:47 -08:00
Timothy Jaeryang Baek
2b7f9d14d0 refac 2025-02-12 23:21:16 -08:00
Timothy Jaeryang Baek
c83e68282d feat: direct connections integration 2025-02-12 22:56:33 -08:00
Timothy Jaeryang Baek
9be8bea6f4 fix: filter 2025-02-08 01:07:05 -08:00
Timothy Jaeryang Baek
3dde2f67cf refac 2025-02-07 22:57:39 -08:00
Xingjian Xie
89669a21fc Refactor common code between inlet and outlet 2025-02-06 23:07:47 +00:00
Timothy Jaeryang Baek
f3a4d61f81 fix: actions 2025-01-03 21:31:24 -08:00
Timothy Jaeryang Baek
54daf3b765 fix: outlet filter hook 2024-12-28 18:05:07 -08:00
Timothy Jaeryang Baek
e6e8978f78 refac 2024-12-28 16:42:43 -08:00
Timothy Jaeryang Baek
e51722348a refac 2024-12-24 19:27:17 -07:00
Timothy Jaeryang Baek
556c75e876 refac 2024-12-21 09:59:12 -07:00
Timothy Jaeryang Baek
2be9e55545 refac: chat requests 2024-12-19 01:00:32 -08:00
Timothy Jaeryang Baek
6efca03a8f refac 2024-12-13 22:51:43 -08:00
Timothy Jaeryang Baek
f9a05dd1e1 refac 2024-12-12 23:31:08 -08:00
Timothy Jaeryang Baek
1197c640c4 refac 2024-12-12 22:28:42 -08:00
Timothy Jaeryang Baek
4311bb7b99 wip 2024-12-12 20:22:17 -08:00