Commit Graph

927 Commits

Author SHA1 Message Date
Dounx 8df12aeee2 fix: make Milvus vector metric type configurable via MILVUS_METRIC_TYPE 2026-03-25 21:20:49 +08:00
ochan.kwon 5af8e4e9f8 feat(i18n): add missing locale keys and extract hardcoded Chinese strings
- Add 26 missing i18n keys to ko-KR and ru-RU for image upload,
  storage, VLM model, and multimodal features
- Add 7 new tool name keys (queryKnowledgeGraph, finalAnswer,
  readSkill, executeSkillScript, dataAnalysis, dataSchema,
  databaseQuery) to all 4 locales (zh-CN, en-US, ko-KR, ru-RU)
- Replace hardcoded Chinese tool name map (TOOL_NAME_DISPLAY) in
  AgentStreamDisplay with i18n key references via i18n.global.t(),
  merged into existing TOOL_NAME_KEYS
- Fix hardcoded Chinese error message in KnowledgeBase.vue to use
  existing i18n key knowledgeBase.fileExists
2026-03-25 21:20:05 +08:00
ChenRussell bfa78cc933 fix(rerank): filter empty passages to prevent Aliyun API error
Aliyun rerank API rejects empty documents with error "document index:X
should not be empty". This fix validates passage content before building
the documents array, skipping empty chunks and logging them for data
quality monitoring.
2026-03-25 21:19:40 +08:00
nullkey 804a17d58c docs(im): add Telegram and DingTalk platform documentation
- add setup guides for both WebSocket and Webhook modes
- document streaming reply mechanisms (editMessage / AI card)
- update architecture diagrams, data model, and config reference
2026-03-24 22:12:08 +08:00
nullkey 1bf6603271 feat(im): add AI card streaming for DingTalk and improve IM platform robustness
- Add DingTalk AI Card streaming support with create/deliver/update via OpenAPI
- Extract shared think-block rendering into reusable im.TransformThinkBlocks
- Add stream orphan reaper and edit throttling for DingTalk and Telegram
- Apply think-block transform on all reply paths (DingTalk, Telegram, Feishu)
- Add Card Template ID config to frontend IM channel panel with i18n
2026-03-24 22:12:08 +08:00
nullkey a1a384ec67 feat(im): add DingTalk platform integration
Add DingTalk bot adapter supporting both webhook (HmacSHA256 signature
verification) and Stream mode (via official dingtalk-stream-sdk-go),
with sessionWebhook/OpenAPI reply fallback and AccessToken caching.
2026-03-24 22:12:08 +08:00
nullkey aea0a97be3 feat(im): add Telegram platform integration
Add Telegram Bot API adapter supporting both webhook and long-polling
modes with streaming replies via editMessageText, file download via
getFile API, and timing-safe secret token verification.
2026-03-24 22:12:08 +08:00
Alex-wuhu f0c6d0752a feat(provider): add Novita AI as LLM provider
Add Novita AI as a new model provider supporting chat, embedding,
and VLLM model types via OpenAI-compatible API endpoint.

- Add NovitaProvider implementation with OpenAI-compatible API
- Register ProviderNovita in provider registry
- Add ModelSourceNovita constant
- Add Novita to frontend fallback provider options
- Add i18n translations for en-US, zh-CN, ru-RU, ko-KR
2026-03-24 22:10:42 +08:00
Andy Yang 62e6ae960f fix(chat): support reasoning content in streaming responses for vLLM models
- Parse reasoning field together with standard stream response using local struct
- Unify reasoning content extraction from standard and vLLM response paths
- Adapt processStreamDelta to accept reasoning content as a separate parameter
- Send reasoning content as thinking response in the stream when available
- Ensure compatibility with existing SDK logic by constructing standard choice object
2026-03-24 11:56:55 +08:00
ChenRussell 5b43d04d6b fix(frontend): reset page counter when reloading knowledge files
Reset the global page variable to 1 when reloading the file list after operations like tagging, uploading, moving, editing, or deleting documents. This fixes a pagination bug where scrolling would skip pages after performing these operations.
2026-03-24 11:52:39 +08:00
joeyczheng 4b0f2d4cc6 chore(client): remove redeclared UserInfo in client package
Signed-off-by: joeyczheng <joeyczheng@tencent.com>
2026-03-24 11:52:15 +08:00
qunbo.guo 4a39081d53 fix(chat): preserve image markdown during sanitize
Made-with: Cursor
2026-03-24 10:44:14 +08:00
lyingbug 28b3f1b9dd feat: friendly display for MCP tool names in frontend (#715)
- Format MCP tool names from "mcp_my_server_search_docs" to
  "My Server Search Docs" in the agent stream UI
- Apply same formatting in sanitizeForDisplay for inline text
- Update tool-icons.ts getToolDisplayName with MCP support
2026-03-21 10:22:05 +08:00
lyingbug da9f7b43b6 fix: use service name for MCP tool naming with collision protection (#715)
- Use service.Name instead of service.ID (UUID) for stable tool names
  across MCP server reconnections
- Add (tenant_id, name) unique index on MCPService to prevent name
  collisions at the DB level
- Add collision detection logging in RegisterMCPTools for defense-in-depth
- Improve truncation logic to prioritize keeping the tool name intact

Security: first-wins policy in ToolRegistry + unique name constraint
prevents tool hijacking (GHSA-67q9-58vj-32qx).
2026-03-21 10:22:05 +08:00
lyingbug e3ab971430 fix: use service name instead of UUID for MCP tool naming (#715)
When an MCP server re-registers after long idle, a new UUID is generated,
causing tool names to change and agent tool calls to fail. Switch from
t.service.ID to t.service.Name so tool names remain stable across
re-registrations.
2026-03-21 10:22:05 +08:00
lyingbug db16de084d fix: respect global default storage engine when creating knowledge base (#772)
Change default storageProvider in initFormData() from hardcoded 'local'
to empty string so KBStorageSettings.vue can apply the global config.
2026-03-21 10:21:49 +08:00
Dounx e11bd8c57d fix: use milvus result set length for empty search results 2026-03-20 18:22:40 +08:00
Andy Yang 5c31a9123f fix: Adjust temperature validation to allow zero as a valid setting and default only for negative values. 2026-03-20 18:21:39 +08:00
Dounx a4d3d69843 feat: expose builtin parser engine in settings 2026-03-20 15:52:33 +08:00
Dounx a9c2d61695 fix: add OpenRouter embedding provider support 2026-03-20 15:50:42 +08:00
Dounx cf9b935144 fix(dev): add milvus env and versioned docreader image 2026-03-20 15:50:16 +08:00
Dounx fc5c405639 feat(dev): add milvus service and db host config 2026-03-20 15:50:16 +08:00
nullkey f01dcd4129 feat(im): add multi-instance support with Redis-based distributed coordination
- config: add IMConfig for tunable workers, queue size, rate limit params
- qaqueue: add Redis global per-user limits and global concurrency gate
- ratelimit: add distributedLimiter with Redis ZSET sliding window + local fallback
- service: add Redis message dedup, WebSocket leader election, cross-instance /stop
2026-03-20 15:49:59 +08:00
nullkey d2bd3881e7 docs(im): update IM integration doc with Slack, commands, queue and streaming sections
- add Slack WebSocket/Webhook setup guide
- add slash-command system documentation
- add QA queue and rate limiting section
- add streaming output and file message handling details
2026-03-20 15:49:59 +08:00
nullkey fff9efb4f5 feat(im): integrate command dispatch, QA queue, rate limiting, and streaming improvements
- Wire slash-command registry into Service and HandleMessage dispatch
- Add bounded QA worker pool (qaQueue) with per-user backpressure
- Add sliding-window rate limiter to prevent message abuse
- Support /stop cancellation for queued and in-flight QA requests
- Fix WeCom group chat replies via appchat API with user fallback
- Fix WeCom longconn nil map panic and stream buffer memory leak
- Add Feishu stream reaper to clean orphaned streams (memory leak fix)
- Show "正在思考..." placeholder during Feishu streaming
- Handle empty-stream fallback when no visible content is produced
- Derive WebSearchEnabled from agent config for IM channels
2026-03-20 15:49:59 +08:00
nullkey f05f9b0e11 feat(im): add slash-command system with /help, /info, /search, /stop, /clear
Introduce a pluggable command framework for IM channels. Includes
Command interface, CommandRegistry for registration and dispatch,
and five built-in commands: /help (list commands), /info (inspect
knowledge bases), /search (search knowledge), /stop (cancel running
QA), and /clear (reset conversation context).
2026-03-20 15:49:59 +08:00
Dounx 838a49601c fix: guard pg_search update with skip_embedding 2026-03-19 22:03:09 +08:00
wizardchen 954c994b61 chore(release): bump version to 0.3.4 and update changelog 2026-03-19 18:20:09 +08:00
wizardchen be4f040aa6 feat(types): enhance FAQ metadata normalization and sanitization 2026-03-19 18:20:09 +08:00
wizardchen 8880df57f0 fix(i18n): simplify listChunks translation across multiple languages 2026-03-19 18:20:09 +08:00
wizardchen 8f1237d64f feat(agent): enhance event emission for final answers and fallback handling
- Updated the AgentEngine to emit final answer events even when the LLM stops without calling the final_answer tool, ensuring the frontend can render responses correctly.
- Added fallback logic in the AgentStreamHandler to emit final answers as fallback events when no answer events are streamed, improving robustness in edge cases.
2026-03-19 18:20:09 +08:00
wizardchen c25741673c feat(chunk): implement batch deletion for chunks to avoid MySQL placeholder limit
- Updated DeleteChunks method to split IDs into batches of 5000 to prevent MySQL Error 1390.
- Added unit tests for CalculateFAQContentHash to ensure consistent hashing behavior across various scenarios, including normalization and case sensitivity.
2026-03-19 18:20:09 +08:00
wizardchen 8db4b6cdea fix(chunk): update timestamp function in UpdateChunks method to use NOW() for consistency 2026-03-19 18:20:09 +08:00
wizardchen 4c3f083642 refactor(agent): streamline document info retrieval and enhance chunk search logic
- Removed the validation for a maximum of 10 knowledge IDs in GetDocumentInfoTool to allow more flexibility.
- Adjusted pagination settings in chunk retrieval to limit results to 1 per request for more granular control.
- Updated the searchChunks method to use case-insensitive matching based on the database type, improving compatibility across different systems.
- Enhanced query structure for better readability and maintainability.
2026-03-19 18:20:09 +08:00
joeyczheng b4f3ad71ad Docs(IM): add docs for slack im channel
Signed-off-by: joeyczheng <joeyczheng@tencent.com>
2026-03-19 14:45:54 +08:00
wizardchen 2a63b58deb feat(im): enhance message handling and formatting for Feishu compatibility
- Updated the message streaming logic to handle <think> blocks more effectively, ensuring proper formatting for Feishu.
- Introduced a new transformThinkBlocks function to convert <think> content into Feishu-compatible markdown blockquotes.
- Improved the handling of tool call events to prevent duplicate processing and ensure correct message formatting.
- Enhanced documentation for permission configuration in the IM channel setup.
2026-03-18 21:56:34 +08:00
wizardchen 3de78dc3e8 refactor(im): improve tool invocation and result formatting
- Updated formatToolCallStart and formatToolCallResult functions to return plain-text lines instead of Markdown snippets for better integration within <think> blocks.
- Introduced briefToolSummary function to extract concise summaries from tool output.
- Enhanced handleMessageStream to manage <think> blocks more effectively during agent interactions.
- Added handling for server-side events in WeCom long connection management to improve reconnection logic.
2026-03-18 21:56:34 +08:00
wizardchen f3a3c72a4f fix(docparser): handle nested linked images and url parens 2026-03-18 21:56:34 +08:00
wizardchen 3450ed5e41 feat(knowledge): offload manual processing to async tasks 2026-03-18 21:56:34 +08:00
joeyczheng 49b5f1a739 feat(IM): support both websocket/webhook mode im channel for slack
Signed-off-by: joeyczheng <joeyczheng@tencent.com>
2026-03-18 21:26:53 +08:00
Suroy 5c6b710bae Update rerank_server_demo.py
1. Added CUDA debugging support
2. Improved memory management during model inference.
3. Fixed logits output

Test Device: Windows WSL Ubuntu 20.04 (python3.10 CUDA 5090 32G)
2026-03-18 18:25:05 +08:00
wizardchen 5506956e87 fix: update session title word count requirement
- Adjusted the session title generation template to require 4-10 words instead of 3-8 words for improved clarity and consistency in title generation.
2026-03-17 22:23:24 +08:00
wizardchen 4e2583e58d feat: add language support to summary generation payload
- Enhanced the SummaryGenerationPayload struct to include a Language field for better localization.
- Updated enqueueSummaryGenerationTask and ProcessSummaryGeneration methods to handle language context in summary generation tasks.
2026-03-17 22:23:24 +08:00
wizardchen 17da967f92 refactor: update session title generation and language context handling
- Modified the session title generation template to focus on extracting only the intent of the user's question.
- Enhanced the session service to include language context when generating titles.
- Updated middleware to inject language into the request context.
- Added a new test suite for validating SSRF safety of URLs.
2026-03-17 22:23:24 +08:00
wizardchen f7750d65c1 fix: update default language setting to Chinese 2026-03-17 22:23:24 +08:00
wizardchen 2ad1faf85f chore: update fallback templates
- Added critical language rules to fallback response templates to ensure consistent language usage in responses.
- Updated logger context to include language and session-related keys for improved context management.
2026-03-17 22:23:24 +08:00
wizardchen 139a9c40ff feat: enhance localization and configuration support
- Added timezone and language settings to the environment configuration.
- Introduced built-in agent configurations with multilingual support for various agents.
- Updated Docker Compose to utilize new environment variables for timezone and language.
- Created new prompt templates for question generation, summary generation, and keywords extraction.
2026-03-17 22:23:24 +08:00
wizardchen 09d9fe5ddb feat(im): add file support and knowledge base integration 2026-03-17 22:23:24 +08:00
ChenRussell d89e5db0f6 git commit -m "fix: clarify MinIO endpoint format error message
Add specific error handling for 'Endpoint url cannot have fully qualified paths'
to guide users to remove http:// or https:// prefix from endpoint URL."
2026-03-16 21:50:07 +08:00
lyingbug 32a364f2cb Merge pull request #764 from lyingbug/main
feat: enhance storage engine configuration and user notifications
2026-03-16 21:46:34 +08:00