Commit Graph

347 Commits

Author SHA1 Message Date
wizardchen 4158773849 feat: add organization management features
- Introduced a new API for organization management, including creation, updating, and deletion of organizations.
- Implemented organization sharing functionality for knowledge bases, allowing users to share knowledge bases with specific organizations and set permissions.
- Added UI components for organization selection and sharing dialogs.
- Enhanced existing components to support organization-related features, including shared knowledge base handling and organization role management.

This update enhances collaboration capabilities within the application by allowing users to manage and share knowledge bases across different organizations.
2026-02-09 11:40:25 +08:00
Dounx 548450c170 feat: add REDIS_USERNAME support for asynq client 2026-02-06 21:47:34 +08:00
wizardchen 602086d884 feat: implement tenant isolation for knowledge base retrieval
- Added GetKnowledgeBaseByIDAndTenant method to enforce tenant isolation when retrieving knowledge bases by ID.
- Updated CopyKnowledgeBase method to use tenant-scoped retrieval, preventing cross-tenant cloning.
- Enhanced error handling in the KnowledgeBaseHandler to validate tenant ownership for source and target knowledge bases during copy operations.
2026-02-06 19:55:29 +08:00
wizardchen 67fba0679a feat: enhance MCP tool name and description handling for security
- Updated the tool name format to use service ID instead of service name, preventing name collisions across MCP services.
- Modified the tool description to indicate external sources, reducing the risk of indirect prompt injection.
- Added a prefix to the MCP tool output to treat it as untrusted data, further mitigating security risks.
2026-02-06 19:55:29 +08:00
hobostay a39c9dab9b fix: replace standard log with structured logger in main and recovery middleware
This PR continues the migration to structured logging by replacing the
standard Go log package usage with the project's structured logger.

Changes:
- cmd/server/main.go: Replace all log.Printf, log.Println, log.Fatalf
  with logger.Infof, logger.Info, logger.Fatalf
- internal/middleware/recovery.go: Replace log.Printf with
  logger.ErrorWithFields for better panic logging with structured data
- Remove log.SetFlags and log.SetOutput from main.go as they're no
  longer needed with the structured logger

Benefits:
- Consistent logging format across the entire application
- Better log parsing and analysis with structured fields
- Request ID tracking in recovery middleware for easier debugging
- Proper integration with the project's logging configuration

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
2026-02-06 17:59:15 +08:00
nullkey 84086f55de fix: typo missed in previous commit 2026-02-06 17:58:30 +08:00
ChenRussell 0bf55dd8f7 chore: fix ChunkExtracter typo (ChunkExtractor) 2026-02-06 13:39:28 +08:00
CodeMarker 5fda6bc266 Optimize Jaccard function for set comparisons 2026-02-05 20:05:55 +08:00
wizardchen 03585a161d feat: update sandbox service configuration in Docker Compose files
- Added container name for the sandbox service in both docker-compose.dev.yml and docker-compose.yml.
- Changed the profile from 'sandbox' to 'full' for the sandbox service, enhancing its integration within the application.
- Added logging for skill availability and sandbox mode in the skill handler, improving debugging capabilities.
2026-02-04 21:34:07 +08:00
wizardchen 2d6efec84f feat: enhance agent skills sandbox configuration and availability
- Updated .env.example to set default sandbox mode to 'docker' and added timeout and docker image variables.
- Modified docker-compose files to include a sandbox service for building and pulling the sandbox image.
- Adjusted frontend API to reflect sandbox availability for skills, ensuring UI elements are conditionally displayed based on sandbox status.
- Implemented backend logic to disable skills when the sandbox is not enabled, improving error handling and user experience.
2026-02-04 20:58:24 +08:00
nullkey 03446f35d3 feat: adjust sandbox setting of agentConfig 2026-02-04 20:08:49 +08:00
nullkey 43a2c647ea feat: optimize security and deployment of agent skills 2026-02-04 20:08:49 +08:00
nullkey 3f21345546 feat: adapt preloaded skills to smart-reasoning agent 2026-02-04 20:08:49 +08:00
nullkey 33f7e7da66 feat: support agent skills
feat:support agent skills
2026-02-04 20:08:49 +08:00
Dounx 6e03f1ea79 feat(redis): add REDIS_USERNAME support for Redis ACL 2026-02-04 19:38:40 +08:00
MEKXH c2cdc16712 fix(chat): strip thinking content from model output
Handle thinking models that return wrapped content even when
Thinking=false is configured. This is a fallback strategy for models
like MiniMax-M2.1 that do not fully support the Thinking parameter.
The thinking tags and their enclosed content are completely stripped.
2026-02-04 19:35:55 +08:00
begoniezhao 10c2be0e6e feat: Add configurable global log level via env 2026-02-04 19:18:35 +08:00
begoniezhao 4610a4d1ee feat: Use num_ctx instead of truncate for embedding truncation 2026-02-04 14:24:01 +08:00
joeyczheng 9c57e11f63 feat: add bing search provider
Signed-off-by: joeyczheng <joeyczheng@tencent.com>
2026-02-02 20:53:22 +08:00
begoniezhao 5f7c23a1b9 refactor: Refactor rune handling for correct chunk merging 2026-02-02 16:47:35 +08:00
wizardchen 2b3f76e418 feat(web_fetch): enhance web fetch tool with DNS pinning and validation improvements
- Introduced a new validatedParams struct to hold validated input along with DNS-pinned host/IP for SSRF protection.
- Updated the validateParams function to validate and resolve the host to a single public IP, ensuring safe outbound fetches.
- Modified executeFetch and fetchHTMLContent methods to utilize the new validatedParams for improved security and clarity.
- Enhanced logging to reflect the display URL and provide better context during fetch operations.

This update strengthens the web fetch tool's security against SSRF attacks and improves the overall robustness of URL handling.
2026-02-02 13:33:39 +08:00
manx98 788f6e14c2 fix: MCP Client connection state not marked as closed after connection loss in SSE transport type 2026-02-02 10:42:19 +08:00
wizardchen 14ad38fd83 fix: tighten SSRF protection for URL imports 2026-01-27 11:09:53 +08:00
wizardchen faf1c9a37b feat: add matched question field to FAQ search results 2026-01-26 16:32:18 +08:00
wizardchen 67f3423e9b feat: implement SSRF-safe HTTP client
Add SSRF protection by validating redirect targets and resolved IPs,
blocking internal hostnames, restricted suffixes, and private IP ranges
including Docker and Kubernetes internal endpoints.
2026-01-26 12:00:49 +08:00
wizardchen 01d1aeab0e fix: add comprehensive SQL node validation 2026-01-26 12:00:49 +08:00
wizardchen 90ebd492ce fix: restrict database query allowed tables 2026-01-26 12:00:49 +08:00
wizardchen 1dd76df261 fix: replace dots with underscores in MCP tool names 2026-01-26 12:00:49 +08:00
wizardchen 7d272cc92c feat: add retrieve KB only when mentioned option 2026-01-26 10:44:09 +08:00
MEKXH 467ac01384 fix(zhipu): correct Embedding BaseURL to match API structure
Remove '/embeddings' suffix from ZhipuEmbeddingBaseURL to align with
Chat and Rerank BaseURL patterns. The OpenAIEmbedder automatically
appends '/embeddings' to the baseURL, so including it in the constant
would result in duplicate '/embeddings/embeddings' in the final URL.
2026-01-25 16:53:49 +08:00
nullkey de06bb24d3 fix: cleanup conversation context stored in Redis 2026-01-23 10:33:01 +08:00
begoniezhao fe6f84b67b refactor: Centralize and simplify SQL validation logic 2026-01-21 20:39:37 +08:00
wizardchen 03987b99de chore: remove metadata IP addresses from blocklist 2026-01-21 19:13:14 +08:00
wizardchen 44a9835642 fix: prevent SQL injection via OR conditions 2026-01-21 19:13:14 +08:00
wizardchen 2a99e2458d feat: add SSRF protection for URL fetching 2026-01-21 19:13:14 +08:00
wizardchen e55cbaa057 fix: switch to append mode on retry to prevent data loss 2026-01-21 19:13:14 +08:00
wizardchen f183b5c598 feat: offload large FAQ imports to object storage 2026-01-21 19:13:14 +08:00
DJ 8b160bba15 fix: use typed context key instead of string literal- Add UserContextKey constant to types package- Replace bare string 'user' with types.UserContextKey in auth middleware- Update user service to use UserContextKey for context value retrieval- Fixes staticcheck SA1029 warningThis prevents potential context key collisions. 2026-01-21 19:12:24 +08:00
wizardchen aa4af5365e feat: add thinking mode support for agents 2026-01-20 18:19:44 +08:00
wizardchen b1895f7443 perf: batch tag reference counting 2026-01-20 18:19:44 +08:00
wizardchen a6ba12f389 fix: switch to append mode on retry to prevent data loss 2026-01-20 18:19:44 +08:00
wizardchen 4636bca2b7 perf: optimize FAQ security check with concurrency 2026-01-20 18:19:44 +08:00
wizardchen 5665fb00cb refactor: store FAQ import task info instead of ID 2026-01-20 18:19:44 +08:00
wizardchen fad72fc272 refactor: web search provider registry pattern 2026-01-20 18:19:44 +08:00
wizardchen b74545b007 fix: check existing progress before saving 2026-01-20 18:19:44 +08:00
wizardchen b969681269 fix: only cleanup unused tags in replace mode 2026-01-20 18:19:44 +08:00
wizardchen cb9369b16b feat: support large FAQ imports via object storage 2026-01-20 18:19:44 +08:00
wizardchen a9df80b5db feat: offload large FAQ imports to object storage 2026-01-20 18:19:44 +08:00
lyingbug e5baf69624 Merge pull request #555 from lyingbug/main
FAQ Update
2026-01-15 20:09:20 +08:00
joeyczheng b1633c836a fix: concurrent map writes due to dig.Container is not thread safe
Signed-off-by: joeyczheng <joeyczheng@tencent.com>
2026-01-15 20:07:11 +08:00