492e92580b
Closes #620 #497. Add opt-in Langfuse observability covering all five model types (chat, embedding, rerank, VLM, ASR) with HTTP-request-scoped traces and Docker Compose support (both cloud and self-hosted). Core package internal/tracing/langfuse: - HTTP client with batched async ingestion (non-blocking in request path) - Sampling, environment / release tagging, and graceful fallback when LANGFUSE_* env vars are absent (wrappers become no-ops) - Gin middleware opens one trace per traced request and finishes it after the handler chain returns, attaching method / path / user / session - Trace context is stored under a typed key exported from internal/types so logger.CloneContext can preserve it across handler / goroutine boundaries (otherwise each LLM call auto-created an orphan trace, fragmenting one request into many) Per-model generation wrappers (opt-in via NewChat/NewEmbedder/...): - chat: captures prompt, streaming output, token usage + TTFT - embedding: approximates tokens when the provider omits usage - rerank: previews query/docs, summarizes results to keep payload small - vlm: records image count and total bytes, never uploads raw pixels - asr: records file size and audio duration, never uploads audio bytes Async title generation (GenerateTitleAsync) now forwards the trace key into the goroutine so title calls appear under the parent chat trace. Docker Compose: - LANGFUSE_* env passthrough on the `app` service for cloud deployments - Optional `langfuse` profile spins up a self-hosted Langfuse stack that reuses WeKnora's existing PostgreSQL (separate database via an idempotent init container that fixes ICU collation drift) and Redis (separate DB number), adding only ClickHouse, MinIO, web and worker containers - web/worker entrypoints URL-encode DB_PASSWORD / REDIS_PASSWORD at start to avoid Prisma P1013 when passwords contain @ / # / etc. Docs: docs/Langfuse集成.md covers cloud vs self-hosted, per-model usage strategy, code map, and resource footprint.
66 lines
1.9 KiB
Go
66 lines
1.9 KiB
Go
package asr
|
|
|
|
import (
|
|
"context"
|
|
|
|
"github.com/Tencent/WeKnora/internal/types"
|
|
)
|
|
|
|
// Segment represents a transcribed segment with timestamps.
|
|
type Segment struct {
|
|
Start float64 `json:"start"`
|
|
End float64 `json:"end"`
|
|
Text string `json:"text"`
|
|
}
|
|
|
|
// TranscriptionResult holds the full text and its segments.
|
|
type TranscriptionResult struct {
|
|
Text string `json:"text"`
|
|
Segments []Segment `json:"segments,omitempty"`
|
|
}
|
|
|
|
// ASR defines the interface for Automatic Speech Recognition model operations.
|
|
type ASR interface {
|
|
// Transcribe sends audio bytes to the ASR model and returns the transcribed text and segments.
|
|
Transcribe(ctx context.Context, audioBytes []byte, fileName string) (*TranscriptionResult, error)
|
|
|
|
GetModelName() string
|
|
GetModelID() string
|
|
}
|
|
|
|
// Config holds the configuration needed to create an ASR instance.
|
|
type Config struct {
|
|
Source types.ModelSource
|
|
BaseURL string
|
|
ModelName string
|
|
APIKey string
|
|
ModelID string
|
|
Language string // optional: specify language for transcription
|
|
// CustomHeaders 允许在调用远程 API 时附加自定义 HTTP 请求头(类似 OpenAI Python SDK 的 extra_headers)。
|
|
CustomHeaders map[string]string
|
|
}
|
|
|
|
// ConfigFromModel 根据 types.Model 构造 asr.Config。
|
|
// 生产路径(从 DB 拉起)和测试连接路径(临时表单)共享这份映射。
|
|
// 当前 ASR 不涉及 WeKnoraCloud 凭证,所以签名不含 appID/appSecret。
|
|
func ConfigFromModel(m *types.Model) *Config {
|
|
if m == nil {
|
|
return nil
|
|
}
|
|
return &Config{
|
|
ModelID: m.ID,
|
|
APIKey: m.Parameters.APIKey,
|
|
BaseURL: m.Parameters.BaseURL,
|
|
ModelName: m.Name,
|
|
Source: m.Source,
|
|
CustomHeaders: m.Parameters.CustomHeaders,
|
|
}
|
|
}
|
|
|
|
// NewASR creates an ASR instance based on the provided configuration.
|
|
// All ASR vendors use the OpenAI-compatible /v1/audio/transcriptions API.
|
|
func NewASR(config *Config) (ASR, error) {
|
|
a, err := NewOpenAIASR(config)
|
|
return wrapASRLangfuse(a, err)
|
|
}
|