5ee96019e0
Migrate WeKnora's Langfuse tracing from the legacy /api/public/ingestion batch API to the OpenTelemetry Go SDK emitting OTLP/HTTP to /api/public/otel/v1/traces — the Langfuse v3+ standard ingestion protocol. Why: Langfuse v3 deprecated the legacy ingestion API in favor of OTLP, and OTel-only backends (e.g. the LiteFuse Doris fork) dropped it entirely, so the legacy client was incompatible. Migrating to the OTel SDK also adds W3C traceparent cross-service propagation: an upstream caller's trace id is inherited so its run and the WeKnora call land under one trace in the UI. What: - Manager owns an OTel TracerProvider backed by an otlptracehttp exporter (Basic auth + the x-langfuse-ingestion-version gate header). Spans are buffered by BatchSpanProcessor and exported complete on End, so a long trace no longer fragments across flush batches. - *Trace/*Span/*Generation wrap OTel spans; the public API (StartTrace/ Span/Generation, handles, InjectTracing, asynq/gin middleware, Config, TokenUsage) is unchanged, so callers (agent/chat/handler/scheduler/asynqdl) need no edits. - W3C traceparent: GinMiddleware extracts traceparent from incoming requests; AsynqMiddleware + InjectTracing propagate it across the asynq payload. types.TracingContext gains a LangfuseTraceparent field. - logger.CloneContext preserves the active OTel span across context rebuilds so child spans (agent engine, summary generation) stitch to the HTTP trace instead of orphaning into separate traces. - StartSpan/StartGeneration re-establish the parent from the *Trace handle when the ctx lost the active OTel span, covering background/derived contexts. Compatibility: works with Langfuse v3+ (cloud / self-hosted / the bundled docker-compose profile) and LiteFuse. Drops Langfuse v2 (legacy-only) support. Uses the OTel Go SDK already (indirectly) in go.mod, promoting otlptracehttp to direct; no third-party langfuse-go library. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
46 lines
1.6 KiB
Go
46 lines
1.6 KiB
Go
package langfuse
|
|
|
|
import (
|
|
"context"
|
|
|
|
"github.com/Tencent/WeKnora/internal/types"
|
|
)
|
|
|
|
// traceCtxKey is the exported context key defined in types/const.go. It lives
|
|
// there (not inside this package) so that logger.CloneContext — which rebuilds
|
|
// a stripped-down context on every request — can preserve the Langfuse trace
|
|
// without importing this package. If we kept the key private here, every
|
|
// CloneContext call would drop the trace and downstream LLM wrappers would
|
|
// each auto-create their own shallow trace, fragmenting a single HTTP request
|
|
// into many unrelated traces in the Langfuse UI.
|
|
//
|
|
// Span parenting is NOT carried by this key: it flows through the standard
|
|
// OpenTelemetry context (trace.SpanFromContext), which tracer.Start wires up
|
|
// automatically. The *Trace on this key is only for handlers/middleware that
|
|
// need to set trace-level input/output.
|
|
var traceCtxKey = types.LangfuseTraceContextKey
|
|
|
|
// withTrace stores a *Trace on the context so downstream LLM wrappers can
|
|
// attach their generations to it.
|
|
func withTrace(ctx context.Context, t *Trace) context.Context {
|
|
if t == nil || ctx == nil {
|
|
return ctx
|
|
}
|
|
return context.WithValue(ctx, traceCtxKey, t)
|
|
}
|
|
|
|
// traceFromCtx retrieves the active trace, if any.
|
|
func traceFromCtx(ctx context.Context) (*Trace, bool) {
|
|
if ctx == nil {
|
|
return nil, false
|
|
}
|
|
t, ok := ctx.Value(traceCtxKey).(*Trace)
|
|
return t, ok && t != nil
|
|
}
|
|
|
|
// TraceFromContext is the public accessor used by HTTP middlewares and
|
|
// handlers that want to set the trace input/output on the active trace.
|
|
func TraceFromContext(ctx context.Context) (*Trace, bool) {
|
|
return traceFromCtx(ctx)
|
|
}
|