为什么:Astra 复验已独立复现旧 LocalIDs 循环的三种盲区——目标互换、错误来源集合、
不存在的目标都能绿;引用把 pre/next/parent 混在一个 OR 里,parent 分支没有覆盖;
成功路径没有序列非空比对;零 Embedding 只测了一个 client;旧侧对照用 rev-list 的
258 冒充 0.1.258(该工作树 identity 实际是 0.1.148);runner 在异常/超时路径不保证
清理,读回把任何非零退出都当"不存在"。
改了什么:
- 抽出独立语义 mapping checker:三表 (table,column,source,target) 精确集合 + 真实行
对应;持久账本正例与语义副本变异走同一 checker,digest gate 与语义 gate 分开。
- 测试自带十表 scope 声明并与 schema 列集合对拍;逐种引用非空命中,软导航字段显式
列为范围外;外围 ES 完整 _source、res-other 字节各补负控制。
- 零 Embedding 改为发布段独立记账:ES + 对象存储两个可达 client,自定义 /v1/encode
负控制;范围只声明本测试可达 client,正式全链留给 DS03。
- 冻结输入 bundle(十表行/目标种子/序列/ES/对象/DDL,逐表 hash):旧 6fe98c9 与新源码
同一 bundle 文件;旧侧真实 23505,新侧发布成功 + 独立 oracle。
- 测试进程身份:runner 注入 test-only nonce/commit/树摘要,进程自报 executable hash。
- 历史兼容矩阵改同 catalog 初始化,三条序列显式存在并逐例 before/after。
- runner v2(证据根,不在本仓):失败关闭、finally 清理、所有权重核、keep-failure。
验证:make verify 16 项全绿;ds02_runner_v2 三次隔离运行(含负控制与 keep-failure)
raw 见 handoffs/develop-release-contract/ds02-v2-*;旧侧探针 ds02-bundle-old2。
This commit is contained in:
+62
-8
@@ -1,18 +1,72 @@
|
||||
# Changelog
|
||||
|
||||
## 开发快照(DS02 oracle 独立性、映射语义与运行器失败关闭)
|
||||
|
||||
### Added
|
||||
|
||||
- 新增独立本地号映射 oracle:只接收测试声明的来源行、独立推导的期望目标行、真实目标行
|
||||
与持久账本,按 `(table,column,source,target)` 精确集合比较;目标互换、不存在的目标、
|
||||
被替换的来源、少项/多项/重复、错列都会被判红,而合法账本与真实行逐列相等才算绿。
|
||||
- 新增十表范围声明(测试自带 `tenant_id`/`knowledge_base_id` 规则并与真实 schema 列集合
|
||||
对拍),不再复用产品的范围分类生成期望。
|
||||
- 新增逐种引用覆盖:`chunk.pre/next/parent_chunk_id`、`wiki_folders.parent_id`、
|
||||
`wiki_pages.source_refs/chunk_refs`、`wiki_page_issues.suspected_knowledge_ids`、
|
||||
`wiki_log_entries.pages_affected` 等各自 `violations=0` 且非空命中;没有外键契约的软
|
||||
导航字段(`parent_slug`、`in_links/out_links`、`relation_chunks`)显式列为范围外。
|
||||
- 新增外围哨兵:`chunk-foreign` 文档完整 `_source` 逐字段比较、`res-other` 对象字节比较,
|
||||
两者各有"改坏必须红"的负控制。
|
||||
- 新增冻结输入 bundle(十表来源行、目标种子、序列种子、ES 文档、对象字节、完整 DDL,
|
||||
时间固定、逐表 hash):旧源码 `6fe98c9` 与当前源码读取同一份文件、同一 sha256。旧侧真实
|
||||
复现 `wiki_log_entries_pkey / SQLSTATE 23505`,新侧同一输入发布成功并通过独立 oracle。
|
||||
差异单列:6fe98c9 在 wiki 之前无法跨租户搬运资源,旧侧归档省略 `resources` /
|
||||
`resource_bindings` 两表,其余八表与碰撞行逐字节相同;新侧按十表完整运行。
|
||||
- 新增测试进程身份断言:runner 注入 test-only nonce/commit/源码树摘要,测试进程自报
|
||||
`os.Executable` 的 sha256,与 runner 期望逐字符比较;构建与执行前后各算一次二进制哈希。
|
||||
- 新增隔离运行器 v2(`ds02_runner_v2.py`,v1 保留):超时/构建/准备异常都走 finally 清理,
|
||||
源码、HEAD、工作区、二进制哈希、bundle 字节、required 缺失/跳过任一变化即失败;
|
||||
清理前重核 namespace 前缀与容器 Id/label,读回区分"确实不存在"与认证/连接错误;
|
||||
`--keep-failure` 保留现场并写 `resources-kept.json`。
|
||||
|
||||
### Changed
|
||||
|
||||
- DS02 的零 Embedding 断言改为按"发布段"记账:ES 与对象存储两个可达 client 注入同一
|
||||
记录器,按目的地址(路径含 embed/encode 或已知模型域名)识别向量化调用,并补了另一个
|
||||
client 走自定义 `/v1/encode` 的负控制;声明范围只到本测试的 client 清单,正式
|
||||
API→worker 全链仍留给 DS03。
|
||||
- 映射 RED 与摘要 gate 分开:语义变异只改内存账本副本(目标存储不动),归档字节变异只
|
||||
证明 `LoadWriteSet` 摘要拒收,不再拿后者冒充映射断言。
|
||||
- 日志内容变异重命名为 `log-content`,不再当作 mapping RED。
|
||||
- 历史兼容矩阵改用同一份真实 v071 catalog 初始化,三条本地号序列显式断言存在并逐例比较
|
||||
before/after 摘要(不再有空集合"不变")。
|
||||
- 旧侧对照措辞修正为"精确旧 SHA 回归对照":不再用 `git rev-list --count` 的 258 当版本号;
|
||||
该工作树资源 identity 实际是 0.1.148,没有原发布产物就不做历史考古。
|
||||
|
||||
### Fixed
|
||||
|
||||
- 修正旧 oracle 只检查"每表来源/目标数量与重复"导致的三种盲区(目标互换、错误来源集合、
|
||||
不存在的目标号)。
|
||||
- 修正引用断言把 pre/next/parent 混在一个 OR 里、无法证明 parent 分支有覆盖的问题。
|
||||
- 修正"序列不变"在最小 schema 上没有序列可比的空覆盖。
|
||||
- 修正运行器把 namespace 解析失败静默跳过、删除前不重核所有权、读回把任何非零退出都当
|
||||
"不存在"、失败路径不保证清理的问题。
|
||||
|
||||
## 开发快照(整库发布的数据/证明 oracle 与历史兼容矩阵)
|
||||
|
||||
### Added
|
||||
|
||||
- 新增 `TestDS02FullShapeOracleIsolated`:复用现有十表全形状夹具,用**独立 oracle**
|
||||
逐列比对目标行内容、全部父子/标签/资源/知识库/Wiki 引用、索引正文与向量、对象
|
||||
字节,并断言发布过程中 Embedding 调用为 0。期望值由夹具声明推导(来源→目标范围
|
||||
映射、资源定位符与 `location_hash` 在本测试里重算),不调用被测映射器生成。
|
||||
- 新增 Wiki 日志映射双射断言:来源日志数字 id 与目标本地号一一对应、无重复、内容
|
||||
元组多重集相等。
|
||||
- 新增对照夹具探针(旧代码工作树):0.1.258(6fe98c9)在同一隔离库/桶/索引里以
|
||||
相同输入复现 `wiki_log_entries_pkey` / SQLSTATE 23505;当前代码同一输入发布成功
|
||||
并分配本地号,其它知识库的历史行不变。
|
||||
逐列比对目标行内容、逐种引用(父子/标签/资源/知识库/Wiki,含 parent 分支与
|
||||
source_refs/chunk_refs/suspected ids)、索引正文与向量、目标及外围对象字节,并按发布段
|
||||
断言 Embedding 调用为 0。期望值由夹具声明推导(来源→目标范围映射、资源定位符与
|
||||
`location_hash` 在本测试里重算),不调用被测映射器生成;`parent_slug` 与 in/out_links
|
||||
这类没有外键契约的软导航字段明确列为范围外。
|
||||
- 新增 Wiki 日志映射 oracle:来源日志数字 id 与目标本地号按独立期望精确配对,并用
|
||||
真实目标行逐列对应;持久账本正例通过同一 checker,语义副本变异(互换/不存在/替换来源/
|
||||
少项/多项/重复/错列)必须红。
|
||||
- 新增对照夹具探针(旧代码工作树):精确旧 SHA `6fe98c9` 在同一隔离库/桶/索引里以
|
||||
同一份冻结 bundle 复现 `wiki_log_entries_pkey` / SQLSTATE 23505;当前代码同一输入发布
|
||||
成功并分配本地号,其它知识库的历史行不变。这是**旧源码回归对照**,不是原 0.1.258 发布
|
||||
产物;该工作树的资源身份实际是 0.1.148,`git rev-list --count` 的 258 只是自根提交数。
|
||||
- 新增 `TestDS02LegacyCompatibilityMatrixIsolated`:旧 manifest、V1 台账、空作业/
|
||||
目标身份等缺证明组合必须在正式入口被拒绝,拒绝前后 PG 逐行 + 索引 + 对象版本 +
|
||||
序列哈希不变;不做 V1→V2 迁移。
|
||||
|
||||
@@ -0,0 +1,319 @@
|
||||
package v071
|
||||
|
||||
// DS-02 冻结输入 bundle:同一份文件同时给旧源码探针(6fe98c9 工作树)与当前源码
|
||||
// 使用。bundle 只含业务输入(十表来源行、目标种子行、序列种子、ES 文档、对象字节、
|
||||
// 固定时间与完整 DDL);两个隔离目标各自执行同一份 DDL、插入同一批行。
|
||||
//
|
||||
// 唯一的环境替换是对象桶名:bundle 里写 %BUCKET%,两侧各自换成自己的桶。
|
||||
// 这不是输入差异,必须在报告里显式列出。
|
||||
//
|
||||
// 导出(不连接任何服务):
|
||||
// KG_DS02_BUNDLE_OUT=/path/dir go test -run TestDS02ExportFrozenBundle
|
||||
// 新侧对照:
|
||||
// KG_DS02_BUNDLE=/path/dir/ds02-frozen-bundle.json go test -run TestDS02FrozenBundleIsolated
|
||||
|
||||
import (
|
||||
"crypto/sha256"
|
||||
"encoding/hex"
|
||||
"encoding/json"
|
||||
"fmt"
|
||||
"os"
|
||||
"path/filepath"
|
||||
"sort"
|
||||
"strings"
|
||||
"testing"
|
||||
|
||||
"knowledge-governance/internal/libraryrelease"
|
||||
)
|
||||
|
||||
type ds02BundleSeedRow struct {
|
||||
Table string `json:"table"`
|
||||
Row map[string]any `json:"row"`
|
||||
}
|
||||
|
||||
type ds02BundleSeedDoc struct {
|
||||
ID string `json:"id"`
|
||||
Tenant uint64 `json:"tenant"`
|
||||
KB string `json:"kb"`
|
||||
Knowledge string `json:"knowledge"`
|
||||
Content string `json:"content"`
|
||||
}
|
||||
|
||||
type ds02FrozenBundle struct {
|
||||
Bundle string `json:"bundle"`
|
||||
Version int `json:"version"`
|
||||
CreatedAt string `json:"created_at"`
|
||||
Scope map[string]any `json:"scope"`
|
||||
Sequences map[string][]any `json:"sequences"`
|
||||
SourceRows map[string][]map[string]any `json:"source_rows"`
|
||||
TargetRows []ds02BundleSeedRow `json:"target_rows"`
|
||||
// OldAdapterRows 只给旧源码探针用:6fe98c9 在 resources 阶段按目标范围查资源行
|
||||
// (它在 database 阶段不重写租户),所以目标必须先有这两行才能走到 wiki。
|
||||
// 这是旧入口适配差异,不是业务输入;新侧不读这个字段。
|
||||
OldAdapterRows []ds02BundleSeedRow `json:"old_adapter_target_rows"`
|
||||
SeedDocs []ds02BundleSeedDoc `json:"seed_docs"`
|
||||
SeedObjects map[string]string `json:"seed_objects"`
|
||||
Vectors map[string][]float64 `json:"vectors"`
|
||||
DDL []string `json:"ddl"`
|
||||
}
|
||||
|
||||
// ds02BundleDDL 从保留的真实 v071 catalog 生成完整 DDL;旧/新隔离目标执行同一份。
|
||||
func ds02BundleDDL(t *testing.T) []string {
|
||||
t.Helper()
|
||||
catalog := r11CatalogData(t)
|
||||
ddl := []string{
|
||||
`CREATE EXTENSION IF NOT EXISTS "uuid-ossp"`,
|
||||
`CREATE EXTENSION IF NOT EXISTS pg_trgm`,
|
||||
// 预备份的 schema 契约从这张台账读版本;bundle 必须自带,不能靠夹具残留。
|
||||
`CREATE TABLE schema_migrations(version int,dirty bool)`,
|
||||
`INSERT INTO schema_migrations VALUES(74,false)`,
|
||||
// 旧源码的"库已结清"查询要读这两张任务表;同一份 DDL 两侧都建。
|
||||
`CREATE TABLE task_pending_ops(tenant_id bigint,task_type text,scope text,scope_id text)`,
|
||||
`CREATE TABLE task_dead_letters(tenant_id bigint,task_type text,scope text,scope_id text)`,
|
||||
`CREATE TABLE knowledge_bases(id text,tenant_id bigint,indexing_strategy jsonb,deleted_at timestamptz)`,
|
||||
`INSERT INTO knowledge_bases VALUES('` + wsTargetKB + `',10001,'{}',NULL),('` + wsOtherKB + `',10001,'{}',NULL),('` + wsSourceKB + `',10002,'{}',NULL)`,
|
||||
`CREATE TABLE storage_backends(id text PRIMARY KEY, tenant_id bigint, provider text, config jsonb, created_at timestamptz)`,
|
||||
`INSERT INTO storage_backends VALUES('backend-target',10001,'minio','{"bucket_name":"` + ds02BucketPlaceholder + `"}',now())`,
|
||||
}
|
||||
for _, sequence := range catalog.Sequences {
|
||||
ddl = append(ddl, fmt.Sprintf("CREATE SEQUENCE %s START %d", sequence.Name, sequence.Start))
|
||||
}
|
||||
for _, table := range productionLibraryTables {
|
||||
defs := []string{}
|
||||
for _, column := range catalog.Columns {
|
||||
if column.Table != table {
|
||||
continue
|
||||
}
|
||||
definition := pgxIdentifier(column.Name) + " " + column.Type
|
||||
if column.Required {
|
||||
definition += " NOT NULL"
|
||||
}
|
||||
if column.Default != "" {
|
||||
definition += " DEFAULT " + column.Default
|
||||
}
|
||||
defs = append(defs, definition)
|
||||
}
|
||||
ddl = append(ddl, "CREATE TABLE "+table+"("+strings.Join(defs, ",")+")")
|
||||
}
|
||||
ddl = append(ddl, `ALTER SEQUENCE wiki_log_entries_id_seq OWNED BY wiki_log_entries.id`,
|
||||
`CREATE TABLE resource_access_grants(id text,resource_id varchar(36))`)
|
||||
constraints := append([]struct {
|
||||
Table string `json:"table_name"`
|
||||
Name string `json:"name"`
|
||||
Definition string `json:"definition"`
|
||||
}{}, catalog.Constraints...)
|
||||
sort.SliceStable(constraints, func(i, j int) bool {
|
||||
return !strings.HasPrefix(constraints[i].Definition, "FOREIGN KEY") && strings.HasPrefix(constraints[j].Definition, "FOREIGN KEY")
|
||||
})
|
||||
names := map[string]bool{}
|
||||
for _, constraint := range constraints {
|
||||
ddl = append(ddl, "ALTER TABLE "+constraint.Table+" ADD CONSTRAINT "+constraint.Name+" "+constraint.Definition)
|
||||
names[constraint.Name] = true
|
||||
}
|
||||
for _, index := range catalog.Indexes {
|
||||
if names[index.Name] {
|
||||
continue
|
||||
}
|
||||
ddl = append(ddl, index.Definition)
|
||||
}
|
||||
return ddl
|
||||
}
|
||||
|
||||
// pgxIdentifier 只处理本 catalog 里的普通小写列名。
|
||||
func pgxIdentifier(name string) string { return `"` + strings.ReplaceAll(name, `"`, `""`) + `"` }
|
||||
|
||||
func ds02BundleSequences() map[string][]any {
|
||||
return map[string][]any{
|
||||
"chunks_seq_id_seq": {int64(100000005), false},
|
||||
"knowledge_tags_seq_id_seq": {int64(50), false},
|
||||
"wiki_log_entries_id_seq": {int64(10), false},
|
||||
}
|
||||
}
|
||||
|
||||
func TestDS02ExportFrozenBundle(t *testing.T) {
|
||||
root := os.Getenv("KG_DS02_BUNDLE_OUT")
|
||||
if root == "" {
|
||||
t.Skip("set KG_DS02_BUNDLE_OUT to write the frozen input bundle")
|
||||
}
|
||||
rows := ds02SourceRows()
|
||||
// 逐表 hash,便于两侧各自核对同一份输入。
|
||||
perTable := map[string]string{}
|
||||
for table, list := range rows {
|
||||
raw, err := json.Marshal(list)
|
||||
if err != nil {
|
||||
t.Fatal(err)
|
||||
}
|
||||
sum := sha256.Sum256(raw)
|
||||
perTable[table] = hex.EncodeToString(sum[:])
|
||||
}
|
||||
bundle := ds02FrozenBundle{
|
||||
Bundle: "ds02-frozen-input",
|
||||
Version: 1,
|
||||
CreatedAt: "2026-11-02T00:00:00Z",
|
||||
Scope: map[string]any{"source_tenant": wsSourceTenant, "source_kb": wsSourceKB, "target_tenant": wsTargetTenant, "target_kb": wsTargetKB, "other_kb": wsOtherKB, "foreign_tenant": 20000},
|
||||
Sequences: ds02BundleSequences(),
|
||||
SourceRows: rows,
|
||||
SeedObjects: func() map[string]string {
|
||||
out := map[string]string{}
|
||||
for id, body := range ds02Objects {
|
||||
out[id] = body
|
||||
}
|
||||
for id, body := range ds02SeedObjects() {
|
||||
out[id] = body
|
||||
}
|
||||
return out
|
||||
}(),
|
||||
Vectors: ds02Vectors,
|
||||
DDL: ds02BundleDDL(t),
|
||||
}
|
||||
for _, row := range ds02SeedRows() {
|
||||
bundle.TargetRows = append(bundle.TargetRows, ds02BundleSeedRow{Table: row.table, Row: row.row})
|
||||
}
|
||||
for _, doc := range ds02SeedDocs() {
|
||||
bundle.SeedDocs = append(bundle.SeedDocs, ds02BundleSeedDoc{ID: doc.id, Tenant: doc.tenant, KB: doc.kb, Knowledge: doc.knowledge, Content: doc.content})
|
||||
}
|
||||
raw, err := json.MarshalIndent(bundle, "", " ")
|
||||
if err != nil {
|
||||
t.Fatal(err)
|
||||
}
|
||||
if err := os.MkdirAll(root, 0700); err != nil {
|
||||
t.Fatal(err)
|
||||
}
|
||||
path := filepath.Join(root, "ds02-frozen-bundle.json")
|
||||
if err := os.WriteFile(path, append(raw, '\n'), 0600); err != nil {
|
||||
t.Fatal(err)
|
||||
}
|
||||
sum := sha256.Sum256(append(raw, '\n'))
|
||||
hash := hex.EncodeToString(sum[:])
|
||||
if err := os.WriteFile(filepath.Join(root, "ds02-frozen-bundle.sha256"), []byte(hash+" ds02-frozen-bundle.json\n"), 0600); err != nil {
|
||||
t.Fatal(err)
|
||||
}
|
||||
result := map[string]any{"bundle": path, "sha256": hash, "table_hashes": perTable,
|
||||
"bytes": len(raw) + 1, "ddl_statements": len(bundle.DDL), "created_at": bundle.CreatedAt}
|
||||
if run := os.Getenv("KG_R10_RUN"); run != "" {
|
||||
r10Save(t, "bundle", result)
|
||||
}
|
||||
encoded, _ := json.MarshalIndent(result, "", " ")
|
||||
t.Logf("%s", encoded)
|
||||
}
|
||||
|
||||
func ds02LoadBundle(t *testing.T) (ds02FrozenBundle, string) {
|
||||
t.Helper()
|
||||
path := os.Getenv("KG_DS02_BUNDLE")
|
||||
if path == "" {
|
||||
t.Skip("set KG_DS02_BUNDLE to run the frozen-bundle comparison")
|
||||
}
|
||||
raw, err := os.ReadFile(path)
|
||||
if err != nil {
|
||||
t.Fatalf("read frozen bundle: %v", err)
|
||||
}
|
||||
sum := sha256.Sum256(raw)
|
||||
hash := hex.EncodeToString(sum[:])
|
||||
sidecar, err := os.ReadFile(strings.TrimSuffix(path, ".json") + ".sha256")
|
||||
if err != nil {
|
||||
t.Fatalf("read bundle sha256 sidecar: %v", err)
|
||||
}
|
||||
if !strings.HasPrefix(strings.TrimSpace(string(sidecar)), hash) {
|
||||
t.Fatalf("bundle sha256 %s does not match sidecar %q", hash, strings.TrimSpace(string(sidecar)))
|
||||
}
|
||||
var bundle ds02FrozenBundle
|
||||
if err := json.Unmarshal(raw, &bundle); err != nil {
|
||||
t.Fatalf("parse frozen bundle: %v", err)
|
||||
}
|
||||
if bundle.Bundle != "ds02-frozen-input" || bundle.Version != 1 || len(bundle.DDL) == 0 {
|
||||
t.Fatalf("unexpected frozen bundle header: %+v", bundle.Bundle)
|
||||
}
|
||||
return bundle, hash
|
||||
}
|
||||
|
||||
// TestDS02FrozenBundleIsolated 用与旧源码探针同一份 bundle 初始化新目标并发布,
|
||||
// 再用独立 oracle 检查;bundle hash 写进 raw,供与旧侧结果对齐。
|
||||
func TestDS02FrozenBundleIsolated(t *testing.T) {
|
||||
bundle, hash := ds02LoadBundle(t)
|
||||
// 桶名在两个隔离目标里不同:fixture 在真正建 schema 时把 %BUCKET% 换成自己的桶。
|
||||
fx := openWriteSetFixtureWith(t, writeSetFixtureOptions{reset: true, ddl: bundle.DDL})
|
||||
for name, value := range bundle.Sequences {
|
||||
last := int64(value[0].(float64))
|
||||
called := value[1].(bool)
|
||||
r10Exec(t, fx, fmt.Sprintf("SELECT setval('%s',%d,%t)", name, last, called))
|
||||
}
|
||||
for id, body := range bundle.SeedObjects {
|
||||
if id != "res-other" {
|
||||
continue
|
||||
}
|
||||
path := wsLocator("backend-target", "minio", fx.bucket, wsTargetTenant, id)
|
||||
if err := fx.objects.s3.Put(fx.ctx, "minio", path, strings.NewReader(body), int64(len(body))); err != nil {
|
||||
t.Fatal(err)
|
||||
}
|
||||
}
|
||||
for _, row := range bundle.TargetRows {
|
||||
if _, ok := ds02ScopeDecl[row.Table]; !ok {
|
||||
t.Fatalf("bundle target row for undeclared table %s", row.Table)
|
||||
}
|
||||
r11Insert(t, fx, row.Table, ds02SeedRow(row.Row, fx.bucket))
|
||||
}
|
||||
for _, doc := range bundle.SeedDocs {
|
||||
fx.indexDoc(t, doc.ID, doc.Tenant, doc.KB, doc.Knowledge, doc.Content)
|
||||
}
|
||||
spec := ds02Spec{rows: map[string][]map[string]any{}, vectors: bundle.Vectors, objects: map[string]string{}}
|
||||
for table, rows := range bundle.SourceRows {
|
||||
for _, row := range rows {
|
||||
spec.rows[table] = append(spec.rows[table], ds02Canon(t, fx, table, row))
|
||||
}
|
||||
}
|
||||
// 来源对象只取"来源资源行声明的那几个";res-other 是外围哨兵,不参与来源对象比对。
|
||||
for _, row := range bundle.SourceRows["resources"] {
|
||||
id := fmt.Sprint(row["id"])
|
||||
body, ok := bundle.SeedObjects[id]
|
||||
if !ok {
|
||||
t.Fatalf("bundle has no bytes for source resource %s", id)
|
||||
}
|
||||
spec.objects[id] = body
|
||||
}
|
||||
preserved := map[string][]map[string]any{}
|
||||
for _, table := range ds02TargetTables {
|
||||
preserved[table] = ds02OtherRows(t, fx, table)
|
||||
}
|
||||
expectation := ds02Expected(t, fx, spec)
|
||||
expected, paths := expectation.Rows, expectation.Paths
|
||||
for _, table := range []string{"resources", "resource_bindings"} {
|
||||
expected[table] = append(expected[table], ds02SameTenantRows(t, fx, table)...)
|
||||
}
|
||||
expected["knowledge_tag_relations"] = append(expected["knowledge_tag_relations"],
|
||||
ds02Read(t, fx, `SELECT to_jsonb(x)::text FROM knowledge_tag_relations AS x
|
||||
WHERE knowledge_id NOT IN (SELECT id FROM knowledges WHERE tenant_id=$1 AND knowledge_base_id=$2)`,
|
||||
wsTargetTenant, wsTargetKB)...)
|
||||
snapshot := ds02Seal(t, fx, spec)
|
||||
recorder, inventory := ds02AttachEgress(t, fx)
|
||||
target := fx.target(t)
|
||||
backups := fx.backups(t, target)
|
||||
recorder.setPhase("publish")
|
||||
out := libraryrelease.Run(fx.ctx, requestFor(snapshot), target, backups, nil)
|
||||
recorder.setPhase("oracle-read")
|
||||
r10Save(t, "bundle-identity", map[string]any{"path": os.Getenv("KG_DS02_BUNDLE"), "sha256": hash,
|
||||
"source_tenant": bundle.Scope["source_tenant"], "target_tenant": bundle.Scope["target_tenant"],
|
||||
"created_at": bundle.CreatedAt, "adapter_note": "DDL 与行内容相同;对象桶名以 %BUCKET% 占位,两侧各自替换。"})
|
||||
r10Save(t, "outcome", out)
|
||||
if out.State != "succeeded" {
|
||||
t.Fatalf("new source must publish the frozen bundle: %+v", out)
|
||||
}
|
||||
if out.Backup.WriteSet == nil {
|
||||
t.Fatal("write set missing")
|
||||
}
|
||||
ledger, err := LoadWriteSet(fx.archiveRoot, out.Backup.WriteSet.Digest)
|
||||
if err != nil {
|
||||
t.Fatalf("load write set: %v", err)
|
||||
}
|
||||
columns := ds02LocalColumns(t, fx, spec, expectation)
|
||||
mappingDiffs := ds02CheckLocalIDMapping(columns, ledger.LocalIDs)
|
||||
r10Save(t, "mapping-diffs", mappingDiffs)
|
||||
if len(mappingDiffs) != 0 {
|
||||
t.Fatalf("frozen-bundle publish fails the independent mapping oracle:\n%s", strings.Join(mappingDiffs, "\n"))
|
||||
}
|
||||
diffs := ds02Check(t, fx, spec, expected, paths, preserved, recorder, inventory)
|
||||
r10Save(t, "green-diffs", diffs)
|
||||
if len(diffs) != 0 {
|
||||
t.Fatalf("frozen-bundle independent oracle disagrees:\n%s", strings.Join(diffs, "\n"))
|
||||
}
|
||||
r10Save(t, "sequences-after", ds02SequenceSummary(t, fx))
|
||||
}
|
||||
@@ -0,0 +1,78 @@
|
||||
package v071
|
||||
|
||||
// DS-02 测试进程身份:把"runner 记录的那份源码构建的二进制"与"真正执行的进程"
|
||||
// 绑定起来。runner 用 -ldflags 注入三个只在本测试包存在的值(run nonce、完整
|
||||
// commit、源码树摘要),并在启动前后各算一次二进制 sha256;这里在进程内读
|
||||
// os.Executable 的哈希,与 runner 通过环境变量声明的期望值逐字符比较。
|
||||
//
|
||||
// 这些值不是产品 metadata:不参与发布、不改 internal/version。
|
||||
|
||||
import (
|
||||
"crypto/sha256"
|
||||
"encoding/hex"
|
||||
"encoding/json"
|
||||
"os"
|
||||
"testing"
|
||||
)
|
||||
|
||||
// 由 runner 的 -ldflags -X 注入;未注入时保留显眼的值,绝不伪装成已知身份。
|
||||
var (
|
||||
ds02ProvenanceNonce = "unlinked"
|
||||
ds02ProvenanceCommit = "unlinked"
|
||||
ds02ProvenanceTree = "unlinked"
|
||||
)
|
||||
|
||||
type ds02ProcessIdentity struct {
|
||||
Nonce string `json:"nonce"`
|
||||
Commit string `json:"commit"`
|
||||
SourceTree string `json:"source_tree"`
|
||||
Executable string `json:"executable"`
|
||||
BinarySHA256 string `json:"binary_sha256"`
|
||||
}
|
||||
|
||||
func TestDS02ProcessIdentity(t *testing.T) {
|
||||
expectedNonce := os.Getenv("KG_DS02_EXPECT_NONCE")
|
||||
if expectedNonce == "" {
|
||||
t.Skip("requires runner-injected expectations (KG_DS02_EXPECT_NONCE)")
|
||||
}
|
||||
executable, err := os.Executable()
|
||||
if err != nil {
|
||||
t.Fatalf("resolve own executable: %v", err)
|
||||
}
|
||||
raw, err := os.ReadFile(executable)
|
||||
if err != nil {
|
||||
t.Fatalf("read own executable: %v", err)
|
||||
}
|
||||
sum := sha256.Sum256(raw)
|
||||
identity := ds02ProcessIdentity{
|
||||
Nonce: ds02ProvenanceNonce,
|
||||
Commit: ds02ProvenanceCommit,
|
||||
SourceTree: ds02ProvenanceTree,
|
||||
Executable: executable,
|
||||
BinarySHA256: hex.EncodeToString(sum[:]),
|
||||
}
|
||||
encoded, err := json.Marshal(identity)
|
||||
if err != nil {
|
||||
t.Fatal(err)
|
||||
}
|
||||
// 单行输出给 runner 解析:证明是"这个进程自报",不是 runner 事后补写。
|
||||
t.Logf("DS02-IDENTITY %s", encoded)
|
||||
cases := []struct {
|
||||
name string
|
||||
linked string
|
||||
expected string
|
||||
}{
|
||||
{"nonce", identity.Nonce, expectedNonce},
|
||||
{"commit", identity.Commit, os.Getenv("KG_DS02_EXPECT_COMMIT")},
|
||||
{"source tree", identity.SourceTree, os.Getenv("KG_DS02_EXPECT_TREE")},
|
||||
{"binary sha256", identity.BinarySHA256, os.Getenv("KG_DS02_EXPECT_BINARY_SHA256")},
|
||||
}
|
||||
for _, item := range cases {
|
||||
if item.expected == "" {
|
||||
t.Fatalf("%s expectation missing from runner environment", item.name)
|
||||
}
|
||||
if item.linked != item.expected {
|
||||
t.Fatalf("%s mismatch: process has %q, runner expected %q", item.name, item.linked, item.expected)
|
||||
}
|
||||
}
|
||||
}
|
||||
@@ -8,6 +8,7 @@ import (
|
||||
"crypto/sha256"
|
||||
"encoding/hex"
|
||||
"encoding/json"
|
||||
"fmt"
|
||||
"os"
|
||||
"path/filepath"
|
||||
"strings"
|
||||
@@ -82,9 +83,36 @@ func ds02OldManifest(t *testing.T, fx *writeSetFixture) (string, string) {
|
||||
return id, hex.EncodeToString(fileSum[:])
|
||||
}
|
||||
|
||||
// ds02LegacySeed 用与 full-shape 用例同一份真实 v071 catalog(r11Mirror)造目标行:
|
||||
// 三条本地号序列必须真实存在,否则"序列不变"就是空覆盖。
|
||||
func ds02LegacySeed(t *testing.T, fx *writeSetFixture) {
|
||||
t.Helper()
|
||||
for _, row := range []struct {
|
||||
table string
|
||||
row map[string]any
|
||||
}{
|
||||
{"knowledges", map[string]any{"id": "doc-target", "tenant_id": wsTargetTenant, "knowledge_base_id": wsTargetKB, "type": "document", "title": "目标旧文档"}},
|
||||
{"chunks", map[string]any{"id": "chunk-target", "tenant_id": wsTargetTenant, "knowledge_base_id": wsTargetKB, "knowledge_id": "doc-target", "content": "目标旧正文", "chunk_index": 0}},
|
||||
{"knowledge_tags", map[string]any{"id": "tag-target", "tenant_id": wsTargetTenant, "knowledge_base_id": wsTargetKB, "name": "目标标签"}},
|
||||
{"knowledge_tag_relations", map[string]any{"knowledge_id": "doc-target", "tag_id": "tag-target"}},
|
||||
{"resources", map[string]any{"id": "res-target", "handle": wsHandleTarget, "tenant_id": wsTargetTenant, "provider": "minio", "storage_backend_id": "backend-target", "physical_path": wsLocator("backend-target", "minio", fx.bucket, wsTargetTenant, "res-target"), "size": int64(8)}},
|
||||
{"resource_bindings", map[string]any{"id": "bind-target", "tenant_id": wsTargetTenant, "resource_id": "res-target", "owner_type": "knowledge", "owner_id": "doc-target", "relation": "attachment"}},
|
||||
{"wiki_folders", map[string]any{"id": "folder-target", "tenant_id": wsTargetTenant, "knowledge_base_id": wsTargetKB, "name": "目标目录"}},
|
||||
{"wiki_pages", map[string]any{"id": "wiki-target", "tenant_id": wsTargetTenant, "knowledge_base_id": wsTargetKB, "slug": "index", "content": "目标旧 wiki"}},
|
||||
{"wiki_page_issues", map[string]any{"id": "issue-target", "tenant_id": wsTargetTenant, "knowledge_base_id": wsTargetKB, "slug": "index", "issue_type": "review"}},
|
||||
{"wiki_log_entries", map[string]any{"id": int64(5), "tenant_id": wsTargetTenant, "knowledge_base_id": wsTargetKB, "action": "ingest"}},
|
||||
} {
|
||||
r11Insert(t, fx, row.table, row.row)
|
||||
}
|
||||
}
|
||||
|
||||
func TestDS02LegacyCompatibilityMatrixIsolated(t *testing.T) {
|
||||
fx := openWriteSetFixture(t)
|
||||
seedTargetData(t, fx)
|
||||
// 同 catalog 初始化:十表真实列/约束/三条序列都在,目标行不是最小 schema 的残影。
|
||||
r11Mirror(t, fx)
|
||||
ds02LegacySeed(t, fx)
|
||||
sequences := ds02SequenceSummary(t, fx)
|
||||
r10Save(t, "sequences-before", sequences)
|
||||
target := fx.target(t)
|
||||
oldManifest, oldManifestHash := ds02OldManifest(t, fx)
|
||||
before := ds02UniverseHash(t, fx)
|
||||
@@ -169,6 +197,9 @@ func TestDS02LegacyCompatibilityMatrixIsolated(t *testing.T) {
|
||||
if after := ds02UniverseHash(t, fx); after != before {
|
||||
t.Fatalf("%s: rejected plan changed target data (%s -> %s)", scenario.name, before, after)
|
||||
}
|
||||
if after := ds02SequenceSummary(t, fx); fmt.Sprint(after) != fmt.Sprint(sequences) {
|
||||
t.Fatalf("%s: rejected plan changed local sequences (%v -> %v)", scenario.name, sequences, after)
|
||||
}
|
||||
}
|
||||
r10Save(t, "universe-hash", before)
|
||||
}
|
||||
|
||||
@@ -0,0 +1,242 @@
|
||||
package v071
|
||||
|
||||
// DS-02 本地号映射 oracle。
|
||||
//
|
||||
// 旧检查只数"每表来源/目标各几个、是否重复",因此三种语义错误能一路绿:
|
||||
// 目标互换(1→11,2→10)、来源集合被替换(999→10)、目标根本不存在(1→999)。
|
||||
// 这里的检查器只接收四样东西:
|
||||
// * 测试声明的来源行(数字 id 来自夹具声明,不由被测映射器产生);
|
||||
// * 独立推导的期望目标行(来源 id 经过独立算出的分配顺序得到目标数字 id);
|
||||
// * 真实目标行(按目标数字 id 从数据库读回);
|
||||
// * 持久账本(WriteSet.LocalIDs)。
|
||||
//
|
||||
// 它不调用任何产品映射函数,也不读写存储:把 (table,column,source,target) 当
|
||||
// 精确集合比较,并用 source 关联声明行、用 target 关联真实目标行。因此
|
||||
// "账本里的配对本身正确、真实行也正确" 和 "账本把配对写错" 是两件独立的事:
|
||||
// 语义副本变异只改账本内存副本,不会碰 digest 校验;反过来,改归档字节让摘要
|
||||
// 拒绝也不等于映射语义检查红,两者必须分开报告。
|
||||
|
||||
import (
|
||||
"encoding/json"
|
||||
"fmt"
|
||||
"sort"
|
||||
"strconv"
|
||||
|
||||
"knowledge-governance/internal/libraryrelease"
|
||||
)
|
||||
|
||||
// ds02LocalColumn 是一张含本地号的表的独立期望与真实读回。
|
||||
type ds02LocalColumn struct {
|
||||
Table string
|
||||
Column string
|
||||
// Sources 是夹具声明的来源数字 id(升序,即分配顺序)。
|
||||
Sources []int64
|
||||
// Expected 是 source→target 的独立期望(来源序列起点 + 声明顺序)。
|
||||
Expected map[int64]int64
|
||||
// ExpectedRows 是 source→独立推导的完整目标行(逐列,含真实目标数字 id)。
|
||||
ExpectedRows map[int64]map[string]any
|
||||
// Actual 是真实目标行:target 数字 id→整行。
|
||||
Actual map[int64]map[string]any
|
||||
}
|
||||
|
||||
func ds02RowKey(row map[string]any) string {
|
||||
raw, err := json.Marshal(row)
|
||||
if err != nil {
|
||||
return fmt.Sprintf("<unencodable:%v>", err)
|
||||
}
|
||||
return string(raw)
|
||||
}
|
||||
|
||||
// ds02CheckLocalIDMapping 返回差异;空表示账本与独立期望一致,且每个配对都能
|
||||
// 落到真实目标行上。
|
||||
func ds02CheckLocalIDMapping(columns []ds02LocalColumn, ledger []libraryrelease.LocalIDMapping) []string {
|
||||
var diffs []string
|
||||
declared := map[string]*ds02LocalColumn{}
|
||||
for index := range columns {
|
||||
column := &columns[index]
|
||||
if _, ok := declared[column.Table]; ok {
|
||||
diffs = append(diffs, "duplicate declared local column for "+column.Table)
|
||||
continue
|
||||
}
|
||||
declared[column.Table] = column
|
||||
}
|
||||
// 解析账本:逐条严格校验,任何解析失败都是差异,不静默跳过。
|
||||
type pair struct {
|
||||
source int64
|
||||
target int64
|
||||
}
|
||||
observed := map[string]map[int64]int64{}
|
||||
seenSource := map[string]map[int64]bool{}
|
||||
seenTarget := map[string]map[int64]bool{}
|
||||
seenColumn := map[string]map[string]bool{}
|
||||
for _, mapping := range ledger {
|
||||
column, ok := declared[mapping.Table]
|
||||
if !ok {
|
||||
diffs = append(diffs, "unexpected ledger table "+mapping.Table)
|
||||
continue
|
||||
}
|
||||
if mapping.Column != column.Column {
|
||||
diffs = append(diffs, fmt.Sprintf("%s ledger column %q, want %q", mapping.Table, mapping.Column, column.Column))
|
||||
continue
|
||||
}
|
||||
source, err := strconv.ParseInt(mapping.Source, 10, 64)
|
||||
if err != nil || source <= 0 {
|
||||
diffs = append(diffs, fmt.Sprintf("%s ledger source %q is not a positive integer", mapping.Table, mapping.Source))
|
||||
continue
|
||||
}
|
||||
target, err := strconv.ParseInt(mapping.Target, 10, 64)
|
||||
if err != nil || target <= 0 {
|
||||
diffs = append(diffs, fmt.Sprintf("%s ledger target %q is not a positive integer", mapping.Table, mapping.Target))
|
||||
continue
|
||||
}
|
||||
if observed[mapping.Table] == nil {
|
||||
observed[mapping.Table] = map[int64]int64{}
|
||||
seenSource[mapping.Table] = map[int64]bool{}
|
||||
seenTarget[mapping.Table] = map[int64]bool{}
|
||||
seenColumn[mapping.Table] = map[string]bool{}
|
||||
}
|
||||
if seenSource[mapping.Table][source] {
|
||||
diffs = append(diffs, fmt.Sprintf("%s duplicate ledger source %d", mapping.Table, source))
|
||||
}
|
||||
if seenTarget[mapping.Table][target] {
|
||||
diffs = append(diffs, fmt.Sprintf("%s duplicate ledger target %d", mapping.Table, target))
|
||||
}
|
||||
key := strconv.FormatInt(source, 10) + "->" + strconv.FormatInt(target, 10)
|
||||
if seenColumn[mapping.Table][key] {
|
||||
diffs = append(diffs, fmt.Sprintf("%s duplicate ledger pair %s", mapping.Table, key))
|
||||
}
|
||||
seenSource[mapping.Table][source] = true
|
||||
seenTarget[mapping.Table][target] = true
|
||||
seenColumn[mapping.Table][key] = true
|
||||
observed[mapping.Table][source] = target
|
||||
}
|
||||
for _, column := range columns {
|
||||
table := column.Table
|
||||
got := observed[table]
|
||||
// 1) 来源集合必须精确等于声明集合。
|
||||
var missing []int64
|
||||
expectedTargets := map[int64]bool{}
|
||||
for _, source := range column.Sources {
|
||||
want, ok := column.Expected[source]
|
||||
if !ok {
|
||||
diffs = append(diffs, fmt.Sprintf("%s source %d has no independent expectation", table, source))
|
||||
continue
|
||||
}
|
||||
expectedTargets[want] = true
|
||||
actual, ok := got[source]
|
||||
if !ok {
|
||||
missing = append(missing, source)
|
||||
continue
|
||||
}
|
||||
if actual != want {
|
||||
diffs = append(diffs, fmt.Sprintf("%s wrong target pair: source %d mapped to %d, want %d", table, source, actual, want))
|
||||
}
|
||||
// 3) 来源 id 关联声明行、target id 关联真实目标行:必须逐列相等。
|
||||
wantRow, ok := column.ExpectedRows[source]
|
||||
if !ok {
|
||||
diffs = append(diffs, fmt.Sprintf("%s source %d has no expected target row", table, source))
|
||||
continue
|
||||
}
|
||||
actualRow, ok := column.Actual[want]
|
||||
if !ok {
|
||||
diffs = append(diffs, fmt.Sprintf("%s target %d has no real target row", table, want))
|
||||
continue
|
||||
}
|
||||
if ds02RowKey(wantRow) != ds02RowKey(actualRow) {
|
||||
diffs = append(diffs, fmt.Sprintf("%s source %d -> target %d row mismatch: want %s got %s",
|
||||
table, source, want, ds02RowKey(wantRow), ds02RowKey(actualRow)))
|
||||
}
|
||||
}
|
||||
var extraSources []int64
|
||||
for source := range got {
|
||||
if _, ok := column.Expected[source]; !ok {
|
||||
extraSources = append(extraSources, source)
|
||||
}
|
||||
}
|
||||
if len(missing) > 0 {
|
||||
sort.Slice(missing, func(i, j int) bool { return missing[i] < missing[j] })
|
||||
diffs = append(diffs, fmt.Sprintf("%s missing ledger source %v", table, missing))
|
||||
}
|
||||
if len(extraSources) > 0 {
|
||||
sort.Slice(extraSources, func(i, j int) bool { return extraSources[i] < extraSources[j] })
|
||||
diffs = append(diffs, fmt.Sprintf("%s unexpected ledger source %v", table, extraSources))
|
||||
}
|
||||
// 2) target 集合必须精确等于独立预测集合,而且确实存在这些目标行。
|
||||
for _, target := range got {
|
||||
if !expectedTargets[target] {
|
||||
diffs = append(diffs, fmt.Sprintf("%s ledger target %d is not an independently predicted target", table, target))
|
||||
}
|
||||
}
|
||||
for target := range expectedTargets {
|
||||
if _, ok := column.Actual[target]; !ok {
|
||||
diffs = append(diffs, fmt.Sprintf("%s predicted target %d does not exist in target storage", table, target))
|
||||
}
|
||||
}
|
||||
if len(got) == 0 && len(column.Sources) > 0 {
|
||||
diffs = append(diffs, fmt.Sprintf("%s has no ledger mapping rows", table))
|
||||
}
|
||||
}
|
||||
return diffs
|
||||
}
|
||||
|
||||
// ds02FlipMappingTargets 互换同一张表两条映射的目标,模拟"配对写反"。
|
||||
func ds02FlipMappingTargets(ledger []libraryrelease.LocalIDMapping, table string) []libraryrelease.LocalIDMapping {
|
||||
out := append([]libraryrelease.LocalIDMapping(nil), ledger...)
|
||||
first := -1
|
||||
for index := range out {
|
||||
if out[index].Table != table {
|
||||
continue
|
||||
}
|
||||
if first < 0 {
|
||||
first = index
|
||||
continue
|
||||
}
|
||||
out[first].Target, out[index].Target = out[index].Target, out[first].Target
|
||||
return out
|
||||
}
|
||||
return out
|
||||
}
|
||||
|
||||
// ds02ReplaceMapping 把同一张表第一条映射的某个字段替换成新值。
|
||||
func ds02ReplaceMapping(ledger []libraryrelease.LocalIDMapping, table, field, value string) []libraryrelease.LocalIDMapping {
|
||||
out := append([]libraryrelease.LocalIDMapping(nil), ledger...)
|
||||
for index := range out {
|
||||
if out[index].Table != table {
|
||||
continue
|
||||
}
|
||||
switch field {
|
||||
case "source":
|
||||
out[index].Source = value
|
||||
case "target":
|
||||
out[index].Target = value
|
||||
case "column":
|
||||
out[index].Column = value
|
||||
}
|
||||
return out
|
||||
}
|
||||
return out
|
||||
}
|
||||
|
||||
// ds02DropMapping 删掉同一张表的最后一条映射(少项)。
|
||||
func ds02DropMapping(ledger []libraryrelease.LocalIDMapping, table string) []libraryrelease.LocalIDMapping {
|
||||
out := append([]libraryrelease.LocalIDMapping(nil), ledger...)
|
||||
for index := len(out) - 1; index >= 0; index-- {
|
||||
if out[index].Table != table {
|
||||
continue
|
||||
}
|
||||
return append(out[:index], out[index+1:]...)
|
||||
}
|
||||
return out
|
||||
}
|
||||
|
||||
// ds02DuplicateMapping 复制同一张表的第一条映射(多项/重复来源与目标)。
|
||||
func ds02DuplicateMapping(ledger []libraryrelease.LocalIDMapping, table string) []libraryrelease.LocalIDMapping {
|
||||
out := append([]libraryrelease.LocalIDMapping(nil), ledger...)
|
||||
for index := range out {
|
||||
if out[index].Table != table {
|
||||
continue
|
||||
}
|
||||
return append(out, out[index])
|
||||
}
|
||||
return out
|
||||
}
|
||||
@@ -0,0 +1,103 @@
|
||||
package v071
|
||||
|
||||
// 映射 oracle 自身的负例矩阵:这里不连数据库,只用合成行证明检查器对
|
||||
// "目标互换 / 不存在目标 / 来源被替换 / 少项 / 多项 / 重复 / 错列" 会红,
|
||||
// 且对合法账本为绿。真实账本正例与语义副本变异在 full-shape 用例里跑同一个
|
||||
// 检查器(那里才连接真实 PG/ES/MinIO)。
|
||||
|
||||
import (
|
||||
"strings"
|
||||
"testing"
|
||||
|
||||
"knowledge-governance/internal/libraryrelease"
|
||||
)
|
||||
|
||||
func ds02UnitColumns() []ds02LocalColumn {
|
||||
rows := func(target int64, id string) map[string]any {
|
||||
return map[string]any{"id": id, "seq_id": target, "tenant_id": 10001}
|
||||
}
|
||||
return []ds02LocalColumn{{
|
||||
Table: "chunks",
|
||||
Column: "seq_id",
|
||||
Sources: []int64{41, 42},
|
||||
Expected: map[int64]int64{
|
||||
41: 100,
|
||||
42: 101,
|
||||
},
|
||||
ExpectedRows: map[int64]map[string]any{
|
||||
41: rows(100, "chunk-src"),
|
||||
42: rows(101, "chunk-src2"),
|
||||
},
|
||||
Actual: map[int64]map[string]any{
|
||||
100: rows(100, "chunk-src"),
|
||||
101: rows(101, "chunk-src2"),
|
||||
},
|
||||
}}
|
||||
}
|
||||
|
||||
func ds02UnitLedger() []libraryrelease.LocalIDMapping {
|
||||
return []libraryrelease.LocalIDMapping{
|
||||
{Table: "chunks", Column: "seq_id", Source: "41", Target: "100"},
|
||||
{Table: "chunks", Column: "seq_id", Source: "42", Target: "101"},
|
||||
}
|
||||
}
|
||||
|
||||
func TestDS02MappingOracleUnitCases(t *testing.T) {
|
||||
valid := ds02CheckLocalIDMapping(ds02UnitColumns(), ds02UnitLedger())
|
||||
if len(valid) != 0 {
|
||||
t.Fatalf("valid ledger must be green, got %v", valid)
|
||||
}
|
||||
cases := []struct {
|
||||
name string
|
||||
build func() []libraryrelease.LocalIDMapping
|
||||
want string
|
||||
}{
|
||||
{"swapped-targets", func() []libraryrelease.LocalIDMapping {
|
||||
return ds02FlipMappingTargets(ds02UnitLedger(), "chunks")
|
||||
}, "wrong target pair"},
|
||||
{"nonexistent-target", func() []libraryrelease.LocalIDMapping {
|
||||
return ds02ReplaceMapping(ds02UnitLedger(), "chunks", "target", "999")
|
||||
}, "not an independently predicted target"},
|
||||
{"replaced-source", func() []libraryrelease.LocalIDMapping {
|
||||
return ds02ReplaceMapping(ds02UnitLedger(), "chunks", "source", "999")
|
||||
}, "unexpected ledger source"},
|
||||
{"missing-entry", func() []libraryrelease.LocalIDMapping {
|
||||
return ds02DropMapping(ds02UnitLedger(), "chunks")
|
||||
}, "missing ledger source"},
|
||||
{"duplicate-pair", func() []libraryrelease.LocalIDMapping {
|
||||
return ds02DuplicateMapping(ds02UnitLedger(), "chunks")
|
||||
}, "duplicate ledger source"},
|
||||
{"wrong-column", func() []libraryrelease.LocalIDMapping {
|
||||
return ds02ReplaceMapping(ds02UnitLedger(), "chunks", "column", "id")
|
||||
}, "ledger column"},
|
||||
{"garbled-source", func() []libraryrelease.LocalIDMapping {
|
||||
return ds02ReplaceMapping(ds02UnitLedger(), "chunks", "source", "41x")
|
||||
}, "not a positive integer"},
|
||||
{"unexpected-table", func() []libraryrelease.LocalIDMapping {
|
||||
ledger := ds02UnitLedger()
|
||||
return append(ledger, libraryrelease.LocalIDMapping{Table: "knowledges", Column: "seq_id", Source: "1", Target: "2"})
|
||||
}, "unexpected ledger table"},
|
||||
}
|
||||
for _, scenario := range cases {
|
||||
diffs := ds02CheckLocalIDMapping(ds02UnitColumns(), scenario.build())
|
||||
joined := strings.Join(diffs, "\n")
|
||||
if len(diffs) == 0 {
|
||||
t.Fatalf("%s: checker stayed green", scenario.name)
|
||||
}
|
||||
if !strings.Contains(joined, scenario.want) {
|
||||
t.Fatalf("%s: failed for an unrelated reason:\n%s", scenario.name, joined)
|
||||
}
|
||||
}
|
||||
}
|
||||
|
||||
// 真实目标行被改错一个字也必须红:配对正确但行内容不对不算通过。
|
||||
func TestDS02MappingOracleChecksTargetRowContent(t *testing.T) {
|
||||
columns := ds02UnitColumns()
|
||||
columns[0].Actual[101] = map[string]any{"id": "chunk-src2", "seq_id": 101, "tenant_id": 10001, "content": "tampered"}
|
||||
columns[0].ExpectedRows[42] = map[string]any{"id": "chunk-src2", "seq_id": 101, "tenant_id": 10001, "content": "expected"}
|
||||
diffs := ds02CheckLocalIDMapping(columns, ds02UnitLedger())
|
||||
joined := strings.Join(diffs, "\n")
|
||||
if !strings.Contains(joined, "row mismatch") {
|
||||
t.Fatalf("row content tamper must be red, got %v", diffs)
|
||||
}
|
||||
}
|
||||
File diff suppressed because it is too large
Load Diff
@@ -117,6 +117,8 @@ type writeSetFixtureOptions struct {
|
||||
reset bool
|
||||
archiveRoot string
|
||||
index string
|
||||
// ddl 非空时替换最小夹具 schema:DS-02 冻结 bundle 用同一份 DDL 初始化两个隔离目标。
|
||||
ddl []string
|
||||
}
|
||||
|
||||
func openWriteSetFixtureWith(t *testing.T, options writeSetFixtureOptions) *writeSetFixture {
|
||||
@@ -159,6 +161,15 @@ func openWriteSetFixtureWith(t *testing.T, options writeSetFixtureOptions) *writ
|
||||
t.Fatalf("reset isolated schema: %v", err)
|
||||
}
|
||||
}
|
||||
// 冻结 bundle 自带完整 DDL 时,不叠加最小夹具(否则两个目标的 schema 又不同)。
|
||||
if len(options.ddl) > 0 {
|
||||
for _, statement := range options.ddl {
|
||||
statement = strings.ReplaceAll(statement, "%BUCKET%", wsBucket)
|
||||
if _, err := pool.Exec(ctx, statement); err != nil {
|
||||
t.Fatalf("bundle schema: %v\n%s", err, statement)
|
||||
}
|
||||
}
|
||||
}
|
||||
schemaStatements := []string{
|
||||
libraryTestSchema,
|
||||
// 清掉共用夹具里的示例行:本文件只用自己造的目标/其它租户数据,
|
||||
@@ -177,7 +188,7 @@ func openWriteSetFixtureWith(t *testing.T, options writeSetFixtureOptions) *writ
|
||||
`INSERT INTO storage_backends VALUES('backend-target',10001,'minio','{"bucket_name":"` + wsBucket + `"}',now())`,
|
||||
`INSERT INTO knowledge_bases VALUES('` + wsTargetKB + `',10001,'{}',NULL),('` + wsOtherKB + `',10001,'{}',NULL),('` + wsSourceKB + `',10002,'{}',NULL)`,
|
||||
}
|
||||
if options.reset {
|
||||
if options.reset && len(options.ddl) == 0 {
|
||||
for _, statement := range schemaStatements {
|
||||
if _, err := pool.Exec(ctx, statement); err != nil {
|
||||
t.Fatalf("fixture schema: %v", err)
|
||||
|
||||
@@ -11,6 +11,8 @@
|
||||
"optional": [
|
||||
{"package":"knowledge-governance/internal/releaseadapter/v071","test":"TestDS02FullShapeOracleIsolated","reason":"需显式一次性本机PG/ES/MinIO:十表逐列/引用/向量/对象字节独立oracle、零Embedding计数与正文/向量/引用/映射变异自检;普通CI跳过不是通过"},
|
||||
{"package":"knowledge-governance/internal/releaseadapter/v071","test":"TestDS02LegacyCompatibilityMatrixIsolated","reason":"需显式一次性本机PG/ES/MinIO:旧manifest/V1/空作业或目标身份的正式入口拒绝且全数据hash不变;普通CI跳过不是通过"},
|
||||
{"package":"knowledge-governance/internal/releaseadapter/v071","test":"TestDS02FrozenBundleIsolated","reason":"需 KG_DS02_BUNDLE 指向的冻结输入 bundle 加一次性本机PG/ES/MinIO:与旧SHA同一bundle hash的新侧发布与独立oracle;普通CI没有bundle,跳过不是通过"},
|
||||
{"package":"knowledge-governance/internal/releaseadapter/v071","test":"TestDS02ProcessIdentity","reason":"需隔离运行器注入 test-only nonce/commit/源码树与二进制哈希期望;普通CI没有注入,跳过不是通过"},
|
||||
{"package":"knowledge-governance/cmd/worker","test":"TestR13AnchorWriteFailureBlocksTargetIsolated","reason":"需显式一次性本机治理PG:真实约束拒绝写锚点,验证目标零写入且不留假基线;普通CI跳过不是通过"},
|
||||
{"package":"knowledge-governance/internal/releaseadapter/v071","test":"TestR13OrphanOraclePropagatesDriverFailureIsolated","reason":"需显式一次性本机PG:用真实 statement timeout 让校验查询中途失败,断言不是\"无孤儿\";普通CI跳过不是通过"},
|
||||
{"package":"knowledge-governance/internal/releaseadapter/v071","test":"TestR13OrphanOracleRejectsMalformedAndUnknownDocumentsIsolated","reason":"需显式一次性本机PG/ES/MinIO:孤儿校验的缺失/未知 knowledge_id 分支;普通CI跳过不是通过"},
|
||||
|
||||
Reference in New Issue
Block a user