zheromiku
dcdc8d1ddd
全栈知识治理平台首次入库（P1-P10 + 发布链路模拟验证闭环）： - 治理核心：源目录/变更集/人工审核/发布批次/发布执行（fail-closed 闸口） - 测试通道：WeKnora 测试 KB 上传/轮询/验收；poll 完成时写入 parser_generation/index_generation，修复 manual/seed 路径发布闸口永久拦截 - 发布适配器 v071（本地 source=测试角色 / 云端 target=生产角色 模拟验证通过）： * ES 导出/导入 mapping 自适应（.keyword 子字段、可选 tenant_id） * OSS locator 支持嵌套 scheme；chunks.seq_id 由目标序列分配 * bundle 归档同身份重试原子替换；verifier 按 bundle chunk_type 计数 * 回滚 job payload 支持 prior_execution_id（strict 解码） - 三通道发布+回滚演练实测：publish 4/4 verified，检索命中， rollback 4/4 rolled_back，目标端 PG is_enabled=false、ES is_enabled=false - 前端 A·Data-console 风格全站统一，120 用例通过 - 门禁：go vet / go test 全包通过，gofmt 干净
20 lines
1.7 KiB
Python
20 lines
1.7 KiB
Python
"""Trigger one catalog refresh and verify its durable terminal state."""
|
|
import argparse,json,time,urllib.request,uuid
|
|
BASE='http://127.0.0.1:8088'
|
|
def get(path):
|
|
with urllib.request.urlopen(BASE+path,timeout=20) as response:return json.load(response)
|
|
def main():
|
|
parser=argparse.ArgumentParser();parser.add_argument('name');parser.add_argument('--timeout',type=int,default=600);args=parser.parse_args();source=next(item for item in get('/api/v1/source-catalog/sources')['data'] if item['name']==args.name);before=source['observed_at'];request=urllib.request.Request(BASE+f"/api/v1/source-catalog/sources/{source['connection_id']}/refresh",method='POST',headers={'Accept':'application/json','Idempotency-Key':'accept-'+uuid.uuid4().hex})
|
|
with urllib.request.urlopen(request,timeout=20) as response:job=json.load(response)['data']
|
|
print('job',job['id'],'source',args.name,'before',before,flush=True);seen=None;deadline=time.monotonic()+args.timeout
|
|
while time.monotonic()<deadline:
|
|
current=next(item for item in get('/api/v1/jobs?limit=50')['data'] if item['id']==job['id']);payload=current.get('payload') or {};state=(current['state'],payload.get('stage'),payload.get('progress'),payload.get('message'),payload.get('processed'),payload.get('total'))
|
|
if state!=seen:print(*state,flush=True);seen=state
|
|
if current['state'] in ('completed','failed'):break
|
|
time.sleep(1)
|
|
else:raise SystemExit('refresh timeout')
|
|
after=next(item for item in get('/api/v1/source-catalog/sources')['data'] if item['name']==args.name)
|
|
print('final',current['state'],'after',after['observed_at'],'files',after['file_count'],flush=True)
|
|
if current['state']!='completed' or after['observed_at']==before:raise SystemExit(1)
|
|
if __name__=='__main__':main()
|