Compare commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
a87c2154ff | ||
|
|
8f1010f967 | ||
|
|
e3d9021bb6 | ||
|
|
142ab523d6 |
No files matched your search
@@ -221,7 +221,7 @@ Design: [ext-quantum.md](../../doc/design/ext-quantum.md) · Q7: [ext-quantum-q7
|
|||||||
|
|
||||||
- `invoke` returns a record (`ok`, `code`, `stdout`, `stderr`, `ms`, `timed_out`, `truncated`, `result`); pass `input` for JSON stdin and `output="json"` for a parsed result.
|
- `invoke` returns a record (`ok`, `code`, `stdout`, `stderr`, `ms`, `timed_out`, `truncated`, `result`); pass `input` for JSON stdin and `output="json"` for a parsed result.
|
||||||
- `call` is JSON-in / JSON-out; `call_many` fans out one program over a list with ordered results.
|
- `call` is JSON-in / JSON-out; `call_many` fans out one program over a list with ordered results.
|
||||||
- `session_open` starts a persistent Python/Node kernel; `session_eval` evaluates source; `session_set` / `session_get` bridge values explicitly as JSON. Close it with `session_close`. JSON integers outside \(\pm(2^{53}-1)\) are refused (`json: integer outside V_safe`); use a decimal string + host `BigInt` for wider ints (`doc/design/v-safe-json.md`).
|
- `session_open` returns an opaque `handle` (not text; not JSON-serializable). `session_eval` / `set` / `get` borrow the handle; `session_close` consumes it (double-close / use-after-close fault). Prefer `foreign.replay_check` / language-level `foreign.oracle_journal` when comparing recordings (`replay_snapshot` only re-runs). JSON integers outside \(\pm(2^{53}-1)\) and ragged table columns are refused (`doc/design/v-safe-json.md`, `foreign-strong-correspondence.md`, `oracle-journal-values.md`).
|
||||||
- A view document opts into kernel state with `会话 = > foreign.session kernels=... cells=...`; the table names are free. `view` consumes only the `会话` handle and never scans source lines or reserved table names. Without `会话`, cells are stateless one-shot runs; no kernel is created. Clearing outputs calls `/api/session/clear` and keeps persistent kernel state. There is no separate notebook CLI mode or command, and no new Markdown marker exists.
|
- A view document opts into kernel state with `会话 = > foreign.session kernels=... cells=...`; the table names are free. `view` consumes only the `会话` handle and never scans source lines or reserved table names. Without `会话`, cells are stateless one-shot runs; no kernel is created. Clearing outputs calls `/api/session/clear` and keeps persistent kernel state. There is no separate notebook CLI mode or command, and no new Markdown marker exists.
|
||||||
- The same source remains the authority; state crossing kernels is explicit, never implicitly mirrored.
|
- The same source remains the authority; state crossing kernels is explicit, never implicitly mirrored.
|
||||||
|
|
||||||
|
|||||||
@@ -126,9 +126,12 @@ jobs:
|
|||||||
## Marqdo ${{ github.ref_name }}
|
## Marqdo ${{ github.ref_name }}
|
||||||
|
|
||||||
### 亮点 / Highlights
|
### 亮点 / Highlights
|
||||||
- **v2.2.2**:\(V_{\mathsf{safe}}\) JSON 整数——外联/`json` 拒绝域外整数,禁止静默扭曲;宽整数用十进制字符串
|
- **v2.4.0**:Oracle journal 作语言值——`foreign.oracle_journal`/`replay_check`;bytecode/frontend 硬化;MSRV 1.81
|
||||||
- **v2.2.2**: \(V_{\mathsf{safe}}\) JSON integers — foreign/`json` refuse OOD ints (no silent distortion); wide ints via decimal strings
|
- **v2.4.0**: Oracle journal as language values — foreign.oracle_journal/replay_check; bytecode/frontend hardening; MSRV 1.81
|
||||||
- **v2.2.2 ext**:扩展包同步 2.2.2 / Ext pack 2.2.2
|
- **v2.4.0 ext**:扩展包同步 2.4.0 / Ext pack 2.4.0
|
||||||
|
- **v2.3.0**:Foreign Strong——不透明 `handle`、仿射 close、`replay_check`/oracle journal、表 arity refuse、Ω∈V_safe
|
||||||
|
- **v2.3.0**: Foreign Strong — opaque handle, affine close, replay_check/oracle journal, table arity refuse, Ω∈V_safe
|
||||||
|
- **v2.3.0 ext**:扩展包同步 2.3.0 / Ext pack 2.3.0
|
||||||
- **v2.2.1**:view / 静态导出——修复 occlusion 与中等宽度下大纲侧栏掉到正文下方
|
- **v2.2.1**:view / 静态导出——修复 occlusion 与中等宽度下大纲侧栏掉到正文下方
|
||||||
- **v2.2.1**: view / static export — fix outline rail nested under document (occlusion + mid-width layout)
|
- **v2.2.1**: view / static export — fix outline rail nested under document (occlusion + mid-width layout)
|
||||||
- **v2.2.1 ext**:扩展包同步 2.2.1 / Ext pack 2.2.1
|
- **v2.2.1 ext**:扩展包同步 2.2.1 / Ext pack 2.2.1
|
||||||
|
|||||||
@@ -79,6 +79,9 @@ plugins/*/tmp/
|
|||||||
# Plot SVGs emitted beside tests / notebooks when demos run
|
# Plot SVGs emitted beside tests / notebooks when demos run
|
||||||
/tests/**/*-plot-*.svg
|
/tests/**/*-plot-*.svg
|
||||||
|
|
||||||
|
# Lean Lake build outputs (sources under verification/ stay tracked)
|
||||||
|
**/.lake/
|
||||||
|
|
||||||
# PLDI / thesis harness scratch must never land in this tree
|
# PLDI / thesis harness scratch must never land in this tree
|
||||||
.lx*-tmp/
|
.lx*-tmp/
|
||||||
|
|
||||||
|
|||||||
@@ -8,6 +8,56 @@
|
|||||||
|
|
||||||
### Changed
|
### Changed
|
||||||
|
|
||||||
|
## v2.4.0 — 2026-11-06
|
||||||
|
|
||||||
|
### Highlights
|
||||||
|
|
||||||
|
**Oracle journal 作语言值**:`foreign.oracle_journal` / `foreign.replay_check` 把观测与纯比较暴露为普通 Marqdo 值(非仅 notebook API);handle/code 不得入 journal;`copy` 拒绝 code。Bytecode / frontend / foreign session 模块化与 applications 金样例;`verification/replay-policy` Lean 策略身份。CLI · wasm · ext **2.4.0**。
|
||||||
|
|
||||||
|
**核心表面 Δ(Core surface Δ)**:**无增删**(仍 19 个构造)——变更在 `lib/foreign` 宿主表面与实现结构,不增 Markdown 标记。
|
||||||
|
|
||||||
|
### Added
|
||||||
|
|
||||||
|
- **`foreign.oracle_journal` / `foreign.replay_check`**:文档级观测列表与纯 journal 比较(`doc/design/oracle-journal-values.md`)。
|
||||||
|
- **回归**:`foreign-oracle-{journal,names,failure}`、`foreign-{,session-}copy-code-refuse`、`tests/oracle_journal.rs`、applications 四场景、`verification/replay-policy`。
|
||||||
|
- **文档**:`oracle-journal-values.md`;frontend-call / foreign-library 方向笔记。
|
||||||
|
|
||||||
|
### Fixed
|
||||||
|
|
||||||
|
- **view notebook API**:`OnceLock` 初始化等待兼容 MSRV **1.81**(不再调用 ≥1.84 的 `wait`)。
|
||||||
|
- JSON `float_roundtrip` 特征,减少外联浮点往返失真。
|
||||||
|
|
||||||
|
### Changed
|
||||||
|
|
||||||
|
- Bytecode compile/VM、foreign_doc/session、sema resolution、notebook interrupt 路径拆模块(行为对齐既有 Strong 契约)。
|
||||||
|
|
||||||
|
## v2.3.0 — 2026-11-01
|
||||||
|
|
||||||
|
### Highlights
|
||||||
|
|
||||||
|
**Foreign Strong(session / value / replay)**:会话句柄改为不透明 `handle`(不可 JSON 过桥、禁止 text 伪造);`close` 仿射消费(双 close / use-after-close 故障);`replay_check` 对照 oracle journal(旧 `replay_snapshot` 仅重跑保留);GFM 表行 arity 与列长映射拒绝静默补空;Ω 返回域外整数故障。对齐 PLDI Strong 叙事与 Lean SessionReg / \(V_{\mathsf{safe}}\)。CLI · wasm · ext **2.3.0**。
|
||||||
|
|
||||||
|
**核心表面 Δ(Core surface Δ)**:**无增删**(仍 19 个构造)——破坏面在宿主 foreign/session/JSON 与表解析纪律,不增 Markdown 标记。
|
||||||
|
|
||||||
|
### Added
|
||||||
|
|
||||||
|
- **`Value::Handle`**:`session_open` 返回句柄;session 操作拒绝 text 伪造。
|
||||||
|
- **`DocumentSession::replay_check`** + API `/api/session/snapshot/replay_check`;snapshot 录音字段 + **`oracle_journal`**(与 execution journal 分名)。
|
||||||
|
- **API** `/api/session/oracle_journal`。
|
||||||
|
- **文档**:`doc/design/foreign-strong-correspondence.md`;`v-safe-json.md` 补 Handle / 列 arity / Ω 门。
|
||||||
|
- **回归**:`foreign-session-{use-before-open,use-after-close,double-close,cold-replay-empty,isolation,handle-no-serialize,result-vsafe-refuse}`;`tests/errors/table-arity.mq.md`。
|
||||||
|
|
||||||
|
### Fixed
|
||||||
|
|
||||||
|
- 不等宽 GFM 表不再静默补空单元格;解析报 `table row arity mismatch`。
|
||||||
|
- Py/Node session bootstrap:Ω 结果 OOD 整数不再 `default=str` 偷渡,宿主升级为故障。
|
||||||
|
|
||||||
|
### Changed
|
||||||
|
|
||||||
|
- **`session_close`**:未知 / 已关闭句柄 → 故障(不再返回 `False`)。
|
||||||
|
- **`session_list`**:`id` 字段为 `handle`。
|
||||||
|
- Snapshot export 含 `ok`/`code`/`stdout`/`result`/`source_hash` 与 `oracle_journal`。
|
||||||
|
|
||||||
## v2.2.2 — 2026-11-01
|
## v2.2.2 — 2026-11-01
|
||||||
|
|
||||||
### Highlights
|
### Highlights
|
||||||
|
|||||||
Generated
+2
-2
@@ -572,7 +572,7 @@ checksum = "0ceec5bc11778974d1bcb055b18002eba7f4b3518b6a0081b3af5f21666da9ad"
|
|||||||
|
|
||||||
[[package]]
|
[[package]]
|
||||||
name = "marqdo"
|
name = "marqdo"
|
||||||
version = "2.2.2"
|
version = "2.4.0"
|
||||||
dependencies = [
|
dependencies = [
|
||||||
"anyhow",
|
"anyhow",
|
||||||
"assert_cmd",
|
"assert_cmd",
|
||||||
@@ -611,7 +611,7 @@ dependencies = [
|
|||||||
|
|
||||||
[[package]]
|
[[package]]
|
||||||
name = "marqdo-wasm"
|
name = "marqdo-wasm"
|
||||||
version = "2.2.2"
|
version = "2.4.0"
|
||||||
dependencies = [
|
dependencies = [
|
||||||
"marqdo",
|
"marqdo",
|
||||||
"serde_json",
|
"serde_json",
|
||||||
|
|||||||
+2
-2
@@ -1,6 +1,6 @@
|
|||||||
[package]
|
[package]
|
||||||
name = "marqdo"
|
name = "marqdo"
|
||||||
version = "2.2.2"
|
version = "2.4.0"
|
||||||
edition = "2021"
|
edition = "2021"
|
||||||
license = "Apache-2.0"
|
license = "Apache-2.0"
|
||||||
description = "Marqdo — Markdown markers as an interpreted programming language"
|
description = "Marqdo — Markdown markers as an interpreted programming language"
|
||||||
@@ -30,7 +30,7 @@ chrono = { version = "0.4", default-features = false, features = ["clock", "std"
|
|||||||
clap = { version = "=4.4.18", features = ["derive"], optional = true }
|
clap = { version = "=4.4.18", features = ["derive"], optional = true }
|
||||||
pulldown-cmark = "0.12"
|
pulldown-cmark = "0.12"
|
||||||
serde = { version = "1", features = ["derive"] }
|
serde = { version = "1", features = ["derive"] }
|
||||||
serde_json = "1"
|
serde_json = { version = "1", features = ["float_roundtrip"] }
|
||||||
thiserror = "1"
|
thiserror = "1"
|
||||||
tiny_http = { version = "0.12", optional = true }
|
tiny_http = { version = "0.12", optional = true }
|
||||||
sha2 = { version = "=0.10.9", default-features = false }
|
sha2 = { version = "=0.10.9", default-features = false }
|
||||||
|
|||||||
@@ -284,9 +284,11 @@ marqdo catalog public -o .marqdo
|
|||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## 现状(v2.2.2)
|
## 现状(v2.4.0)
|
||||||
|
|
||||||
- **\(V_{\mathsf{safe}}\) JSON 整数(v2.2.2)**:外联与 `lib/json` 拒绝 `|n| > 2^{53}-1` 的 JSON 整数(对齐 Lean ForeignJSON);宽整数用十进制字符串 + Node `BigInt`。扩展包同步 **2.2.2**
|
- **Oracle journal 语言值(v2.4.0)**:`foreign.oracle_journal` / `foreign.replay_check` 作普通值;handle/code 拒入 journal;bytecode/frontend 硬化;扩展包同步 **2.4.0**
|
||||||
|
- **Foreign Strong(v2.3.0)**:会话 `handle`(不可过桥)· 仿射 close · `replay_check`/oracle journal · 表 arity refuse · Ω∈\(V_{\mathsf{safe}}\)。扩展包同步 **2.3.0**
|
||||||
|
- **\(V_{\mathsf{safe}}\) JSON 整数(v2.2.2)**:外联与 `lib/json` 拒绝 `|n| > 2^{53}-1` 的 JSON 整数(对齐 Lean ForeignJSON);宽整数用十进制字符串 + Node `BigInt`。
|
||||||
- **view 大纲侧栏(v2.2.1)**:修复 occlusion 文档与中等宽度下 Functions / Variables 掉到正文下方的问题;静态 `view output` 同源。
|
- **view 大纲侧栏(v2.2.1)**:修复 occlusion 文档与中等宽度下 Functions / Variables 掉到正文下方的问题;静态 `view output` 同源。
|
||||||
- **函数级调用(v2.2.0)**:`marqdo call <文件.mq.md> <函数> 名字=值`。同一份文档给人读,也按函数执行;Tree 与 Bytecode 都跑被点名的函数,不回退到 `# main`。默认只执行纯函数。`--json` 给 Agent 读取结果或诊断。说明与价值见 [22-函数调用](public/features/22-函数调用.mq.md)。示例:`marqdo call examples/calculator.mq.md 计算器.加法 a=2 b=3` → `5`。扩展包同步 **2.2.1**
|
- **函数级调用(v2.2.0)**:`marqdo call <文件.mq.md> <函数> 名字=值`。同一份文档给人读,也按函数执行;Tree 与 Bytecode 都跑被点名的函数,不回退到 `# main`。默认只执行纯函数。`--json` 给 Agent 读取结果或诊断。说明与价值见 [22-函数调用](public/features/22-函数调用.mq.md)。示例:`marqdo call examples/calculator.mq.md 计算器.加法 a=2 b=3` → `5`。扩展包同步 **2.2.1**
|
||||||
- **Agent 可靠工作台(v2.1.5)**:ResourceView(JSON/CSV/PDF/image)· ToolSpec 授权先于调用 · CheckpointV2 / EffectLedger / ContextPackV2 · EKC `ir.json` 暖机与 `--refresh` · Web 短读/控制与 execute 槽隔离;扩展包同步 **2.1.5**
|
- **Agent 可靠工作台(v2.1.5)**:ResourceView(JSON/CSV/PDF/image)· ToolSpec 授权先于调用 · CheckpointV2 / EffectLedger / ContextPackV2 · EKC `ir.json` 暖机与 `--refresh` · Web 短读/控制与 execute 槽隔离;扩展包同步 **2.1.5**
|
||||||
@@ -331,7 +333,7 @@ marqdo catalog public -o .marqdo
|
|||||||
- **浏览器 Marqdo(WASM)**:`marqdo wasm build` + 官方 bridge 自启(作者零业务 JS;桥内可含列表/路由/storage/ws/文件/Canvas/音频/Observer/拖放);`lib/browser` + GFM;`web.client_embed`;示例 [browser-hello](examples/browser-hello/) · [browser-app](examples/browser-app/) · [browser-media](examples/browser-media/) · [web-client-site](examples/web-client-site/)([ADR 0002](doc/adr/0002-browser-marqdo-wasm.md) · [D](doc/roadmap/browser-wasm-d.md) · [E](doc/roadmap/browser-wasm-e.md) · [F](doc/roadmap/browser-wasm-f.md))
|
- **浏览器 Marqdo(WASM)**:`marqdo wasm build` + 官方 bridge 自启(作者零业务 JS;桥内可含列表/路由/storage/ws/文件/Canvas/音频/Observer/拖放);`lib/browser` + GFM;`web.client_embed`;示例 [browser-hello](examples/browser-hello/) · [browser-app](examples/browser-app/) · [browser-media](examples/browser-media/) · [web-client-site](examples/web-client-site/)([ADR 0002](doc/adr/0002-browser-marqdo-wasm.md) · [D](doc/roadmap/browser-wasm-d.md) · [E](doc/roadmap/browser-wasm-e.md) · [F](doc/roadmap/browser-wasm-f.md))
|
||||||
- 选型:[ADR 0001 — Rust](doc/adr/0001-implementation-language.md) · [ADR 0002 — 浏览器 WASM](doc/adr/0002-browser-marqdo-wasm.md)(C0–C5 完结,见 [roadmap/browser-wasm.md](doc/roadmap/browser-wasm.md))· [ADR 0003 — 异步效应](doc/adr/0003-browser-async-effects.md)
|
- 选型:[ADR 0001 — Rust](doc/adr/0001-implementation-language.md) · [ADR 0002 — 浏览器 WASM](doc/adr/0002-browser-marqdo-wasm.md)(C0–C5 完结,见 [roadmap/browser-wasm.md](doc/roadmap/browser-wasm.md))· [ADR 0003 — 异步效应](doc/adr/0003-browser-async-effects.md)
|
||||||
|
|
||||||
### 如何使用最新 Marqdo(v2.2.2)
|
### 如何使用最新 Marqdo(v2.4.0)
|
||||||
|
|
||||||
**安装解释器(任选其一)**
|
**安装解释器(任选其一)**
|
||||||
|
|
||||||
@@ -346,7 +348,7 @@ marqdo catalog public -o .marqdo
|
|||||||
```bash
|
```bash
|
||||||
# 1) 源码安装(跟 tag 或 main)
|
# 1) 源码安装(跟 tag 或 main)
|
||||||
git clone https://github.com/cflmy/marqdo.git && cd marqdo
|
git clone https://github.com/cflmy/marqdo.git && cd marqdo
|
||||||
git checkout v2.2.2 # 或留在 main
|
git checkout v2.4.0 # 或留在 main
|
||||||
cargo build --release
|
cargo build --release
|
||||||
export PATH="$PWD/target/release:$PATH"
|
export PATH="$PWD/target/release:$PATH"
|
||||||
marqdo version
|
marqdo version
|
||||||
@@ -387,7 +389,7 @@ marqdo wasm build
|
|||||||
# → dist/wasm/ … 见 examples/browser-hello/
|
# → dist/wasm/ … 见 examples/browser-hello/
|
||||||
|
|
||||||
# 6) Releases:Windows exe/zip/vsix;Linux CLI zip + native `.so` zip
|
# 6) Releases:Windows exe/zip/vsix;Linux CLI zip + native `.so` zip
|
||||||
# https://github.com/cflmy/marqdo/releases/tag/v2.2.2
|
# https://github.com/cflmy/marqdo/releases/tag/v2.4.0
|
||||||
```
|
```
|
||||||
|
|
||||||
开发期也可用 `cargo run -- …` 代替已安装的 `marqdo`:
|
开发期也可用 `cargo run -- …` 代替已安装的 `marqdo`:
|
||||||
|
|||||||
@@ -1,6 +1,6 @@
|
|||||||
[package]
|
[package]
|
||||||
name = "marqdo-wasm"
|
name = "marqdo-wasm"
|
||||||
version = "2.2.2"
|
version = "2.4.0"
|
||||||
edition = "2021"
|
edition = "2021"
|
||||||
license = "Apache-2.0"
|
license = "Apache-2.0"
|
||||||
description = "Marqdo interpreter as WebAssembly (browser host bridge)"
|
description = "Marqdo interpreter as WebAssembly (browser host bridge)"
|
||||||
|
|||||||
Vendored
+14
@@ -1,3 +1,17 @@
|
|||||||
|
marqdo (2.4.0-1ppa1) noble; urgency=medium
|
||||||
|
|
||||||
|
* Marqdo 2.4.0: oracle journal as language values (foreign.oracle_journal /
|
||||||
|
replay_check), bytecode/frontend hardening, MSRV 1.81 OnceLock wait fix.
|
||||||
|
|
||||||
|
-- Marqdo Maintainers <cflmy@users.noreply.github.com> Fri, 06 Nov 2026 15:15:00 +0800
|
||||||
|
|
||||||
|
marqdo (2.3.0-1ppa1) noble; urgency=medium
|
||||||
|
|
||||||
|
* Marqdo 2.3.0: Strong foreign session — opaque Handle, affine close,
|
||||||
|
replay_check vs oracle journal, table arity refuse, Omega V_safe gate.
|
||||||
|
|
||||||
|
-- Marqdo Maintainers <cflmy@users.noreply.github.com> Sat, 01 Nov 2026 14:45:00 +0800
|
||||||
|
|
||||||
marqdo (2.2.2-1ppa1) noble; urgency=medium
|
marqdo (2.2.2-1ppa1) noble; urgency=medium
|
||||||
|
|
||||||
* Marqdo 2.2.2: V_safe JSON integer contract on foreign/json bridge —
|
* Marqdo 2.2.2: V_safe JSON integer contract on foreign/json bridge —
|
||||||
|
|||||||
@@ -0,0 +1,24 @@
|
|||||||
|
# 外联库论文的研究方向
|
||||||
|
|
||||||
|
作者于 2026-11-05 将论文主线明确为:**叙述本身是程序,外部代码是值**。
|
||||||
|
Marqdo 的外联库用于在这一宿主模型中组合既有语言的计算能力,统一说明、控制流、
|
||||||
|
代码复用、状态与显式数据交换。论文应先解释 Notebook/文学编程中的实际设计问题,
|
||||||
|
再给出解决方案、可核验的收益、形式化依据和应用实验。
|
||||||
|
|
||||||
|
后续实现工作围绕绑定的代码值、参数化调用、持久会话、复制值和文档计划展开。
|
||||||
|
生命周期、值域和重放机制为这个统一设计提供保证;不能将重放检查器重新提升成
|
||||||
|
取代外联库与叙述式编程的论文主题。不得把未测的人因优势或未证明的实现正确性
|
||||||
|
写成既成事实。
|
||||||
|
|
||||||
|
完整方向文件在论文工作区:
|
||||||
|
|
||||||
|
- 方向(当前):`MarqdoThesis/PLDI/design/V7-NARRATIVE-FIRST-DIRECTION-2026-11-05.md`
|
||||||
|
- v6 方向(历史):`MarqdoThesis/PLDI/design/V6-NARRATIVE-FIRST-DIRECTION-2026-11-05.md`
|
||||||
|
- 证据映射:`MarqdoThesis/PLDI/design/V6-EVIDENCE-MAP-2026-11-05.md`
|
||||||
|
- 章节与页预算:`MarqdoThesis/PLDI/design/V6-OUTLINE-2026-11-05.md`
|
||||||
|
|
||||||
|
当前稿位于 `MarqdoThesis/PLDI/paper-v7`;v6 保留,历史 v5 及其证据保留。方向文件取代了
|
||||||
|
此前把论文缩成“外联会话值 + 因果重放”的 N3 路线:重放是支撑机制,不是主线。
|
||||||
|
|
||||||
|
2026-11-05 交付:`MarqdoThesis/PLDI/paper-v7/main.pdf`,正文(含 AI Use)20 页。
|
||||||
|
v6 保留为上一版尝试;更早的 v6 草稿保留在 `paper-v6-draft-2026-11-05/`。
|
||||||
@@ -0,0 +1,44 @@
|
|||||||
|
# Foreign Strong: Lean ↔ host correspondence
|
||||||
|
|
||||||
|
2026-11-02 补充:`ForeignSource.lean` 对显式局部环境、返回、函数调用/递归、
|
||||||
|
分支和有界 while 的源解释器与独立 effect 编译器证明一般精化,并推出安全
|
||||||
|
观察和旧句柄不可复活。`CheckForeignSource.lean` 消费真实加载后 AST 的显式
|
||||||
|
适配格式,用独立 counter oracle 对照 tree/bytecode 的返回、journal、fault
|
||||||
|
与故障后 n。它已用于发现并修复 tree 的父词法作用域查找缺陷。
|
||||||
|
这是源控制流层的证明与实现 translation validation;Rust parser/adapter、
|
||||||
|
全部 AST 构造、机器数值运算和物理调度的完整 refinement 仍须完成。
|
||||||
|
模型中的 fuel 是分析界限,不能称为真实程序必然终止或有界取消。
|
||||||
|
|
||||||
|
Pinned with PLDI Strong / paper-v5 (sessions as values; three gates).
|
||||||
|
Marqdo **2.3.0** host implements the same objects the Lean development decides.
|
||||||
|
|
||||||
|
| Lean / paper rule | Host surface | Evidence |
|
||||||
|
|---|---|---|
|
||||||
|
| `SessionReg` + `sessionOpen` / `Close` / `sessionEval` | `HostContext.foreign_sessions` + `Value::Handle` | `DocCalc.lean` S1–S6, `requires_live`; `foreign_session.rs` |
|
||||||
|
| `Ω(s, τ, c)` | Persistent kernel + process order | Oracle journal `(cell, source_hash, stdout, result)` |
|
||||||
|
| `SafeVal` / Encode / Decode | `src/host/json.rs` + bootstrap sanitize | `ForeignJSON.lean`; gold `foreign-*-vsafe-*` |
|
||||||
|
| Handle ∉ \(V_{\mathsf{safe}}\) | `value_to_json(Handle) → Err` | `foreign-session-handle-no-serialize.mq.md` |
|
||||||
|
| Closed / Closed-Close | use-after-close / double-close `Err` | gold misuse; `sessionClose_then_eval_none_w` |
|
||||||
|
| Oracle-Domain | Ω OOD integer → host `Err` | `foreign-session-result-vsafe-refuse.mq.md` |
|
||||||
|
| Table arity stuck | Parse refuse unequal GFM; JSON unequal columns | `Surface.lean`; `tests/errors/table-arity.mq.md` |
|
||||||
|
| Snapshot hash match/mismatch | `view/output.rs` `snapshot_page` | unit snapshot hash tests |
|
||||||
|
| **Thm. corr** (`corr_fresh_functional`) | Cold `evaldoc`; step values = Ω | `corr_step_eq_omega`; `corr_doc_fresh_foreign`; foreign-session gold |
|
||||||
|
| `OracleJournal` / `replayCheck` | `oracle_journal` + `DocumentSession::replay_check` | `replayCheck_*`; fate R1–R3 |
|
||||||
|
| `corr_fail_warm_store` / `corr_fail_reordered_plan` | cold vs warm / schedule order | DocCalc witnesses; Table corr-fail |
|
||||||
|
| Dual-backend differential | `tests/gold.rs` tree + bytecode | 308 × 2; foreign session/V_safe subset |
|
||||||
|
|
||||||
|
## Scope (not distance)
|
||||||
|
|
||||||
|
- SafeVal mechanization covers the **integer** fragment; finite floats are admitted by the host under the same refuse-not-coerce bridge policy for non-integers already in SafeVal.
|
||||||
|
- Session discipline is a **dynamic registry** (affine close + borrow-use). Static linear types over OS-killable processes are out of scope by design, not an unfinished host feature.
|
||||||
|
- Correspondence is mechanized for the **closed / fresh-open / functional-Ω** fragment (`corr_fresh_functional`): per-step interactive value = Ω answer, interactive runner = normative runner, `replayCheck` on the journal. Broken hypotheses are `corr_fail_*`. Host discharge is foreign-session gold plus R1–R3, not R1–R3 alone.
|
||||||
|
|
||||||
|
## Reviewer-driven implementation update (2026-11-01)
|
||||||
|
|
||||||
|
The independent live cursor and multisession action-plan simulation are in
|
||||||
|
`DocCalc.runForeignLive_simulation` and `MarqdoProof.ForeignTrace`. The language
|
||||||
|
now exposes oracle observations and pure journal comparison through
|
||||||
|
`foreign.oracle_journal` / `foreign.replay_check`. Strict interactive snapshot
|
||||||
|
replay uses the full oracle history with source identity and per-step input.
|
||||||
|
See `oracle-journal-values.md` for the API and the research experiment manifest
|
||||||
|
under `PLDI/experiments/reviewer-v5/` for exact source hashes and actual runs.
|
||||||
@@ -0,0 +1,336 @@
|
|||||||
|
# Executable call and integer semantics
|
||||||
|
|
||||||
|
This describes the implementation contract exercised by
|
||||||
|
`src/frontend_elaboration_tests.rs`; it is not a claim of a verified parser.
|
||||||
|
|
||||||
|
All explicit actual arguments evaluate once in authored order, including extra
|
||||||
|
named arguments whose values the callee does not read. Binding then permutes
|
||||||
|
already computed values into parameter slots. Named arguments take precedence
|
||||||
|
over positional filling; duplicate names and excess positional arguments fail.
|
||||||
|
A duplicate-actual binding fault occurs only when its call is reached, after
|
||||||
|
all explicit actuals have evaluated; it cannot reject an unused function at
|
||||||
|
compile time or erase an earlier argument effect.
|
||||||
|
Local calls and imported calls use the same order. Builtins and host primitives
|
||||||
|
must not reorder expression evaluation when selecting their parameter values.
|
||||||
|
|
||||||
|
All supplied parameters are available before defaults. Missing defaults execute
|
||||||
|
in parameter declaration order, once per call, in the target definition's
|
||||||
|
module and lexical scope. A default can see supplied parameters, earlier
|
||||||
|
computed defaults, and an explicitly bound method receiver. It cannot capture
|
||||||
|
the caller's locals. A still omitted later parameter is unbound. Explicit None
|
||||||
|
is a supplied value and never triggers a default. Required-argument validation
|
||||||
|
precedes default execution. Default expressions participate in receiver
|
||||||
|
classification, dependency analysis and transitive effect inference.
|
||||||
|
|
||||||
|
A dynamic method's signature belongs to the resolved receiver and selected
|
||||||
|
method; a different object's same-named method cannot supply its parameter
|
||||||
|
list. Imported definitions retain their module scope. A compiled document's
|
||||||
|
entry is selected only from its own module; an imported `main` is not an entry.
|
||||||
|
|
||||||
|
The bytecode retains argument names and explicit presence bits. Callee
|
||||||
|
prologues evaluate defaults in their own frame. Local slots distinguish an
|
||||||
|
unbound slot from a slot holding None. Local, constant, call-layout and jump
|
||||||
|
indices use container-sized indices rather than unchecked 8/16-bit casts.
|
||||||
|
Scratch slots are reused across sequential calls while pending outer actuals
|
||||||
|
remain live. Scalar constant interning uses a hash table; floating constants
|
||||||
|
are keyed by their exact bits.
|
||||||
|
|
||||||
|
Host integers are signed 64-bit values. Add, subtract, multiply, divide and
|
||||||
|
negation report a language error on overflow in every build profile; division
|
||||||
|
by zero is a separate error. Division truncates toward zero. The negative
|
||||||
|
endpoint has a valid signed literal. Float-to-int conversion rejects nonfinite
|
||||||
|
or out-of-range inputs instead of silently saturating. This local integer
|
||||||
|
domain is distinct from the narrower continuous foreign-copy domain.
|
||||||
|
|
||||||
|
The Lean call-combinator proof preserves complete interaction programs for
|
||||||
|
arbitrary argument evaluators, including failure and reply-dependent requests.
|
||||||
|
The integer model specifies exact arithmetic followed by representability
|
||||||
|
checking. Native documents, independently derived Python expectations, a Lean
|
||||||
|
arithmetic consumer and isolated source mutations validate the implementation
|
||||||
|
links. These do not prove the entire Rust parser, binder, object representation
|
||||||
|
or adapter. The research coverage ledger must keep those obligations explicit.
|
||||||
|
|
||||||
|
## Module identity, entry inputs and source-bound invocation
|
||||||
|
|
||||||
|
Instances retain the existing map representation and safe-copy domain. The
|
||||||
|
reserved `_type_module` field is a list of import binding names, paired with
|
||||||
|
`_type`. Class selection uses that module instance within the active import
|
||||||
|
tree; inherited methods resolve their bases in the defining module. Equal
|
||||||
|
class names in different imports remain distinct. These fields are ordinary,
|
||||||
|
forgeable data, not capabilities or globally portable nominal identities.
|
||||||
|
Round trips through Python/Node preserve these descriptors in the same module
|
||||||
|
context. Opaque session handles remain outside the copy domain.
|
||||||
|
|
||||||
|
Entry metadata is passed to `Vm::run`, never compiled into `main`'s body.
|
||||||
|
Explicit named/recursive invocations of `main` therefore keep their own inputs.
|
||||||
|
Defaults run with the invocation's actual registry; a session-valued default
|
||||||
|
must not be evaluated in a separate interpreter and then injected into a VM.
|
||||||
|
Reads appearing only in explicit/prose defaults participate in input inference
|
||||||
|
and effect analysis. Default failures use the parameter declaration's span.
|
||||||
|
Source-bound APIs preserve the selected declaration's source identity and
|
||||||
|
span, even when two declarations have the same dotted path. Textual path calls
|
||||||
|
retain the existing first-declaration rule. Duplicate parameter names are
|
||||||
|
rejected because they cannot define distinct binding slots.
|
||||||
|
|
||||||
|
Both backends retain parameter, return and local field contracts. Bytecode
|
||||||
|
checks supplied/defaulted inputs before the body, explicit returns before
|
||||||
|
returning, table bindings before writing a local and direct footnote accesses
|
||||||
|
before/after lookup. Unknown fields report the contract error before a generic
|
||||||
|
missing-key error. Entry/raw invocations also check their completed inputs.
|
||||||
|
Contract diagnostics retain the declaration quote and the failure location.
|
||||||
|
|
||||||
|
## Refinement obligations and current evidence
|
||||||
|
|
||||||
|
| Link | Mechanized result or implementation evidence | Remaining obligation |
|
||||||
|
|---|---|---|
|
||||||
|
| Raw Markdown to executable AST | Native explicit/prose defaults, source snapshots, parameter spans, inference and duplicate-parameter diagnostics | Prove the actual Rust classifier/parser and extraction rules; the older abstract grammar is not that proof |
|
||||||
|
| Loaded module tree to flattened declarations | Independent inventories of source digests, module instances, lexical parents, class/method ownership and resolved bases | Connect the actual resolver to the Lean namespace lookup model, including failed/ambiguous resolution |
|
||||||
|
| Effectful actual evaluation to parameter values | `FrontendCalls` proves interaction-program equality for arbitrary expression evaluators; native authored-order/unused-actual/builtin/foreign probes | Prove Rust scratch allocation, every expression case and its stack invariant against that combinator |
|
||||||
|
| Default evaluation and invocation inputs | Native callee-scope, presence, receiver, entry/raw/metadata, inference, error-span and stateful-session cases | A complete default-binding semantics and universal compiler refinement, including errors and host context |
|
||||||
|
| Module-qualified object dispatch | `ModularObjects` proves namespace flattening lookup, resolved-parent dispatch and safe descriptor round trips | Connect every real object constructor, resolver and copied descriptor to the model; justify Rust module-root lifetimes |
|
||||||
|
| Machine integers | `MachineInts` exact signed-64 model, checked boundary implementation, independent Python and Lean consumers | Connect Rust checked arithmetic and every conversion to the mathematical evaluator; floats remain an extension |
|
||||||
|
| Progressive contracts | Four real source boundary failures preserve codes, anchors and failure spans; valid contract execution | Universal contract-preservation theorem and imported declaration/call-site attribution |
|
||||||
|
| Source-bound external calls | Two same-path declarations execute their separately selected source lines on both backends | Full external argument validation, effect-policy and environment-injection refinement |
|
||||||
|
|
||||||
|
The ledger deliberately does not turn a new model lemma, a finite passing
|
||||||
|
corpus, or independent reconstruction into a complete frontend theorem. Those
|
||||||
|
remaining proof links are required to discharge the full frontend objective.
|
||||||
|
|
||||||
|
## Default prologue proof and imported contract attribution (November 4)
|
||||||
|
|
||||||
|
`DefaultPrologue.default_prologue_refines` relates source default binding, which
|
||||||
|
rechecks the current environment for omission, to a guarded block machine with
|
||||||
|
an immutable initial presence mask. It proves whole interaction-program equality
|
||||||
|
for arbitrary effectful evaluators, assuming distinct parameter slots and an
|
||||||
|
initially faithful presence mask. Earlier default stores preserve that invariant
|
||||||
|
for later parameters. The duplicate-slot counterexample issues two requests in
|
||||||
|
the machine versus one in the source, demonstrating why slot uniqueness matters.
|
||||||
|
Explicit None skips and immediate failure stopping are separately checked.
|
||||||
|
This is a model of guard/evaluate/store blocks, not a proof of the Rust emitter,
|
||||||
|
flat instruction stepping, actual expression compilation or parser.
|
||||||
|
|
||||||
|
The generated implementation family crosses all 27 omitted/int/None states for
|
||||||
|
three parameters with all six declaration orders. An independent environment
|
||||||
|
model checks 162 documents and 324 executions, including 34 faults when a default
|
||||||
|
reads a later omitted parameter. Source text is reconstructed independently;
|
||||||
|
expected traces are not derived from either backend. This finite family does
|
||||||
|
not prove arbitrary defaults. Imported argument-contract diagnostics now retain
|
||||||
|
the caller's failure span and source revision while pointing the declaration
|
||||||
|
anchor and suggestion at the actual library. Supplied and defaulted invalid
|
||||||
|
arguments both refuse before entering the callee body.
|
||||||
|
|
||||||
|
## Concrete name and flat-code interfaces
|
||||||
|
|
||||||
|
The compiler now borrows each original declaration and owning module while
|
||||||
|
flattening. Bare-call selection uses the same source `lookup_local` operation
|
||||||
|
as Tree, then maps the selected declaration identity to its flat index. This
|
||||||
|
removes a second, subtly different lookup algorithm: repeated top-level names
|
||||||
|
previously selected the first declaration in Tree but failed compilation in VM.
|
||||||
|
It does not prove the source lookup operation itself.
|
||||||
|
|
||||||
|
`NameSlots` proves reads, writes and the complete named-argument binding fold
|
||||||
|
commute with an injective local-name vector. Unknown names and repeated raw
|
||||||
|
API names are covered; repeated raw names retain last-write semantics. A
|
||||||
|
presence mask computed from initialized slots is faithful by construction.
|
||||||
|
The Rust raw entry and argument binder now derive their mask from the actual
|
||||||
|
initial logical slots. Method receiver aliases are overlaid only for default
|
||||||
|
evaluation, and restored into the body frame after logical argument checks.
|
||||||
|
`ReceiverDefaults` supplies the additional environment reasoning for explicitly
|
||||||
|
declared self/自 parameters; the slot theorem alone does not cover that case.
|
||||||
|
|
||||||
|
Every compiled Program is structurally verified before return, and the VM
|
||||||
|
verifies even publicly constructed/mutated Programs before any instruction.
|
||||||
|
All current opcode variants are handled exhaustively. Checks include operand
|
||||||
|
bounds, parameter/local prefix and injectivity, declaration and inheritance
|
||||||
|
forests, call-layout and function references, spans, reachable stack underflow,
|
||||||
|
branch/loop join heights and absence of leaked stack values on return. Missing
|
||||||
|
variable values remain language faults; this checker does not prohibit them.
|
||||||
|
|
||||||
|
Rust exports the computed per-PC heights alongside the real emitted opcode
|
||||||
|
text. `CheckFlatCertificate.lean` independently decodes that text and applies
|
||||||
|
an executable checker whose soundness is proved in `FlatCertificate`. Accepted
|
||||||
|
certificates preserve heights along every finite path and guarantee a valid
|
||||||
|
fetch with sufficient operands on each reachable PC, including loop prefixes.
|
||||||
|
The independent reader rejects unmodeled opcodes. Rust debug serialization and
|
||||||
|
opcode-to-concrete-VM-step correspondence remain interfaces to justify; a
|
||||||
|
structural certificate does not establish source/bytecode functional equality.
|
||||||
|
|
||||||
|
Neither this ordinary bytecode verification technique nor reuse of a resolver
|
||||||
|
is an originality claim. Complete functional lowering, parser semantics and the
|
||||||
|
Rust implementation correspondence remain open proof obligations.
|
||||||
|
|
||||||
|
## Functional expression checks and receiver views (November 4)
|
||||||
|
|
||||||
|
The emitter now records source-directed expression rules before emission, with
|
||||||
|
child order and exact instruction intervals. The mandatory native verifier
|
||||||
|
checks literal identity (including floating-point bits), local names, unary and
|
||||||
|
binary operators, short-circuit targets, interpolation, collections, indexing
|
||||||
|
and occlusion. Calls delegate staging and selection checks to `bytecode/call.rs`;
|
||||||
|
resolution and dispatch semantics remain explicit boundaries.
|
||||||
|
All seven statement forms have source-directed templates; a separate forest
|
||||||
|
check covers the entire default prologue, statement body and implicit return.
|
||||||
|
These checks detect stack-preserving semantic corruption, including Add to Sub,
|
||||||
|
and refuse it before host effects. A forged source witness remains outside this
|
||||||
|
check's guarantee; the recorder and actual AST correspondence need justification.
|
||||||
|
|
||||||
|
`ExpressionLowering` proves postfix expression compilation preserves complete
|
||||||
|
interaction programs for arbitrary effectful leaves and operator interpretations,
|
||||||
|
including faults and an arbitrary caller stack and continuation. `ShortCircuit`
|
||||||
|
proves the exact absolute-PC AND/OR macros under arbitrary effectful child
|
||||||
|
evaluation. `CheckExpressionLowering.lean` independently reads actual emitted
|
||||||
|
operators, constants and local names, and applies the proved core checker.
|
||||||
|
It counts call, collection, index and interpolation boundaries explicitly.
|
||||||
|
Child inlining, Rust VM stepping, leaf interpretation and source-witness fidelity
|
||||||
|
remain obligations; none of these results is whole-frontend functional refinement.
|
||||||
|
|
||||||
|
`ReceiverDefaults` proves that the source's separately maintained default
|
||||||
|
environment equals the machine's receiver view after every successful prefix.
|
||||||
|
The mask describes logical argument slots, while omitted self/自 defaults may
|
||||||
|
replace the evaluation view. Supplied None remains present. The real receiver
|
||||||
|
is restored before entering the body; argument contracts check both the logical
|
||||||
|
arguments at the call site and the restored frame at the declaration, preserving
|
||||||
|
source identity and diagnostic frames. The theorem composes this view invariant
|
||||||
|
with `DefaultPrologue` for arbitrary effectful defaults and distinct slots.
|
||||||
|
|
||||||
|
Concrete repairs also share scalar/unary semantics across evaluators, stringify
|
||||||
|
every interpolation part, allocate fresh loop temporaries, restrict dynamic
|
||||||
|
calls to their defining module scope, and enforce the existing one-million
|
||||||
|
truthy-iteration limit in VM as well as Tree. Regression evidence records each
|
||||||
|
repair separately from proof claims. These compiler techniques are not new
|
||||||
|
originality claims.
|
||||||
|
|
||||||
|
## Actual call staging and bounded control-flow macros
|
||||||
|
|
||||||
|
Every emitted call now has a separate source obligation captured before actuals
|
||||||
|
are replaced with scratch reads. The checker covers authored actual order,
|
||||||
|
evaluate/store/pop triples, source-local and loop-slot separation, nested-call
|
||||||
|
scratch separation, argument reloads, layouts, builtin selection/defaults, host
|
||||||
|
primitive identity, plugin name/pair ordering, method name/receiver and resolved
|
||||||
|
user target/tag. Every call expression must have exactly one obligation. The
|
||||||
|
reserved source-local prefix is established before any synthetic slots are
|
||||||
|
allocated. Disjoint nested calls may reuse scratch slots after their lifetimes.
|
||||||
|
|
||||||
|
`CallStaging` proves the flat evaluate/save/pop program restores an arbitrary
|
||||||
|
caller stack and has the same effects and failures as authored-order collection.
|
||||||
|
It proves outside slots unchanged and unique staged slots read back the exact
|
||||||
|
actual vector. The dispatch continuation is arbitrary and effectful, so binding,
|
||||||
|
defaults and receiver effects can follow collection without commuting effects.
|
||||||
|
`CheckCallStaging.lean` decodes real stores and reloads, applies the proved stage
|
||||||
|
checker and independently checks the complete selection/dispatch template.
|
||||||
|
Source-expression callback correspondence, name resolution and the semantics of
|
||||||
|
each dispatch continuation remain proof interfaces. Host parameter metadata is
|
||||||
|
an exported registry interface, not an independently verified registry theorem.
|
||||||
|
|
||||||
|
`WhileLowering` proves the condition/JF/check/body/backedge macro preserves the
|
||||||
|
complete interaction program for a bounded loop, including a final false
|
||||||
|
condition, condition/body faults, the truthy-iteration limit and early returns.
|
||||||
|
It relates an increasing native counter to a decreasing model budget and proves
|
||||||
|
admitted increments below one million fit u32. Model machine-step fuel is
|
||||||
|
distinct from this language-visible iteration budget.
|
||||||
|
`CheckStatementLowering.lean` checks actual default prologues, all seven statement
|
||||||
|
templates, forests and implicit returns, including the exact while macro layout.
|
||||||
|
The while theorem uses condition/body callbacks; concrete child inlining and the
|
||||||
|
full Rust state machine are not discharged by checking those layouts. Branches
|
||||||
|
and foreach currently have independent template evidence, not new functional
|
||||||
|
refinement theorems. No ordinary compiler-checking technique is a novelty claim.
|
||||||
|
|
||||||
|
## Loaded executable AST and coherent witness corruption
|
||||||
|
|
||||||
|
`SourceFunction` now captures parameters, defaults, executable bodies and complete
|
||||||
|
contract data directly from the loaded declaration before emission. The native
|
||||||
|
source checker walks that snapshot separately from the rule recorder, checks
|
||||||
|
ordered expression/statement correspondence and complete witness ownership,
|
||||||
|
and accounts for the generated scratch reloads explicitly. It also compares
|
||||||
|
full contracts with structural Rust equality, including types, nullable fields,
|
||||||
|
descriptions, source lines and declaration quotes. Contract presence alone would
|
||||||
|
not detect a Number-to-Any weakening.
|
||||||
|
|
||||||
|
The evidence exports the executable AST separately from the original module and
|
||||||
|
from the compiled snapshot. `CheckSourceWitness.lean` matches declaration
|
||||||
|
identities and applies `SourceWitness`'s proved ordered-tree reconstruction
|
||||||
|
checker. Interpolation parts, index labels, code payloads and formula structure
|
||||||
|
are retained; all formula floats and matrix entries retain their exact bits.
|
||||||
|
The old Debug formula text was insufficient for NaN payload identity. Inert
|
||||||
|
occlusion prose and pre-inference parser metadata are not execution-tree nodes.
|
||||||
|
|
||||||
|
Ten native coordinated-corruption cases change code together with its witness,
|
||||||
|
including operators, constants, variables, assignments, callees, NaN payloads,
|
||||||
|
index keys, interpolation, contract metadata and an orphan expression record.
|
||||||
|
Eight independent source-witness negatives include changing the compiled snapshot
|
||||||
|
as well. A coordinated wrong operator is a positive acceptance control for all
|
||||||
|
four earlier independent consumers and a rejection control for the AST checker.
|
||||||
|
This distinguishes trusted source correspondence from agreement among emitted
|
||||||
|
metadata fields.
|
||||||
|
|
||||||
|
The theorem proves exact correspondence of the supplied executable trees, hence
|
||||||
|
preservation under any interpretation of those trees. The native and JSON AST
|
||||||
|
adapters, normalization helpers and snapshot capture remain trusted interfaces.
|
||||||
|
No theorem here verifies the actual Markdown classifier/parser/inference or
|
||||||
|
connects every concrete Rust operation to the semantic models. A caller who
|
||||||
|
changes both the reference AST and its program has supplied a different
|
||||||
|
translation-validation input; this is not source authentication.
|
||||||
|
|
||||||
|
## Runtime argument-preparation faults
|
||||||
|
|
||||||
|
The expanded AST audit exposed a concrete acceptance mismatch: Tree can execute
|
||||||
|
main while an unused function contains a conflicting bracket modifier, whereas
|
||||||
|
VM compilation previously rejected the entire module. Modifier preparation now
|
||||||
|
lowers its failure to `RejectArgumentExpansion` before actual evaluation. A
|
||||||
|
provided default parameter, including explicit None, skips that fault; reaching
|
||||||
|
it preserves prior output and stops before actual effects or a suffix. The
|
||||||
|
error's message, span, source revision and diagnostic frames match Tree.
|
||||||
|
|
||||||
|
`CallExpr::for_evaluation` normalizes bare aliases before modifier expansion,
|
||||||
|
matching Tree's existing order. The expression checker validates an effect-free
|
||||||
|
fault leaf and the independent decoder handles its actual terminal opcode.
|
||||||
|
The AST adapter explicitly represents that executable fault without children;
|
||||||
|
unexecuted actual expressions are not falsely counted as evaluated code.
|
||||||
|
Two independent fault-opcode/message negatives and a positive AST-identity-only
|
||||||
|
control keep representation checking distinct from instruction interpretation.
|
||||||
|
|
||||||
|
The independent Python oracle now compares JSON values with exact recursive
|
||||||
|
types and requires integer arithmetic inputs to be actual integers. Python's
|
||||||
|
True==1 and 1==1.0 equalities must not erase language-visible value distinctions.
|
||||||
|
Four type-corruption controls are added. These improvements do not discharge
|
||||||
|
other call-error timing, parser, resolver, dispatch or Rust-step proof obligations.
|
||||||
|
|
||||||
|
## Native binding and declaration graph validation
|
||||||
|
|
||||||
|
Builtins, host primitives and plugins retain authored labels in native bytecode.
|
||||||
|
The shared value-independent binding plan selects named parameters before
|
||||||
|
positionals, preserves omitted optional bindings and unknown named extras, and
|
||||||
|
reports duplicate, missing and surplus positional arguments after actual effects.
|
||||||
|
Plugin lookup precedes signature binding. Eighteen reached/unreached error cases
|
||||||
|
check explicit expected output, messages, spans, source revisions and frames.
|
||||||
|
A registered C ABI echo probe checks mixed and extra named arguments. Execution
|
||||||
|
uses the native VM and plugin bridge throughout.
|
||||||
|
|
||||||
|
The source and flat declaration views share ordered resolution. A loaded snapshot
|
||||||
|
captures ordinal declaration paths, levels, child/root counts, imports and ordered
|
||||||
|
use aliases before emission. Verification checks identity, parent/child/root order,
|
||||||
|
module scopes and object/method names, then derives call targets independently of
|
||||||
|
emitted target records. Two-component paths check runtime receiver presence before
|
||||||
|
static fallback; an unbound reserved slot differs from a supplied None. Imports
|
||||||
|
retain priority. Resolution failures are native terminal instructions after actuals.
|
||||||
|
|
||||||
|
`NameResolution` proves first-match, path and lexical commutation under an
|
||||||
|
ordered embedding. Its rank checker proves sufficient depth and connects a
|
||||||
|
well-founded total source policy to flat lookup. Rust uses the same parent-chain
|
||||||
|
policy; parent-view extraction remains a trusted adapter. The finite checkers consume actual AST/flat evidence in
|
||||||
|
`CheckNameResolution.lean`. Nine native corruptions and seven independent graph
|
||||||
|
negatives test this boundary. A coordinated wrong target remains a positive control
|
||||||
|
for the older stack, staging and AST-shape consumers. Ordinary compiler correctness
|
||||||
|
ingredients are not novelty claims. Snapshot/JSON adapters, primitive registries,
|
||||||
|
parent-view extraction and concrete Rust
|
||||||
|
instruction refinement remain explicit obligations; universal frontend verification
|
||||||
|
and overall paper readiness are not established by these results.
|
||||||
|
|
||||||
|
`ArgumentBinding` separately models per-parameter omission permission and proves
|
||||||
|
value substitution preserves selections and faults. A successful index plan has
|
||||||
|
a finite-index witness. `CheckArgumentBinding.lean` checks actual static call
|
||||||
|
plans and an independently enumerated mask/label corpus. User VM calls now use
|
||||||
|
the shared planner with the callee default mask, correcting their surplus-count
|
||||||
|
diagnostic and preserving missing-required-before-default priority. Default
|
||||||
|
evaluation, contracts, dynamic signature selection and concrete Rust/JSON steps
|
||||||
|
remain separate interfaces. The mathematical planner is not a proof of the
|
||||||
|
entire native binding implementation.
|
||||||
@@ -1,5 +1,35 @@
|
|||||||
# 文档会话(View Cells)
|
# 文档会话(View Cells)
|
||||||
|
|
||||||
|
## 2026-11-02:并发控制与完整历史 v5
|
||||||
|
|
||||||
|
以下为当前实现;后文保留首版设计与当时的状态表。
|
||||||
|
|
||||||
|
- HTTP `kernel/interrupt` 查找已存在的会话,经独立控制器发送请求,不等待单元执行锁或其他文档的初始化。未打开、尚在初始化的会话返回错误,不启动新内核。已加载文档的源码文件被删除后仍可取消正在执行的单元。
|
||||||
|
- 内核的中断能力绑定其持有的子进程,并在回收前撤销;旧能力不能指向后来启动的内核。引导阶段的取消被暂存,收到 ready 后投递。逻辑取消输入会合并重复信号;投递错误明确返回。Windows 尚无对应的保状态中断实现。
|
||||||
|
- 取消使 Run All 在当前单元结束后停止,返回实际 `ran`、`remaining` 和 `cancelled`;不会继续运行后续单元。内核没有退出时,取消前已发生的状态修改保留。close 撤销 API 会话,重新打开不会激活旧引用。
|
||||||
|
- 完整历史 v5 将并发取消作为所在操作的 `controls` 输入记录:操作起点之后的微秒偏移及各内核的真实接收结果。严格回放按输入重新投递并重新观察回执;操作先结束时撤销剩余定时请求,不能流入下一操作。实际回执或观察不匹配就报告差异。v4 无控制输入的历史仍可检查;v4 中出现 controls 字段会被拒绝。
|
||||||
|
- 严格检查先完成纯验证,再启动回放内核。实际执行中,每次协议请求必须先与预期请求一致;实际回复和每个单元的观察、批次结果也立即比较。首个差异后停止依赖后缀,包括同一个 Run All 内的后续单元。未执行的观察标记 `compared=false`,不冒充已比较的第二个差异。
|
||||||
|
|
||||||
|
快照导出支持可选 `compact:true`。默认仍为完整 JSON;紧凑格式
|
||||||
|
`marqdo.history.dag` v1 对相同子值做自底向上共享,整数使用十进制文本、
|
||||||
|
浮点数保存 IEEE 位模式,保留映射顺序和全部历史字段。导入和严格回放会自动
|
||||||
|
识别格式。SHA-256 校验只检测内容一致性,不提供来源认证。
|
||||||
|
解码要求规范节点、向后引用、全部可达和唯一键,并在展开前检查最多
|
||||||
|
1,000,000 个节点、8,000,000 个展开值、512 MiB 保守展开预算、128 层深度;
|
||||||
|
展开后再次检查安全值域。此格式减少导出字节数,尚未减少录制时内存,也不保证更快。
|
||||||
|
|
||||||
|
实际取消实验覆盖 Unix 上同步 Python/Node 持久会话;不能推导任意外部代码均有界停止。
|
||||||
|
[Python 3.14 信号文档](https://docs.python.org/3.14/library/signal.html#execution-of-python-signal-handlers)
|
||||||
|
说明纯 C 计算可延迟信号处理;
|
||||||
|
[Node 22.22.1 vm 文档](https://nodejs.org/download/release/v22.22.1/docs/api/vm.html#timeout-interactions-with-asynchronous-tasks-and-promises)
|
||||||
|
说明异步任务可能逃出同步求值的中断范围。完整源码 elaboration、控制适配器、
|
||||||
|
真实时钟与信号调度到形式模型的 refinement 仍需完成,不能以这些测试代替。
|
||||||
|
|
||||||
|
相关实现:`foreign_session/control.rs`、`foreign_doc/control.rs`、
|
||||||
|
`foreign_doc/packing.rs`、`foreign_doc/replay.rs` 与 `view/notebook_api.rs`。
|
||||||
|
真实 TCP/HTTP 取消、逐单元副作用屏障和独立快照消费记录位于论文
|
||||||
|
`PLDI/experiments/reviewer-v5/`。
|
||||||
|
|
||||||
| | |
|
| | |
|
||||||
|---|---|
|
|---|---|
|
||||||
| 状态 | **D1–D3 首版已实现;D4/D5 待做** |
|
| 状态 | **D1–D3 首版已实现;D4/D5 待做** |
|
||||||
|
|||||||
@@ -0,0 +1,131 @@
|
|||||||
|
# Document oracle observations and strict replay
|
||||||
|
|
||||||
|
`foreign.oracle_journal` returns a copy of this evaluation's observations as
|
||||||
|
ordinary `index/channel/value` records. Successful admitted `session_eval`,
|
||||||
|
`session_get`, and document `json.parse` operations append `eval`, `get`, and
|
||||||
|
`decode`, respectively. Set/open/close do not append. An observation is
|
||||||
|
validated recursively before append; handles and code objects cannot enter.
|
||||||
|
Each new HostContext starts with an empty observation list.
|
||||||
|
|
||||||
|
`foreign.replay_check expected=J observed=J2` is a pure comparison, with no
|
||||||
|
foreign execution. It validates contiguous zero-based indices, channel tags
|
||||||
|
and crossing-domain membership. Records compare structurally by field name,
|
||||||
|
independent of field order. The result contains `ok`, the least mismatching
|
||||||
|
`index`, and both records (None for a missing entry). Two empty journals
|
||||||
|
match. Failure to provide a valid journal is an error, not a match.
|
||||||
|
|
||||||
|
The interactive `DocumentSession::replay_check(snapshot)` is a different layer:
|
||||||
|
it executes a recorded trace from fresh state. Version-2 snapshots contain the
|
||||||
|
full chronological oracle trace, recorded stdin per step, its declared count,
|
||||||
|
the plan and source identity. Preflight validates every step before any foreign
|
||||||
|
execution. Every step is compared; none is skipped. Repeated cell executions
|
||||||
|
are distinct observations. Execution timing logs and cell display summaries
|
||||||
|
are not comparison inputs. Matching input values in a supplied snapshot is
|
||||||
|
consistency checking, not cryptographic authentication of the recording.
|
||||||
|
|
||||||
|
Snapshots carry the SHA-256 of the loaded document text. Import checks it
|
||||||
|
before restoring foreign bindings, and preflights all crossing payloads before
|
||||||
|
mutation. Reload retains prior oracle observations with their original source
|
||||||
|
hashes, so a later checker can reject an incompatible trace.
|
||||||
|
|
||||||
|
Lean: DocCalc's independent `runForeignLive` cursor simulates `runForeignAcc`
|
||||||
|
for arbitrary prefixes, observation accumulators and code sequences, including
|
||||||
|
oracle failures. `ForeignTrace` composes the registry's open/eval/close
|
||||||
|
judgments using independent normative and interactive execution control;
|
||||||
|
`trace_simulation`, `trace_correspondence`, and `trace_replay` quantify arbitrary
|
||||||
|
multisession action sequences, also when a run faults. These supplement the
|
||||||
|
existing theorems without removing them.
|
||||||
|
|
||||||
|
Tests: `tests/oracle_journal.rs` runs the public document API on both evaluators;
|
||||||
|
`host::oracle::tests` covers journal equality and length localization;
|
||||||
|
`host::foreign_doc::tests` covers the live trace preflight and actual replay;
|
||||||
|
`host::foreign_session::tests` includes generated two-session model checks and
|
||||||
|
Python/Node boundary and process-failure experiments. The research runner is
|
||||||
|
`MarqdoThesis/PLDI/experiments/reviewer-v5/run.py`.
|
||||||
|
|
||||||
|
## Stateful requests and semantic projection
|
||||||
|
|
||||||
|
`HostContext.foreign_protocol_steps` records internal request attempts and
|
||||||
|
replies, including set values, copied eval input and raw stdin. It is separate
|
||||||
|
from the admitted language journal: rejected inbound responses belong to the
|
||||||
|
protocol evidence, while only admitted values belong to the oracle journal.
|
||||||
|
An input refused before send produces no protocol request. A response refused
|
||||||
|
after execution does not undo kernel effects; the post-state is retained.
|
||||||
|
|
||||||
|
Language observations are recorded at the document API boundary and by live
|
||||||
|
cell evaluation. Low-level get/names used during snapshot export do not append
|
||||||
|
language observations. A successful eval projects to its result. A failed eval
|
||||||
|
projects to a record of stable status, output and diagnostics. Process timing,
|
||||||
|
commands and handles are not semantic values. The exact source path allocated
|
||||||
|
for one-shot execution is alpha-renamed only in diagnostic fields; raw stderr
|
||||||
|
and stdout remain available unchanged, and ordinary paths/error differences
|
||||||
|
are still compared. Live oracle records carry this same projected `value`.
|
||||||
|
|
||||||
|
Python/Node replies mark serialization-domain failure with `domain_error`.
|
||||||
|
Error text is not used to infer this flag. Python refuses non-string object
|
||||||
|
keys; Node sanitizes objects with a null prototype to preserve special keys.
|
||||||
|
The common strict JSON decoder checks duplicate keys before materializing a
|
||||||
|
map, rather than losing them through overwrite.
|
||||||
|
|
||||||
|
`ForeignState.lean` refines the earlier eval-only fragment with opaque kernel
|
||||||
|
state, complete request histories, set/get/eval input/decode, monotonic handle
|
||||||
|
allocation and fault outcomes carrying the admitted prefix. An adaptive
|
||||||
|
Program has continuations on actual observations; its correspondence theorem
|
||||||
|
covers data-dependent next actions, not just a fixed schedule. Mapping actual
|
||||||
|
document elaboration and host bindings to this program is a further proof
|
||||||
|
obligation recorded in the research status file.
|
||||||
|
|
||||||
|
## Complete history, snapshot version 4 (2026-11-02)
|
||||||
|
|
||||||
|
Strict interactive replay now records operations, not just successful cells.
|
||||||
|
Each public execution/mutation boundary records typed arguments, success or
|
||||||
|
failure, admitted observations, cell-oracle records, and stable resulting
|
||||||
|
state. Nested implementation calls are grouped under the user's operation.
|
||||||
|
The history includes set/get, run/step/run-all, restart, reload, plan edits,
|
||||||
|
clear, snapshot inspection and imported values. Failed attempts remain in the
|
||||||
|
history; rejected handles and secrets have only non-capability/redacted tags.
|
||||||
|
Clearing display outputs cannot erase the history's oracle projection.
|
||||||
|
|
||||||
|
The snapshot stores the materialized initial plan and historical reload plans.
|
||||||
|
Entry text is parsed at its original path, retaining relative imports without
|
||||||
|
rewriting the user's document. Initial bindings are reapplied when a kernel is
|
||||||
|
reopened; unchanged reload kernels retain state, whereas changed language or
|
||||||
|
command retires the incompatible process. Loaded source/metadata and cached
|
||||||
|
cell outputs are updated consistently.
|
||||||
|
|
||||||
|
Preflight checks the entire operation stream, all source revisions, plan edits,
|
||||||
|
binding/cursor/generation transitions, and oracle projections before starting
|
||||||
|
any replay kernel. Executing the trace compares each result, admitted value,
|
||||||
|
cell result and stable state. The first mismatch stops its dependent suffix;
|
||||||
|
`executed_actions` and `remaining_actions` make this explicit. `matched` counts
|
||||||
|
admitted observations and `matched_actions` counts operations. No missing
|
||||||
|
record is silently accepted or skipped.
|
||||||
|
|
||||||
|
The HTTP replay-check endpoint performs an isolated comparison and retains an
|
||||||
|
existing warm session. It validates malformed input before starting even a
|
||||||
|
seed kernel; duplicate JSON fields are refused before overwrite. Verification
|
||||||
|
can still run recorded foreign work and its external effects: isolation is of
|
||||||
|
the document session, not a process sandbox. `replay_snapshot` remains the
|
||||||
|
separate legacy cell re-run API and makes no strict-history comparison claim.
|
||||||
|
Older version-2/3 snapshots may be used by legacy restoration/re-run surfaces;
|
||||||
|
they cannot prove a complete action history and strict checking requires v4.
|
||||||
|
|
||||||
|
`ForeignHistory.lean` models explicit command boundaries. A fault terminates
|
||||||
|
its command, a later command receives the actual retained registry, and the
|
||||||
|
history retains all command faults and admitted observations. It proves
|
||||||
|
command-history correspondence, journal membership and no alias resurrection
|
||||||
|
through arbitrary recovery histories. This extends the adaptive Program
|
||||||
|
results; the general source-elaboration refinement is a separate outstanding
|
||||||
|
proof obligation.
|
||||||
|
|
||||||
|
Experiment source inputs are frozen before running, checked again afterward,
|
||||||
|
and archived with their hashes. The current passing bundle is identified by
|
||||||
|
`MarqdoThesis/PLDI/experiments/reviewer-v5/LATEST-PASSING.json`.
|
||||||
|
|
||||||
|
Each operation also retains its internal protocol attempts/replies, including
|
||||||
|
refused inspection results. Those records are compared even when an inspector
|
||||||
|
could not return a value. They are control evidence and do not admit rejected
|
||||||
|
payloads into the language journal. An explicit document session_names request
|
||||||
|
adds its admitted array on the decode channel; internal names/get probes do not.
|
||||||
|
Reload records either a historical source/plan input or its input-read error;
|
||||||
|
replay consumes that captured version input and does not rewrite past files.
|
||||||
@@ -24,17 +24,29 @@ MAX_SAFE = 9007199254740991 # 2^53 - 1
|
|||||||
| `array` | `List` |
|
| `array` | `List` |
|
||||||
| `object` | `Map` |
|
| `object` | `Map` |
|
||||||
|
|
||||||
**Host extension (not in Lean `SafeVal`):** JSON non-integer numbers → `Value::Num(f64)` (NaN/Inf encode as `null`). Floats are documented host behavior; they are **not** claimed as mechanized \(V_{\mathsf{safe}}\) fidelity.
|
**Host extension (not in Lean `SafeVal`):** JSON non-integer numbers → `Value::Num(f64)`. Non-finite numbers (NaN/Inf) are refused on encode and in Python/Node oracle responses, including nested payloads. Floats are documented host behavior; they are **not** claimed as mechanized \(V_{\mathsf{safe}}\) fidelity.
|
||||||
|
|
||||||
## Encode (`value_to_json`)
|
## Encode (`value_to_json`)
|
||||||
|
|
||||||
- `Value::Int(n)` with `|n| ≤ MAX_SAFE` → JSON number.
|
- `Value::Int(n)` with `|n| ≤ MAX_SAFE` → JSON number.
|
||||||
- `Value::Int(n)` with `|n| > MAX_SAFE` → **refuse** (error).
|
- `Value::Int(n)` with `|n| > MAX_SAFE` → **refuse** (error).
|
||||||
|
- `Value::Handle(_)` → **refuse** (`json: session handle cannot be serialized`).
|
||||||
|
- Column-table `Map` whose fields are all `List` with **unequal lengths** →
|
||||||
|
**refuse** (`json: table column arity mismatch`).
|
||||||
- Nested `List` / `Map`: any child refuse fails the whole tree.
|
- Nested `List` / `Map`: any child refuse fails the whole tree.
|
||||||
|
- GFM table **parse** also refuses unequal row width
|
||||||
|
(`table row arity mismatch`) before a value is built.
|
||||||
- Wide integers that must cross a language boundary: author converts to a
|
- Wide integers that must cross a language boundary: author converts to a
|
||||||
**decimal string** (∈ \(V_{\mathsf{safe}}\)); the foreign program may use
|
**decimal string** (∈ \(V_{\mathsf{safe}}\)); the foreign program may use
|
||||||
`BigInt` / Python `int` on that string.
|
`BigInt` / Python `int` on that string.
|
||||||
|
|
||||||
|
## Foreign oracle (`session_eval` / `session_get`)
|
||||||
|
|
||||||
|
Python/Node session bootstraps sanitize results with the same integer gate
|
||||||
|
before JSON emission. An Ω response containing an OOD integer is a **fault**
|
||||||
|
(host `Err`), not a soft `ok:false` cell record. Stdout text that authors
|
||||||
|
`json.parse` themselves is still gated by host `json_to_value`.
|
||||||
|
|
||||||
## Decode (`json_to_value`)
|
## Decode (`json_to_value`)
|
||||||
|
|
||||||
- JSON integer with `|n| ≤ MAX_SAFE` → `Int`.
|
- JSON integer with `|n| ≤ MAX_SAFE` → `Int`.
|
||||||
@@ -64,3 +76,15 @@ json: integer outside V_safe (±(2^53-1)): <n>
|
|||||||
- Not automatic BigInt promotion inside Node/Python bootstraps.
|
- Not automatic BigInt promotion inside Node/Python bootstraps.
|
||||||
- Document-level `Value::Int` may still hold i64 values that are OOD for JSON;
|
- Document-level `Value::Int` may still hold i64 values that are OOD for JSON;
|
||||||
the gate fires when those values enter JSON encode/decode.
|
the gate fires when those values enter JSON encode/decode.
|
||||||
|
|
||||||
|
## Strict request boundary update
|
||||||
|
|
||||||
|
The numeric gate applies to the represented value, including integer-valued
|
||||||
|
floats and exponent notation. `9007199254740992.0` and
|
||||||
|
`9.007199254740992e15` are refused; fractions such as `1.5` remain in the host
|
||||||
|
extension. `serde_json` uses `float_roundtrip` to avoid endpoint decoding loss.
|
||||||
|
The strict text decoder rejects duplicate object keys and unequal column maps
|
||||||
|
before information is lost. One-shot, call_many and persistent input paths
|
||||||
|
use recursive domain admission; code, handle and secret values are not copied
|
||||||
|
implicitly. Auto-detection may leave non-JSON output as text, but valid JSON
|
||||||
|
outside the domain is a refusal, including in batch results.
|
||||||
+1
-1
@@ -1 +1 @@
|
|||||||
2.2.2
|
2.4.0
|
||||||
+23
-3
@@ -177,8 +177,9 @@ view has no persistent kernel state.
|
|||||||
+ `cwd`=None
|
+ `cwd`=None
|
||||||
+ `timeout`=None
|
+ `timeout`=None
|
||||||
|
|
||||||
Start a persistent Python/Node kernel; returns a session id. `timeout` is the
|
Start a persistent Python/Node kernel; returns an opaque `handle` value.
|
||||||
default per-eval timeout.
|
Text fabrications are refused by session ops; handles cannot cross the JSON
|
||||||
|
bridge. `timeout` is the default per-eval timeout.
|
||||||
|
|
||||||
*> host_foreign_session_open lang=`lang` cmd=`cmd` env=`env` cwd=`cwd` timeout=`timeout`*
|
*> host_foreign_session_open lang=`lang` cmd=`cmd` env=`env` cwd=`cwd` timeout=`timeout`*
|
||||||
|
|
||||||
@@ -223,7 +224,9 @@ List kernel variable names.
|
|||||||
## session_close
|
## session_close
|
||||||
+ `id`
|
+ `id`
|
||||||
|
|
||||||
Kill and remove a session; returns whether it existed.
|
Consume (affine close) a live session handle: kill and remove it. Returns
|
||||||
|
`True` on success. Closing an unknown or already-closed id is a fault
|
||||||
|
(`foreign session … not found`), matching use-after-close on eval/set/get.
|
||||||
|
|
||||||
*> host_foreign_session_close id=`id`*
|
*> host_foreign_session_close id=`id`*
|
||||||
|
|
||||||
@@ -246,3 +249,20 @@ List live sessions with id/lang/cmd/evals/alive/started_ms.
|
|||||||
List configured foreign languages.
|
List configured foreign languages.
|
||||||
|
|
||||||
*> host_foreign_langs*
|
*> host_foreign_langs*
|
||||||
|
|
||||||
|
## oracle_journal
|
||||||
|
|
||||||
|
Return this document evaluation's admitted eval/get/decode observations as
|
||||||
|
ordinary records with index, channel, value. Opening, setting and closing do
|
||||||
|
not append observations.
|
||||||
|
|
||||||
|
*> host_oracle_journal *
|
||||||
|
|
||||||
|
## replay_check
|
||||||
|
+ `expected`
|
||||||
|
+ `observed`
|
||||||
|
|
||||||
|
Compare two oracle journals without executing foreign code. Returns ok and
|
||||||
|
the least mismatching index, with the expected and observed records.
|
||||||
|
|
||||||
|
*> host_oracle_replay_check expected=`expected` observed=`observed`*
|
||||||
@@ -0,0 +1,293 @@
|
|||||||
|
//! Application compositions with precomputed independent SQL/Floyd oracles.
|
||||||
|
use crate::host::{
|
||||||
|
foreign_doc::{packing, DocumentSession},
|
||||||
|
json::{json_to_value, value_to_json},
|
||||||
|
};
|
||||||
|
use crate::value::Value;
|
||||||
|
use serde_json::{json, Value as Json};
|
||||||
|
use sha2::{Digest, Sha256};
|
||||||
|
use std::path::{Path, PathBuf};
|
||||||
|
|
||||||
|
fn root() -> PathBuf {
|
||||||
|
PathBuf::from(env!("CARGO_MANIFEST_DIR"))
|
||||||
|
}
|
||||||
|
fn cases() -> Vec<Json> {
|
||||||
|
let path = std::env::var_os("MARQDO_APPLICATION_CASES")
|
||||||
|
.map(PathBuf::from)
|
||||||
|
.unwrap_or_else(|| root().join("tests/applications/CASES.json"));
|
||||||
|
let rows: Vec<Json> = serde_json::from_slice(&std::fs::read(path).unwrap()).unwrap();
|
||||||
|
assert!(!rows.is_empty());
|
||||||
|
rows
|
||||||
|
}
|
||||||
|
fn out() -> PathBuf {
|
||||||
|
let path = std::env::var_os("MARQDO_APPLICATION_ARTIFACT_DIR")
|
||||||
|
.map(PathBuf::from)
|
||||||
|
.unwrap_or_else(|| root().join("target/applications"));
|
||||||
|
std::fs::create_dir_all(&path).unwrap();
|
||||||
|
path
|
||||||
|
}
|
||||||
|
fn code(case: &Json, stage: &str) -> String {
|
||||||
|
let lang = if stage == "producer" {
|
||||||
|
case["producer"].as_str().unwrap()
|
||||||
|
} else {
|
||||||
|
case["consumer"].as_str().unwrap()
|
||||||
|
};
|
||||||
|
let ext = if lang == "python" { "py" } else { "js" };
|
||||||
|
std::fs::read_to_string(
|
||||||
|
root()
|
||||||
|
.join("tests/applications")
|
||||||
|
.join(case["family"].as_str().unwrap())
|
||||||
|
.join(format!("{stage}.{ext}")),
|
||||||
|
)
|
||||||
|
.unwrap()
|
||||||
|
}
|
||||||
|
fn failure(lang: &str) -> &'static str {
|
||||||
|
if lang == "python" {
|
||||||
|
"retained = answer\nraise RuntimeError('application_expected_failure')"
|
||||||
|
} else {
|
||||||
|
"globalThis.retained = answer; throw new Error('application_expected_failure');"
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn mutate(lang: &str) -> &'static str {
|
||||||
|
if lang == "python" {
|
||||||
|
"bridge = None\nNone"
|
||||||
|
} else {
|
||||||
|
"bridge = null; null;"
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn field<'a>(value: &'a Value, name: &str) -> &'a Value {
|
||||||
|
let Value::Map(fields) = value else {
|
||||||
|
panic!("expected record: {value:?}")
|
||||||
|
};
|
||||||
|
&fields.iter().find(|(k, _)| k == name).unwrap().1
|
||||||
|
}
|
||||||
|
fn save(path: &Path, value: &Json) {
|
||||||
|
std::fs::write(path, serde_json::to_vec_pretty(value).unwrap()).unwrap();
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn compositions_preserve_data_failure_recovery_and_copy_isolation_on_both_backends() {
|
||||||
|
let out = out();
|
||||||
|
let rows = cases();
|
||||||
|
for case in &rows {
|
||||||
|
let id = case["id"].as_str().unwrap();
|
||||||
|
let q = |s: &str| serde_json::to_string(s).unwrap();
|
||||||
|
let input = q(&case["input"].to_string());
|
||||||
|
let family = root().join("lib");
|
||||||
|
let consumer = case["consumer"].as_str().unwrap();
|
||||||
|
let source = format!(
|
||||||
|
r#"---
|
||||||
|
markup: occlusion
|
||||||
|
import:
|
||||||
|
foreign: {foreign}
|
||||||
|
json: {json}
|
||||||
|
---
|
||||||
|
# main
|
||||||
|
**data = > json.parse text={input}**
|
||||||
|
**p = > foreign.session_open lang={producer}**
|
||||||
|
**c = > foreign.session_open lang={consumer}**
|
||||||
|
**> foreign.session_set id=`p` name="data" value=`data`**
|
||||||
|
**first = > evaluate target=`p` source={produce}**
|
||||||
|
**bridge = > foreign.session_get id=`p` name="bridge"**
|
||||||
|
**> foreign.session_set id=`c` name="bridge" value=`bridge`**
|
||||||
|
**second = > evaluate target=`c` source={consume}**
|
||||||
|
**failure = > evaluate target=`c` source={failure}**
|
||||||
|
**kept = > foreign.session_get id=`c` name="retained"**
|
||||||
|
**cleared = > evaluate target=`c` source={mutate}**
|
||||||
|
**empty = > foreign.session_get id=`c` name="bridge"**
|
||||||
|
**original = > foreign.session_get id=`p` name="bridge"**
|
||||||
|
**answer = > foreign.session_get id=`c` name="answer"**
|
||||||
|
**> foreign.session_close id=`p`**
|
||||||
|
**> foreign.session_close id=`c`**
|
||||||
|
*answer*
|
||||||
|
|
||||||
|
## evaluate
|
||||||
|
+ `target`
|
||||||
|
+ `source`
|
||||||
|
**record = > foreign.session_eval id=`target` source=`source`**
|
||||||
|
*record*
|
||||||
|
"#,
|
||||||
|
foreign = family.join("foreign.mq.md").display(),
|
||||||
|
json = family.join("json.mq.md").display(),
|
||||||
|
producer = q(case["producer"].as_str().unwrap()),
|
||||||
|
consumer = q(consumer),
|
||||||
|
produce = q(&code(case, "producer")),
|
||||||
|
consume = q(&code(case, "consumer")),
|
||||||
|
failure = q(failure(consumer)),
|
||||||
|
mutate = q(mutate(consumer))
|
||||||
|
);
|
||||||
|
let path = out.join(format!("{id}.mq.md"));
|
||||||
|
std::fs::write(&path, &source).unwrap();
|
||||||
|
let module = crate::load::load_module(&path).unwrap();
|
||||||
|
let mut executions = Vec::new();
|
||||||
|
for backend in ["tree", "bytecode"] {
|
||||||
|
let (result, stdout, (journal, protocol, live)) = if backend == "tree" {
|
||||||
|
let mut tree = crate::interp::Interpreter::with_capture(Some(&path), false);
|
||||||
|
let result = tree.run_module(&module);
|
||||||
|
(
|
||||||
|
result,
|
||||||
|
tree.captured_stdout.clone(),
|
||||||
|
tree.application_evidence(),
|
||||||
|
)
|
||||||
|
} else {
|
||||||
|
let program = crate::bytecode::compile_module(Some(&path), &module).unwrap();
|
||||||
|
let mut vm = crate::bytecode::Vm::with_capture(Some(&path));
|
||||||
|
let result = vm.run(&program);
|
||||||
|
(
|
||||||
|
result,
|
||||||
|
vm.captured_stdout.clone(),
|
||||||
|
vm.application_evidence(),
|
||||||
|
)
|
||||||
|
};
|
||||||
|
let error = result.as_ref().err().map(|e| e.to_string());
|
||||||
|
let actual = result.ok().map(|v| value_to_json(&v).unwrap());
|
||||||
|
executions.push(json!({"backend":backend,"ok":error.is_none(),"error":error,"result":actual,"stdout":stdout,"live_sessions":live,
|
||||||
|
"journal":value_to_json(&Value::List(journal)).unwrap(),"protocol":protocol.iter().map(|p|json!({"session":p.session,"request":p.request,"response":p.response})).collect::<Vec<_>>()}));
|
||||||
|
}
|
||||||
|
let result = json!({"version":1,"kind":"document","case":case,"source":source,"source_sha256":format!("{:x}",Sha256::digest(source.as_bytes())),"executions":executions});
|
||||||
|
save(&out.join(format!("{id}-document.json")), &result);
|
||||||
|
for execution in result["executions"].as_array().unwrap() {
|
||||||
|
assert_eq!(execution["result"], case["answer"], "{id}: {execution}");
|
||||||
|
assert_eq!(execution["ok"], true, "{id}: {execution}");
|
||||||
|
assert_eq!(execution["stdout"], "");
|
||||||
|
assert_eq!(execution["live_sessions"], 0);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
println!(
|
||||||
|
"APPLICATION_METRIC:{}",
|
||||||
|
json!({"cases":rows.len(),"executions":rows.len()*2})
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn application_action_histories_replay_raw_and_packed_after_failure() {
|
||||||
|
let out = out();
|
||||||
|
let rows = cases();
|
||||||
|
for case in &rows {
|
||||||
|
let id = case["id"].as_str().unwrap();
|
||||||
|
let consumer = case["consumer"].as_str().unwrap();
|
||||||
|
let source=format!("---\nimport:\n foreign: {}\n---\n# main\n\n`会话` = > foreign.session\n\n`produce` =\n```{}\n{}\n```\n\n`consume` =\n```{}\n{}\n```\n\n`failure` =\n```{}\n{}\n```\n\n`mutate` =\n```{}\n{}\n```\n",root().join("lib/foreign.mq.md").display(),case["producer"].as_str().unwrap(),code(case,"producer"),consumer,code(case,"consumer"),consumer,failure(consumer),consumer,mutate(consumer));
|
||||||
|
let path = out.join(format!("{id}-interactive.mq.md"));
|
||||||
|
std::fs::write(&path, &source).unwrap();
|
||||||
|
let mut session = DocumentSession::open(&path, &root()).unwrap();
|
||||||
|
let p = session
|
||||||
|
.cells
|
||||||
|
.iter()
|
||||||
|
.find(|c| c.name == "produce")
|
||||||
|
.unwrap()
|
||||||
|
.kernel
|
||||||
|
.clone();
|
||||||
|
let c = session
|
||||||
|
.cells
|
||||||
|
.iter()
|
||||||
|
.find(|c| c.name == "consume")
|
||||||
|
.unwrap()
|
||||||
|
.kernel
|
||||||
|
.clone();
|
||||||
|
let expected = json_to_value(&case["answer"]).unwrap();
|
||||||
|
session
|
||||||
|
.set_value(&p, "data", json_to_value(&case["input"]).unwrap())
|
||||||
|
.unwrap();
|
||||||
|
let first = session.run_cell("produce", None).unwrap();
|
||||||
|
assert_eq!(field(&first, "ok"), &Value::Bool(true), "{id}: {first:?}");
|
||||||
|
let bridge = session.pull_value(&p, "bridge").unwrap();
|
||||||
|
assert_eq!(value_to_json(&bridge).unwrap(), case["bridge"]);
|
||||||
|
session.set_value(&c, "bridge", bridge.clone()).unwrap();
|
||||||
|
let second = session.run_cell("consume", None).unwrap();
|
||||||
|
assert_eq!(field(&second, "result"), &expected, "{id}: {second:?}");
|
||||||
|
let failed = session.run_cell("failure", None).unwrap();
|
||||||
|
assert_eq!(field(&failed, "ok"), &Value::Bool(false));
|
||||||
|
assert_eq!(
|
||||||
|
session
|
||||||
|
.cells
|
||||||
|
.iter()
|
||||||
|
.find(|c| c.name == "failure")
|
||||||
|
.unwrap()
|
||||||
|
.last_result,
|
||||||
|
Value::None
|
||||||
|
);
|
||||||
|
assert_eq!(session.pull_value(&c, "retained").unwrap(), expected);
|
||||||
|
session.run_cell("mutate", None).unwrap();
|
||||||
|
assert_eq!(
|
||||||
|
session
|
||||||
|
.cells
|
||||||
|
.iter()
|
||||||
|
.find(|c| c.name == "mutate")
|
||||||
|
.unwrap()
|
||||||
|
.last_result,
|
||||||
|
Value::None
|
||||||
|
);
|
||||||
|
assert_eq!(session.pull_value(&c, "bridge").unwrap(), Value::None);
|
||||||
|
assert_eq!(session.pull_value(&p, "bridge").unwrap(), bridge);
|
||||||
|
assert_eq!(session.pull_value(&c, "answer").unwrap(), expected);
|
||||||
|
let snapshot = session.export_snapshot().unwrap();
|
||||||
|
session.close();
|
||||||
|
let packed = packing::pack(&snapshot).unwrap();
|
||||||
|
assert_eq!(
|
||||||
|
value_to_json(&packing::unpack(&packed).unwrap()).unwrap(),
|
||||||
|
value_to_json(&snapshot).unwrap()
|
||||||
|
);
|
||||||
|
let raw_check =
|
||||||
|
DocumentSession::check_snapshot_isolated(&path, &root(), &snapshot).unwrap();
|
||||||
|
let packed_check =
|
||||||
|
DocumentSession::check_snapshot_isolated(&path, &root(), &packed).unwrap();
|
||||||
|
save(
|
||||||
|
&out.join(format!("{id}-interactive.json")),
|
||||||
|
&json!({"version":1,"kind":"interactive","case":case,"source":source,"source_sha256":format!("{:x}",Sha256::digest(source.as_bytes())),"snapshot":value_to_json(&snapshot).unwrap(),"packed":value_to_json(&packed).unwrap(),"raw_check":value_to_json(&raw_check).unwrap(),"packed_check":value_to_json(&packed_check).unwrap()}),
|
||||||
|
);
|
||||||
|
assert_eq!(
|
||||||
|
field(&raw_check, "ok"),
|
||||||
|
&Value::Bool(true),
|
||||||
|
"{id}: {raw_check:?}"
|
||||||
|
);
|
||||||
|
assert_eq!(
|
||||||
|
field(&packed_check, "ok"),
|
||||||
|
&Value::Bool(true),
|
||||||
|
"{id}: {packed_check:?}"
|
||||||
|
);
|
||||||
|
}
|
||||||
|
println!(
|
||||||
|
"APPLICATION_REPLAY_METRIC:{}",
|
||||||
|
json!({"cases":rows.len(),"strict_replays":rows.len()*2})
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn explicit_null_and_stdout_remain_distinct_and_only_success_can_persist() {
|
||||||
|
for lang in ["python", "node"] {
|
||||||
|
let (good, bad) = if lang == "python" {
|
||||||
|
(
|
||||||
|
"print('audit')\nNone",
|
||||||
|
"print('failed audit')\nraise RuntimeError('expected_failure')",
|
||||||
|
)
|
||||||
|
} else {
|
||||||
|
(
|
||||||
|
"console.log('audit'); null;",
|
||||||
|
"console.log('failed audit'); throw Error('expected_failure');",
|
||||||
|
)
|
||||||
|
};
|
||||||
|
let path = out().join(format!("null-persist-{lang}-{}.mq.md", std::process::id()));
|
||||||
|
std::fs::write(&path,format!("---\nimport:\n foreign: {}\n---\n# main\n\n`会话` = > foreign.session\n\n`good` =\n```{lang}\n{good}\n```\n\n`bad` =\n```{lang}\n{bad}\n```\n",root().join("lib/foreign.mq.md").display())).unwrap();
|
||||||
|
let mut session = DocumentSession::open(&path, &root()).unwrap();
|
||||||
|
assert!(session.persist_cell("good", "empty").is_err());
|
||||||
|
session.run_cell("good", None).unwrap();
|
||||||
|
let cell = session.cells.iter().find(|c| c.name == "good").unwrap();
|
||||||
|
assert_eq!(cell.last_result, Value::None);
|
||||||
|
assert_eq!(cell.last_stdout, "audit\n");
|
||||||
|
assert_eq!(session.oracle_journal.last().unwrap().value, Value::None);
|
||||||
|
assert_eq!(session.oracle_journal.last().unwrap().result, Value::None);
|
||||||
|
session.persist_cell("good", "empty").unwrap();
|
||||||
|
session.run_cell("bad", None).unwrap();
|
||||||
|
assert_eq!(
|
||||||
|
session
|
||||||
|
.cells
|
||||||
|
.iter()
|
||||||
|
.find(|c| c.name == "bad")
|
||||||
|
.unwrap()
|
||||||
|
.last_result,
|
||||||
|
Value::None
|
||||||
|
);
|
||||||
|
assert!(session.persist_cell("bad", "must_not_write").is_err());
|
||||||
|
session.close();
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,122 @@
|
|||||||
|
//! Value-independent argument binding. Effects finish before this plan is used.
|
||||||
|
use std::collections::HashMap;
|
||||||
|
|
||||||
|
#[derive(Debug, Clone, PartialEq, Eq)]
|
||||||
|
pub(crate) struct ArgumentPlan {
|
||||||
|
pub parameters: Vec<Option<usize>>,
|
||||||
|
pub assignments: Vec<(String, usize)>,
|
||||||
|
}
|
||||||
|
pub(crate) fn plan(
|
||||||
|
params: &[String],
|
||||||
|
names: &[Option<String>],
|
||||||
|
allow_missing: bool,
|
||||||
|
) -> Result<ArgumentPlan, String> {
|
||||||
|
plan_with(params, names, |_| allow_missing)
|
||||||
|
}
|
||||||
|
|
||||||
|
pub(crate) fn plan_with_omissions(
|
||||||
|
params: &[String],
|
||||||
|
names: &[Option<String>],
|
||||||
|
omissions: &[bool],
|
||||||
|
) -> Result<ArgumentPlan, String> {
|
||||||
|
if params.len() != omissions.len() {
|
||||||
|
return Err("argument omission mask count mismatch".into());
|
||||||
|
}
|
||||||
|
plan_with(params, names, |index| omissions[index])
|
||||||
|
}
|
||||||
|
|
||||||
|
fn plan_with(
|
||||||
|
params: &[String],
|
||||||
|
names: &[Option<String>],
|
||||||
|
may_omit: impl Fn(usize) -> bool,
|
||||||
|
) -> Result<ArgumentPlan, String> {
|
||||||
|
let mut named = HashMap::new();
|
||||||
|
let mut positionals = Vec::new();
|
||||||
|
for (index, name) in names.iter().enumerate() {
|
||||||
|
match name {
|
||||||
|
Some(name) => {
|
||||||
|
if named.insert(name.clone(), index).is_some() {
|
||||||
|
return Err(format!("duplicate named argument `{name}`"));
|
||||||
|
}
|
||||||
|
}
|
||||||
|
None => positionals.push(index),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let mut pos = 0;
|
||||||
|
let mut parameters = Vec::new();
|
||||||
|
let mut assignments = Vec::new();
|
||||||
|
for (parameter_index, param) in params.iter().enumerate() {
|
||||||
|
let index = if let Some(index) = named.get(param) {
|
||||||
|
Some(*index)
|
||||||
|
} else if let Some(index) = positionals.get(pos) {
|
||||||
|
pos += 1;
|
||||||
|
Some(*index)
|
||||||
|
} else if may_omit(parameter_index) {
|
||||||
|
None
|
||||||
|
} else {
|
||||||
|
return Err(format!("missing argument for parameter `{param}`"));
|
||||||
|
};
|
||||||
|
parameters.push(index);
|
||||||
|
if let Some(index) = index {
|
||||||
|
assignments.push((param.clone(), index));
|
||||||
|
}
|
||||||
|
}
|
||||||
|
if pos < positionals.len() {
|
||||||
|
return Err(format!(
|
||||||
|
"too many positional arguments ({} extra)",
|
||||||
|
positionals.len() - pos
|
||||||
|
));
|
||||||
|
}
|
||||||
|
for (index, name) in names.iter().enumerate() {
|
||||||
|
if let Some(name) = name {
|
||||||
|
if !params.contains(name) {
|
||||||
|
assignments.push((name.clone(), index));
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Ok(ArgumentPlan {
|
||||||
|
parameters,
|
||||||
|
assignments,
|
||||||
|
})
|
||||||
|
}
|
||||||
|
pub(crate) fn bind<T: Clone>(
|
||||||
|
params: &[String],
|
||||||
|
names: &[Option<String>],
|
||||||
|
values: &[T],
|
||||||
|
allow_missing: bool,
|
||||||
|
) -> Result<HashMap<String, T>, String> {
|
||||||
|
if names.len() != values.len() {
|
||||||
|
return Err("argument layout/value count mismatch".into());
|
||||||
|
}
|
||||||
|
let plan = plan(params, names, allow_missing)?;
|
||||||
|
Ok(plan
|
||||||
|
.assignments
|
||||||
|
.into_iter()
|
||||||
|
.map(|(name, index)| (name, values[index].clone()))
|
||||||
|
.collect())
|
||||||
|
}
|
||||||
|
|
||||||
|
pub(crate) fn plan_evidence(
|
||||||
|
params: &[String],
|
||||||
|
names: &[Option<String>],
|
||||||
|
omissions: &[bool],
|
||||||
|
) -> serde_json::Value {
|
||||||
|
let result = match plan_with_omissions(params, names, omissions) {
|
||||||
|
Ok(plan) => {
|
||||||
|
serde_json::json!({"ok":true,"parameters":plan.parameters,"assignments":plan.assignments})
|
||||||
|
}
|
||||||
|
Err(error) => serde_json::json!({"ok":false,"error":error}),
|
||||||
|
};
|
||||||
|
serde_json::json!({"params":params,"arguments":names,"omissions":omissions,"result":result})
|
||||||
|
}
|
||||||
|
pub(crate) fn builtin_signature(name: &str) -> Option<(&'static [&'static str], bool)> {
|
||||||
|
Some(match name {
|
||||||
|
"print" => (&["text"], false),
|
||||||
|
"input" => (&["prompt"], true),
|
||||||
|
"len" | "str" | "int" | "type" | "trim" => (&["value"], false),
|
||||||
|
"split" | "join" => (&["value", "sep"], false),
|
||||||
|
"at" => (&["value", "index"], false),
|
||||||
|
"call_fn" => (&["name"], false),
|
||||||
|
_ => return None,
|
||||||
|
})
|
||||||
|
}
|
||||||
+47
-13
@@ -22,6 +22,7 @@ pub struct Use {
|
|||||||
|
|
||||||
#[derive(Debug, Clone)]
|
#[derive(Debug, Clone)]
|
||||||
pub struct Module {
|
pub struct Module {
|
||||||
|
pub source: crate::diagnostics::SourceIdentity,
|
||||||
pub imports: Vec<Import>,
|
pub imports: Vec<Import>,
|
||||||
pub uses: Vec<Use>,
|
pub uses: Vec<Use>,
|
||||||
pub functions: Vec<Function>,
|
pub functions: Vec<Function>,
|
||||||
@@ -36,6 +37,7 @@ pub struct Module {
|
|||||||
impl Default for Module {
|
impl Default for Module {
|
||||||
fn default() -> Self {
|
fn default() -> Self {
|
||||||
Self {
|
Self {
|
||||||
|
source: Default::default(),
|
||||||
imports: Vec::new(),
|
imports: Vec::new(),
|
||||||
uses: Vec::new(),
|
uses: Vec::new(),
|
||||||
functions: Vec::new(),
|
functions: Vec::new(),
|
||||||
@@ -46,9 +48,31 @@ impl Default for Module {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
|
/// Parameter names have distinct slots. Function lookup retains its existing
|
||||||
|
/// first-match/ambiguity rules rather than narrowing accepted declaration trees.
|
||||||
|
pub(crate) fn validate_parameters(module:&Module) -> Result<(),crate::diagnostics::Diagnostic> {
|
||||||
|
fn siblings(module:&Module,functions:&[Function]) -> Result<(),crate::diagnostics::Diagnostic> {
|
||||||
|
for fun in functions {
|
||||||
|
let mut params=std::collections::HashSet::new();
|
||||||
|
for param in &fun.params {
|
||||||
|
if !params.insert(¶m.name) {
|
||||||
|
return Err(crate::diagnostics::Diagnostic::new(module.source.path.as_deref(),param.span,format!("duplicate parameter `{}`",param.name)).with_source(&module.source));
|
||||||
|
}
|
||||||
|
}
|
||||||
|
siblings(module,&fun.children)?;
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
siblings(module,&module.functions)?;
|
||||||
|
let mut imports=module.import_modules.iter().collect::<Vec<_>>();imports.sort_by_key(|(name,_)|*name);
|
||||||
|
for (_,child) in imports { validate_parameters(child)?; }
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
|
||||||
#[derive(Debug, Clone)]
|
#[derive(Debug, Clone)]
|
||||||
pub struct Param {
|
pub struct Param {
|
||||||
pub name: String,
|
pub name: String,
|
||||||
|
pub span: Span,
|
||||||
pub default: Option<Expr>,
|
pub default: Option<Expr>,
|
||||||
/// True when collected by v0.3 body/prose inference (not an explicit `+` line).
|
/// True when collected by v0.3 body/prose inference (not an explicit `+` line).
|
||||||
pub inferred: bool,
|
pub inferred: bool,
|
||||||
@@ -91,6 +115,16 @@ pub fn function_uses_receiver(fun: &Function) -> bool {
|
|||||||
matches!(name, "self" | "自")
|
matches!(name, "self" | "自")
|
||||||
}
|
}
|
||||||
|
|
||||||
|
fn call_uses_receiver(call: &CallExpr) -> bool {
|
||||||
|
call.receiver.as_deref().is_some_and(is_receiver)
|
||||||
|
|| call.path.as_ref().is_some_and(|path| {
|
||||||
|
path.first().is_some_and(|name| is_receiver(name))
|
||||||
|
})
|
||||||
|
|| call.args.iter().any(|arg| match arg {
|
||||||
|
Arg::Positional(value) | Arg::Named { value, .. } => expr_uses_receiver(value),
|
||||||
|
})
|
||||||
|
}
|
||||||
|
|
||||||
fn expr_uses_receiver(expr: &Expr) -> bool {
|
fn expr_uses_receiver(expr: &Expr) -> bool {
|
||||||
match expr {
|
match expr {
|
||||||
Expr::Var(name) => is_receiver(name),
|
Expr::Var(name) => is_receiver(name),
|
||||||
@@ -102,12 +136,7 @@ pub fn function_uses_receiver(fun: &Function) -> bool {
|
|||||||
Expr::Binary { left, right, .. } => {
|
Expr::Binary { left, right, .. } => {
|
||||||
expr_uses_receiver(left) || expr_uses_receiver(right)
|
expr_uses_receiver(left) || expr_uses_receiver(right)
|
||||||
}
|
}
|
||||||
Expr::Call(call) => {
|
Expr::Call(call) => call_uses_receiver(call),
|
||||||
call.receiver.as_deref().is_some_and(is_receiver)
|
|
||||||
|| call.args.iter().any(|arg| match arg {
|
|
||||||
Arg::Positional(value) | Arg::Named { value, .. } => expr_uses_receiver(value),
|
|
||||||
})
|
|
||||||
}
|
|
||||||
Expr::List(items) => items.iter().any(expr_uses_receiver),
|
Expr::List(items) => items.iter().any(expr_uses_receiver),
|
||||||
Expr::Map(entries) => entries.iter().any(|(_, value)| expr_uses_receiver(value)),
|
Expr::Map(entries) => entries.iter().any(|(_, value)| expr_uses_receiver(value)),
|
||||||
Expr::Index { base, label } => {
|
Expr::Index { base, label } => {
|
||||||
@@ -124,12 +153,7 @@ pub fn function_uses_receiver(fun: &Function) -> bool {
|
|||||||
Stmt::Assign { value, .. } | Stmt::Return { value, .. } | Stmt::Expr { value, .. } => {
|
Stmt::Assign { value, .. } | Stmt::Return { value, .. } | Stmt::Expr { value, .. } => {
|
||||||
expr_uses_receiver(value)
|
expr_uses_receiver(value)
|
||||||
}
|
}
|
||||||
Stmt::Call { call, .. } => {
|
Stmt::Call { call, .. } => call_uses_receiver(call),
|
||||||
call.receiver.as_deref().is_some_and(is_receiver)
|
|
||||||
|| call.args.iter().any(|arg| match arg {
|
|
||||||
Arg::Positional(value) | Arg::Named { value, .. } => expr_uses_receiver(value),
|
|
||||||
})
|
|
||||||
}
|
|
||||||
Stmt::Branch { arms, .. } => arms.iter().any(|arm| {
|
Stmt::Branch { arms, .. } => arms.iter().any(|arm| {
|
||||||
arm.condition.as_ref().is_some_and(expr_uses_receiver)
|
arm.condition.as_ref().is_some_and(expr_uses_receiver)
|
||||||
|| arm.body.iter().any(stmt_uses_receiver)
|
|| arm.body.iter().any(stmt_uses_receiver)
|
||||||
@@ -143,7 +167,8 @@ pub fn function_uses_receiver(fun: &Function) -> bool {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
fun.body.iter().any(stmt_uses_receiver)
|
fun.params.iter().any(|param| param.default.as_ref().is_some_and(expr_uses_receiver))
|
||||||
|
|| fun.body.iter().any(stmt_uses_receiver)
|
||||||
}
|
}
|
||||||
|
|
||||||
/// Source line of a statement (every variant carries a span).
|
/// Source line of a statement (every variant carries a span).
|
||||||
@@ -257,6 +282,15 @@ pub struct CallExpr {
|
|||||||
}
|
}
|
||||||
|
|
||||||
impl CallExpr {
|
impl CallExpr {
|
||||||
|
/// Shared execution preparation: normalize bare aliases before testing
|
||||||
|
/// modifier conflicts, matching the source evaluator's binding order.
|
||||||
|
pub fn for_evaluation(&self) -> Result<CallExpr,String> {
|
||||||
|
let mut call=self.clone();
|
||||||
|
if call.path.is_none() && call.receiver.is_none(){
|
||||||
|
call.callee=crate::aliases::normalize_call_callee_and_args(&call.callee,&mut call.args);
|
||||||
|
}
|
||||||
|
call.with_modifiers_expanded()
|
||||||
|
}
|
||||||
/// Fold `pre_modifiers` into leading `name=True` named args (conflicts → Err).
|
/// Fold `pre_modifiers` into leading `name=True` named args (conflicts → Err).
|
||||||
pub fn with_modifiers_expanded(&self) -> Result<CallExpr, String> {
|
pub fn with_modifiers_expanded(&self) -> Result<CallExpr, String> {
|
||||||
let mut call = self.clone();
|
let mut call = self.clone();
|
||||||
|
|||||||
+30
-1
@@ -1,7 +1,29 @@
|
|||||||
//! Built-in helpers shared by tree-walk and bytecode.
|
//! Built-in helpers shared by tree-walk and bytecode.
|
||||||
|
|
||||||
|
mod primitives;
|
||||||
|
pub use primitives::{eval_binary,eval_unary};
|
||||||
|
|
||||||
use crate::value::Value;
|
use crate::value::Value;
|
||||||
|
|
||||||
|
/// Machine integer arithmetic has one profile-independent failure contract.
|
||||||
|
/// Overflow must remain a language diagnostic in debug, release and Wasm.
|
||||||
|
pub fn checked_int_binary(op: crate::ast::BinaryOp, left: i64, right: i64) -> Result<i64, String> {
|
||||||
|
use crate::ast::BinaryOp;
|
||||||
|
if matches!(op, BinaryOp::Div) && right == 0 { return Err("division by zero".into()); }
|
||||||
|
let result = match op {
|
||||||
|
BinaryOp::Add => left.checked_add(right),
|
||||||
|
BinaryOp::Sub => left.checked_sub(right),
|
||||||
|
BinaryOp::Mul => left.checked_mul(right),
|
||||||
|
BinaryOp::Div => left.checked_div(right),
|
||||||
|
_ => return Err("not an integer arithmetic operation".into()),
|
||||||
|
};
|
||||||
|
result.ok_or_else(|| "integer overflow".into())
|
||||||
|
}
|
||||||
|
|
||||||
|
pub fn checked_int_neg(value: i64) -> Result<i64, String> {
|
||||||
|
value.checked_neg().ok_or_else(|| "integer overflow".into())
|
||||||
|
}
|
||||||
|
|
||||||
/// `len`: text → Unicode scalar count; list → element count.
|
/// `len`: text → Unicode scalar count; list → element count.
|
||||||
pub fn builtin_len(v: &Value) -> Result<i64, String> {
|
pub fn builtin_len(v: &Value) -> Result<i64, String> {
|
||||||
match v {
|
match v {
|
||||||
@@ -20,7 +42,13 @@ pub fn builtin_str(v: &Value) -> Value {
|
|||||||
pub fn builtin_int(v: &Value) -> Result<i64, String> {
|
pub fn builtin_int(v: &Value) -> Result<i64, String> {
|
||||||
match v {
|
match v {
|
||||||
Value::Int(n) => Ok(*n),
|
Value::Int(n) => Ok(*n),
|
||||||
Value::Num(n) => Ok(*n as i64),
|
Value::Num(n) => {
|
||||||
|
// The upper bound is exclusive: i64::MAX rounds to 2^63 as f64.
|
||||||
|
if !n.is_finite() || *n < -9223372036854775808.0 || *n >= 9223372036854775808.0 {
|
||||||
|
return Err("int conversion outside signed 64-bit domain".into());
|
||||||
|
}
|
||||||
|
Ok(*n as i64)
|
||||||
|
}
|
||||||
Value::Bool(true) => Ok(1),
|
Value::Bool(true) => Ok(1),
|
||||||
Value::Bool(false) => Ok(0),
|
Value::Bool(false) => Ok(0),
|
||||||
Value::Text(s) => {
|
Value::Text(s) => {
|
||||||
@@ -42,6 +70,7 @@ pub fn builtin_type(v: &Value) -> Value {
|
|||||||
Value::Num(_) => "num",
|
Value::Num(_) => "num",
|
||||||
Value::Text(_) => "text",
|
Value::Text(_) => "text",
|
||||||
Value::Secret(_) => "secret",
|
Value::Secret(_) => "secret",
|
||||||
|
Value::Handle(_) => "handle",
|
||||||
Value::List(_) => "list",
|
Value::List(_) => "list",
|
||||||
Value::Map(_) => "map",
|
Value::Map(_) => "map",
|
||||||
Value::Formula(_) => "formula",
|
Value::Formula(_) => "formula",
|
||||||
|
|||||||
@@ -0,0 +1,88 @@
|
|||||||
|
//! Scalar operator semantics shared by source evaluation and VM.
|
||||||
|
use crate::{ast::BinaryOp, value::Value};
|
||||||
|
pub fn eval_binary(op: BinaryOp, l: &Value, r: &Value) -> Result<Value, String> {
|
||||||
|
match op {
|
||||||
|
BinaryOp::Add => match (l, r) {
|
||||||
|
(Value::Int(a), Value::Int(b)) => {
|
||||||
|
crate::builtin::checked_int_binary(op, *a, *b).map(Value::Int)
|
||||||
|
}
|
||||||
|
(Value::Num(a), Value::Num(b)) => Ok(Value::Num(a + b)),
|
||||||
|
(Value::Int(a), Value::Num(b)) => Ok(Value::Num(*a as f64 + b)),
|
||||||
|
(Value::Num(a), Value::Int(b)) => Ok(Value::Num(a + *b as f64)),
|
||||||
|
(Value::Text(a), Value::Text(b)) => Ok(Value::Text(format!("{a}{b}"))),
|
||||||
|
(Value::Text(a), Value::Secret(b)) => Ok(Value::Text(format!("{a}{b}"))),
|
||||||
|
(Value::Secret(a), Value::Text(b)) => Ok(Value::Text(format!("{a}{b}"))),
|
||||||
|
(Value::Secret(a), Value::Secret(b)) => Ok(Value::Text(format!("{a}{b}"))),
|
||||||
|
(Value::Text(a), b) => Ok(Value::Text(format!("{a}{}", b.as_display()))),
|
||||||
|
(a, Value::Text(b)) => Ok(Value::Text(format!("{}{b}", a.as_display()))),
|
||||||
|
_ => Err("`+` needs ints, nums, or text".into()),
|
||||||
|
},
|
||||||
|
BinaryOp::Sub => match (l, r) {
|
||||||
|
(Value::Int(a), Value::Int(b)) => {
|
||||||
|
crate::builtin::checked_int_binary(op, *a, *b).map(Value::Int)
|
||||||
|
}
|
||||||
|
(Value::Num(a), Value::Num(b)) => Ok(Value::Num(a - b)),
|
||||||
|
(Value::Int(a), Value::Num(b)) => Ok(Value::Num(*a as f64 - b)),
|
||||||
|
(Value::Num(a), Value::Int(b)) => Ok(Value::Num(a - *b as f64)),
|
||||||
|
_ => Err("`-` needs ints or nums".into()),
|
||||||
|
},
|
||||||
|
BinaryOp::Mul => match (l, r) {
|
||||||
|
(Value::Int(a), Value::Int(b)) => {
|
||||||
|
crate::builtin::checked_int_binary(op, *a, *b).map(Value::Int)
|
||||||
|
}
|
||||||
|
(Value::Num(a), Value::Num(b)) => Ok(Value::Num(a * b)),
|
||||||
|
(Value::Int(a), Value::Num(b)) => Ok(Value::Num(*a as f64 * b)),
|
||||||
|
(Value::Num(a), Value::Int(b)) => Ok(Value::Num(a * *b as f64)),
|
||||||
|
_ => Err("`*` needs ints or nums".into()),
|
||||||
|
},
|
||||||
|
BinaryOp::Div => match (l, r) {
|
||||||
|
(Value::Int(_), Value::Int(0)) => Err("division by zero".into()),
|
||||||
|
(Value::Int(a), Value::Int(b)) => {
|
||||||
|
crate::builtin::checked_int_binary(op, *a, *b).map(Value::Int)
|
||||||
|
}
|
||||||
|
(Value::Num(_), Value::Num(b)) if *b == 0.0 => Err("division by zero".into()),
|
||||||
|
(Value::Int(_), Value::Num(b)) if *b == 0.0 => Err("division by zero".into()),
|
||||||
|
(Value::Num(_), Value::Int(0)) => Err("division by zero".into()),
|
||||||
|
(Value::Num(a), Value::Num(b)) => Ok(Value::Num(a / b)),
|
||||||
|
(Value::Int(a), Value::Num(b)) => Ok(Value::Num(*a as f64 / b)),
|
||||||
|
(Value::Num(a), Value::Int(b)) => Ok(Value::Num(a / *b as f64)),
|
||||||
|
_ => Err("`/` needs ints or nums".into()),
|
||||||
|
},
|
||||||
|
BinaryOp::Eq => Ok(Value::Bool(l == r)),
|
||||||
|
BinaryOp::Ne => Ok(Value::Bool(l != r)),
|
||||||
|
BinaryOp::Lt => cmp_ord(l, r, |o| o.is_lt()),
|
||||||
|
BinaryOp::Le => cmp_ord(l, r, |o| o.is_le()),
|
||||||
|
BinaryOp::Gt => cmp_ord(l, r, |o| o.is_gt()),
|
||||||
|
BinaryOp::Ge => cmp_ord(l, r, |o| o.is_ge()),
|
||||||
|
BinaryOp::And | BinaryOp::Or => unreachable!("handled above"),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
fn cmp_ord(l: &Value, r: &Value, f: impl Fn(std::cmp::Ordering) -> bool) -> Result<Value, String> {
|
||||||
|
match (l, r) {
|
||||||
|
(Value::Int(a), Value::Int(b)) => Ok(Value::Bool(f(a.cmp(b)))),
|
||||||
|
(Value::Num(a), Value::Num(b)) => Ok(Value::Bool(f(a
|
||||||
|
.partial_cmp(b)
|
||||||
|
.unwrap_or(std::cmp::Ordering::Equal)))),
|
||||||
|
(Value::Int(a), Value::Num(b)) => Ok(Value::Bool(f((*a as f64)
|
||||||
|
.partial_cmp(b)
|
||||||
|
.unwrap_or(std::cmp::Ordering::Equal)))),
|
||||||
|
(Value::Num(a), Value::Int(b)) => Ok(Value::Bool(f(a
|
||||||
|
.partial_cmp(&(*b as f64))
|
||||||
|
.unwrap_or(std::cmp::Ordering::Equal)))),
|
||||||
|
(Value::Text(a), Value::Text(b)) => Ok(Value::Bool(f(a.cmp(b)))),
|
||||||
|
_ => Err("comparison needs two ints/nums or two texts".into()),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
/// Scalar unary semantics shared by source and target execution.
|
||||||
|
pub fn eval_unary(op: crate::ast::UnaryOp, value: &Value) -> Result<Value, String> {
|
||||||
|
match op {
|
||||||
|
crate::ast::UnaryOp::Not => Ok(Value::Bool(!value.truthy())),
|
||||||
|
crate::ast::UnaryOp::Neg => match value {
|
||||||
|
Value::Int(n) => crate::builtin::checked_int_neg(*n).map(Value::Int),
|
||||||
|
Value::Num(n) => Ok(Value::Num(-n)),
|
||||||
|
_ => Err("unary `-` needs int or num".into()),
|
||||||
|
},
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,327 @@
|
|||||||
|
//! Check actual staging, scratch separation and post-evaluation call selection.
|
||||||
|
//! Resolution and dispatch implementations remain semantic interfaces.
|
||||||
|
use super::{expression::Cursor, ExpressionRule, FnChunk, Op, Program};
|
||||||
|
use crate::{
|
||||||
|
ast::{Arg, CallExpr},
|
||||||
|
value::Value,
|
||||||
|
};
|
||||||
|
use std::collections::HashSet;
|
||||||
|
|
||||||
|
#[derive(Debug, Clone)]
|
||||||
|
pub struct CallStage {
|
||||||
|
pub expression: usize,
|
||||||
|
pub slot: usize,
|
||||||
|
}
|
||||||
|
#[derive(Debug, Clone, PartialEq, Eq)]
|
||||||
|
pub enum PathFallback {
|
||||||
|
User { target: usize, tag_instance: bool },
|
||||||
|
Error { message: String },
|
||||||
|
}
|
||||||
|
impl PathFallback {
|
||||||
|
fn evidence(&self) -> serde_json::Value {
|
||||||
|
match self {
|
||||||
|
Self::User { target, tag_instance } => serde_json::json!({"kind":"user","target":target,"tag_instance":tag_instance}),
|
||||||
|
Self::Error { message } => serde_json::json!({"kind":"error","message":message}),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
#[derive(Debug, Clone, PartialEq, Eq)]
|
||||||
|
pub enum CallDispatch {
|
||||||
|
User { target: usize, tag_instance: bool },
|
||||||
|
Method { receiver: String },
|
||||||
|
Builtin,
|
||||||
|
Host { function: u16 },
|
||||||
|
Plugin,
|
||||||
|
RejectDuplicate { name: String },
|
||||||
|
Path { receiver: String, check_receiver: bool, fallback: PathFallback },
|
||||||
|
ResolutionFault { message: String },
|
||||||
|
}
|
||||||
|
#[derive(Debug, Clone)]
|
||||||
|
pub struct CallEmission {
|
||||||
|
pub expression: usize,
|
||||||
|
/// Expanded and normalized source, captured before argument replacement.
|
||||||
|
pub source: CallExpr,
|
||||||
|
pub stages: Vec<CallStage>,
|
||||||
|
pub dispatch: Option<CallDispatch>,
|
||||||
|
pub as_statement: bool,
|
||||||
|
}
|
||||||
|
impl CallEmission {
|
||||||
|
pub fn binding_evidence(&self,program:&Program)->serde_json::Value {
|
||||||
|
let signature=match self.dispatch.as_ref() {
|
||||||
|
Some(CallDispatch::User{target,..})|Some(CallDispatch::Path{fallback:PathFallback::User{target,..},..})=>{
|
||||||
|
program.functions.get(*target).map(|callee|(callee.params.clone(),callee.defaults.clone()))
|
||||||
|
},
|
||||||
|
Some(CallDispatch::Builtin)=>crate::arguments::builtin_signature(&self.source.callee).map(|(params,optional)|
|
||||||
|
(params.iter().map(|p|p.to_string()).collect::<Vec<_>>(),vec![optional;params.len()])),
|
||||||
|
Some(CallDispatch::Host{function})=>crate::host::HostFn::from_u16(*function).map(|h|{
|
||||||
|
let params=h.all_params();let len=params.len();(params.into_iter().map(str::to_string).collect(),vec![true;len])
|
||||||
|
}),
|
||||||
|
_=>None,
|
||||||
|
};
|
||||||
|
match signature {
|
||||||
|
Some((params,omissions))=>crate::arguments::plan_evidence(¶ms,&names(self),&omissions),
|
||||||
|
None=>serde_json::Value::Null,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
pub fn evidence(&self) -> serde_json::Value {
|
||||||
|
use serde_json::json;
|
||||||
|
let dispatch = match &self.dispatch {
|
||||||
|
Some(CallDispatch::User {
|
||||||
|
target,
|
||||||
|
tag_instance,
|
||||||
|
}) => json!({"kind":"user","target":target,"tag_instance":tag_instance}),
|
||||||
|
Some(CallDispatch::Method { receiver }) => json!({"kind":"method","receiver":receiver}),
|
||||||
|
Some(CallDispatch::Builtin) => json!({"kind":"builtin"}),
|
||||||
|
Some(CallDispatch::Host { function }) => {
|
||||||
|
let host = crate::host::HostFn::from_u16(*function);
|
||||||
|
json!({"kind":"host","function":function,"params":host.map(|h|h.all_params()),"required":host.map(|h|h.required_params().len())})
|
||||||
|
}
|
||||||
|
Some(CallDispatch::Plugin) => json!({"kind":"plugin"}),
|
||||||
|
Some(CallDispatch::RejectDuplicate { name }) => json!({"kind":"duplicate","name":name}),
|
||||||
|
Some(CallDispatch::Path { receiver, check_receiver, fallback }) => json!({"kind":"path","receiver":receiver,"check_receiver":check_receiver,"fallback":fallback.evidence()}),
|
||||||
|
Some(CallDispatch::ResolutionFault { message }) => json!({"kind":"resolution_fault","message":message}),
|
||||||
|
None => serde_json::Value::Null,
|
||||||
|
};
|
||||||
|
json!({"expression":self.expression,"callee":self.source.callee,"receiver":self.source.receiver,"path":self.source.path,
|
||||||
|
"arguments":self.source.args.iter().map(|a|match a {Arg::Positional(_)=>None,Arg::Named{name,..}=>Some(name)}).collect::<Vec<_>>(),
|
||||||
|
"source_rules":self.source.args.iter().map(|a|match a {Arg::Positional(e)|Arg::Named{value:e,..}=>ExpressionRule::from_source(e).evidence()}).collect::<Vec<_>>(),
|
||||||
|
"stages":self.stages.iter().map(|s|json!({"expression":s.expression,"slot":s.slot})).collect::<Vec<_>>(),
|
||||||
|
"dispatch":dispatch,"as_statement":self.as_statement})
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn names(call: &CallEmission) -> Vec<Option<String>> {
|
||||||
|
call.source
|
||||||
|
.args
|
||||||
|
.iter()
|
||||||
|
.map(|a| match a {
|
||||||
|
Arg::Positional(_) => None,
|
||||||
|
Arg::Named { name, .. } => Some(name.clone()),
|
||||||
|
})
|
||||||
|
.collect()
|
||||||
|
}
|
||||||
|
fn read(c: &mut Cursor<'_>, slot: usize) -> Result<(), String> {
|
||||||
|
c.op(Op::GetLocal(slot))
|
||||||
|
}
|
||||||
|
fn read_child(
|
||||||
|
c: &mut Cursor<'_>,
|
||||||
|
ids: &mut std::slice::Iter<'_, usize>,
|
||||||
|
slot: usize,
|
||||||
|
) -> Result<(), String> {
|
||||||
|
let id = *ids.next().ok_or("missing staged argument reload witness")?;
|
||||||
|
let expr = c
|
||||||
|
.fun
|
||||||
|
.expressions
|
||||||
|
.get(id)
|
||||||
|
.ok_or("missing reload expression")?;
|
||||||
|
if expr.start != c.position
|
||||||
|
|| expr.end != c.position + 1
|
||||||
|
|| !matches!(&expr.rule,ExpressionRule::Read(name) if c.fun.locals.get(slot)==Some(name))
|
||||||
|
|| !expr.children.is_empty()
|
||||||
|
{
|
||||||
|
return Err("staged argument reload source differs".into());
|
||||||
|
}
|
||||||
|
read(c, slot)
|
||||||
|
}
|
||||||
|
fn layout(c: &mut Cursor<'_>, arguments: &[Option<String>]) -> Result<usize, String> {
|
||||||
|
let id = match c.fun.code.get(c.position) {
|
||||||
|
Some(Op::CallArgs(_, id) | Op::MethodCallArgs(_, id)) => *id,
|
||||||
|
_ => return Err("missing argument-layout call".into()),
|
||||||
|
};
|
||||||
|
if c.fun.call_layouts.get(id).map(Vec::as_slice) != Some(arguments) {
|
||||||
|
return Err("call argument layout differs from source".into());
|
||||||
|
}
|
||||||
|
Ok(id)
|
||||||
|
}
|
||||||
|
pub fn verify(program: &Program, fun: &FnChunk) -> Result<(), String> {
|
||||||
|
let caller=program.functions.iter().position(|f|std::ptr::eq(f,fun)).ok_or("missing call owner")?;
|
||||||
|
if fun.source_local_count < fun.params.len() || fun.source_local_count > fun.locals.len() {
|
||||||
|
return Err("invalid source/scratch local boundary".into());
|
||||||
|
}
|
||||||
|
let mut owners = HashSet::new();
|
||||||
|
let loops = fun
|
||||||
|
.statements
|
||||||
|
.iter()
|
||||||
|
.flat_map(|s| s.auxiliary.iter().copied())
|
||||||
|
.collect::<HashSet<_>>();
|
||||||
|
let mut active: Vec<(&super::ExpressionEmission, HashSet<usize>)> = Vec::new();
|
||||||
|
for call in &fun.calls {
|
||||||
|
let node = fun
|
||||||
|
.expressions
|
||||||
|
.get(call.expression)
|
||||||
|
.ok_or("missing call source expression")?;
|
||||||
|
if !matches!(node.rule, ExpressionRule::CallBoundary(_))
|
||||||
|
|| !owners.insert(call.expression)
|
||||||
|
|| call.as_statement
|
||||||
|
{
|
||||||
|
return Err("call source owner differs".into());
|
||||||
|
}
|
||||||
|
let arguments = names(call);
|
||||||
|
if call.stages.len() != arguments.len() || node.children.len() < arguments.len() {
|
||||||
|
return Err("call authored-actual inventory".into());
|
||||||
|
}
|
||||||
|
let slots = call.stages.iter().map(|s| s.slot).collect::<HashSet<_>>();
|
||||||
|
if slots.len() != arguments.len()
|
||||||
|
|| slots
|
||||||
|
.iter()
|
||||||
|
.any(|s| *s < fun.source_local_count || *s >= fun.locals.len() || loops.contains(s))
|
||||||
|
{
|
||||||
|
return Err("call scratch aliases source/loop/another actual".into());
|
||||||
|
}
|
||||||
|
while active
|
||||||
|
.last()
|
||||||
|
.is_some_and(|(parent, _)| parent.end <= node.start)
|
||||||
|
{
|
||||||
|
active.pop();
|
||||||
|
}
|
||||||
|
if active.iter().any(|(parent, other)| {
|
||||||
|
node.start < parent.start || node.end > parent.end || !slots.is_disjoint(other)
|
||||||
|
}) {
|
||||||
|
return Err("nested call scratch overlap or interval order".into());
|
||||||
|
}
|
||||||
|
let mut c = Cursor {
|
||||||
|
fun,
|
||||||
|
position: node.start,
|
||||||
|
end: node.end,
|
||||||
|
};
|
||||||
|
for (i, stage) in call.stages.iter().enumerate() {
|
||||||
|
if node.children[i] != stage.expression {
|
||||||
|
return Err("authored actual order differs".into());
|
||||||
|
}
|
||||||
|
let source = match &call.source.args[i] {
|
||||||
|
Arg::Positional(e) | Arg::Named { value: e, .. } => e,
|
||||||
|
};
|
||||||
|
if ExpressionRule::from_source(source).evidence()
|
||||||
|
!= fun.expressions[stage.expression].rule.evidence()
|
||||||
|
{
|
||||||
|
return Err("authored argument source rule differs".into());
|
||||||
|
}
|
||||||
|
c.child(stage.expression)?;
|
||||||
|
c.op(Op::SetLocal(stage.slot))?;
|
||||||
|
c.op(Op::Pop)?;
|
||||||
|
}
|
||||||
|
let mut reloads = node.children[arguments.len()..].iter();
|
||||||
|
let dispatch=call.dispatch.as_ref().ok_or("missing call dispatch obligation")?;
|
||||||
|
use crate::sema::{DynamicReason, resolution::Target};
|
||||||
|
let target=super::names::resolve(program,caller,&call.source);
|
||||||
|
let user=match &target { Target::Local(id)|Target::Import{fun:id,..}=>Some(*id),_=>None };
|
||||||
|
let user_dispatch=|id:usize|CallDispatch::User{target:id,tag_instance:program.parents[id].is_none()&&program.functions[id].source_ast.level==1};
|
||||||
|
let expected=if let Some(receiver)=&call.source.receiver {
|
||||||
|
CallDispatch::Method{receiver:receiver.clone()}
|
||||||
|
} else if let Some(path)=call.source.path.as_ref().filter(|p|p.len()==2) {
|
||||||
|
let fallback=match user.map(user_dispatch) {
|
||||||
|
Some(CallDispatch::User{target,tag_instance})=>PathFallback::User{target,tag_instance},
|
||||||
|
_=>PathFallback::Error{message:match target {Target::Unresolved{message,..}=>message,_=>format!("unresolved dynamic call `{}`",crate::sema::call_display(&call.source))}},
|
||||||
|
};
|
||||||
|
CallDispatch::Path{receiver:path[0].clone(),check_receiver:!fun.source_ast.imports.contains(&path[0]),fallback}
|
||||||
|
} else if let Some(id)=user {user_dispatch(id)} else {match target {
|
||||||
|
Target::Builtin(_)|Target::Dynamic{reason:DynamicReason::CallFn,..}=>CallDispatch::Builtin,
|
||||||
|
Target::Host(h)=>CallDispatch::Host{function:h.as_u16()},
|
||||||
|
Target::Dynamic{reason:DynamicReason::Plugin,..}=>CallDispatch::Plugin,
|
||||||
|
Target::Unresolved{message,..}=>CallDispatch::ResolutionFault{message},
|
||||||
|
_=>return Err("unmodeled source call resolution".into()),
|
||||||
|
}};
|
||||||
|
if *dispatch!=expected{return Err("call resolution differs from source declaration graph".into());}
|
||||||
|
match dispatch {
|
||||||
|
CallDispatch::Path{..}=>{
|
||||||
|
for stage in &call.stages{read_child(&mut c,&mut reloads,stage.slot)?;}
|
||||||
|
let id=match fun.code.get(c.position){Some(Op::PathCallArgs(owner,id)) if fun.calls.get(*owner).is_some_and(|other|std::ptr::eq(other,call))=>*id,_=>return Err("path call owner differs".into())};
|
||||||
|
if fun.call_layouts.get(id)!=Some(&arguments){return Err("path call layout differs".into());}
|
||||||
|
let owner=fun.calls.iter().position(|other|std::ptr::eq(other,call)).unwrap();
|
||||||
|
c.op(Op::PathCallArgs(owner,id))?;
|
||||||
|
},
|
||||||
|
CallDispatch::ResolutionFault{message}=>{
|
||||||
|
let index=match fun.code.get(c.position){Some(Op::RejectCallResolution(index))=>*index,_=>return Err("missing call resolution fault".into())};
|
||||||
|
if fun.constants.get(index)!=Some(&Value::Text(message.clone())){return Err("call resolution fault payload differs".into());}
|
||||||
|
c.op(Op::RejectCallResolution(index))?;
|
||||||
|
},
|
||||||
|
CallDispatch::RejectDuplicate { name } => {
|
||||||
|
let index = match fun.code.get(c.position) {
|
||||||
|
Some(Op::RejectDuplicateArgument(i)) => *i,
|
||||||
|
_ => return Err("duplicate argument refusal missing".into()),
|
||||||
|
};
|
||||||
|
if fun.constants.get(index) != Some(&Value::Text(name.clone())) {
|
||||||
|
return Err("duplicate argument name differs".into());
|
||||||
|
}
|
||||||
|
c.op(Op::RejectDuplicateArgument(index))?;
|
||||||
|
}
|
||||||
|
CallDispatch::User {
|
||||||
|
target,
|
||||||
|
tag_instance,
|
||||||
|
} => {
|
||||||
|
if *target >= program.functions.len()
|
||||||
|
|| *tag_instance != program.objects.iter().any(|(_, id)| id == target)
|
||||||
|
{
|
||||||
|
return Err("resolved call target/tag differs".into());
|
||||||
|
}
|
||||||
|
for stage in &call.stages {
|
||||||
|
read_child(&mut c, &mut reloads, stage.slot)?;
|
||||||
|
}
|
||||||
|
let id = layout(&mut c, &arguments)?;
|
||||||
|
c.op(Op::CallArgs(*target, id))?;
|
||||||
|
if *tag_instance {
|
||||||
|
c.op(Op::TagInstance(*target))?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
CallDispatch::Method { receiver } => {
|
||||||
|
if call.source.receiver.as_ref() != Some(receiver)
|
||||||
|
&& call.source.path.as_ref().and_then(|p| p.first()) != Some(receiver)
|
||||||
|
{
|
||||||
|
return Err("method receiver differs from source".into());
|
||||||
|
}
|
||||||
|
for stage in &call.stages {
|
||||||
|
read_child(&mut c, &mut reloads, stage.slot)?;
|
||||||
|
}
|
||||||
|
let slot = fun
|
||||||
|
.locals
|
||||||
|
.iter()
|
||||||
|
.position(|n| n == receiver)
|
||||||
|
.ok_or("method receiver slot")?;
|
||||||
|
read(&mut c, slot)?;
|
||||||
|
let index = match fun.code.get(c.position) {
|
||||||
|
Some(Op::MethodCallArgs(i, _)) => *i,
|
||||||
|
_ => return Err("method dispatch missing".into()),
|
||||||
|
};
|
||||||
|
if fun.constants.get(index) != Some(&Value::Text(call.source.callee.clone())) {
|
||||||
|
return Err("method name differs from source".into());
|
||||||
|
}
|
||||||
|
let id = layout(&mut c, &arguments)?;
|
||||||
|
c.op(Op::MethodCallArgs(index, id))?;
|
||||||
|
}
|
||||||
|
CallDispatch::Builtin|CallDispatch::Plugin|CallDispatch::Host{..}=>{
|
||||||
|
for stage in &call.stages{read_child(&mut c,&mut reloads,stage.slot)?;}
|
||||||
|
let (first,id)=match fun.code.get(c.position){Some(Op::BuiltinCallArgs(n,l)|Op::PluginCallArgs(n,l))=>(*n,*l),Some(Op::HostCallArgs(n,l))=>(*n as usize,*l),_=>return Err("missing native argument dispatch".into())};
|
||||||
|
if fun.call_layouts.get(id)!=Some(&arguments){return Err("native argument layout differs".into());}
|
||||||
|
match dispatch {
|
||||||
|
CallDispatch::Builtin=>{
|
||||||
|
if crate::arguments::builtin_signature(&call.source.callee).is_none() || fun.constants.get(first)!=Some(&Value::Text(call.source.callee.clone())){return Err("builtin identity differs".into());}
|
||||||
|
c.op(Op::BuiltinCallArgs(first,id))?;
|
||||||
|
},
|
||||||
|
CallDispatch::Plugin=>{
|
||||||
|
if fun.constants.get(first)!=Some(&Value::Text(call.source.callee.clone())){return Err("plugin identity differs".into());}
|
||||||
|
c.op(Op::PluginCallArgs(first,id))?;
|
||||||
|
},
|
||||||
|
CallDispatch::Host{function}=>{
|
||||||
|
let hf=crate::host::HostFn::from_name(&call.source.callee).ok_or("source host name")?;
|
||||||
|
if hf.as_u16()!=*function || first!=*function as usize{return Err("host primitive identity differs".into());}
|
||||||
|
c.op(Op::HostCallArgs(*function,id))?;
|
||||||
|
},_=>unreachable!(),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
}
|
||||||
|
if reloads.next().is_some() || c.position != node.end {
|
||||||
|
return Err("call instruction/expression coverage differs".into());
|
||||||
|
}
|
||||||
|
active.push((node, slots));
|
||||||
|
}
|
||||||
|
if fun
|
||||||
|
.expressions
|
||||||
|
.iter()
|
||||||
|
.filter(|e| matches!(e.rule, ExpressionRule::CallBoundary(_)))
|
||||||
|
.count()
|
||||||
|
!= owners.len()
|
||||||
|
{
|
||||||
|
return Err("uncovered call source expression".into());
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
+382
-479
File diff suppressed because it is too large.
Load diff
@@ -0,0 +1,439 @@
|
|||||||
|
//! Source-directed expression emission obligations. Call staging and selection
|
||||||
|
//! are checked separately in call.rs; dispatch semantics remain a proof boundary.
|
||||||
|
use super::{FnChunk, Op};
|
||||||
|
use crate::{
|
||||||
|
ast::{BinaryOp, Expr, IndexKey, InterpPart, Literal, UnaryOp},
|
||||||
|
value::Value,
|
||||||
|
};
|
||||||
|
|
||||||
|
#[derive(Debug, Clone)]
|
||||||
|
pub enum ExpressionRule {
|
||||||
|
Literal(Value),
|
||||||
|
Read(String),
|
||||||
|
Unary(UnaryOp),
|
||||||
|
Binary(BinaryOp),
|
||||||
|
Interpolation(Vec<InterpPart>),
|
||||||
|
List(usize),
|
||||||
|
Map(Vec<String>),
|
||||||
|
Index {
|
||||||
|
label: IndexKey,
|
||||||
|
base_variable: Option<String>,
|
||||||
|
},
|
||||||
|
Occluded(bool),
|
||||||
|
CallBoundary(Vec<String>),
|
||||||
|
CallFault(String),
|
||||||
|
}
|
||||||
|
impl ExpressionRule {
|
||||||
|
pub fn from_source(expr: &Expr) -> Self {
|
||||||
|
match expr {
|
||||||
|
Expr::Literal(value) => Self::Literal(match value {
|
||||||
|
Literal::None => Value::None,
|
||||||
|
Literal::Bool(v) => Value::Bool(*v),
|
||||||
|
Literal::Int(v) => Value::Int(*v),
|
||||||
|
Literal::Num(v) => Value::Num(*v),
|
||||||
|
Literal::Text(v) => Value::Text(v.clone()),
|
||||||
|
}),
|
||||||
|
Expr::Var(name) => Self::Read(name.clone()),
|
||||||
|
Expr::Unary { op, .. } => Self::Unary(*op),
|
||||||
|
Expr::Binary { op, .. } => Self::Binary(*op),
|
||||||
|
Expr::Interp(parts) => Self::Interpolation(parts.clone()),
|
||||||
|
Expr::List(items) => Self::List(items.len()),
|
||||||
|
Expr::Map(items) => Self::Map(items.iter().map(|(k, _)| k.clone()).collect()),
|
||||||
|
Expr::Index { base, label } => Self::Index {
|
||||||
|
label: label.clone(),
|
||||||
|
base_variable: if let Expr::Var(name) = base.as_ref() {
|
||||||
|
Some(name.clone())
|
||||||
|
} else {
|
||||||
|
None
|
||||||
|
},
|
||||||
|
},
|
||||||
|
Expr::Formula(value) => Self::Literal(Value::Formula(value.clone())),
|
||||||
|
Expr::Code(value) => Self::Literal(Value::Code(value.clone())),
|
||||||
|
Expr::Occluded { payload, .. } => Self::Occluded(payload.is_some()),
|
||||||
|
Expr::Call(call) if call.for_evaluation().is_err() => {
|
||||||
|
Self::CallFault(call.for_evaluation().unwrap_err())
|
||||||
|
}
|
||||||
|
Expr::Call(call) => Self::CallBoundary(
|
||||||
|
call.receiver
|
||||||
|
.iter()
|
||||||
|
.cloned()
|
||||||
|
.chain(call.path.iter().filter_map(|path| path.first().cloned()))
|
||||||
|
.collect(),
|
||||||
|
),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
#[derive(Debug, Clone)]
|
||||||
|
pub struct ExpressionEmission {
|
||||||
|
pub rule: ExpressionRule,
|
||||||
|
pub start: usize,
|
||||||
|
pub end: usize,
|
||||||
|
pub children: Vec<usize>,
|
||||||
|
}
|
||||||
|
|
||||||
|
pub(super) fn formula_equal(a: &crate::formula::Expr, b: &crate::formula::Expr) -> bool {
|
||||||
|
use crate::formula::Expr::*;
|
||||||
|
match (a, b) {
|
||||||
|
(Num(x), Num(y)) => x.to_bits() == y.to_bits(),
|
||||||
|
(Var(x), Var(y)) => x == y,
|
||||||
|
(UnaryNeg(x), UnaryNeg(y)) => formula_equal(x, y),
|
||||||
|
(
|
||||||
|
Bin {
|
||||||
|
op: a,
|
||||||
|
left: x,
|
||||||
|
right: y,
|
||||||
|
},
|
||||||
|
Bin {
|
||||||
|
op: b,
|
||||||
|
left: u,
|
||||||
|
right: v,
|
||||||
|
},
|
||||||
|
) => a == b && formula_equal(x, u) && formula_equal(y, v),
|
||||||
|
(Call { name: a, args: x }, Call { name: b, args: y }) => {
|
||||||
|
a == b && x.len() == y.len() && x.iter().zip(y).all(|(a, b)| formula_equal(a, b))
|
||||||
|
}
|
||||||
|
(Matrix { source: a, rows: x }, Matrix { source: b, rows: y }) => {
|
||||||
|
a == b
|
||||||
|
&& x.len() == y.len()
|
||||||
|
&& x.iter().zip(y).all(|(a, b)| {
|
||||||
|
a.len() == b.len() && a.iter().zip(b).all(|(x, y)| x.to_bits() == y.to_bits())
|
||||||
|
})
|
||||||
|
}
|
||||||
|
_ => false,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn value_equal(a: &Value, b: &Value) -> bool {
|
||||||
|
match (a, b) {
|
||||||
|
(Value::Num(x), Value::Num(y)) => x.to_bits() == y.to_bits(),
|
||||||
|
(Value::Formula(x), Value::Formula(y)) => formula_equal(x, y),
|
||||||
|
_ => a == b,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
pub(super) struct Cursor<'a> {
|
||||||
|
pub(super) fun: &'a FnChunk,
|
||||||
|
pub(super) position: usize,
|
||||||
|
pub(super) end: usize,
|
||||||
|
}
|
||||||
|
impl Cursor<'_> {
|
||||||
|
pub(super) fn op(&mut self, expected: Op) -> Result<(), String> {
|
||||||
|
if self.position >= self.end || self.fun.code.get(self.position) != Some(&expected) {
|
||||||
|
return Err(format!(
|
||||||
|
"source expression opcode differs at {}: expected {expected:?}",
|
||||||
|
self.position
|
||||||
|
));
|
||||||
|
}
|
||||||
|
self.position += 1;
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
pub(super) fn literal(&mut self, value: &Value) -> Result<(), String> {
|
||||||
|
match value {
|
||||||
|
Value::None => self.op(Op::None_),
|
||||||
|
Value::Bool(true) => self.op(Op::True),
|
||||||
|
Value::Bool(false) => self.op(Op::False),
|
||||||
|
_ => {
|
||||||
|
let Some(Op::Constant(index)) = self.fun.code.get(self.position) else {
|
||||||
|
return Err("source literal is not a constant instruction".into());
|
||||||
|
};
|
||||||
|
if !self
|
||||||
|
.fun
|
||||||
|
.constants
|
||||||
|
.get(*index)
|
||||||
|
.is_some_and(|actual| value_equal(actual, value))
|
||||||
|
{
|
||||||
|
return Err("source literal value differs".into());
|
||||||
|
}
|
||||||
|
self.op(Op::Constant(*index))
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn read(&mut self, name: &str) -> Result<(), String> {
|
||||||
|
let slot = self
|
||||||
|
.fun
|
||||||
|
.locals
|
||||||
|
.iter()
|
||||||
|
.position(|local| local == name)
|
||||||
|
.ok_or("source variable has no slot")?;
|
||||||
|
self.op(Op::GetLocal(slot))
|
||||||
|
}
|
||||||
|
pub(super) fn child(&mut self, id: usize) -> Result<(), String> {
|
||||||
|
let child = &self.fun.expressions[id];
|
||||||
|
if child.start != self.position {
|
||||||
|
return Err("source operand order/range differs".into());
|
||||||
|
}
|
||||||
|
self.position = child.end;
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
}
|
||||||
|
pub fn verify(fun: &FnChunk) -> Result<usize, String> {
|
||||||
|
let mut boundaries = 0;
|
||||||
|
for (id, node) in fun.expressions.iter().enumerate() {
|
||||||
|
if node.start >= node.end || node.end > fun.code.len() {
|
||||||
|
return Err("invalid source expression interval".into());
|
||||||
|
}
|
||||||
|
for child in &node.children {
|
||||||
|
if *child <= id || *child >= fun.expressions.len() {
|
||||||
|
return Err("invalid source expression child".into());
|
||||||
|
}
|
||||||
|
let c = &fun.expressions[*child];
|
||||||
|
if c.start < node.start || c.end > node.end {
|
||||||
|
return Err("expression child outside parent".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let mut c = Cursor {
|
||||||
|
fun,
|
||||||
|
position: node.start,
|
||||||
|
end: node.end,
|
||||||
|
};
|
||||||
|
let expected_children = match &node.rule {
|
||||||
|
ExpressionRule::Literal(v) => {
|
||||||
|
c.literal(v)?;
|
||||||
|
0
|
||||||
|
}
|
||||||
|
ExpressionRule::Read(name) => {
|
||||||
|
c.read(name)?;
|
||||||
|
0
|
||||||
|
}
|
||||||
|
ExpressionRule::Unary(op) => {
|
||||||
|
if node.children.len() != 1 {
|
||||||
|
return Err("unary source arity".into());
|
||||||
|
}
|
||||||
|
c.child(node.children[0])?;
|
||||||
|
c.op(match op {
|
||||||
|
UnaryOp::Not => Op::Not,
|
||||||
|
UnaryOp::Neg => Op::Negate,
|
||||||
|
})?;
|
||||||
|
1
|
||||||
|
}
|
||||||
|
ExpressionRule::Binary(op) => {
|
||||||
|
if node.children.len() != 2 {
|
||||||
|
return Err("binary source arity".into());
|
||||||
|
}
|
||||||
|
let left = &fun.expressions[node.children[0]];
|
||||||
|
let right = &fun.expressions[node.children[1]];
|
||||||
|
c.child(node.children[0])?;
|
||||||
|
match op {
|
||||||
|
BinaryOp::And => {
|
||||||
|
c.op(Op::JumpIfFalse(right.end + 5))?;
|
||||||
|
c.child(node.children[1])?;
|
||||||
|
for op in [
|
||||||
|
Op::JumpIfFalse(right.end + 3),
|
||||||
|
Op::True,
|
||||||
|
Op::Jump(node.end),
|
||||||
|
Op::False,
|
||||||
|
Op::Jump(node.end),
|
||||||
|
Op::False,
|
||||||
|
] {
|
||||||
|
c.op(op)?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
BinaryOp::Or => {
|
||||||
|
c.op(Op::JumpIfFalse(right.start))?;
|
||||||
|
c.op(Op::True)?;
|
||||||
|
c.op(Op::Jump(node.end))?;
|
||||||
|
c.child(node.children[1])?;
|
||||||
|
for op in [
|
||||||
|
Op::JumpIfFalse(right.end + 3),
|
||||||
|
Op::True,
|
||||||
|
Op::Jump(node.end),
|
||||||
|
Op::False,
|
||||||
|
] {
|
||||||
|
c.op(op)?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
_ => {
|
||||||
|
let _ = left;
|
||||||
|
c.child(node.children[1])?;
|
||||||
|
c.op(match op {
|
||||||
|
BinaryOp::Add => Op::Add,
|
||||||
|
BinaryOp::Sub => Op::Sub,
|
||||||
|
BinaryOp::Mul => Op::Mul,
|
||||||
|
BinaryOp::Div => Op::Div,
|
||||||
|
BinaryOp::Eq => Op::Equal,
|
||||||
|
BinaryOp::Ne => Op::NotEqual,
|
||||||
|
BinaryOp::Lt => Op::Less,
|
||||||
|
BinaryOp::Le => Op::Lessequal,
|
||||||
|
BinaryOp::Gt => Op::Greater,
|
||||||
|
BinaryOp::Ge => Op::GreaterEqual,
|
||||||
|
_ => unreachable!(),
|
||||||
|
})?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
2
|
||||||
|
}
|
||||||
|
ExpressionRule::List(count) => {
|
||||||
|
for child in &node.children {
|
||||||
|
c.child(*child)?;
|
||||||
|
}
|
||||||
|
c.op(Op::BuildList(*count))?;
|
||||||
|
*count
|
||||||
|
}
|
||||||
|
ExpressionRule::Map(keys) => {
|
||||||
|
if node.children.len() != keys.len() {
|
||||||
|
return Err("map source arity".into());
|
||||||
|
}
|
||||||
|
for (key, child) in keys.iter().zip(&node.children) {
|
||||||
|
c.literal(&Value::Text(key.clone()))?;
|
||||||
|
c.child(*child)?;
|
||||||
|
}
|
||||||
|
c.op(Op::BuildMap(keys.len()))?;
|
||||||
|
keys.len()
|
||||||
|
}
|
||||||
|
ExpressionRule::Occluded(payload) => {
|
||||||
|
if *payload {
|
||||||
|
if node.children.len() != 1 {
|
||||||
|
return Err("occluded source arity".into());
|
||||||
|
}
|
||||||
|
c.child(node.children[0])?;
|
||||||
|
1
|
||||||
|
} else {
|
||||||
|
c.literal(&Value::None)?;
|
||||||
|
0
|
||||||
|
}
|
||||||
|
}
|
||||||
|
ExpressionRule::Index {
|
||||||
|
label,
|
||||||
|
base_variable,
|
||||||
|
} => {
|
||||||
|
if node.children.len() != 1 {
|
||||||
|
return Err("index source arity".into());
|
||||||
|
}
|
||||||
|
c.child(node.children[0])?;
|
||||||
|
match label {
|
||||||
|
IndexKey::Lit(key) => c.literal(&Value::Text(key.clone()))?,
|
||||||
|
IndexKey::Var(name) => {
|
||||||
|
c.read(name)?;
|
||||||
|
c.op(Op::Str)?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
if let Some(name) = base_variable
|
||||||
|
.as_ref()
|
||||||
|
.filter(|name| fun.var_contracts.contains_key(*name))
|
||||||
|
{
|
||||||
|
let slot = fun
|
||||||
|
.locals
|
||||||
|
.iter()
|
||||||
|
.position(|local| local == name)
|
||||||
|
.ok_or("index source slot")?;
|
||||||
|
c.op(Op::ContractFootnoteGet(slot))?;
|
||||||
|
} else {
|
||||||
|
c.op(Op::FootnoteGet)?;
|
||||||
|
}
|
||||||
|
1
|
||||||
|
}
|
||||||
|
ExpressionRule::Interpolation(parts) => {
|
||||||
|
if parts.is_empty() {
|
||||||
|
c.literal(&Value::Text(String::new()))?;
|
||||||
|
}
|
||||||
|
for (i, part) in parts.iter().enumerate() {
|
||||||
|
match part {
|
||||||
|
InterpPart::Lit(value) => c.literal(&Value::Text(value.clone()))?,
|
||||||
|
InterpPart::Var(name) => c.read(name)?,
|
||||||
|
InterpPart::Index { base, labels } => {
|
||||||
|
c.read(base)?;
|
||||||
|
for label in labels {
|
||||||
|
c.literal(&Value::Text(label.clone()))?;
|
||||||
|
c.op(Op::FootnoteGet)?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
c.op(Op::Str)?;
|
||||||
|
if i > 0 {
|
||||||
|
c.op(Op::Add)?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
0
|
||||||
|
}
|
||||||
|
ExpressionRule::CallFault(message) => {
|
||||||
|
let Some(Op::RejectArgumentExpansion(index)) = fun.code.get(c.position) else {
|
||||||
|
return Err("missing argument preparation fault".into());
|
||||||
|
};
|
||||||
|
if fun.constants.get(*index) != Some(&Value::Text(message.clone())) {
|
||||||
|
return Err("argument preparation message differs".into());
|
||||||
|
}
|
||||||
|
c.op(Op::RejectArgumentExpansion(*index))?;
|
||||||
|
0
|
||||||
|
}
|
||||||
|
ExpressionRule::CallBoundary(_) => {
|
||||||
|
boundaries += 1;
|
||||||
|
continue;
|
||||||
|
}
|
||||||
|
};
|
||||||
|
if node.children.len() != expected_children || c.position != node.end {
|
||||||
|
return Err("source expression coverage differs".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Ok(boundaries)
|
||||||
|
}
|
||||||
|
|
||||||
|
/// Local evidence preserves machine values, not the narrower foreign copy domain.
|
||||||
|
pub(super) fn interpolation_evidence(part: &InterpPart) -> serde_json::Value {
|
||||||
|
use serde_json::json;
|
||||||
|
match part {
|
||||||
|
InterpPart::Lit(value) => json!({"kind":"text","value":value}),
|
||||||
|
InterpPart::Var(name) => json!({"kind":"read","name":name}),
|
||||||
|
InterpPart::Index { base, labels } => json!({"kind":"index","base":base,"labels":labels}),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
pub(super) fn index_evidence(key: &IndexKey) -> serde_json::Value {
|
||||||
|
use serde_json::json;
|
||||||
|
match key {
|
||||||
|
IndexKey::Lit(value) => json!({"kind":"literal","value":value}),
|
||||||
|
IndexKey::Var(name) => json!({"kind":"read","name":name}),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
pub(super) fn formula_evidence(value: &crate::formula::Expr) -> serde_json::Value {
|
||||||
|
use crate::formula::Expr::*;
|
||||||
|
use serde_json::json;
|
||||||
|
match value {
|
||||||
|
Num(n) => json!({"kind":"number","bits":n.to_bits()}),
|
||||||
|
Var(name) => json!({"kind":"variable","name":name}),
|
||||||
|
UnaryNeg(value) => json!({"kind":"negative","value":formula_evidence(value)}),
|
||||||
|
Bin { op, left, right } => {
|
||||||
|
json!({"kind":"binary","op":format!("{op:?}"),"left":formula_evidence(left),"right":formula_evidence(right)})
|
||||||
|
}
|
||||||
|
Call { name, args } => {
|
||||||
|
json!({"kind":"call","name":name,"args":args.iter().map(formula_evidence).collect::<Vec<_>>()})
|
||||||
|
}
|
||||||
|
Matrix { source, rows } => {
|
||||||
|
json!({"kind":"matrix","source":source,"rows":rows.iter().map(|row|row.iter().map(|n|n.to_bits()).collect::<Vec<_>>()).collect::<Vec<_>>()})
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
pub fn value_evidence(value: &Value) -> serde_json::Value {
|
||||||
|
use serde_json::json;
|
||||||
|
match value {
|
||||||
|
Value::None => json!({"tag":"none"}),
|
||||||
|
Value::Bool(v) => json!({"tag":"bool","value":v}),
|
||||||
|
Value::Int(v) => json!({"tag":"int","value":v}),
|
||||||
|
Value::Num(v) => json!({"tag":"num","bits":v.to_bits()}),
|
||||||
|
Value::Text(v) => json!({"tag":"text","value":v}),
|
||||||
|
Value::Code(v) => json!({"tag":"code","lang":v.lang,"source":v.source}),
|
||||||
|
Value::Formula(v) => json!({"tag":"formula","value":formula_evidence(v)}),
|
||||||
|
_ => json!({"tag":"nonliteral","value":format!("{value:?}")}),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
impl ExpressionRule {
|
||||||
|
pub fn evidence(&self) -> serde_json::Value {
|
||||||
|
use serde_json::json;
|
||||||
|
match self {
|
||||||
|
Self::Literal(v) => json!({"kind":"literal","value":value_evidence(v)}),
|
||||||
|
Self::Read(name) => json!({"kind":"read","name":name}),
|
||||||
|
Self::Unary(op) => json!({"kind":"unary","op":format!("{op:?}")}),
|
||||||
|
Self::Binary(op) => json!({"kind":"binary","op":format!("{op:?}")}),
|
||||||
|
Self::CallBoundary(names) => json!({"kind":"call_boundary","names":names}),
|
||||||
|
Self::CallFault(message) => json!({"kind":"call_expansion_fault","message":message}),
|
||||||
|
Self::Interpolation(parts) => {
|
||||||
|
json!({"kind":"interpolation_boundary","parts":parts.iter().map(interpolation_evidence).collect::<Vec<_>>()})
|
||||||
|
}
|
||||||
|
Self::List(n) => json!({"kind":"list","arity":n}),
|
||||||
|
Self::Map(keys) => json!({"kind":"map","keys":keys}),
|
||||||
|
Self::Index {
|
||||||
|
label,
|
||||||
|
base_variable,
|
||||||
|
} => {
|
||||||
|
json!({"kind":"index_boundary","label":index_evidence(label),"base_variable":base_variable})
|
||||||
|
}
|
||||||
|
Self::Occluded(payload) => json!({"kind":"occluded","payload":payload}),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
+74
-13
@@ -2,6 +2,17 @@
|
|||||||
|
|
||||||
mod compile;
|
mod compile;
|
||||||
mod vm;
|
mod vm;
|
||||||
|
mod verify;
|
||||||
|
mod expression;
|
||||||
|
mod statement;
|
||||||
|
mod call;
|
||||||
|
mod source;
|
||||||
|
mod names;
|
||||||
|
pub use source::SourceFunction;
|
||||||
|
pub use call::{CallEmission, CallStage, CallDispatch, PathFallback};
|
||||||
|
pub use statement::{StatementRule,StatementEmission};
|
||||||
|
pub use expression::{ExpressionRule,ExpressionEmission,value_evidence as expression_value_evidence};
|
||||||
|
pub use verify::StackCertificate;
|
||||||
|
|
||||||
pub use compile::{compile_for_call, compile_module};
|
pub use compile::{compile_for_call, compile_module};
|
||||||
pub use vm::Vm;
|
pub use vm::Vm;
|
||||||
@@ -13,13 +24,13 @@ use crate::value::Value;
|
|||||||
|
|
||||||
#[derive(Debug, Clone, Copy, PartialEq, Eq)]
|
#[derive(Debug, Clone, Copy, PartialEq, Eq)]
|
||||||
pub enum Op {
|
pub enum Op {
|
||||||
Constant(u16),
|
Constant(usize),
|
||||||
True,
|
True,
|
||||||
False,
|
False,
|
||||||
None_,
|
None_,
|
||||||
Pop,
|
Pop,
|
||||||
GetLocal(u8),
|
GetLocal(usize),
|
||||||
SetLocal(u8),
|
SetLocal(usize),
|
||||||
Add,
|
Add,
|
||||||
Sub,
|
Sub,
|
||||||
Mul,
|
Mul,
|
||||||
@@ -33,14 +44,14 @@ pub enum Op {
|
|||||||
Less,
|
Less,
|
||||||
Lessequal,
|
Lessequal,
|
||||||
/// Absolute jump to instruction index.
|
/// Absolute jump to instruction index.
|
||||||
Jump(u16),
|
Jump(usize),
|
||||||
JumpIfFalse(u16),
|
JumpIfFalse(usize),
|
||||||
Print,
|
Print,
|
||||||
/// Pop prompt text, print it (no newline), read one stdin line → push Text.
|
/// Pop prompt text, print it (no newline), read one stdin line → push Text.
|
||||||
Input,
|
Input,
|
||||||
BuildList(u16),
|
BuildList(usize),
|
||||||
/// Stack (bottom→top): k0, v0, k1, v1, … (n pairs); push Map.
|
/// Stack (bottom→top): k0, v0, k1, v1, … (n pairs); push Map.
|
||||||
BuildMap(u16),
|
BuildMap(usize),
|
||||||
/// Pop value → push `len` (text/list).
|
/// Pop value → push `len` (text/list).
|
||||||
Len,
|
Len,
|
||||||
/// Pop value → push display text.
|
/// Pop value → push display text.
|
||||||
@@ -61,25 +72,73 @@ pub enum Op {
|
|||||||
/// Pop footnote label text, then base → push indexed value (1-based list / map key).
|
/// Pop footnote label text, then base → push indexed value (1-based list / map key).
|
||||||
FootnoteGet,
|
FootnoteGet,
|
||||||
/// Call function by index; argc values are on the stack (param order).
|
/// Call function by index; argc values are on the stack (param order).
|
||||||
Call(u16, u8),
|
Call(usize, usize),
|
||||||
|
/// Evaluated actuals in authored order; layout preserves optional names.
|
||||||
|
CallArgs(usize, usize),
|
||||||
|
/// Runtime binding fault after all explicit actual effects.
|
||||||
|
RejectDuplicateArgument(usize),
|
||||||
|
/// Modifier/argument preparation failed before any actual is evaluated.
|
||||||
|
RejectArgumentExpansion(usize),
|
||||||
|
/// Skip a callee default when the parameter was explicitly supplied.
|
||||||
|
JumpIfProvided(usize, usize),
|
||||||
|
/// Entry/raw-call parameters without a value retain language None after defaults.
|
||||||
|
FillMissingParameters,
|
||||||
|
ResetLoop(usize),
|
||||||
|
CheckLoop(usize),
|
||||||
|
CheckArguments,
|
||||||
|
RestoreReceiver,
|
||||||
|
CheckFrameArguments,
|
||||||
|
CheckReturn,
|
||||||
|
/// Check the stack top against the named local's field contract.
|
||||||
|
CheckBinding(usize),
|
||||||
|
/// Checked footnote access; operand identifies the contracted base local.
|
||||||
|
ContractFootnoteGet(usize),
|
||||||
/// Pop function name text → call zero-arg top-level or lexically visible function.
|
/// Pop function name text → call zero-arg top-level or lexically visible function.
|
||||||
CallFn,
|
CallFn,
|
||||||
/// After a constructor Call: tag top-of-stack map with `_type` = constants[idx].
|
/// After a constructor call: stamp name and module of functions[idx].
|
||||||
TagInstance(u16),
|
TagInstance(usize),
|
||||||
/// Method call: stack has argc args (param order) then receiver on top.
|
/// Method call: stack has argc args (param order) then receiver on top.
|
||||||
/// constants[name_idx] is method name text; resolve via receiver `_type`.
|
/// constants[name_idx] is method name text; resolve via receiver `_type`.
|
||||||
MethodCall(u16, u8),
|
MethodCall(usize, usize),
|
||||||
|
/// Resolve the receiver first, then bind against that method's signature.
|
||||||
|
MethodCallArgs(usize, usize),
|
||||||
/// Plugin call: stack has argc args in registered param order; name in constants.
|
/// Plugin call: stack has argc args in registered param order; name in constants.
|
||||||
PluginCall(u16, u8),
|
PluginCall(usize, usize),
|
||||||
/// Host primitive: pop `argc` args (param order), push result.
|
/// Host primitive: pop `argc` args (param order), push result.
|
||||||
HostCall(u16, u8),
|
HostCall(u16, usize),
|
||||||
|
/// Native dispatch with authored argument labels; binding happens at runtime.
|
||||||
|
BuiltinCallArgs(usize, usize),
|
||||||
|
HostCallArgs(u16, usize),
|
||||||
|
PluginCallArgs(usize, usize),
|
||||||
|
/// Two-component paths inspect actual receiver presence before static fallback.
|
||||||
|
PathCallArgs(usize, usize),
|
||||||
|
RejectCallResolution(usize),
|
||||||
Return,
|
Return,
|
||||||
}
|
}
|
||||||
|
|
||||||
#[derive(Debug, Clone)]
|
#[derive(Debug, Clone)]
|
||||||
pub struct FnChunk {
|
pub struct FnChunk {
|
||||||
|
/// Captured directly from the loaded declaration before emission.
|
||||||
|
pub source_ast: SourceFunction,
|
||||||
|
pub module_scope: u32,
|
||||||
|
pub module_path: Vec<String>,
|
||||||
|
pub source: crate::diagnostics::SourceIdentity,
|
||||||
|
pub declaration_span: Span,
|
||||||
pub name: String,
|
pub name: String,
|
||||||
pub params: Vec<String>,
|
pub params: Vec<String>,
|
||||||
|
pub contract: Option<crate::contract::Contract>,
|
||||||
|
pub var_contracts: HashMap<String, crate::contract::Contract>,
|
||||||
|
pub receiver_aliases: bool,
|
||||||
|
pub defaults: Vec<bool>,
|
||||||
|
pub default_expressions: Vec<Option<usize>>,
|
||||||
|
pub call_layouts: Vec<Vec<Option<String>>>,
|
||||||
|
pub calls: Vec<CallEmission>,
|
||||||
|
/// Source names are reserved before synthetic slots are allocated.
|
||||||
|
pub source_local_count: usize,
|
||||||
|
pub expressions: Vec<ExpressionEmission>,
|
||||||
|
pub statements: Vec<StatementEmission>,
|
||||||
|
pub statement_roots: Vec<usize>,
|
||||||
|
pub body_start: usize,
|
||||||
pub code: Vec<Op>,
|
pub code: Vec<Op>,
|
||||||
/// Parallel to `code`: source location for diagnostics / debug.
|
/// Parallel to `code`: source location for diagnostics / debug.
|
||||||
pub spans: Vec<Span>,
|
pub spans: Vec<Span>,
|
||||||
@@ -92,6 +151,8 @@ pub struct FnChunk {
|
|||||||
pub struct Program {
|
pub struct Program {
|
||||||
pub functions: Vec<FnChunk>,
|
pub functions: Vec<FnChunk>,
|
||||||
pub entry: usize,
|
pub entry: usize,
|
||||||
|
/// Applied by run(), not by named or nested calls to the entry function.
|
||||||
|
pub entry_metadata: Vec<(String, Value)>,
|
||||||
/// Top-level object name → function index (level-1).
|
/// Top-level object name → function index (level-1).
|
||||||
pub objects: Vec<(String, usize)>,
|
pub objects: Vec<(String, usize)>,
|
||||||
/// Parallel to `objects`: base object flat index (`# Child = > Parent`).
|
/// Parallel to `objects`: base object flat index (`# Child = > Parent`).
|
||||||
|
|||||||
@@ -0,0 +1,172 @@
|
|||||||
|
//! Source-grounded declaration identities and the flat view of name resolution.
|
||||||
|
use super::Program;
|
||||||
|
use crate::sema::resolution::{NameView, Target};
|
||||||
|
use std::collections::{HashMap, HashSet};
|
||||||
|
|
||||||
|
pub(crate) struct FlatView<'a>(pub &'a Program);
|
||||||
|
impl NameView for FlatView<'_> {
|
||||||
|
type Function = usize;
|
||||||
|
type Module = Vec<String>;
|
||||||
|
fn roots(&self, m: &Self::Module) -> Vec<usize> {
|
||||||
|
self.0
|
||||||
|
.functions
|
||||||
|
.iter()
|
||||||
|
.enumerate()
|
||||||
|
.filter(|(i, f)| &f.module_path == m && self.0.parents[*i].is_none())
|
||||||
|
.map(|(i, _)| i)
|
||||||
|
.collect()
|
||||||
|
}
|
||||||
|
fn children(&self, f: usize) -> Vec<usize> {
|
||||||
|
self.0.children[f].clone()
|
||||||
|
}
|
||||||
|
fn parent(&self, _: &Self::Module, f: usize) -> Option<usize> {
|
||||||
|
self.0.parents[f]
|
||||||
|
}
|
||||||
|
fn same(&self, a: usize, b: usize) -> bool {
|
||||||
|
a == b
|
||||||
|
}
|
||||||
|
fn name(&self, f: usize) -> String {
|
||||||
|
self.0.functions[f].source_ast.name.clone()
|
||||||
|
}
|
||||||
|
fn level(&self, f: usize) -> u8 {
|
||||||
|
self.0.functions[f].source_ast.level
|
||||||
|
}
|
||||||
|
fn is_object(&self, f: usize) -> bool {
|
||||||
|
self.level(f) == 1
|
||||||
|
}
|
||||||
|
fn uses_receiver(&self, f: usize) -> bool {
|
||||||
|
self.0.functions[f].source_ast.receiver_aliases
|
||||||
|
}
|
||||||
|
fn import(&self, m: &Self::Module, name: &str) -> Option<Self::Module> {
|
||||||
|
let owner = self.0.functions.iter().find(|f| &f.module_path == m)?;
|
||||||
|
if !owner.source_ast.imports.iter().any(|n| n == name) {
|
||||||
|
return None;
|
||||||
|
}
|
||||||
|
let mut path = m.clone();
|
||||||
|
path.push(name.into());
|
||||||
|
Some(path)
|
||||||
|
}
|
||||||
|
fn used_path(&self, m: &Self::Module, name: &str) -> Option<Vec<String>> {
|
||||||
|
self.0
|
||||||
|
.functions
|
||||||
|
.iter()
|
||||||
|
.find(|f| &f.module_path == m)?
|
||||||
|
.source_ast
|
||||||
|
.uses
|
||||||
|
.iter()
|
||||||
|
.find(|(n, _)| n == name)
|
||||||
|
.map(|(_, p)| p.clone())
|
||||||
|
}
|
||||||
|
}
|
||||||
|
pub(crate) fn resolve(
|
||||||
|
program: &Program,
|
||||||
|
caller: usize,
|
||||||
|
call: &crate::ast::CallExpr,
|
||||||
|
) -> Target<usize, Vec<String>> {
|
||||||
|
crate::sema::resolution::resolve(
|
||||||
|
&FlatView(program),
|
||||||
|
&program.functions[caller].module_path,
|
||||||
|
caller,
|
||||||
|
call,
|
||||||
|
)
|
||||||
|
}
|
||||||
|
pub(crate) fn lookup(program: &Program, caller: usize, name: &str) -> Option<usize> {
|
||||||
|
crate::sema::resolution::lookup(
|
||||||
|
&FlatView(program),
|
||||||
|
&program.functions[caller].module_path,
|
||||||
|
caller,
|
||||||
|
name,
|
||||||
|
)
|
||||||
|
}
|
||||||
|
pub(crate) fn verify(program: &Program) -> Result<(), String> {
|
||||||
|
let objects = program
|
||||||
|
.functions
|
||||||
|
.iter()
|
||||||
|
.enumerate()
|
||||||
|
.filter(|(id, f)| program.parents[*id].is_none() && f.source_ast.level == 1)
|
||||||
|
.map(|(id, f)| (f.source_ast.name.clone(), id))
|
||||||
|
.collect::<Vec<_>>();
|
||||||
|
if program.objects != objects {
|
||||||
|
return Err("object names differ from source declarations".into());
|
||||||
|
}
|
||||||
|
let methods = objects
|
||||||
|
.iter()
|
||||||
|
.flat_map(|(_, owner)| {
|
||||||
|
program.children[*owner].iter().map(|child| {
|
||||||
|
(
|
||||||
|
*owner,
|
||||||
|
program.functions[*child].source_ast.name.clone(),
|
||||||
|
*child,
|
||||||
|
)
|
||||||
|
})
|
||||||
|
})
|
||||||
|
.collect::<Vec<_>>();
|
||||||
|
if program.methods != methods {
|
||||||
|
return Err("method names differ from source declarations".into());
|
||||||
|
}
|
||||||
|
let mut identities = HashSet::new();
|
||||||
|
let mut scopes = HashMap::new();
|
||||||
|
let mut namespaces = HashMap::new();
|
||||||
|
for f in &program.functions {
|
||||||
|
let source = &f.source_ast;
|
||||||
|
if source.declaration_path.is_empty()
|
||||||
|
|| !identities.insert((f.module_path.clone(), source.declaration_path.clone()))
|
||||||
|
{
|
||||||
|
return Err("duplicate or missing source declaration identity".into());
|
||||||
|
}
|
||||||
|
if scopes
|
||||||
|
.insert(f.module_scope, f.module_path.clone())
|
||||||
|
.is_some_and(|p| p != f.module_path)
|
||||||
|
|| namespaces
|
||||||
|
.insert(f.module_path.clone(), f.module_scope)
|
||||||
|
.is_some_and(|s| s != f.module_scope)
|
||||||
|
|| (f.module_scope == 0) != f.module_path.is_empty()
|
||||||
|
{
|
||||||
|
return Err("source module scope mapping differs".into());
|
||||||
|
}
|
||||||
|
let owner = program
|
||||||
|
.functions
|
||||||
|
.iter()
|
||||||
|
.find(|g| g.module_path == f.module_path)
|
||||||
|
.unwrap();
|
||||||
|
if source.module_root_count != owner.source_ast.module_root_count
|
||||||
|
|| source.imports != owner.source_ast.imports
|
||||||
|
|| source.uses != owner.source_ast.uses
|
||||||
|
{
|
||||||
|
return Err("inconsistent source module header".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
for (id, f) in program.functions.iter().enumerate() {
|
||||||
|
let source = &f.source_ast;
|
||||||
|
let parent_path = &source.declaration_path[..source.declaration_path.len() - 1];
|
||||||
|
match program.parents[id] {
|
||||||
|
Some(parent)
|
||||||
|
if program.functions[parent].source_ast.declaration_path == parent_path =>
|
||||||
|
{
|
||||||
|
()
|
||||||
|
}
|
||||||
|
None if parent_path.is_empty() => (),
|
||||||
|
_ => return Err("flat parent differs from source declaration".into()),
|
||||||
|
}
|
||||||
|
if program.children[id].len() != source.child_count {
|
||||||
|
return Err("source child inventory differs".into());
|
||||||
|
}
|
||||||
|
for (ordinal, child) in program.children[id].iter().enumerate() {
|
||||||
|
let mut expected = source.declaration_path.clone();
|
||||||
|
expected.push(ordinal);
|
||||||
|
if program.functions[*child].source_ast.declaration_path != expected {
|
||||||
|
return Err("source child order differs".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let roots = FlatView(program).roots(&f.module_path);
|
||||||
|
if roots.len() != source.module_root_count
|
||||||
|
|| roots
|
||||||
|
.iter()
|
||||||
|
.enumerate()
|
||||||
|
.any(|(i, r)| program.functions[*r].source_ast.declaration_path != [i])
|
||||||
|
{
|
||||||
|
return Err("source root inventory/order differs".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
@@ -0,0 +1,366 @@
|
|||||||
|
//! Structural correspondence from a separately captured loaded AST to emission
|
||||||
|
//! witnesses. Parsing and capture of the source snapshot remain trusted inputs.
|
||||||
|
use super::{ExpressionRule, FnChunk};
|
||||||
|
use crate::ast::{Arg, CallExpr, Expr, Function, Literal, Param, Stmt};
|
||||||
|
use serde_json::{json, Value as Json};
|
||||||
|
|
||||||
|
#[derive(Debug, Clone)]
|
||||||
|
pub struct SourceFunction {
|
||||||
|
pub declaration_path: Vec<usize>,
|
||||||
|
pub level: u8,
|
||||||
|
pub child_count: usize,
|
||||||
|
pub module_root_count: usize,
|
||||||
|
pub imports: Vec<String>,
|
||||||
|
pub uses: Vec<(String, Vec<String>)>,
|
||||||
|
pub name: String,
|
||||||
|
pub line: u32,
|
||||||
|
pub params: Vec<Param>,
|
||||||
|
pub body: Vec<Stmt>,
|
||||||
|
pub receiver_aliases: bool,
|
||||||
|
pub has_contract: bool,
|
||||||
|
pub binding_contracts: Vec<String>,
|
||||||
|
pub contract: Option<crate::contract::Contract>,
|
||||||
|
pub var_contracts: std::collections::HashMap<String, crate::contract::Contract>,
|
||||||
|
}
|
||||||
|
impl SourceFunction {
|
||||||
|
pub fn from_function(fun: &Function) -> Self {
|
||||||
|
let mut bindings = fun.var_contracts.keys().cloned().collect::<Vec<_>>();
|
||||||
|
bindings.sort();
|
||||||
|
Self {
|
||||||
|
declaration_path: Vec::new(),
|
||||||
|
level: fun.level,
|
||||||
|
child_count: fun.children.len(),
|
||||||
|
module_root_count: 0,
|
||||||
|
imports: Vec::new(),
|
||||||
|
uses: Vec::new(),
|
||||||
|
name: fun.name.clone(),
|
||||||
|
line: fun.span.line,
|
||||||
|
params: fun.params.clone(),
|
||||||
|
body: fun.body.clone(),
|
||||||
|
receiver_aliases: crate::ast::function_uses_receiver(fun),
|
||||||
|
has_contract: fun.contract.is_some(),
|
||||||
|
binding_contracts: bindings,
|
||||||
|
contract: fun.contract.clone(),
|
||||||
|
var_contracts: fun.var_contracts.clone(),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
pub fn from_declaration(module: &crate::ast::Module, fun: &Function) -> Self {
|
||||||
|
fn locate(nodes: &[Function], target: &Function, path: &mut Vec<usize>) -> bool {
|
||||||
|
for (index, node) in nodes.iter().enumerate() {
|
||||||
|
path.push(index);
|
||||||
|
if std::ptr::eq(node, target) || locate(&node.children, target, path) { return true; }
|
||||||
|
path.pop();
|
||||||
|
}
|
||||||
|
false
|
||||||
|
}
|
||||||
|
let mut result = Self::from_function(fun);
|
||||||
|
assert!(locate(&module.functions, fun, &mut result.declaration_path), "source declaration belongs to its module");
|
||||||
|
result.module_root_count = module.functions.len();
|
||||||
|
result.imports = module.import_modules.keys().cloned().collect();
|
||||||
|
result.imports.sort();
|
||||||
|
result.uses = module.uses.iter().map(|u| (u.bind.clone(), u.path.clone())).collect();
|
||||||
|
result
|
||||||
|
}
|
||||||
|
pub fn evidence(&self) -> Result<Json, String> {
|
||||||
|
Ok(
|
||||||
|
json!({"declaration_path":self.declaration_path,"level":self.level,"child_count":self.child_count,"module_root_count":self.module_root_count,"imports":self.imports,"uses":self.uses,
|
||||||
|
"name":self.name,"line":self.line,"params":self.params.iter().map(|p|Ok(json!({"name":p.name,"default":p.default.as_ref().map(expression_tree).transpose()?}))).collect::<Result<Vec<_>,String>>()?,
|
||||||
|
"body":self.body.iter().map(statement_tree).collect::<Result<Vec<_>,_>>()?,"receiver_aliases":self.receiver_aliases,"has_contract":self.has_contract,"binding_contracts":self.binding_contracts,"contracts":Self::contract_metadata(self.contract.as_ref(),&self.var_contracts)}),
|
||||||
|
)
|
||||||
|
}
|
||||||
|
pub fn contract_metadata(
|
||||||
|
contract: Option<&crate::contract::Contract>,
|
||||||
|
bindings: &std::collections::HashMap<String, crate::contract::Contract>,
|
||||||
|
) -> Json {
|
||||||
|
fn ty(ty: &crate::contract::Ty) -> Json {
|
||||||
|
match ty {
|
||||||
|
crate::contract::Ty::Object(name) => json!({"kind":"object","name":name}),
|
||||||
|
other => json!({"kind":other.name()}),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn encode(c: &crate::contract::Contract) -> Json {
|
||||||
|
json!({"params":c.params.iter().map(|p|json!({"name":p.name,"type":ty(&p.ty),"description":p.desc})).collect::<Vec<_>>(),
|
||||||
|
"returns":c.returns.as_ref().map(|r|json!({"type":ty(&r.ty),"description":r.desc})),
|
||||||
|
"fields":c.fields.iter().map(|f|json!({"name":f.name,"type":ty(&f.ty),"nullable":f.nullable,"description":f.desc})).collect::<Vec<_>>(),
|
||||||
|
"start_line":c.start_line,"end_line":c.end_line,"quote":c.quote})
|
||||||
|
}
|
||||||
|
let bindings = bindings
|
||||||
|
.iter()
|
||||||
|
.map(|(name, c)| (name, encode(c)))
|
||||||
|
.collect::<std::collections::BTreeMap<_, _>>();
|
||||||
|
json!({"function":contract.map(encode),"bindings":bindings})
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn normalized(call: &CallExpr) -> Result<CallExpr, String> {
|
||||||
|
call.for_evaluation()
|
||||||
|
}
|
||||||
|
fn call_shape(call: &CallExpr) -> Json {
|
||||||
|
json!({"callee":call.callee,"receiver":call.receiver,"path":call.path,"arguments":call.args.iter().map(|a|match a {Arg::Positional(_)=>None,Arg::Named{name,..}=>Some(name)}).collect::<Vec<_>>()})
|
||||||
|
}
|
||||||
|
fn arg_expr(arg: &Arg) -> &Expr {
|
||||||
|
match arg {
|
||||||
|
Arg::Positional(e) | Arg::Named { value: e, .. } => e,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
// Deliberately match the loaded AST directly, rather than invoking the emitter's
|
||||||
|
// ExpressionRule::from_source or StatementRule::from_source recorder.
|
||||||
|
fn rule(expr: &Expr) -> Json {
|
||||||
|
use crate::value::Value;
|
||||||
|
match expr {
|
||||||
|
Expr::Literal(lit) => {
|
||||||
|
let value = match lit {
|
||||||
|
Literal::None => json!({"tag":"none"}),
|
||||||
|
Literal::Bool(v) => json!({"tag":"bool","value":v}),
|
||||||
|
Literal::Int(v) => json!({"tag":"int","value":v}),
|
||||||
|
Literal::Num(v) => json!({"tag":"num","bits":v.to_bits()}),
|
||||||
|
Literal::Text(v) => json!({"tag":"text","value":v}),
|
||||||
|
};
|
||||||
|
json!({"kind":"literal","value":value})
|
||||||
|
}
|
||||||
|
Expr::Var(name) => json!({"kind":"read","name":name}),
|
||||||
|
Expr::Unary { op, .. } => json!({"kind":"unary","op":format!("{op:?}")}),
|
||||||
|
Expr::Binary { op, .. } => json!({"kind":"binary","op":format!("{op:?}")}),
|
||||||
|
Expr::Call(call) => {
|
||||||
|
if let Err(message) = normalized(call) {
|
||||||
|
return json!({"kind":"call_expansion_fault","message":message});
|
||||||
|
}
|
||||||
|
json!({"kind":"call_boundary","names":call.receiver.iter().cloned().chain(call.path.iter().filter_map(|p|p.first().cloned())).collect::<Vec<_>>()})
|
||||||
|
}
|
||||||
|
Expr::List(items) => json!({"kind":"list","arity":items.len()}),
|
||||||
|
Expr::Map(items) => {
|
||||||
|
json!({"kind":"map","keys":items.iter().map(|(name,_)|name).collect::<Vec<_>>()})
|
||||||
|
}
|
||||||
|
Expr::Interp(parts) => {
|
||||||
|
json!({"kind":"interpolation_boundary","parts":parts.iter().map(super::expression::interpolation_evidence).collect::<Vec<_>>()})
|
||||||
|
}
|
||||||
|
Expr::Index { base, label } => {
|
||||||
|
json!({"kind":"index_boundary","label":super::expression::index_evidence(label),"base_variable":if let Expr::Var(name)=base.as_ref(){Some(name)}else{None}})
|
||||||
|
}
|
||||||
|
Expr::Occluded { payload, .. } => json!({"kind":"occluded","payload":payload.is_some()}),
|
||||||
|
Expr::Formula(value) => {
|
||||||
|
json!({"kind":"literal","value":super::expression::value_evidence(&Value::Formula(value.clone()))})
|
||||||
|
}
|
||||||
|
Expr::Code(value) => {
|
||||||
|
json!({"kind":"literal","value":{"tag":"code","lang":value.lang,"source":value.source}})
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn children(expr: &Expr) -> Vec<&Expr> {
|
||||||
|
match expr {
|
||||||
|
Expr::Unary { expr, .. } => vec![expr],
|
||||||
|
Expr::Binary { left, right, .. } => vec![left, right],
|
||||||
|
Expr::List(items) => items.iter().collect(),
|
||||||
|
Expr::Map(items) => items.iter().map(|(_, e)| e).collect(),
|
||||||
|
Expr::Index { base, .. } => vec![base],
|
||||||
|
Expr::Occluded { payload, .. } => payload.iter().map(|e| e.as_ref()).collect(),
|
||||||
|
_ => Vec::new(),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn expression_tree(expr: &Expr) -> Result<Json, String> {
|
||||||
|
if matches!(expr,Expr::Call(call) if normalized(call).is_err()) {
|
||||||
|
return Ok(json!({"rule":rule(expr),"children":[],"call":null}));
|
||||||
|
}
|
||||||
|
let (children, call) = if let Expr::Call(call) = expr {
|
||||||
|
let expanded = normalized(call)?;
|
||||||
|
(
|
||||||
|
expanded
|
||||||
|
.args
|
||||||
|
.iter()
|
||||||
|
.map(|a| expression_tree(arg_expr(a)))
|
||||||
|
.collect::<Result<Vec<_>, _>>()?,
|
||||||
|
Some(call_shape(&expanded)),
|
||||||
|
)
|
||||||
|
} else {
|
||||||
|
(
|
||||||
|
children(expr)
|
||||||
|
.iter()
|
||||||
|
.map(|e| expression_tree(e))
|
||||||
|
.collect::<Result<Vec<_>, _>>()?,
|
||||||
|
None,
|
||||||
|
)
|
||||||
|
};
|
||||||
|
Ok(json!({"rule":rule(expr),"children":children,"call":call}))
|
||||||
|
}
|
||||||
|
fn statement_rule(stmt: &Stmt) -> Json {
|
||||||
|
match stmt {
|
||||||
|
Stmt::Assign { name, .. } => json!({"kind":"assign","name":name}),
|
||||||
|
Stmt::Return { .. } => json!({"kind":"return"}),
|
||||||
|
Stmt::Call { .. } => json!({"kind":"call"}),
|
||||||
|
Stmt::Expr { .. } => json!({"kind":"expression"}),
|
||||||
|
Stmt::Branch { arms, .. } => {
|
||||||
|
json!({"kind":"branch","arms":arms.iter().map(|a|(a.condition.is_some(),a.body.len())).collect::<Vec<_>>()})
|
||||||
|
}
|
||||||
|
Stmt::While { body, .. } => json!({"kind":"while","body":body.len()}),
|
||||||
|
Stmt::ForEach {
|
||||||
|
item,
|
||||||
|
collection,
|
||||||
|
body,
|
||||||
|
..
|
||||||
|
} => json!({"kind":"foreach","item":item,"collection":collection,"body":body.len()}),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn statement_children(stmt: &Stmt) -> Vec<&Stmt> {
|
||||||
|
match stmt {
|
||||||
|
Stmt::Branch { arms, .. } => arms.iter().flat_map(|a| a.body.iter()).collect(),
|
||||||
|
Stmt::While { body, .. } | Stmt::ForEach { body, .. } => body.iter().collect(),
|
||||||
|
_ => Vec::new(),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn statement_expressions(stmt: &Stmt) -> Vec<Expr> {
|
||||||
|
match stmt {
|
||||||
|
Stmt::Assign { value, .. } | Stmt::Return { value, .. } | Stmt::Expr { value, .. } => {
|
||||||
|
vec![value.clone()]
|
||||||
|
}
|
||||||
|
Stmt::Call { call, .. } => vec![Expr::Call(call.clone())],
|
||||||
|
Stmt::Branch { arms, .. } => arms.iter().filter_map(|a| a.condition.clone()).collect(),
|
||||||
|
Stmt::While { condition, .. } => vec![condition.clone()],
|
||||||
|
Stmt::ForEach { collection, .. } => vec![Expr::Var(collection.clone())],
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn statement_tree(stmt: &Stmt) -> Result<Json, String> {
|
||||||
|
Ok(
|
||||||
|
json!({"rule":statement_rule(stmt),"expressions":statement_expressions(stmt).iter().map(expression_tree).collect::<Result<Vec<_>,_>>()?,"statements":statement_children(stmt).iter().map(|s|statement_tree(s)).collect::<Result<Vec<_>,_>>()?}),
|
||||||
|
)
|
||||||
|
}
|
||||||
|
|
||||||
|
struct Walk<'a> {
|
||||||
|
fun: &'a FnChunk,
|
||||||
|
expressions: Vec<bool>,
|
||||||
|
statements: Vec<bool>,
|
||||||
|
}
|
||||||
|
impl Walk<'_> {
|
||||||
|
fn expression(&mut self, source: &Expr, id: usize) -> Result<(), String> {
|
||||||
|
let node = self
|
||||||
|
.fun
|
||||||
|
.expressions
|
||||||
|
.get(id)
|
||||||
|
.ok_or("AST expression reference")?;
|
||||||
|
if self.expressions[id] {
|
||||||
|
return Err("AST expression has multiple owners".into());
|
||||||
|
}
|
||||||
|
self.expressions[id] = true;
|
||||||
|
if node.rule.evidence() != rule(source) {
|
||||||
|
return Err("loaded AST expression rule differs from witness".into());
|
||||||
|
}
|
||||||
|
if let Expr::Call(call) = source {
|
||||||
|
let call = match normalized(call) {
|
||||||
|
Ok(call) => call,
|
||||||
|
Err(_) => {
|
||||||
|
if !node.children.is_empty()
|
||||||
|
|| self.fun.calls.iter().any(|c| c.expression == id)
|
||||||
|
{
|
||||||
|
return Err("AST preparation fault evaluated actuals".into());
|
||||||
|
}
|
||||||
|
return Ok(());
|
||||||
|
}
|
||||||
|
};
|
||||||
|
let record = self
|
||||||
|
.fun
|
||||||
|
.calls
|
||||||
|
.iter()
|
||||||
|
.find(|c| c.expression == id)
|
||||||
|
.ok_or("AST call obligation missing")?;
|
||||||
|
if call_shape(&call) != call_shape(&record.source)
|
||||||
|
|| node.children.len() < call.args.len()
|
||||||
|
{
|
||||||
|
return Err("loaded AST call differs from witness".into());
|
||||||
|
}
|
||||||
|
for (arg, child) in call.args.iter().zip(&node.children) {
|
||||||
|
self.expression(arg_expr(arg), *child)?;
|
||||||
|
}
|
||||||
|
for &generated in &node.children[call.args.len()..] {
|
||||||
|
let expr = self
|
||||||
|
.fun
|
||||||
|
.expressions
|
||||||
|
.get(generated)
|
||||||
|
.ok_or("generated reload reference")?;
|
||||||
|
if self.expressions[generated]
|
||||||
|
|| !expr.children.is_empty()
|
||||||
|
|| !matches!(expr.rule, ExpressionRule::Read(_))
|
||||||
|
{
|
||||||
|
return Err("generated reload is shared or not a read".into());
|
||||||
|
}
|
||||||
|
self.expressions[generated] = true;
|
||||||
|
}
|
||||||
|
} else {
|
||||||
|
let expected = children(source);
|
||||||
|
if expected.len() != node.children.len() {
|
||||||
|
return Err("loaded AST expression child inventory differs".into());
|
||||||
|
}
|
||||||
|
for (source, child) in expected.iter().zip(&node.children) {
|
||||||
|
self.expression(source, *child)?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
fn statement(&mut self, source: &Stmt, id: usize) -> Result<(), String> {
|
||||||
|
let node = self
|
||||||
|
.fun
|
||||||
|
.statements
|
||||||
|
.get(id)
|
||||||
|
.ok_or("AST statement reference")?;
|
||||||
|
if self.statements[id] {
|
||||||
|
return Err("AST statement has multiple owners".into());
|
||||||
|
}
|
||||||
|
self.statements[id] = true;
|
||||||
|
if node.rule.evidence() != statement_rule(source) {
|
||||||
|
return Err("loaded AST statement rule differs from witness".into());
|
||||||
|
}
|
||||||
|
let exprs = statement_expressions(source);
|
||||||
|
let stmts = statement_children(source);
|
||||||
|
if node.expressions.len() != exprs.len() || node.statements.len() != stmts.len() {
|
||||||
|
return Err("loaded AST statement child inventory differs".into());
|
||||||
|
}
|
||||||
|
for (expr, id) in exprs.iter().zip(&node.expressions) {
|
||||||
|
self.expression(expr, *id)?;
|
||||||
|
}
|
||||||
|
for (stmt, id) in stmts.iter().zip(&node.statements) {
|
||||||
|
self.statement(stmt, *id)?;
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
}
|
||||||
|
pub fn verify(fun: &FnChunk) -> Result<(), String> {
|
||||||
|
let source = &fun.source_ast;
|
||||||
|
if source.contract != fun.contract || source.var_contracts != fun.var_contracts {
|
||||||
|
return Err("loaded AST contract metadata differs".into());
|
||||||
|
}
|
||||||
|
if source.name != fun.name
|
||||||
|
|| source.line != fun.declaration_span.line
|
||||||
|
|| source.params.iter().map(|p| &p.name).ne(fun.params.iter())
|
||||||
|
|| source.receiver_aliases != fun.receiver_aliases
|
||||||
|
|| source.has_contract != fun.contract.is_some()
|
||||||
|
|| source.binding_contracts.len() != fun.var_contracts.len()
|
||||||
|
|| source
|
||||||
|
.binding_contracts
|
||||||
|
.iter()
|
||||||
|
.any(|name| !fun.var_contracts.contains_key(name))
|
||||||
|
{
|
||||||
|
return Err("loaded AST function metadata differs".into());
|
||||||
|
}
|
||||||
|
let mut walk = Walk {
|
||||||
|
fun,
|
||||||
|
expressions: vec![false; fun.expressions.len()],
|
||||||
|
statements: vec![false; fun.statements.len()],
|
||||||
|
};
|
||||||
|
if source.params.len() != fun.default_expressions.len()
|
||||||
|
|| source.body.len() != fun.statement_roots.len()
|
||||||
|
{
|
||||||
|
return Err("loaded AST function root inventory differs".into());
|
||||||
|
}
|
||||||
|
for (param, id) in source.params.iter().zip(&fun.default_expressions) {
|
||||||
|
match (¶m.default, id) {
|
||||||
|
(Some(expr), Some(id)) => walk.expression(expr, *id)?,
|
||||||
|
(None, None) => {}
|
||||||
|
_ => return Err("loaded AST default presence differs".into()),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
for (stmt, id) in source.body.iter().zip(&fun.statement_roots) {
|
||||||
|
walk.statement(stmt, *id)?;
|
||||||
|
}
|
||||||
|
if walk.expressions.iter().any(|seen| !seen) || walk.statements.iter().any(|seen| !seen) {
|
||||||
|
return Err("emission witness has no loaded AST owner".into());
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
@@ -0,0 +1,365 @@
|
|||||||
|
//! Source-directed statement and control-flow templates. These checks validate
|
||||||
|
//! emitted templates; they do not prove the parser or source-witness exporter.
|
||||||
|
use super::expression::Cursor;
|
||||||
|
use super::{FnChunk, Op};
|
||||||
|
use crate::ast::Stmt;
|
||||||
|
|
||||||
|
#[derive(Debug, Clone)]
|
||||||
|
pub enum StatementRule {
|
||||||
|
Assign(String),
|
||||||
|
Return,
|
||||||
|
Call,
|
||||||
|
Expression,
|
||||||
|
Branch(Vec<(bool, usize)>),
|
||||||
|
While(usize),
|
||||||
|
ForEach {
|
||||||
|
item: String,
|
||||||
|
collection: String,
|
||||||
|
body: usize,
|
||||||
|
},
|
||||||
|
}
|
||||||
|
impl StatementRule {
|
||||||
|
pub fn from_source(stmt: &Stmt) -> Self {
|
||||||
|
match stmt {
|
||||||
|
Stmt::Assign { name, .. } => Self::Assign(name.clone()),
|
||||||
|
Stmt::Return { .. } => Self::Return,
|
||||||
|
Stmt::Call { .. } => Self::Call,
|
||||||
|
Stmt::Expr { .. } => Self::Expression,
|
||||||
|
Stmt::Branch { arms, .. } => Self::Branch(
|
||||||
|
arms.iter()
|
||||||
|
.map(|a| (a.condition.is_some(), a.body.len()))
|
||||||
|
.collect(),
|
||||||
|
),
|
||||||
|
Stmt::While { body, .. } => Self::While(body.len()),
|
||||||
|
Stmt::ForEach {
|
||||||
|
item,
|
||||||
|
collection,
|
||||||
|
body,
|
||||||
|
..
|
||||||
|
} => Self::ForEach {
|
||||||
|
item: item.clone(),
|
||||||
|
collection: collection.clone(),
|
||||||
|
body: body.len(),
|
||||||
|
},
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
#[derive(Debug, Clone)]
|
||||||
|
pub struct StatementEmission {
|
||||||
|
pub rule: StatementRule,
|
||||||
|
pub start: usize,
|
||||||
|
pub end: usize,
|
||||||
|
pub statements: Vec<usize>,
|
||||||
|
pub expressions: Vec<usize>,
|
||||||
|
pub auxiliary: Vec<usize>,
|
||||||
|
}
|
||||||
|
fn statement(c: &mut Cursor<'_>, id: usize) -> Result<(), String> {
|
||||||
|
let child = c.fun.statements.get(id).ok_or("missing statement child")?;
|
||||||
|
if child.start != c.position {
|
||||||
|
return Err("source statement order/range differs".into());
|
||||||
|
}
|
||||||
|
c.position = child.end;
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
pub fn verify(fun: &FnChunk) -> Result<(), String> {
|
||||||
|
if fun.defaults.len() != fun.params.len() || fun.default_expressions.len() != fun.params.len() {
|
||||||
|
return Err("default expression inventory".into());
|
||||||
|
}
|
||||||
|
let mut prefix = 0;
|
||||||
|
for (parameter, default) in fun.default_expressions.iter().enumerate() {
|
||||||
|
if fun.defaults[parameter] != default.is_some() {
|
||||||
|
return Err("default source presence differs".into());
|
||||||
|
}
|
||||||
|
if let Some(id) = default {
|
||||||
|
let expr = fun
|
||||||
|
.expressions
|
||||||
|
.get(*id)
|
||||||
|
.ok_or("default source expression missing")?;
|
||||||
|
if expr.start != prefix + 1
|
||||||
|
|| fun.code.get(prefix) != Some(&Op::JumpIfProvided(parameter, expr.end + 2))
|
||||||
|
|| fun.code.get(expr.end..expr.end + 2)
|
||||||
|
!= Some([Op::SetLocal(parameter), Op::Pop].as_slice())
|
||||||
|
{
|
||||||
|
return Err("source default prologue differs".into());
|
||||||
|
}
|
||||||
|
prefix = expr.end + 2;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
if fun.code.get(prefix) != Some(&Op::FillMissingParameters) {
|
||||||
|
return Err("missing parameter-fill boundary".into());
|
||||||
|
}
|
||||||
|
prefix += 1;
|
||||||
|
if fun.contract.is_some() {
|
||||||
|
if fun.code.get(prefix) != Some(&Op::CheckArguments) {
|
||||||
|
return Err("missing input contract boundary".into());
|
||||||
|
}
|
||||||
|
prefix += 1;
|
||||||
|
}
|
||||||
|
if fun.receiver_aliases {
|
||||||
|
if fun.code.get(prefix)!=Some(&Op::RestoreReceiver){return Err("missing receiver restoration".into());}prefix+=1;
|
||||||
|
if fun.contract.is_some(){if fun.code.get(prefix)!=Some(&Op::CheckFrameArguments){return Err("missing frame contract boundary".into());}prefix+=1;}
|
||||||
|
}
|
||||||
|
if prefix != fun.body_start {
|
||||||
|
return Err("function prologue/body boundary differs".into());
|
||||||
|
}
|
||||||
|
let mut protected = fun
|
||||||
|
.params
|
||||||
|
.iter()
|
||||||
|
.cloned()
|
||||||
|
.collect::<std::collections::HashSet<_>>();
|
||||||
|
protected.extend(["self".to_string(), "自".to_string()]);
|
||||||
|
for expression in &fun.expressions {
|
||||||
|
use super::ExpressionRule;
|
||||||
|
match &expression.rule {
|
||||||
|
ExpressionRule::Read(name) => {
|
||||||
|
protected.insert(name.clone());
|
||||||
|
}
|
||||||
|
ExpressionRule::CallBoundary(names) => protected.extend(names.iter().cloned()),
|
||||||
|
ExpressionRule::Interpolation(parts) => {
|
||||||
|
for part in parts {
|
||||||
|
match part {
|
||||||
|
crate::ast::InterpPart::Var(name)
|
||||||
|
| crate::ast::InterpPart::Index { base: name, .. } => {
|
||||||
|
protected.insert(name.clone());
|
||||||
|
}
|
||||||
|
_ => {}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
ExpressionRule::Index {
|
||||||
|
label,
|
||||||
|
base_variable,
|
||||||
|
} => {
|
||||||
|
if let Some(name) = base_variable {
|
||||||
|
protected.insert(name.clone());
|
||||||
|
}
|
||||||
|
if let crate::ast::IndexKey::Var(name) = label {
|
||||||
|
protected.insert(name.clone());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
_ => {}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
for statement in &fun.statements {
|
||||||
|
match &statement.rule {
|
||||||
|
StatementRule::Assign(name) => {
|
||||||
|
protected.insert(name.clone());
|
||||||
|
}
|
||||||
|
StatementRule::ForEach {
|
||||||
|
item, collection, ..
|
||||||
|
} => {
|
||||||
|
protected.insert(item.clone());
|
||||||
|
protected.insert(collection.clone());
|
||||||
|
}
|
||||||
|
_ => {}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let mut auxiliary_slots = std::collections::HashSet::new();
|
||||||
|
let mut parent_counts = vec![0usize; fun.statements.len()];
|
||||||
|
for (id, node) in fun.statements.iter().enumerate() {
|
||||||
|
if node.start > node.end || node.end > fun.code.len() {
|
||||||
|
return Err("invalid statement interval".into());
|
||||||
|
}
|
||||||
|
for &child in &node.statements {
|
||||||
|
if child <= id || child >= fun.statements.len() {
|
||||||
|
return Err("invalid statement child".into());
|
||||||
|
}
|
||||||
|
parent_counts[child] += 1;
|
||||||
|
let child = &fun.statements[child];
|
||||||
|
if child.start < node.start || child.end > node.end {
|
||||||
|
return Err("statement child outside parent".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
for &expr in &node.expressions {
|
||||||
|
let expr = fun
|
||||||
|
.expressions
|
||||||
|
.get(expr)
|
||||||
|
.ok_or("invalid statement expression")?;
|
||||||
|
if expr.start < node.start || expr.end > node.end {
|
||||||
|
return Err("expression outside statement".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let mut c = Cursor {
|
||||||
|
fun,
|
||||||
|
position: node.start,
|
||||||
|
end: node.end,
|
||||||
|
};
|
||||||
|
match &node.rule {
|
||||||
|
StatementRule::Assign(_)
|
||||||
|
| StatementRule::Return
|
||||||
|
| StatementRule::Call
|
||||||
|
| StatementRule::Expression => {
|
||||||
|
if !node.statements.is_empty() || node.expressions.len() != 1 {
|
||||||
|
return Err("statement source arity".into());
|
||||||
|
}
|
||||||
|
c.child(node.expressions[0])?;
|
||||||
|
match &node.rule {
|
||||||
|
StatementRule::Assign(name) => {
|
||||||
|
let slot = fun
|
||||||
|
.locals
|
||||||
|
.iter()
|
||||||
|
.position(|n| n == name)
|
||||||
|
.ok_or("assignment slot")?;
|
||||||
|
if fun.var_contracts.contains_key(name) {
|
||||||
|
c.op(Op::CheckBinding(slot))?;
|
||||||
|
}
|
||||||
|
c.op(Op::SetLocal(slot))?;
|
||||||
|
c.op(Op::Pop)?;
|
||||||
|
}
|
||||||
|
StatementRule::Return => {
|
||||||
|
if fun.contract.is_some() {
|
||||||
|
c.op(Op::CheckReturn)?;
|
||||||
|
}
|
||||||
|
c.op(Op::Return)?;
|
||||||
|
}
|
||||||
|
StatementRule::Call | StatementRule::Expression => c.op(Op::Pop)?,
|
||||||
|
_ => unreachable!(),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
StatementRule::While(count) => {
|
||||||
|
if node.expressions.len() != 1 || node.statements.len() != *count {
|
||||||
|
return Err("while source arity".into());
|
||||||
|
}
|
||||||
|
c.op(Op::ResetLoop(id))?;
|
||||||
|
let head = c.position;
|
||||||
|
c.child(node.expressions[0])?;
|
||||||
|
c.op(Op::JumpIfFalse(node.end))?;
|
||||||
|
c.op(Op::CheckLoop(id))?;
|
||||||
|
for &child in &node.statements {
|
||||||
|
statement(&mut c, child)?;
|
||||||
|
}
|
||||||
|
c.op(Op::Jump(head))?;
|
||||||
|
}
|
||||||
|
StatementRule::Branch(arms) => {
|
||||||
|
if node.expressions.len() != arms.iter().filter(|(condition, _)| *condition).count()
|
||||||
|
|| node.statements.len() != arms.iter().map(|(_, n)| n).sum::<usize>()
|
||||||
|
{
|
||||||
|
return Err("branch source arity".into());
|
||||||
|
}
|
||||||
|
let (mut expr, mut stmt) = (0, 0);
|
||||||
|
for (index, (condition, count)) in arms.iter().enumerate() {
|
||||||
|
let guard = if *condition {
|
||||||
|
c.child(node.expressions[expr])?;
|
||||||
|
expr += 1;
|
||||||
|
let pc = c.position;
|
||||||
|
c.position += 1;
|
||||||
|
Some(pc)
|
||||||
|
} else {
|
||||||
|
None
|
||||||
|
};
|
||||||
|
for _ in 0..*count {
|
||||||
|
statement(&mut c, node.statements[stmt])?;
|
||||||
|
stmt += 1;
|
||||||
|
}
|
||||||
|
if index + 1 < arms.len() {
|
||||||
|
c.op(Op::Jump(node.end))?;
|
||||||
|
}
|
||||||
|
if let Some(guard) = guard {
|
||||||
|
if fun.code.get(guard) != Some(&Op::JumpIfFalse(c.position)) {
|
||||||
|
return Err("source branch false target differs".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
StatementRule::ForEach {
|
||||||
|
item,
|
||||||
|
collection,
|
||||||
|
body,
|
||||||
|
} => {
|
||||||
|
if node.expressions.len() != 1
|
||||||
|
|| node.statements.len() != *body
|
||||||
|
|| node.auxiliary.len() != 2
|
||||||
|
{
|
||||||
|
return Err("foreach source arity".into());
|
||||||
|
}
|
||||||
|
let (coll, index) = (node.auxiliary[0], node.auxiliary[1]);
|
||||||
|
if coll == index || coll >= fun.locals.len() || index >= fun.locals.len() {
|
||||||
|
return Err("foreach auxiliary slots".into());
|
||||||
|
}
|
||||||
|
for slot in [coll, index] {
|
||||||
|
if protected.contains(&fun.locals[slot]) || !auxiliary_slots.insert(slot) {
|
||||||
|
return Err("loop temporary aliases source or another loop".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
// The initial expression must read the authored collection.
|
||||||
|
if !matches!(&fun.expressions[node.expressions[0]].rule,super::ExpressionRule::Read(name) if name==collection)
|
||||||
|
{
|
||||||
|
return Err("foreach source collection differs".into());
|
||||||
|
}
|
||||||
|
c.child(node.expressions[0])?;
|
||||||
|
c.op(Op::IterItems)?;
|
||||||
|
c.op(Op::SetLocal(coll))?;
|
||||||
|
c.op(Op::Pop)?;
|
||||||
|
c.literal(&crate::value::Value::Int(0))?;
|
||||||
|
c.op(Op::SetLocal(index))?;
|
||||||
|
c.op(Op::Pop)?;
|
||||||
|
let head = c.position;
|
||||||
|
for op in [
|
||||||
|
Op::GetLocal(index),
|
||||||
|
Op::GetLocal(coll),
|
||||||
|
Op::Len,
|
||||||
|
Op::Less,
|
||||||
|
Op::JumpIfFalse(node.end),
|
||||||
|
Op::GetLocal(coll),
|
||||||
|
Op::GetLocal(index),
|
||||||
|
Op::GetIndex,
|
||||||
|
] {
|
||||||
|
c.op(op)?;
|
||||||
|
}
|
||||||
|
let item = fun
|
||||||
|
.locals
|
||||||
|
.iter()
|
||||||
|
.position(|n| n == item)
|
||||||
|
.ok_or("foreach item slot")?;
|
||||||
|
c.op(Op::SetLocal(item))?;
|
||||||
|
c.op(Op::Pop)?;
|
||||||
|
for &child in &node.statements {
|
||||||
|
statement(&mut c, child)?;
|
||||||
|
}
|
||||||
|
c.op(Op::GetLocal(index))?;
|
||||||
|
c.literal(&crate::value::Value::Int(1))?;
|
||||||
|
for op in [Op::Add, Op::SetLocal(index), Op::Pop, Op::Jump(head)] {
|
||||||
|
c.op(op)?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
if c.position != node.end {
|
||||||
|
return Err("statement instruction coverage differs".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let mut cursor = fun.body_start;
|
||||||
|
for &root in &fun.statement_roots {
|
||||||
|
let node = fun.statements.get(root).ok_or("statement root missing")?;
|
||||||
|
if parent_counts[root] != 0 || node.start != cursor {
|
||||||
|
return Err("source body root order differs".into());
|
||||||
|
}
|
||||||
|
parent_counts[root] += 1;
|
||||||
|
cursor = node.end;
|
||||||
|
}
|
||||||
|
if parent_counts.iter().any(|n| *n != 1) {
|
||||||
|
return Err("statement forest coverage differs".into());
|
||||||
|
}
|
||||||
|
if fun.code.get(cursor..) != Some([Op::None_, Op::Return].as_slice()) {
|
||||||
|
return Err("implicit function return differs".into());
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
|
||||||
|
impl StatementRule {
|
||||||
|
pub fn evidence(&self) -> serde_json::Value {
|
||||||
|
use serde_json::json;
|
||||||
|
match self {
|
||||||
|
Self::Assign(name) => json!({"kind":"assign","name":name}),
|
||||||
|
Self::Return => json!({"kind":"return"}),
|
||||||
|
Self::Call => json!({"kind":"call"}),
|
||||||
|
Self::Expression => json!({"kind":"expression"}),
|
||||||
|
Self::Branch(arms) => json!({"kind":"branch","arms":arms}),
|
||||||
|
Self::While(body) => json!({"kind":"while","body":body}),
|
||||||
|
Self::ForEach {
|
||||||
|
item,
|
||||||
|
collection,
|
||||||
|
body,
|
||||||
|
} => json!({"kind":"foreach","item":item,"collection":collection,"body":body}),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,331 @@
|
|||||||
|
//! Checks every emitted instruction and a control-flow stack-height certificate.
|
||||||
|
//! This is structural validation, not source/bytecode semantic equivalence.
|
||||||
|
use super::{FnChunk, Op, Program};
|
||||||
|
use crate::value::Value;
|
||||||
|
use std::collections::{HashSet, VecDeque};
|
||||||
|
|
||||||
|
#[derive(Debug, Clone)]
|
||||||
|
pub struct StackCertificate {
|
||||||
|
pub heights: Vec<Option<usize>>,
|
||||||
|
}
|
||||||
|
|
||||||
|
impl Program {
|
||||||
|
pub fn verify(&self) -> Result<Vec<StackCertificate>, String> {
|
||||||
|
let n = self.functions.len();
|
||||||
|
if self.entry >= n || self.parents.len() != n || self.children.len() != n {
|
||||||
|
return Err("invalid program function tables".into());
|
||||||
|
}
|
||||||
|
for (i, parent) in self.parents.iter().enumerate() {
|
||||||
|
if parent.is_some_and(|p| p >= n || p == i) {
|
||||||
|
return Err("invalid function parent".into());
|
||||||
|
}
|
||||||
|
for &child in &self.children[i] {
|
||||||
|
if child >= n || self.parents[child] != Some(i) {
|
||||||
|
return Err("inconsistent function child".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
check_forest(&self.parents)?;
|
||||||
|
for (child, parent) in self.parents.iter().enumerate() {
|
||||||
|
if let Some(parent) = parent {
|
||||||
|
if !self.children[*parent].contains(&child)
|
||||||
|
|| self.functions[*parent].module_path != self.functions[child].module_path
|
||||||
|
{
|
||||||
|
return Err("inconsistent parent owner".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
super::names::verify(self)?;
|
||||||
|
if self.objects.len() != self.object_bases.len() {
|
||||||
|
return Err("invalid object tables".into());
|
||||||
|
}
|
||||||
|
for (i, (_, fid)) in self.objects.iter().enumerate() {
|
||||||
|
if *fid >= n
|
||||||
|
|| self.object_bases[i]
|
||||||
|
.is_some_and(|base| base >= n || !self.objects.iter().any(|(_, f)| *f == base))
|
||||||
|
{
|
||||||
|
return Err("invalid object reference".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
if self.methods.iter().any(|(owner, _, fid)| {
|
||||||
|
*owner >= n || *fid >= n || !self.objects.iter().any(|(_, f)| f == owner)
|
||||||
|
}) || self.path_index.values().any(|id| *id >= n)
|
||||||
|
{
|
||||||
|
return Err("invalid method/export reference".into());
|
||||||
|
}
|
||||||
|
let object_ids = self
|
||||||
|
.objects
|
||||||
|
.iter()
|
||||||
|
.enumerate()
|
||||||
|
.map(|(i, (_, fid))| (*fid, i))
|
||||||
|
.collect::<std::collections::HashMap<_, _>>();
|
||||||
|
if object_ids.len() != self.objects.len() {
|
||||||
|
return Err("duplicate object reference".into());
|
||||||
|
}
|
||||||
|
let bases = self
|
||||||
|
.object_bases
|
||||||
|
.iter()
|
||||||
|
.map(|base| base.map(|fid| object_ids[&fid]))
|
||||||
|
.collect::<Vec<_>>();
|
||||||
|
check_forest(&bases)?;
|
||||||
|
if self
|
||||||
|
.methods
|
||||||
|
.iter()
|
||||||
|
.any(|(owner, _, fid)| self.parents[*fid] != Some(*owner))
|
||||||
|
{
|
||||||
|
return Err("inconsistent method owner".into());
|
||||||
|
}
|
||||||
|
self.functions
|
||||||
|
.iter()
|
||||||
|
.enumerate()
|
||||||
|
.map(|(i, f)| {
|
||||||
|
verify_chunk(self, i, f)
|
||||||
|
.map_err(|e| format!("bytecode verification in {}: {e}", f.name))
|
||||||
|
})
|
||||||
|
.collect()
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
fn verify_chunk(program: &Program, _fid: usize, fun: &FnChunk) -> Result<StackCertificate, String> {
|
||||||
|
super::expression::verify(fun)?;
|
||||||
|
super::statement::verify(fun)?;
|
||||||
|
super::call::verify(program,fun)?;
|
||||||
|
super::source::verify(fun)?;
|
||||||
|
let size = fun.code.len();
|
||||||
|
if size == 0 || fun.spans.len() != size {
|
||||||
|
return Err("invalid code/span table".into());
|
||||||
|
}
|
||||||
|
if fun.defaults.len() != fun.params.len()
|
||||||
|
|| fun.locals.get(..fun.params.len()) != Some(fun.params.as_slice())
|
||||||
|
{
|
||||||
|
return Err("parameters must be a local-slot prefix".into());
|
||||||
|
}
|
||||||
|
if fun.locals.iter().collect::<HashSet<_>>().len() != fun.locals.len() {
|
||||||
|
return Err("duplicate local slot name".into());
|
||||||
|
}
|
||||||
|
let local = |i: usize| {
|
||||||
|
if i < fun.locals.len() {
|
||||||
|
Ok(())
|
||||||
|
} else {
|
||||||
|
Err("invalid local reference".to_string())
|
||||||
|
}
|
||||||
|
};
|
||||||
|
let target = |i: usize| {
|
||||||
|
if i < size {
|
||||||
|
Ok(())
|
||||||
|
} else {
|
||||||
|
Err("invalid jump target".to_string())
|
||||||
|
}
|
||||||
|
};
|
||||||
|
let function = |i: usize| {
|
||||||
|
if i < program.functions.len() {
|
||||||
|
Ok(())
|
||||||
|
} else {
|
||||||
|
Err("invalid call target".to_string())
|
||||||
|
}
|
||||||
|
};
|
||||||
|
let text = |i: usize| {
|
||||||
|
if matches!(fun.constants.get(i), Some(Value::Text(_))) {
|
||||||
|
Ok(())
|
||||||
|
} else {
|
||||||
|
Err("invalid text constant reference".to_string())
|
||||||
|
}
|
||||||
|
};
|
||||||
|
let mut shapes = Vec::with_capacity(size);
|
||||||
|
for (ip, op) in fun.code.iter().copied().enumerate() {
|
||||||
|
// pop count, push count, successor PCs. All opcodes are handled.
|
||||||
|
let next = vec![ip + 1];
|
||||||
|
let shape = match op {
|
||||||
|
Op::Constant(i) => {
|
||||||
|
if i >= fun.constants.len() {
|
||||||
|
return Err("invalid constant reference".into());
|
||||||
|
}
|
||||||
|
(0, 1, next)
|
||||||
|
}
|
||||||
|
Op::True | Op::False | Op::None_ => (0, 1, next),
|
||||||
|
Op::GetLocal(i) => {
|
||||||
|
local(i)?;
|
||||||
|
(0, 1, next)
|
||||||
|
}
|
||||||
|
Op::SetLocal(i) | Op::CheckBinding(i) => {
|
||||||
|
local(i)?;
|
||||||
|
(1, 1, next)
|
||||||
|
}
|
||||||
|
Op::Pop | Op::Print => (1, 0, next),
|
||||||
|
Op::Add
|
||||||
|
| Op::Sub
|
||||||
|
| Op::Mul
|
||||||
|
| Op::Div
|
||||||
|
| Op::Equal
|
||||||
|
| Op::NotEqual
|
||||||
|
| Op::Greater
|
||||||
|
| Op::GreaterEqual
|
||||||
|
| Op::Less
|
||||||
|
| Op::Lessequal
|
||||||
|
| Op::Split
|
||||||
|
| Op::Join
|
||||||
|
| Op::GetIndex
|
||||||
|
| Op::FootnoteGet => (2, 1, next),
|
||||||
|
Op::ContractFootnoteGet(i) => {
|
||||||
|
local(i)?;
|
||||||
|
(2, 1, next)
|
||||||
|
}
|
||||||
|
Op::Negate
|
||||||
|
| Op::Not
|
||||||
|
| Op::Input
|
||||||
|
| Op::Len
|
||||||
|
| Op::Str
|
||||||
|
| Op::Int
|
||||||
|
| Op::TypeOf
|
||||||
|
| Op::Trim
|
||||||
|
| Op::IterItems
|
||||||
|
| Op::CallFn => (1, 1, next),
|
||||||
|
Op::BuildList(n) => (n, 1, next),
|
||||||
|
Op::BuildMap(n) => (n.checked_mul(2).ok_or("map arity overflow")?, 1, next),
|
||||||
|
Op::Jump(t) => {
|
||||||
|
target(t)?;
|
||||||
|
(0, 0, vec![t])
|
||||||
|
}
|
||||||
|
Op::JumpIfFalse(t) => {
|
||||||
|
target(t)?;
|
||||||
|
(1, 0, vec![ip + 1, t])
|
||||||
|
}
|
||||||
|
Op::JumpIfProvided(p, t) => {
|
||||||
|
target(t)?;
|
||||||
|
if p >= fun.params.len() {
|
||||||
|
return Err("invalid presence reference".into());
|
||||||
|
}
|
||||||
|
(0, 0, vec![ip + 1, t])
|
||||||
|
}
|
||||||
|
Op::ResetLoop(id)|Op::CheckLoop(id)=>{
|
||||||
|
if !matches!(fun.statements.get(id).map(|s|&s.rule),Some(super::StatementRule::While(_))){return Err("invalid source loop reference".into());}
|
||||||
|
(0,0,next)
|
||||||
|
},
|
||||||
|
Op::FillMissingParameters | Op::CheckArguments | Op::RestoreReceiver | Op::CheckFrameArguments => (0, 0, next),
|
||||||
|
Op::CheckReturn => (1, 1, next),
|
||||||
|
Op::Call(f, n) => {
|
||||||
|
function(f)?;
|
||||||
|
(n, 1, next)
|
||||||
|
}
|
||||||
|
Op::CallArgs(f, l) => {
|
||||||
|
function(f)?;
|
||||||
|
let layout = fun.call_layouts.get(l).ok_or("invalid call layout")?;
|
||||||
|
(layout.len(), 1, next)
|
||||||
|
}
|
||||||
|
Op::BuiltinCallArgs(name,l)|Op::PluginCallArgs(name,l)=>{
|
||||||
|
text(name)?;
|
||||||
|
if matches!(op,Op::BuiltinCallArgs(_,_)) && !matches!(&fun.constants[name],Value::Text(name) if crate::arguments::builtin_signature(name).is_some()){return Err("unknown builtin signature".into());}
|
||||||
|
let layout=fun.call_layouts.get(l).ok_or("invalid call layout")?;(layout.len(),1,next)
|
||||||
|
},
|
||||||
|
Op::HostCallArgs(id,l)=>{
|
||||||
|
if crate::host::HostFn::from_u16(id).is_none(){return Err("unknown host id".into());}
|
||||||
|
let layout=fun.call_layouts.get(l).ok_or("invalid call layout")?;(layout.len(),1,next)
|
||||||
|
},
|
||||||
|
Op::PathCallArgs(id,l)=>{
|
||||||
|
if !matches!(fun.calls.get(id).and_then(|c|c.dispatch.as_ref()),Some(super::CallDispatch::Path{..})){return Err("invalid path call record".into());}
|
||||||
|
let layout=fun.call_layouts.get(l).ok_or("invalid path call layout")?;(layout.len(),1,next)
|
||||||
|
},
|
||||||
|
Op::RejectCallResolution(index)=>{text(index)?;(0,0,vec![])},
|
||||||
|
Op::MethodCall(name, n) => {
|
||||||
|
text(name)?;
|
||||||
|
(n.checked_add(1).ok_or("method arity overflow")?, 1, next)
|
||||||
|
}
|
||||||
|
Op::MethodCallArgs(name, l) => {
|
||||||
|
text(name)?;
|
||||||
|
let layout = fun.call_layouts.get(l).ok_or("invalid method layout")?;
|
||||||
|
(
|
||||||
|
layout.len().checked_add(1).ok_or("method arity overflow")?,
|
||||||
|
1,
|
||||||
|
next,
|
||||||
|
)
|
||||||
|
}
|
||||||
|
Op::PluginCall(name, n) => {
|
||||||
|
text(name)?;
|
||||||
|
if let Value::Text(s) = &fun.constants[name] {
|
||||||
|
if s.starts_with('@') && n % 2 != 0 {
|
||||||
|
return Err("odd named plugin arity".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
(n, 1, next)
|
||||||
|
}
|
||||||
|
Op::HostCall(id, n) => {
|
||||||
|
if crate::host::HostFn::from_u16(id).is_none() {
|
||||||
|
return Err("invalid host reference".into());
|
||||||
|
}
|
||||||
|
(n, 1, next)
|
||||||
|
}
|
||||||
|
Op::TagInstance(f) => {
|
||||||
|
function(f)?;
|
||||||
|
if !program.objects.iter().any(|(_, id)| *id == f) {
|
||||||
|
return Err("invalid constructor reference".into());
|
||||||
|
}
|
||||||
|
(1, 1, next)
|
||||||
|
}
|
||||||
|
Op::RejectDuplicateArgument(name) | Op::RejectArgumentExpansion(name) => {
|
||||||
|
text(name)?;
|
||||||
|
(0, 0, vec![])
|
||||||
|
}
|
||||||
|
Op::Return => (1, 0, vec![]),
|
||||||
|
};
|
||||||
|
shapes.push(shape);
|
||||||
|
}
|
||||||
|
let mut heights = vec![None; size];
|
||||||
|
heights[0] = Some(0);
|
||||||
|
let mut queue = VecDeque::from([0]);
|
||||||
|
while let Some(ip) = queue.pop_front() {
|
||||||
|
let height = heights[ip].unwrap();
|
||||||
|
let (pop, push, edges) = &shapes[ip];
|
||||||
|
if height < *pop {
|
||||||
|
return Err(format!("stack underflow at {ip}"));
|
||||||
|
}
|
||||||
|
if matches!(fun.code[ip], Op::Return) && height != 1 {
|
||||||
|
return Err(format!("return leaks stack values at {ip}"));
|
||||||
|
}
|
||||||
|
let after = (height - pop)
|
||||||
|
.checked_add(*push)
|
||||||
|
.ok_or("stack height overflow")?;
|
||||||
|
for &to in edges {
|
||||||
|
target(to)?;
|
||||||
|
match heights[to] {
|
||||||
|
Some(known) if known != after => {
|
||||||
|
return Err(format!("inconsistent stack join at {to}"))
|
||||||
|
}
|
||||||
|
Some(_) => {}
|
||||||
|
None => {
|
||||||
|
heights[to] = Some(after);
|
||||||
|
queue.push_back(to);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Ok(StackCertificate { heights })
|
||||||
|
}
|
||||||
|
|
||||||
|
fn check_forest(parents: &[Option<usize>]) -> Result<(), String> {
|
||||||
|
let mut colors = vec![0u8; parents.len()];
|
||||||
|
for start in 0..parents.len() {
|
||||||
|
if colors[start] != 0 {
|
||||||
|
continue;
|
||||||
|
}
|
||||||
|
let mut cursor = Some(start);
|
||||||
|
let mut path = Vec::new();
|
||||||
|
while let Some(node) = cursor {
|
||||||
|
if node >= parents.len() {
|
||||||
|
return Err("invalid forest reference".into());
|
||||||
|
}
|
||||||
|
if colors[node] == 1 {
|
||||||
|
return Err("cyclic bytecode declaration graph".into());
|
||||||
|
}
|
||||||
|
if colors[node] == 2 {
|
||||||
|
break;
|
||||||
|
}
|
||||||
|
colors[node] = 1;
|
||||||
|
path.push(node);
|
||||||
|
cursor = parents[node];
|
||||||
|
}
|
||||||
|
for node in path {
|
||||||
|
colors[node] = 2;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
+417
-288
@@ -5,14 +5,13 @@ use std::io::Write;
|
|||||||
use std::path::{Path, PathBuf};
|
use std::path::{Path, PathBuf};
|
||||||
|
|
||||||
use crate::builtin::{
|
use crate::builtin::{
|
||||||
builtin_at, builtin_footnote_get, builtin_int, builtin_iter_items, builtin_join,
|
builtin_at, builtin_footnote_get, builtin_int, builtin_iter_items, builtin_join, builtin_len,
|
||||||
builtin_len, builtin_split, builtin_str, builtin_trim,
|
builtin_split, builtin_str, builtin_trim, builtin_type,
|
||||||
builtin_type,
|
|
||||||
};
|
};
|
||||||
use crate::host::{call_host, HostContext, HostFn};
|
use crate::bytecode::{FnChunk, Op, Program};
|
||||||
use crate::bytecode::{Op, Program};
|
|
||||||
use crate::debug::emit_trace;
|
use crate::debug::emit_trace;
|
||||||
use crate::diagnostics::{bail_at, Span};
|
use crate::diagnostics::{Diagnostic, DiagnosticFrame, SourceIdentity, Span};
|
||||||
|
use crate::host::{call_host, HostContext, HostFn};
|
||||||
use crate::input_feed::InputFeed;
|
use crate::input_feed::InputFeed;
|
||||||
use crate::value::Value;
|
use crate::value::Value;
|
||||||
use std::collections::HashMap;
|
use std::collections::HashMap;
|
||||||
@@ -24,14 +23,32 @@ pub struct Vm {
|
|||||||
input: InputFeed,
|
input: InputFeed,
|
||||||
trace: bool,
|
trace: bool,
|
||||||
host: HostContext,
|
host: HostContext,
|
||||||
|
current_source: SourceIdentity,
|
||||||
|
current_scope: Option<u32>,
|
||||||
|
diagnostic_frames: Vec<DiagnosticFrame>,
|
||||||
}
|
}
|
||||||
|
|
||||||
struct Frame {
|
struct Frame {
|
||||||
fn_idx: usize,
|
fn_idx: usize,
|
||||||
ip: usize,
|
ip: usize,
|
||||||
slots: Vec<Value>,
|
slots: Vec<Option<Value>>,
|
||||||
|
provided: Vec<bool>,
|
||||||
|
loop_counts: HashMap<usize,u32>,
|
||||||
|
receiver: Option<Value>,
|
||||||
|
defaults_active: bool,
|
||||||
/// When set, retag matrix-like return to this `_type` (method chaining).
|
/// When set, retag matrix-like return to this `_type` (method chaining).
|
||||||
retag_matrix: Option<String>,
|
retag_matrix: Option<(String, Option<Vec<String>>)>,
|
||||||
|
has_call_site: bool,
|
||||||
|
retag_instance: Option<usize>,
|
||||||
|
}
|
||||||
|
|
||||||
|
impl Frame {
|
||||||
|
fn read(&self, fun: &FnChunk, index: usize) -> Option<Value> {
|
||||||
|
let name=&fun.locals[index];
|
||||||
|
let overlay=self.defaults_active && self.receiver.is_some() && (name=="self" || name=="自") &&
|
||||||
|
(index>=fun.params.len() || self.provided.get(index).copied().unwrap_or(false) || self.slots[index].is_none());
|
||||||
|
if overlay {self.receiver.clone()} else {self.slots[index].clone()}
|
||||||
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
impl Vm {
|
impl Vm {
|
||||||
@@ -43,6 +60,12 @@ impl Vm {
|
|||||||
input: InputFeed::new(false, Vec::new()),
|
input: InputFeed::new(false, Vec::new()),
|
||||||
trace: false,
|
trace: false,
|
||||||
host: HostContext::for_run(path, Default::default(), Vec::new()),
|
host: HostContext::for_run(path, Default::default(), Vec::new()),
|
||||||
|
current_source: SourceIdentity {
|
||||||
|
path: path.map(Path::to_path_buf),
|
||||||
|
sha256: None,
|
||||||
|
},
|
||||||
|
current_scope: None,
|
||||||
|
diagnostic_frames: Vec::new(),
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -54,6 +77,12 @@ impl Vm {
|
|||||||
input: InputFeed::new(true, Vec::new()),
|
input: InputFeed::new(true, Vec::new()),
|
||||||
trace: false,
|
trace: false,
|
||||||
host: HostContext::for_capture(path, Default::default()),
|
host: HostContext::for_capture(path, Default::default()),
|
||||||
|
current_source: SourceIdentity {
|
||||||
|
path: path.map(Path::to_path_buf),
|
||||||
|
sha256: None,
|
||||||
|
},
|
||||||
|
current_scope: None,
|
||||||
|
diagnostic_frames: Vec::new(),
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -76,6 +105,50 @@ impl Vm {
|
|||||||
std::mem::take(&mut self.host.plots)
|
std::mem::take(&mut self.host.plots)
|
||||||
}
|
}
|
||||||
|
|
||||||
|
#[cfg(all(test, feature = "exec-host"))]
|
||||||
|
pub(crate) fn foreign_source_evidence(
|
||||||
|
&mut self,
|
||||||
|
) -> (
|
||||||
|
Vec<Value>,
|
||||||
|
Vec<Value>,
|
||||||
|
Vec<crate::host::foreign_session::ProtocolStep>,
|
||||||
|
) {
|
||||||
|
crate::source_refinement_tests::boundary_evidence(&mut self.host)
|
||||||
|
}
|
||||||
|
|
||||||
|
#[cfg(test)]
|
||||||
|
pub(crate) fn diagnostic_scope_state(
|
||||||
|
&self,
|
||||||
|
) -> (SourceIdentity, usize, Vec<String>, Vec<u32>, Option<u32>) {
|
||||||
|
(
|
||||||
|
self.current_source.clone(),
|
||||||
|
self.diagnostic_frames.len(),
|
||||||
|
self.host.call_stack.clone(),
|
||||||
|
self.host.call_site_lines.clone(),
|
||||||
|
self.current_scope,
|
||||||
|
)
|
||||||
|
}
|
||||||
|
|
||||||
|
#[cfg(all(test, feature = "exec-host"))]
|
||||||
|
pub(crate) fn causal_replay_evidence(&mut self) -> serde_json::Value {
|
||||||
|
crate::causal_replay_tests::evidence(&mut self.host)
|
||||||
|
}
|
||||||
|
|
||||||
|
#[cfg(all(test, feature = "exec-host"))]
|
||||||
|
pub(crate) fn application_evidence(
|
||||||
|
&self,
|
||||||
|
) -> (
|
||||||
|
Vec<Value>,
|
||||||
|
Vec<crate::host::foreign_session::ProtocolStep>,
|
||||||
|
usize,
|
||||||
|
) {
|
||||||
|
(
|
||||||
|
self.host.oracle_observations.clone(),
|
||||||
|
self.host.foreign_protocol_steps.clone(),
|
||||||
|
self.host.foreign_sessions.len(),
|
||||||
|
)
|
||||||
|
}
|
||||||
|
|
||||||
fn emit_line(&mut self, text: &str) {
|
fn emit_line(&mut self, text: &str) {
|
||||||
if self.capture {
|
if self.capture {
|
||||||
self.captured_stdout.push_str(text);
|
self.captured_stdout.push_str(text);
|
||||||
@@ -98,21 +171,34 @@ impl Vm {
|
|||||||
}
|
}
|
||||||
|
|
||||||
fn err_at(&self, span: Span, message: impl Into<String>) -> anyhow::Error {
|
fn err_at(&self, span: Span, message: impl Into<String>) -> anyhow::Error {
|
||||||
bail_at(self.path.as_deref(), span, message)
|
Diagnostic::new(self.current_source.path.as_deref(), span, message)
|
||||||
|
.with_source(&self.current_source)
|
||||||
|
.with_frames(&self.diagnostic_frames)
|
||||||
|
.into()
|
||||||
|
}
|
||||||
|
|
||||||
|
fn push_source_frame(&mut self, callee: &FnChunk, call_span: Option<Span>) {
|
||||||
|
let mut source = callee.source.clone();
|
||||||
|
if source.path.is_none() {
|
||||||
|
if self.diagnostic_frames.is_empty() {
|
||||||
|
source.path = self.path.clone();
|
||||||
|
} else if self.current_scope == Some(callee.module_scope) {
|
||||||
|
source.path = self.current_source.path.clone();
|
||||||
|
}
|
||||||
|
}
|
||||||
|
self.diagnostic_frames.push(DiagnosticFrame {
|
||||||
|
function: callee.name.clone(),
|
||||||
|
declaration: source.at(callee.declaration_span),
|
||||||
|
call_site: call_span.map(|span| self.current_source.at(span)),
|
||||||
|
});
|
||||||
}
|
}
|
||||||
|
|
||||||
pub fn run(&mut self, program: &Program) -> Result<Value> {
|
pub fn run(&mut self, program: &Program) -> Result<Value> {
|
||||||
let entry = program.entry;
|
// Entry execution, like Interpreter::run_function, seeds unbound locals
|
||||||
let arity = program.functions[entry].params.len();
|
// with None. Inferred prose parameters do not require a program caller.
|
||||||
if arity != 0 {
|
let mut seen=std::collections::HashSet::new();
|
||||||
let span = program.functions[entry]
|
let metadata=program.entry_metadata.iter().filter(|(name,_)|seen.insert(name.clone())).cloned().collect::<Vec<_>>();
|
||||||
.spans
|
self.execute(program, program.entry, &metadata)
|
||||||
.first()
|
|
||||||
.copied()
|
|
||||||
.unwrap_or(Span::new(1, 1));
|
|
||||||
return Err(self.err_at(span, "bytecode: entry function needs arguments"));
|
|
||||||
}
|
|
||||||
self.execute(program, entry, &[])
|
|
||||||
}
|
}
|
||||||
|
|
||||||
/// Run `fn_idx` with named arguments already bound to local slots.
|
/// Run `fn_idx` with named arguments already bound to local slots.
|
||||||
@@ -137,9 +223,35 @@ impl Vm {
|
|||||||
program: &Program,
|
program: &Program,
|
||||||
fn_idx: usize,
|
fn_idx: usize,
|
||||||
args: &[(String, Value)],
|
args: &[(String, Value)],
|
||||||
|
) -> Result<Value> {
|
||||||
|
program.verify().map_err(|error|self.err_at(Span::new(1,1),error))?;
|
||||||
|
let previous_source = self.current_source.clone();
|
||||||
|
let previous_scope = self.current_scope;
|
||||||
|
let previous_depth = self.diagnostic_frames.len();
|
||||||
|
let previous_calls = self.host.call_stack.clone();
|
||||||
|
let previous_sites = self.host.call_site_lines.clone();
|
||||||
|
let previous_line = self.host.current_line;
|
||||||
|
// Scope numbers belong to one compiled program; never carry them into
|
||||||
|
// a new external invocation, even when it preserves an outer prefix.
|
||||||
|
self.current_scope = None;
|
||||||
|
let result = self.execute_inner(program, fn_idx, args);
|
||||||
|
self.diagnostic_frames.truncate(previous_depth);
|
||||||
|
self.current_source = previous_source;
|
||||||
|
self.current_scope = previous_scope;
|
||||||
|
self.host.call_stack = previous_calls;
|
||||||
|
self.host.call_site_lines = previous_sites;
|
||||||
|
self.host.current_line = previous_line;
|
||||||
|
result
|
||||||
|
}
|
||||||
|
|
||||||
|
fn execute_inner(
|
||||||
|
&mut self,
|
||||||
|
program: &Program,
|
||||||
|
fn_idx: usize,
|
||||||
|
args: &[(String, Value)],
|
||||||
) -> Result<Value> {
|
) -> Result<Value> {
|
||||||
let mut stack: Vec<Value> = Vec::new();
|
let mut stack: Vec<Value> = Vec::new();
|
||||||
let mut slots = vec![Value::None; program.functions[fn_idx].locals.len().max(1)];
|
let mut slots = vec![None; program.functions[fn_idx].locals.len().max(1)];
|
||||||
for (name, value) in args {
|
for (name, value) in args {
|
||||||
if let Some(i) = program.functions[fn_idx]
|
if let Some(i) = program.functions[fn_idx]
|
||||||
.locals
|
.locals
|
||||||
@@ -147,45 +259,89 @@ impl Vm {
|
|||||||
.position(|local| local == name)
|
.position(|local| local == name)
|
||||||
{
|
{
|
||||||
if i < slots.len() {
|
if i < slots.len() {
|
||||||
slots[i] = value.clone();
|
slots[i] = Some(value.clone());
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
let mut frames = vec![Frame {
|
let mut frames = vec![Frame {
|
||||||
fn_idx,
|
fn_idx,
|
||||||
|
loop_counts: HashMap::new(),
|
||||||
|
receiver: None, defaults_active: true,
|
||||||
ip: 0,
|
ip: 0,
|
||||||
|
provided: initial_presence(&slots,program.functions[fn_idx].params.len()),
|
||||||
slots,
|
slots,
|
||||||
retag_matrix: None,
|
retag_matrix: None,
|
||||||
|
has_call_site: false,
|
||||||
|
retag_instance: None,
|
||||||
}];
|
}];
|
||||||
|
self.push_source_frame(&program.functions[fn_idx], None);
|
||||||
self.host
|
self.host
|
||||||
.push_call_frame(&program.functions[fn_idx].name.clone());
|
.push_call_frame(&program.functions[fn_idx].name.clone());
|
||||||
|
|
||||||
|
let mut source_owner = None;
|
||||||
loop {
|
loop {
|
||||||
let frame = frames.last_mut().unwrap();
|
let frame = frames.last_mut().unwrap();
|
||||||
let fun = &program.functions[frame.fn_idx];
|
let fun = &program.functions[frame.fn_idx];
|
||||||
|
if source_owner != Some(frame.fn_idx) {
|
||||||
|
self.current_source = self
|
||||||
|
.diagnostic_frames
|
||||||
|
.last()
|
||||||
|
.expect("active source frame")
|
||||||
|
.declaration
|
||||||
|
.source
|
||||||
|
.clone();
|
||||||
|
self.current_scope = Some(fun.module_scope);
|
||||||
|
source_owner = Some(frame.fn_idx);
|
||||||
|
}
|
||||||
if frame.ip >= fun.code.len() {
|
if frame.ip >= fun.code.len() {
|
||||||
let span = fun.spans.last().copied().unwrap_or(Span::new(1, 1));
|
let span = fun.spans.last().copied().unwrap_or(Span::new(1, 1));
|
||||||
return Err(self.err_at(span, format!("bytecode: ip out of range in {}", fun.name)));
|
return Err(self.err_at(span, format!("bytecode: ip out of range in {}", fun.name)));
|
||||||
}
|
}
|
||||||
let ip = frame.ip;
|
let ip = frame.ip;
|
||||||
let op = fun.code[ip];
|
let mut op = fun.code[ip];
|
||||||
let span = fun.spans.get(ip).copied().unwrap_or(Span::new(1, 1));
|
let span = fun.spans.get(ip).copied().unwrap_or(Span::new(1, 1));
|
||||||
frame.ip += 1;
|
frame.ip += 1;
|
||||||
self.host.current_line = span.line;
|
self.host.current_line = span.line;
|
||||||
|
|
||||||
|
let mut print_returns_none=false;
|
||||||
|
let mut method_name_override=None;
|
||||||
|
let mut constructor_tag=None;
|
||||||
|
if let Op::PathCallArgs(owner,layout)=op {
|
||||||
|
let call=&fun.calls[owner];
|
||||||
|
let Some(super::CallDispatch::Path{receiver,check_receiver,fallback})=&call.dispatch else{unreachable!("verified path dispatch")};
|
||||||
|
let value=if *check_receiver {fun.locals.iter().position(|n|n==receiver).and_then(|slot|frame.read(fun,slot))}else{None};
|
||||||
|
if let Some(value)=value {
|
||||||
|
stack.push(value);method_name_override=Some(call.source.callee.clone());op=Op::MethodCallArgs(0,layout);
|
||||||
|
} else {match fallback {
|
||||||
|
super::PathFallback::User{target,tag_instance}=>{op=Op::CallArgs(*target,layout);if *tag_instance{constructor_tag=Some(*target);}},
|
||||||
|
super::PathFallback::Error{message}=>return Err(self.err_at(span,message)),
|
||||||
|
}}
|
||||||
|
}
|
||||||
|
if let Op::BuiltinCallArgs(name,layout)=op {
|
||||||
|
let name=fun.constants[name].as_display();let names=&fun.call_layouts[layout];
|
||||||
|
let values=take_actuals(&mut stack,names.len()).map_err(|m|self.err_at(span,m))?;
|
||||||
|
let (params,allow_missing)=crate::arguments::builtin_signature(&name).ok_or_else(||self.err_at(span,"unknown builtin signature"))?;
|
||||||
|
let parameters=params.iter().map(|p|p.to_string()).collect::<Vec<_>>();
|
||||||
|
let bound=crate::arguments::bind(¶meters,names,&values,allow_missing).map_err(|m|self.err_at(span,m))?;
|
||||||
|
for param in params {
|
||||||
|
stack.push(bound.get(*param).cloned().unwrap_or_else(||Value::Text(String::new())));
|
||||||
|
}
|
||||||
|
op=match name.as_str(){"print"=>{print_returns_none=true;Op::Print},"input"=>Op::Input,"len"=>Op::Len,"str"=>Op::Str,"int"=>Op::Int,"type"=>Op::TypeOf,"trim"=>Op::Trim,"split"=>Op::Split,"join"=>Op::Join,"at"=>Op::GetIndex,"call_fn"=>Op::CallFn,_=>unreachable!()};
|
||||||
|
}
|
||||||
|
|
||||||
if self.trace {
|
if self.trace {
|
||||||
match op {
|
match op {
|
||||||
Op::Print | Op::Input | Op::Call(_, _) | Op::Return => {
|
Op::Print | Op::Input | Op::Call(_, _) | Op::CallArgs(_, _) | Op::Return => {
|
||||||
let kind = match op {
|
let kind = match op {
|
||||||
Op::Print => "print",
|
Op::Print => "print",
|
||||||
Op::Input => "input",
|
Op::Input => "input",
|
||||||
Op::Call(_, _) => "call",
|
Op::Call(_, _) | Op::CallArgs(_, _) => "call",
|
||||||
Op::Return => "return",
|
Op::Return => "return",
|
||||||
_ => unreachable!(),
|
_ => unreachable!(),
|
||||||
};
|
};
|
||||||
let ip_s = ip.to_string();
|
let ip_s = ip.to_string();
|
||||||
emit_trace(
|
emit_trace(
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
Some(span),
|
Some(span),
|
||||||
"op",
|
"op",
|
||||||
&[
|
&[
|
||||||
@@ -200,6 +356,61 @@ impl Vm {
|
|||||||
}
|
}
|
||||||
|
|
||||||
match op {
|
match op {
|
||||||
|
Op::CheckArguments => {
|
||||||
|
if let Some(contract)=&fun.contract {
|
||||||
|
let bound=fun.locals.iter().zip(&frame.slots).filter_map(|(name,value)|
|
||||||
|
value.clone().map(|value|(name.clone(),value))).collect();
|
||||||
|
// Internal call errors identify the authored call site, like Tree.
|
||||||
|
let site=self.diagnostic_frames.last().and_then(|f|f.call_site.as_ref());
|
||||||
|
let call_site=site.cloned().unwrap_or_else(||self.current_source.at(span));
|
||||||
|
if let Some(diag)=crate::contract::call_arg_diag_in(contract,&fun.name,&bound,&call_site,&fun.source) {
|
||||||
|
let depth=self.diagnostic_frames.len()-usize::from(site.is_some());
|
||||||
|
return Err(diag.with_frames(&self.diagnostic_frames[..depth]).into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Op::CheckReturn => {
|
||||||
|
if let Some(contract)=&fun.contract {
|
||||||
|
let value=stack.last().cloned().unwrap_or(Value::None);
|
||||||
|
if let Some(diag)=crate::contract::return_diag(contract,&fun.name,&value,self.current_source.path.as_deref(),span) {
|
||||||
|
return Err(diag.into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Op::CheckBinding(slot) => {
|
||||||
|
let name=&fun.locals[slot];
|
||||||
|
if let Some(contract)=fun.var_contracts.get(name) {
|
||||||
|
let value=stack.last().cloned().unwrap_or(Value::None);
|
||||||
|
if let Some(diag)=crate::contract::fields_diag(contract,name,&value,self.current_source.path.as_deref(),span) {
|
||||||
|
return Err(diag.into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Op::RestoreReceiver => {
|
||||||
|
if let Some(receiver)=&frame.receiver {
|
||||||
|
for (index,name) in fun.locals.iter().enumerate() {
|
||||||
|
if name=="self" || name=="自" {frame.slots[index]=Some(receiver.clone());}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
frame.defaults_active=false;
|
||||||
|
}
|
||||||
|
Op::CheckFrameArguments => {
|
||||||
|
if let Some(contract)=&fun.contract {
|
||||||
|
let bound=fun.locals.iter().zip(&frame.slots).filter_map(|(name,value)|value.clone().map(|value|(name.clone(),value))).collect();
|
||||||
|
if let Some(diag)=crate::contract::call_arg_diag(contract,&fun.name,&bound,self.current_source.path.as_deref(),fun.declaration_span){return Err(diag.with_source(&self.current_source).with_frames(&self.diagnostic_frames).into());}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Op::ResetLoop(id) => {frame.loop_counts.insert(id,0);}
|
||||||
|
Op::CheckLoop(id) => {
|
||||||
|
let counter=frame.loop_counts.get_mut(&id).ok_or_else(||self.err_at(span,"uninitialized loop counter"))?;
|
||||||
|
if *counter>=1_000_000 {return Err(self.err_at(span,"while loop exceeded iteration limit"));}
|
||||||
|
*counter+=1;
|
||||||
|
}
|
||||||
|
Op::FillMissingParameters => {
|
||||||
|
for index in 0..fun.params.len() {
|
||||||
|
if frame.slots[index].is_none() { frame.slots[index]=Some(Value::None); }
|
||||||
|
}
|
||||||
|
}
|
||||||
Op::Constant(i) => stack.push(fun.constants[i as usize].clone()),
|
Op::Constant(i) => stack.push(fun.constants[i as usize].clone()),
|
||||||
Op::True => stack.push(Value::Bool(true)),
|
Op::True => stack.push(Value::Bool(true)),
|
||||||
Op::False => stack.push(Value::Bool(false)),
|
Op::False => stack.push(Value::Bool(false)),
|
||||||
@@ -208,7 +419,10 @@ impl Vm {
|
|||||||
stack.pop();
|
stack.pop();
|
||||||
}
|
}
|
||||||
Op::GetLocal(i) => {
|
Op::GetLocal(i) => {
|
||||||
let v = frames.last().unwrap().slots[i as usize].clone();
|
let current=frames.last().unwrap();
|
||||||
|
let index=i as usize;let name=&fun.locals[index];
|
||||||
|
let value=current.read(fun,index);
|
||||||
|
let v=value.ok_or_else(||self.err_at(span,format!("undefined variable `{name}`")))?;
|
||||||
stack.push(v);
|
stack.push(v);
|
||||||
}
|
}
|
||||||
Op::SetLocal(i) => {
|
Op::SetLocal(i) => {
|
||||||
@@ -216,130 +430,32 @@ impl Vm {
|
|||||||
let slot = i as usize;
|
let slot = i as usize;
|
||||||
let fr = frames.last_mut().unwrap();
|
let fr = frames.last_mut().unwrap();
|
||||||
if fr.slots.len() <= slot {
|
if fr.slots.len() <= slot {
|
||||||
fr.slots.resize(slot + 1, Value::None);
|
fr.slots.resize(slot + 1, None);
|
||||||
}
|
}
|
||||||
fr.slots[slot] = v;
|
fr.slots[slot] = Some(v);
|
||||||
}
|
}
|
||||||
Op::Add => {
|
Op::Add | Op::Sub | Op::Mul | Op::Div | Op::Equal | Op::NotEqual |
|
||||||
let b = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
Op::Greater | Op::GreaterEqual | Op::Less | Op::Lessequal => {
|
||||||
let a = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
use crate::ast::BinaryOp;
|
||||||
if let Some(v) = crate::linalg_ops::try_matrix_binary(
|
let operation=match op {
|
||||||
&mut self.host,
|
Op::Add=>BinaryOp::Add,Op::Sub=>BinaryOp::Sub,Op::Mul=>BinaryOp::Mul,Op::Div=>BinaryOp::Div,
|
||||||
crate::ast::BinaryOp::Add,
|
Op::Equal=>BinaryOp::Eq,Op::NotEqual=>BinaryOp::Ne,Op::Greater=>BinaryOp::Gt,
|
||||||
&a,
|
Op::GreaterEqual=>BinaryOp::Ge,Op::Less=>BinaryOp::Lt,Op::Lessequal=>BinaryOp::Le,
|
||||||
&b,
|
_=>unreachable!(),
|
||||||
)
|
};
|
||||||
.map_err(|m| self.err_at(span, m))?
|
let right=pop(&mut stack).map_err(|m|self.err_at(span,m))?;
|
||||||
{
|
let left=pop(&mut stack).map_err(|m|self.err_at(span,m))?;
|
||||||
stack.push(v);
|
let value=if let Some(value)=crate::linalg_ops::try_matrix_binary(&mut self.host,operation,&left,&right)
|
||||||
} else {
|
.map_err(|m|self.err_at(span,m))? {value} else {
|
||||||
stack.push(add(a, b).map_err(|m| self.err_at(span, m))?);
|
crate::builtin::eval_binary(operation,&left,&right).map_err(|m|self.err_at(span,m))?
|
||||||
}
|
};
|
||||||
|
stack.push(value);
|
||||||
}
|
}
|
||||||
Op::Sub => {
|
Op::Negate | Op::Not => {
|
||||||
let b = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
let value=pop(&mut stack).map_err(|m|self.err_at(span,m))?;
|
||||||
let a = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
let operation=if matches!(op,Op::Negate){crate::ast::UnaryOp::Neg}else{crate::ast::UnaryOp::Not};
|
||||||
if let Some(v) = crate::linalg_ops::try_matrix_binary(
|
stack.push(crate::builtin::eval_unary(operation,&value).map_err(|m|self.err_at(span,m))?);
|
||||||
&mut self.host,
|
|
||||||
crate::ast::BinaryOp::Sub,
|
|
||||||
&a,
|
|
||||||
&b,
|
|
||||||
)
|
|
||||||
.map_err(|m| self.err_at(span, m))?
|
|
||||||
{
|
|
||||||
stack.push(v);
|
|
||||||
} else {
|
|
||||||
match (a, b) {
|
|
||||||
(Value::Int(x), Value::Int(y)) => stack.push(Value::Int(x - y)),
|
|
||||||
(Value::Num(x), Value::Num(y)) => stack.push(Value::Num(x - y)),
|
|
||||||
(Value::Int(x), Value::Num(y)) => {
|
|
||||||
stack.push(Value::Num(x as f64 - y))
|
|
||||||
}
|
|
||||||
(Value::Num(x), Value::Int(y)) => {
|
|
||||||
stack.push(Value::Num(x - y as f64))
|
|
||||||
}
|
|
||||||
_ => return Err(self.err_at(span, "`-` needs ints or nums")),
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
}
|
||||||
Op::Mul => {
|
|
||||||
let b = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
|
||||||
let a = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
|
||||||
if let Some(v) = crate::linalg_ops::try_matrix_binary(
|
|
||||||
&mut self.host,
|
|
||||||
crate::ast::BinaryOp::Mul,
|
|
||||||
&a,
|
|
||||||
&b,
|
|
||||||
)
|
|
||||||
.map_err(|m| self.err_at(span, m))?
|
|
||||||
{
|
|
||||||
stack.push(v);
|
|
||||||
} else {
|
|
||||||
match (a, b) {
|
|
||||||
(Value::Int(x), Value::Int(y)) => stack.push(Value::Int(x * y)),
|
|
||||||
(Value::Num(x), Value::Num(y)) => stack.push(Value::Num(x * y)),
|
|
||||||
(Value::Int(x), Value::Num(y)) => {
|
|
||||||
stack.push(Value::Num(x as f64 * y))
|
|
||||||
}
|
|
||||||
(Value::Num(x), Value::Int(y)) => {
|
|
||||||
stack.push(Value::Num(x * y as f64))
|
|
||||||
}
|
|
||||||
_ => return Err(self.err_at(span, "`*` needs ints or nums")),
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
Op::Div => {
|
|
||||||
let b = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
|
||||||
let a = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
|
||||||
match (a, b) {
|
|
||||||
(Value::Int(_), Value::Int(0)) => {
|
|
||||||
return Err(self.err_at(span, "division by zero"));
|
|
||||||
}
|
|
||||||
(Value::Int(x), Value::Int(y)) => stack.push(Value::Int(x / y)),
|
|
||||||
(Value::Num(_), Value::Num(y)) if y == 0.0 => {
|
|
||||||
return Err(self.err_at(span, "division by zero"));
|
|
||||||
}
|
|
||||||
(Value::Int(_), Value::Num(y)) if y == 0.0 => {
|
|
||||||
return Err(self.err_at(span, "division by zero"));
|
|
||||||
}
|
|
||||||
(Value::Num(_), Value::Int(0)) => {
|
|
||||||
return Err(self.err_at(span, "division by zero"));
|
|
||||||
}
|
|
||||||
(Value::Num(x), Value::Num(y)) => stack.push(Value::Num(x / y)),
|
|
||||||
(Value::Int(x), Value::Num(y)) => {
|
|
||||||
stack.push(Value::Num(x as f64 / y))
|
|
||||||
}
|
|
||||||
(Value::Num(x), Value::Int(y)) => {
|
|
||||||
stack.push(Value::Num(x / y as f64))
|
|
||||||
}
|
|
||||||
_ => return Err(self.err_at(span, "`/` needs ints or nums")),
|
|
||||||
}
|
|
||||||
}
|
|
||||||
Op::Negate => match pop(&mut stack).map_err(|m| self.err_at(span, m))? {
|
|
||||||
Value::Int(n) => stack.push(Value::Int(-n)),
|
|
||||||
Value::Num(n) => stack.push(Value::Num(-n)),
|
|
||||||
_ => return Err(self.err_at(span, "unary `-` needs int or num")),
|
|
||||||
},
|
|
||||||
Op::Not => {
|
|
||||||
let v = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
|
||||||
stack.push(Value::Bool(!v.truthy()));
|
|
||||||
}
|
|
||||||
Op::Equal => {
|
|
||||||
let b = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
|
||||||
let a = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
|
||||||
stack.push(Value::Bool(a == b));
|
|
||||||
}
|
|
||||||
Op::NotEqual => {
|
|
||||||
let b = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
|
||||||
let a = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
|
||||||
stack.push(Value::Bool(a != b));
|
|
||||||
}
|
|
||||||
Op::Greater => cmp(&mut stack, |o| o.is_gt()).map_err(|m| self.err_at(span, m))?,
|
|
||||||
Op::GreaterEqual => {
|
|
||||||
cmp(&mut stack, |o| o.is_ge()).map_err(|m| self.err_at(span, m))?
|
|
||||||
}
|
|
||||||
Op::Less => cmp(&mut stack, |o| o.is_lt()).map_err(|m| self.err_at(span, m))?,
|
|
||||||
Op::Lessequal => cmp(&mut stack, |o| o.is_le()).map_err(|m| self.err_at(span, m))?,
|
|
||||||
Op::Jump(t) => {
|
Op::Jump(t) => {
|
||||||
frames.last_mut().unwrap().ip = t as usize;
|
frames.last_mut().unwrap().ip = t as usize;
|
||||||
}
|
}
|
||||||
@@ -444,7 +560,7 @@ impl Vm {
|
|||||||
let v = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
let v = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
||||||
stack.push(builtin_iter_items(&v).map_err(|m| self.err_at(span, m))?);
|
stack.push(builtin_iter_items(&v).map_err(|m| self.err_at(span, m))?);
|
||||||
}
|
}
|
||||||
Op::FootnoteGet => {
|
Op::FootnoteGet | Op::ContractFootnoteGet(_) => {
|
||||||
let label = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
let label = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
||||||
let base = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
let base = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
||||||
let label = match label {
|
let label = match label {
|
||||||
@@ -453,10 +569,27 @@ impl Vm {
|
|||||||
return Err(self.err_at(span, "footnote label must be text"));
|
return Err(self.err_at(span, "footnote label must be text"));
|
||||||
}
|
}
|
||||||
};
|
};
|
||||||
stack.push(
|
let contract=if let Op::ContractFootnoteGet(slot)=op {
|
||||||
builtin_footnote_get(&base, &label).map_err(|m| self.err_at(span, m))?,
|
let name=&fun.locals[slot];fun.var_contracts.get(name).map(|c|(name,c))
|
||||||
);
|
} else {None};
|
||||||
|
if let Some((name,c))=contract {
|
||||||
|
if let Some(diag)=crate::contract::index_diag(c,name,&label,&Value::None,self.current_source.path.as_deref(),span) {return Err(diag.into());}
|
||||||
|
}
|
||||||
|
let value=builtin_footnote_get(&base,&label).map_err(|m|self.err_at(span,m))?;
|
||||||
|
if let Some((name,c))=contract {
|
||||||
|
if let Some(diag)=crate::contract::index_diag(c,name,&label,&value,self.current_source.path.as_deref(),span) {return Err(diag.into());}
|
||||||
|
}
|
||||||
|
stack.push(value);
|
||||||
}
|
}
|
||||||
|
Op::HostCallArgs(id, layout) => {
|
||||||
|
let hf=HostFn::from_u16(id).ok_or_else(||self.err_at(span,"unknown host id"))?;
|
||||||
|
let names=&fun.call_layouts[layout];let values=take_actuals(&mut stack,names.len()).map_err(|m|self.err_at(span,m))?;
|
||||||
|
let params=hf.all_params().iter().map(|p|p.to_string()).collect::<Vec<_>>();
|
||||||
|
let bound=crate::arguments::bind(¶ms,names,&values,true).map_err(|m|self.err_at(span,m))?;
|
||||||
|
for req in hf.required_params(){if !bound.contains_key(*req){return Err(self.err_at(span,format!("{} requires `{req}`",hf.name())));}}
|
||||||
|
stack.push(call_host(&mut self.host,hf,&bound).map_err(|m|self.err_at(span,m))?);
|
||||||
|
}
|
||||||
|
Op::BuiltinCallArgs(_,_)=>unreachable!("builtin dispatch was prepared above"),
|
||||||
Op::HostCall(id, argc) => {
|
Op::HostCall(id, argc) => {
|
||||||
let hf = HostFn::from_u16(id)
|
let hf = HostFn::from_u16(id)
|
||||||
.ok_or_else(|| self.err_at(span, format!("unknown host id {id}")))?;
|
.ok_or_else(|| self.err_at(span, format!("unknown host id {id}")))?;
|
||||||
@@ -476,71 +609,105 @@ impl Vm {
|
|||||||
}
|
}
|
||||||
for req in hf.required_params() {
|
for req in hf.required_params() {
|
||||||
if !bound.contains_key(*req) {
|
if !bound.contains_key(*req) {
|
||||||
return Err(self.err_at(
|
return Err(
|
||||||
span,
|
self.err_at(span, format!("{} requires `{req}`", hf.name()))
|
||||||
format!("{} requires `{req}`", hf.name()),
|
);
|
||||||
));
|
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
let result =
|
let result =
|
||||||
call_host(&mut self.host, hf, &bound).map_err(|m| self.err_at(span, m))?;
|
call_host(&mut self.host, hf, &bound).map_err(|m| self.err_at(span, m))?;
|
||||||
stack.push(result);
|
stack.push(result);
|
||||||
}
|
}
|
||||||
Op::Call(fid, argc) => {
|
Op::RejectDuplicateArgument(index) => {
|
||||||
|
let name=fun.constants[index].as_display();
|
||||||
|
return Err(self.err_at(span,format!("duplicate named argument `{name}`")));
|
||||||
|
}
|
||||||
|
Op::RejectArgumentExpansion(index) => {
|
||||||
|
return Err(self.err_at(span,fun.constants[index].as_display()));
|
||||||
|
}
|
||||||
|
Op::RejectCallResolution(index)=>return Err(self.err_at(span,fun.constants[index].as_display())),
|
||||||
|
Op::PathCallArgs(_,_)=>unreachable!("path dispatch was selected above"),
|
||||||
|
Op::JumpIfProvided(index, target) => {
|
||||||
|
if frame.provided.get(index as usize).copied().unwrap_or(false) {
|
||||||
|
frame.ip = target as usize;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Op::Call(_, _) | Op::CallArgs(_, _) => {
|
||||||
|
let (fid, argc) = match op {
|
||||||
|
Op::Call(fid, argc) => (fid, argc as usize),
|
||||||
|
Op::CallArgs(fid, layout) => (fid, layout),
|
||||||
|
_ => unreachable!(),
|
||||||
|
};
|
||||||
let fid = fid as usize;
|
let fid = fid as usize;
|
||||||
let argc = argc as usize;
|
|
||||||
let callee = &program.functions[fid];
|
let callee = &program.functions[fid];
|
||||||
if callee.params.len() != argc {
|
let layout = if matches!(op, Op::CallArgs(_, _)) {
|
||||||
return Err(self.err_at(span, "call argument count mismatch"));
|
fun.call_layouts[argc as usize].clone()
|
||||||
}
|
} else { vec![None; argc as usize] };
|
||||||
let mut slots = vec![Value::None; callee.locals.len().max(argc).max(1)];
|
let mut values = Vec::new();
|
||||||
for i in (0..argc).rev() {
|
for _ in &layout { values.push(pop(&mut stack).map_err(|m| self.err_at(span, m))?); }
|
||||||
slots[i] = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
values.reverse();
|
||||||
}
|
let (slots, provided) = bind_call_values(callee, &layout, values).map_err(|m| self.err_at(span, m))?;
|
||||||
let fname = program.functions[fid].name.clone();
|
let fname = program.functions[fid].name.clone();
|
||||||
frames.push(Frame {
|
frames.push(Frame {
|
||||||
fn_idx: fid,
|
fn_idx: fid,
|
||||||
|
loop_counts: HashMap::new(),
|
||||||
|
receiver: None, defaults_active: true,
|
||||||
ip: 0,
|
ip: 0,
|
||||||
|
provided,
|
||||||
slots,
|
slots,
|
||||||
retag_matrix: None,
|
retag_matrix: None,
|
||||||
|
has_call_site: true,
|
||||||
|
retag_instance: constructor_tag,
|
||||||
});
|
});
|
||||||
|
self.push_source_frame(callee, Some(span));
|
||||||
self.host.push_call_frame(&fname);
|
self.host.push_call_frame(&fname);
|
||||||
self.host.push_call_site_line(span.line);
|
self.host.push_call_site_line(span.line);
|
||||||
}
|
}
|
||||||
Op::TagInstance(idx) => {
|
Op::TagInstance(idx) => {
|
||||||
let type_name = match fun.constants.get(idx as usize) {
|
let class = program.functions.get(idx).ok_or_else(|| self.err_at(span,"TagInstance needs an object function"))?;
|
||||||
Some(Value::Text(s)) => s.clone(),
|
|
||||||
_ => {
|
|
||||||
return Err(self.err_at(span, "TagInstance needs type name constant"));
|
|
||||||
}
|
|
||||||
};
|
|
||||||
let v = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
let v = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
||||||
stack.push(tag_instance_value(&type_name, v));
|
stack.push(crate::value::tag_instance(&class.name, &class.module_path, v));
|
||||||
}
|
}
|
||||||
Op::MethodCall(name_idx, argc) => {
|
Op::MethodCall(_, _) | Op::MethodCallArgs(_, _) => {
|
||||||
let argc = argc as usize;
|
let (name_idx, argc) = match op {
|
||||||
let method_name = match fun.constants.get(name_idx as usize) {
|
Op::MethodCall(name, argc) => (name, argc as usize),
|
||||||
|
Op::MethodCallArgs(name, layout) => (name, layout),
|
||||||
|
_ => unreachable!(),
|
||||||
|
};
|
||||||
|
let layout = if matches!(op, Op::MethodCallArgs(_, _)) {
|
||||||
|
fun.call_layouts[argc as usize].clone()
|
||||||
|
} else { vec![None; argc as usize] };
|
||||||
|
let argc = layout.len();
|
||||||
|
let method_name = if let Some(name)=method_name_override {name} else {match fun.constants.get(name_idx as usize) {
|
||||||
Some(Value::Text(s)) => s.clone(),
|
Some(Value::Text(s)) => s.clone(),
|
||||||
_ => {
|
_ => {
|
||||||
return Err(self.err_at(span, "MethodCall needs method name constant"));
|
return Err(self.err_at(span, "MethodCall needs method name constant"));
|
||||||
}
|
}
|
||||||
};
|
}};
|
||||||
let recv = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
let recv = pop(&mut stack).map_err(|m| self.err_at(span, m))?;
|
||||||
let mut vals = Vec::with_capacity(argc);
|
let mut vals = Vec::with_capacity(argc);
|
||||||
for _ in 0..argc {
|
for _ in 0..argc {
|
||||||
vals.push(pop(&mut stack).map_err(|m| self.err_at(span, m))?);
|
vals.push(pop(&mut stack).map_err(|m| self.err_at(span, m))?);
|
||||||
}
|
}
|
||||||
vals.reverse();
|
vals.reverse();
|
||||||
let type_name = instance_type_name_bc(&recv).map_err(|m| self.err_at(span, m))?;
|
let type_name =
|
||||||
let start_oi = program
|
instance_type_name_bc(&recv).map_err(|m| self.err_at(span, m))?;
|
||||||
.objects
|
let namespace=crate::value::instance_module(&recv).map_err(|m| self.err_at(span,m))?;
|
||||||
.iter()
|
let start_oi = if let Some(namespace)=&namespace {
|
||||||
.position(|(n, _)| n == &type_name)
|
program.objects.iter().position(|(name,id)| name==&type_name && &program.functions[*id].module_path==namespace)
|
||||||
|
} else {
|
||||||
|
let local=program.objects.iter().position(|(name,id)| name==&type_name && program.functions[*id].module_scope==fun.module_scope);
|
||||||
|
if local.is_some() { local } else {
|
||||||
|
let candidates=program.objects.iter().enumerate().filter(|(_, (name,_))| name==&type_name).map(|(index,_)|index).collect::<Vec<_>>();
|
||||||
|
if candidates.len()>1 { return Err(self.err_at(span,format!("ambiguous object type `{type_name}`: a module tag is required"))); }
|
||||||
|
candidates.first().copied()
|
||||||
|
}
|
||||||
|
}
|
||||||
.ok_or_else(|| {
|
.ok_or_else(|| {
|
||||||
self.err_at(span, format!("unknown object type `{type_name}`"))
|
self.err_at(span, format!("unknown object type `{type_name}`"))
|
||||||
})?;
|
})?;
|
||||||
let method_fid = resolve_method_fid(program, start_oi, &method_name).ok_or_else(
|
let method_fid = resolve_method_fid(program, start_oi, &method_name)
|
||||||
|| {
|
.ok_or_else(|| {
|
||||||
let mut chain = Vec::new();
|
let mut chain = Vec::new();
|
||||||
let mut oi = Some(start_oi);
|
let mut oi = Some(start_oi);
|
||||||
let mut seen = std::collections::HashSet::new();
|
let mut seen = std::collections::HashSet::new();
|
||||||
@@ -562,36 +729,37 @@ impl Vm {
|
|||||||
chain.join(" → ")
|
chain.join(" → ")
|
||||||
),
|
),
|
||||||
)
|
)
|
||||||
},
|
})?;
|
||||||
)?;
|
|
||||||
let callee = &program.functions[method_fid];
|
let callee = &program.functions[method_fid];
|
||||||
if callee.params.len() != argc {
|
let (slots, provided) = bind_call_values(callee, &layout, vals).map_err(|m| self.err_at(span, m))?;
|
||||||
return Err(self.err_at(span, "method argument count mismatch"));
|
|
||||||
}
|
|
||||||
let mut slots = vec![Value::None; callee.locals.len().max(1)];
|
|
||||||
for (i, v) in vals.into_iter().enumerate() {
|
|
||||||
slots[i] = v;
|
|
||||||
}
|
|
||||||
for (i, name) in callee.locals.iter().enumerate() {
|
|
||||||
if name == "自" || name == "self" {
|
|
||||||
slots[i] = recv.clone();
|
|
||||||
}
|
|
||||||
}
|
|
||||||
let retag_matrix = if crate::linalg_ops::is_matrix_value(&recv) {
|
let retag_matrix = if crate::linalg_ops::is_matrix_value(&recv) {
|
||||||
Some(type_name.clone())
|
Some((type_name.clone(), namespace))
|
||||||
} else {
|
} else {
|
||||||
None
|
None
|
||||||
};
|
};
|
||||||
let fname = callee.name.clone();
|
let fname = callee.name.clone();
|
||||||
frames.push(Frame {
|
frames.push(Frame {
|
||||||
fn_idx: method_fid,
|
fn_idx: method_fid,
|
||||||
|
loop_counts: HashMap::new(),
|
||||||
|
receiver: Some(recv.clone()), defaults_active: true,
|
||||||
ip: 0,
|
ip: 0,
|
||||||
|
provided,
|
||||||
slots,
|
slots,
|
||||||
retag_matrix,
|
retag_matrix,
|
||||||
|
has_call_site: true,
|
||||||
|
retag_instance: None,
|
||||||
});
|
});
|
||||||
|
self.push_source_frame(callee, Some(span));
|
||||||
self.host.push_call_frame(&fname);
|
self.host.push_call_frame(&fname);
|
||||||
self.host.push_call_site_line(span.line);
|
self.host.push_call_site_line(span.line);
|
||||||
}
|
}
|
||||||
|
Op::PluginCallArgs(name_idx,layout) => {
|
||||||
|
let name=fun.constants[name_idx].as_display();let names=&fun.call_layouts[layout];
|
||||||
|
let values=take_actuals(&mut stack,names.len()).map_err(|m|self.err_at(span,m))?;
|
||||||
|
let reg=self.host.plugins.get(&name).cloned().ok_or_else(||self.err_at(span,format!("unknown function `{name}`")))?;
|
||||||
|
let bound=crate::arguments::bind(®.params,names,&values,false).map_err(|m|self.err_at(span,m))?;
|
||||||
|
stack.push(crate::host::plugin::call_registered(&mut self.host,&name,&bound).map_err(|m|self.err_at(span,m))?);
|
||||||
|
}
|
||||||
Op::PluginCall(name_idx, argc) => {
|
Op::PluginCall(name_idx, argc) => {
|
||||||
let argc = argc as usize;
|
let argc = argc as usize;
|
||||||
let raw_name = match fun.constants.get(name_idx as usize) {
|
let raw_name = match fun.constants.get(name_idx as usize) {
|
||||||
@@ -628,14 +796,9 @@ impl Vm {
|
|||||||
vals.push(pop(&mut stack).map_err(|m| self.err_at(span, m))?);
|
vals.push(pop(&mut stack).map_err(|m| self.err_at(span, m))?);
|
||||||
}
|
}
|
||||||
vals.reverse();
|
vals.reverse();
|
||||||
let reg = self
|
let reg = self.host.plugins.get(&raw_name).cloned().ok_or_else(|| {
|
||||||
.host
|
self.err_at(span, format!("unknown function `{raw_name}`"))
|
||||||
.plugins
|
})?;
|
||||||
.get(&raw_name)
|
|
||||||
.cloned()
|
|
||||||
.ok_or_else(|| {
|
|
||||||
self.err_at(span, format!("unknown function `{raw_name}`"))
|
|
||||||
})?;
|
|
||||||
if reg.params.len() != vals.len() {
|
if reg.params.len() != vals.len() {
|
||||||
return Err(self.err_at(
|
return Err(self.err_at(
|
||||||
span,
|
span,
|
||||||
@@ -666,41 +829,60 @@ impl Vm {
|
|||||||
.map_err(|m| self.err_at(span, m))?;
|
.map_err(|m| self.err_at(span, m))?;
|
||||||
let callee = &program.functions[fid];
|
let callee = &program.functions[fid];
|
||||||
if !callee.params.is_empty() {
|
if !callee.params.is_empty() {
|
||||||
return Err(self.err_at(
|
return Err(
|
||||||
span,
|
self.err_at(span, format!("call_fn: `{name}` must have no parameters"))
|
||||||
format!("call_fn: `{name}` must have no parameters"),
|
);
|
||||||
));
|
|
||||||
}
|
}
|
||||||
let slots = vec![Value::None; callee.locals.len().max(1)];
|
let slots = vec![None; callee.locals.len().max(1)];
|
||||||
let fname = callee.name.clone();
|
let fname = callee.name.clone();
|
||||||
frames.push(Frame {
|
frames.push(Frame {
|
||||||
fn_idx: fid,
|
fn_idx: fid,
|
||||||
|
loop_counts: HashMap::new(),
|
||||||
|
receiver: None, defaults_active: true,
|
||||||
ip: 0,
|
ip: 0,
|
||||||
|
provided: Vec::new(),
|
||||||
slots,
|
slots,
|
||||||
retag_matrix: None,
|
retag_matrix: None,
|
||||||
|
has_call_site: true,
|
||||||
|
retag_instance: None,
|
||||||
});
|
});
|
||||||
|
self.push_source_frame(callee, Some(span));
|
||||||
self.host.push_call_frame(&fname);
|
self.host.push_call_frame(&fname);
|
||||||
self.host.push_call_site_line(span.line);
|
self.host.push_call_site_line(span.line);
|
||||||
}
|
}
|
||||||
Op::Return => {
|
Op::Return => {
|
||||||
let ret = pop(&mut stack).unwrap_or(Value::None);
|
let ret = pop(&mut stack).unwrap_or(Value::None);
|
||||||
let frame = frames.pop();
|
let frame = frames.pop();
|
||||||
|
let constructor=frame.as_ref().and_then(|f|f.retag_instance);
|
||||||
|
self.diagnostic_frames.pop();
|
||||||
self.host.pop_call_frame();
|
self.host.pop_call_frame();
|
||||||
self.host.pop_call_site_line();
|
if frame.as_ref().is_some_and(|f| f.has_call_site) {
|
||||||
|
self.host.pop_call_site_line();
|
||||||
|
}
|
||||||
let ret = match frame.and_then(|f| f.retag_matrix) {
|
let ret = match frame.and_then(|f| f.retag_matrix) {
|
||||||
Some(ty) => crate::linalg_ops::retag_matrix_like(&ty, ret),
|
Some((ty,namespace)) => {
|
||||||
|
let result=crate::linalg_ops::retag_matrix_like(&ty,ret);
|
||||||
|
if let Some(namespace)=namespace { crate::value::tag_instance(&ty,&namespace,result) } else { result }
|
||||||
|
},
|
||||||
None => ret,
|
None => ret,
|
||||||
};
|
};
|
||||||
|
let ret=if let Some(id)=constructor {let class=&program.functions[id];crate::value::tag_instance(&class.name,&class.module_path,ret)}else{ret};
|
||||||
if frames.is_empty() {
|
if frames.is_empty() {
|
||||||
return Ok(ret);
|
return Ok(ret);
|
||||||
}
|
}
|
||||||
stack.push(ret);
|
stack.push(ret);
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
if print_returns_none{stack.push(Value::None);}
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
|
fn take_actuals(stack:&mut Vec<Value>,count:usize)->Result<Vec<Value>,String>{
|
||||||
|
if stack.len()<count{return Err("bytecode argument stack underflow".into());}
|
||||||
|
Ok(stack.split_off(stack.len()-count))
|
||||||
|
}
|
||||||
|
|
||||||
fn resolve_method_fid(program: &Program, start_oi: usize, method_name: &str) -> Option<usize> {
|
fn resolve_method_fid(program: &Program, start_oi: usize, method_name: &str) -> Option<usize> {
|
||||||
let mut oi = Some(start_oi);
|
let mut oi = Some(start_oi);
|
||||||
let mut seen = std::collections::HashSet::new();
|
let mut seen = std::collections::HashSet::new();
|
||||||
@@ -716,9 +898,12 @@ fn resolve_method_fid(program: &Program, start_oi: usize, method_name: &str) ->
|
|||||||
{
|
{
|
||||||
return Some(*fid);
|
return Some(*fid);
|
||||||
}
|
}
|
||||||
oi = program.object_bases.get(i).copied().flatten().and_then(|base_flat| {
|
oi = program
|
||||||
program.objects.iter().position(|(_, f)| *f == base_flat)
|
.object_bases
|
||||||
});
|
.get(i)
|
||||||
|
.copied()
|
||||||
|
.flatten()
|
||||||
|
.and_then(|base_flat| program.objects.iter().position(|(_, f)| *f == base_flat));
|
||||||
}
|
}
|
||||||
None
|
None
|
||||||
}
|
}
|
||||||
@@ -729,44 +914,6 @@ fn pop(stack: &mut Vec<Value>) -> Result<Value, String> {
|
|||||||
.ok_or_else(|| "bytecode: stack underflow".to_string())
|
.ok_or_else(|| "bytecode: stack underflow".to_string())
|
||||||
}
|
}
|
||||||
|
|
||||||
fn add(a: Value, b: Value) -> Result<Value, String> {
|
|
||||||
match (a, b) {
|
|
||||||
(Value::Int(x), Value::Int(y)) => Ok(Value::Int(x + y)),
|
|
||||||
(Value::Num(x), Value::Num(y)) => Ok(Value::Num(x + y)),
|
|
||||||
(Value::Int(x), Value::Num(y)) => Ok(Value::Num(x as f64 + y)),
|
|
||||||
(Value::Num(x), Value::Int(y)) => Ok(Value::Num(x + y as f64)),
|
|
||||||
(Value::Text(x), Value::Text(y)) => Ok(Value::Text(format!("{x}{y}"))),
|
|
||||||
(Value::Text(x), Value::Secret(y)) => Ok(Value::Text(format!("{x}{y}"))),
|
|
||||||
(Value::Secret(x), Value::Text(y)) => Ok(Value::Text(format!("{x}{y}"))),
|
|
||||||
(Value::Secret(x), Value::Secret(y)) => Ok(Value::Text(format!("{x}{y}"))),
|
|
||||||
(Value::Text(x), y) => Ok(Value::Text(format!("{x}{}", y.as_display()))),
|
|
||||||
(x, Value::Text(y)) => Ok(Value::Text(format!("{}{y}", x.as_display()))),
|
|
||||||
(Value::Int(x), y) => Ok(Value::Text(format!("{}{}", x, y.as_display()))),
|
|
||||||
(x, Value::Int(y)) => Ok(Value::Text(format!("{}{y}", x.as_display()))),
|
|
||||||
_ => Err("`+` needs ints, nums, or text".into()),
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
|
|
||||||
fn cmp(stack: &mut Vec<Value>, pred: impl Fn(std::cmp::Ordering) -> bool) -> Result<(), String> {
|
|
||||||
let b = pop(stack)?;
|
|
||||||
let a = pop(stack)?;
|
|
||||||
let ord = match (&a, &b) {
|
|
||||||
(Value::Int(x), Value::Int(y)) => x.cmp(y),
|
|
||||||
(Value::Num(x), Value::Num(y)) => x.partial_cmp(y).unwrap_or(std::cmp::Ordering::Equal),
|
|
||||||
(Value::Int(x), Value::Num(y)) => {
|
|
||||||
(*x as f64).partial_cmp(y).unwrap_or(std::cmp::Ordering::Equal)
|
|
||||||
}
|
|
||||||
(Value::Num(x), Value::Int(y)) => {
|
|
||||||
x.partial_cmp(&(*y as f64)).unwrap_or(std::cmp::Ordering::Equal)
|
|
||||||
}
|
|
||||||
(Value::Text(x), Value::Text(y)) => x.cmp(y),
|
|
||||||
_ => return Err("comparison needs two ints/nums or two texts".into()),
|
|
||||||
};
|
|
||||||
stack.push(Value::Bool(pred(ord)));
|
|
||||||
Ok(())
|
|
||||||
}
|
|
||||||
|
|
||||||
fn instance_type_name_bc(v: &Value) -> Result<String, String> {
|
fn instance_type_name_bc(v: &Value) -> Result<String, String> {
|
||||||
match v {
|
match v {
|
||||||
Value::Map(entries) => entries
|
Value::Map(entries) => entries
|
||||||
@@ -781,42 +928,24 @@ fn instance_type_name_bc(v: &Value) -> Result<String, String> {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
fn tag_instance_value(type_name: &str, value: Value) -> Value {
|
fn resolve_fn_dynamic(program: &Program, current: usize, name: &str) -> Result<usize, String> {
|
||||||
match value {
|
super::names::lookup(program,current,name).ok_or_else(||format!("call_fn: unknown function `{name}`"))
|
||||||
Value::Map(mut entries) => {
|
|
||||||
// Always stamp the constructed type so an explicit `` `self` = > Parent ``
|
|
||||||
// inside a child constructor still yields the most specific `_type`.
|
|
||||||
entries.retain(|(k, _)| k != "_type");
|
|
||||||
entries.insert(0, ("_type".into(), Value::Text(type_name.into())));
|
|
||||||
Value::Map(entries)
|
|
||||||
}
|
|
||||||
Value::None => Value::Map(vec![("_type".into(), Value::Text(type_name.into()))]),
|
|
||||||
other => Value::Map(vec![
|
|
||||||
("_type".into(), Value::Text(type_name.into())),
|
|
||||||
("value".into(), other),
|
|
||||||
]),
|
|
||||||
}
|
|
||||||
}
|
}
|
||||||
|
|
||||||
fn resolve_fn_dynamic(program: &Program, current: usize, name: &str) -> Result<usize, String> {
|
/// Bind already evaluated actuals; no expression or foreign effect runs here.
|
||||||
for &cid in &program.children[current] {
|
fn bind_call_values(callee: &FnChunk, layout: &[Option<String>], values: Vec<Value>)
|
||||||
if program.functions[cid].name == name {
|
-> std::result::Result<(Vec<Option<Value>>, Vec<bool>), String> {
|
||||||
return Ok(cid);
|
if layout.len()!=values.len(){return Err("argument layout/value count mismatch".into());}
|
||||||
}
|
let plan=crate::arguments::plan_with_omissions(&callee.params,layout,&callee.defaults)?;
|
||||||
|
let mut slots = vec![None; callee.locals.len().max(1)];
|
||||||
|
for (name,actual) in plan.assignments {
|
||||||
|
if let Some(index)=callee.locals.iter().position(|local|local==&name){slots[index]=Some(values[actual].clone());}
|
||||||
}
|
}
|
||||||
let mut parent = program.parents[current];
|
let provided=initial_presence(&slots,callee.params.len());
|
||||||
while let Some(pid) = parent {
|
Ok((slots, provided))
|
||||||
for &cid in &program.children[pid] {
|
}
|
||||||
if program.functions[cid].name == name {
|
|
||||||
return Ok(cid);
|
/// Presence is derived once, before defaults, rather than independently rebound.
|
||||||
}
|
fn initial_presence(slots:&[Option<Value>],parameters:usize)->Vec<bool> {
|
||||||
}
|
slots.iter().take(parameters).map(Option::is_some).collect()
|
||||||
parent = program.parents[pid];
|
|
||||||
}
|
|
||||||
for (i, f) in program.functions.iter().enumerate() {
|
|
||||||
if program.parents[i].is_none() && f.name == name {
|
|
||||||
return Ok(i);
|
|
||||||
}
|
|
||||||
}
|
|
||||||
Err(format!("call_fn: unknown function `{name}`"))
|
|
||||||
}
|
}
|
||||||
+5
-6
@@ -100,12 +100,11 @@ pub(crate) fn execute_source_function(
|
|||||||
}
|
}
|
||||||
Backend::Bytecode => {
|
Backend::Bytecode => {
|
||||||
let program = compile_for_call(Some(path), &module)?;
|
let program = compile_for_call(Some(path), &module)?;
|
||||||
let key: Vec<String> = display_name
|
// Source binding is authoritative even when declaration paths repeat.
|
||||||
.split('.')
|
let idx = program.functions.iter().position(|chunk|
|
||||||
.filter(|s| !s.is_empty())
|
chunk.module_scope == 0 && chunk.declaration_span == fun.span
|
||||||
.map(|s| s.to_string())
|
&& chunk.name == fun.name && chunk.source.sha256 == module.source.sha256
|
||||||
.collect();
|
).ok_or_else(|| {
|
||||||
let idx = program.path_index.get(&key).copied().ok_or_else(|| {
|
|
||||||
call_diag(
|
call_diag(
|
||||||
Some(path),
|
Some(path),
|
||||||
line,
|
line,
|
||||||
|
|||||||
@@ -0,0 +1,235 @@
|
|||||||
|
use crate::host::{foreign_session as session, json::value_to_json, oracle, HostContext};
|
||||||
|
use crate::value::Value;
|
||||||
|
use serde_json::{json, Value as Json};
|
||||||
|
use sha2::{Digest, Sha256};
|
||||||
|
use std::path::PathBuf;
|
||||||
|
|
||||||
|
fn root() -> PathBuf {
|
||||||
|
PathBuf::from(env!("CARGO_MANIFEST_DIR"))
|
||||||
|
}
|
||||||
|
fn directory() -> PathBuf {
|
||||||
|
let p = std::env::var_os("MARQDO_CAUSAL_DIR")
|
||||||
|
.map(PathBuf::from)
|
||||||
|
.unwrap_or_else(|| root().join("target/causal-replay"));
|
||||||
|
std::fs::create_dir_all(&p).unwrap();
|
||||||
|
p
|
||||||
|
}
|
||||||
|
fn steps(protocol: &[session::ProtocolStep]) -> Vec<Json> {
|
||||||
|
protocol
|
||||||
|
.iter()
|
||||||
|
.map(|p| json!({"session":p.session,"request":p.request,"response":p.response}))
|
||||||
|
.collect()
|
||||||
|
}
|
||||||
|
pub(crate) fn evidence(ctx: &mut HostContext) -> Json {
|
||||||
|
let journal = value_to_json(&Value::List(ctx.oracle_observations.clone())).unwrap();
|
||||||
|
let protocol = steps(&ctx.foreign_protocol_steps);
|
||||||
|
let divergence = ctx.foreign_replay_divergence.clone();
|
||||||
|
let live = ctx.foreign_sessions.len();
|
||||||
|
// Inspection is explicitly outside replay and outside the admitted journal.
|
||||||
|
ctx.foreign_replay_expected = None;
|
||||||
|
ctx.foreign_replay_divergence = None;
|
||||||
|
let n = if live == 1 {
|
||||||
|
session::get(ctx, &Value::Handle("s1".into()), &Value::Text("n".into()))
|
||||||
|
.ok()
|
||||||
|
.map(|v| value_to_json(&v).unwrap())
|
||||||
|
} else {
|
||||||
|
None
|
||||||
|
};
|
||||||
|
json!({"journal":journal,"protocol":protocol,"divergence":divergence,"live":live,"n":n})
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn observation_journal_erases_writes_but_a_context_distinguishes_them() {
|
||||||
|
for lang in ["python", "node"] {
|
||||||
|
let out = directory();
|
||||||
|
let path = out.join(format!("journal-only-{lang}.marker"));
|
||||||
|
let literal = serde_json::to_string(&path.display().to_string()).unwrap();
|
||||||
|
let code = if lang == "python" {
|
||||||
|
format!("from pathlib import Path\nPath({literal}).write_text(str(ticket))\nNone")
|
||||||
|
} else {
|
||||||
|
format!("require('fs').writeFileSync({literal},String(ticket)); null;")
|
||||||
|
};
|
||||||
|
let mut journals = Vec::new();
|
||||||
|
let mut histories = Vec::new();
|
||||||
|
let mut contents = Vec::new();
|
||||||
|
let mut reads = Vec::new();
|
||||||
|
let mut first_history = Vec::new();
|
||||||
|
for ticket in [7, 8] {
|
||||||
|
let mut ctx = HostContext::default();
|
||||||
|
let id =
|
||||||
|
session::open(&mut ctx, &Value::Text(lang.into()), None, None, None, None).unwrap();
|
||||||
|
session::set(
|
||||||
|
&mut ctx,
|
||||||
|
&id,
|
||||||
|
&Value::Text("ticket".into()),
|
||||||
|
&Value::Int(ticket),
|
||||||
|
)
|
||||||
|
.unwrap();
|
||||||
|
let reply = session::eval(
|
||||||
|
&mut ctx,
|
||||||
|
&id,
|
||||||
|
None,
|
||||||
|
Some(&Value::Text(code.clone())),
|
||||||
|
None,
|
||||||
|
None,
|
||||||
|
)
|
||||||
|
.unwrap();
|
||||||
|
let observed = oracle::eval_observation(&reply).unwrap();
|
||||||
|
oracle::append(&mut ctx, "eval", &observed).unwrap();
|
||||||
|
journals.push(Value::List(ctx.oracle_observations.clone()));
|
||||||
|
histories.push(steps(&ctx.foreign_protocol_steps));
|
||||||
|
if ticket == 7 {
|
||||||
|
first_history = ctx.foreign_protocol_steps.clone();
|
||||||
|
}
|
||||||
|
contents.push(std::fs::read_to_string(&path).unwrap());
|
||||||
|
reads.push(session::get(&mut ctx, &id, &Value::Text("ticket".into())).unwrap());
|
||||||
|
session::close(&mut ctx, &id).unwrap();
|
||||||
|
}
|
||||||
|
let checked = oracle::replay_check(&journals[0], &journals[1]).unwrap();
|
||||||
|
assert_eq!(journals[0], journals[1]);
|
||||||
|
assert_eq!(contents, ["7", "8"]);
|
||||||
|
assert_ne!(reads[0], reads[1]);
|
||||||
|
assert_eq!(value_to_json(&checked).unwrap()["ok"], true);
|
||||||
|
// Control requests use a different wrapper than eval. A mismatching
|
||||||
|
// setter must not retire the live kernel or overwrite its prior value.
|
||||||
|
let mut ctx = HostContext::default();
|
||||||
|
let id =
|
||||||
|
session::open(&mut ctx, &Value::Text(lang.into()), None, None, None, None).unwrap();
|
||||||
|
session::set(
|
||||||
|
&mut ctx,
|
||||||
|
&id,
|
||||||
|
&Value::Text("ticket".into()),
|
||||||
|
&Value::Int(99),
|
||||||
|
)
|
||||||
|
.unwrap();
|
||||||
|
ctx.foreign_protocol_steps.clear();
|
||||||
|
ctx.foreign_replay_expected = Some(first_history.into());
|
||||||
|
let error =
|
||||||
|
session::set(&mut ctx, &id, &Value::Text("ticket".into()), &Value::Int(8)).unwrap_err();
|
||||||
|
let dispatched = ctx.foreign_protocol_steps.len();
|
||||||
|
let live = ctx.foreign_sessions.len();
|
||||||
|
ctx.foreign_replay_expected = None;
|
||||||
|
ctx.foreign_replay_divergence = None;
|
||||||
|
let retained = session::get(&mut ctx, &id, &Value::Text("ticket".into())).unwrap();
|
||||||
|
assert_eq!(dispatched, 0);
|
||||||
|
assert_eq!(live, 1);
|
||||||
|
assert_eq!(retained, Value::Int(99));
|
||||||
|
session::close(&mut ctx, &id).unwrap();
|
||||||
|
std::fs::write(out.join(format!("journal-only-{lang}.json")),serde_json::to_vec_pretty(&json!({"kind":"journal-erasure","language":lang,"journals":journals.iter().map(|j|value_to_json(j).unwrap()).collect::<Vec<_>>(),"histories":histories,"contents":contents,"reads":reads.iter().map(|v|value_to_json(v).unwrap()).collect::<Vec<_>>(),"journal_check":value_to_json(&checked).unwrap(),"setter_guard":{"error":error,"dispatched":dispatched,"live":live,"retained":value_to_json(&retained).unwrap()}})).unwrap()).unwrap();
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn first_protocol_divergence_stops_host_suffix_and_preserves_current_effects() {
|
||||||
|
let lengths = std::env::var("MARQDO_CAUSAL_PREFIXES")
|
||||||
|
.unwrap_or("0,4".into())
|
||||||
|
.split(',')
|
||||||
|
.map(|s| s.parse::<usize>().unwrap())
|
||||||
|
.collect::<Vec<_>>();
|
||||||
|
let seeds = std::env::var("MARQDO_CAUSAL_SEEDS")
|
||||||
|
.unwrap_or("3".into())
|
||||||
|
.split(',')
|
||||||
|
.map(|s| s.parse::<i64>().unwrap())
|
||||||
|
.collect::<Vec<_>>();
|
||||||
|
let mut count = 0;
|
||||||
|
for lang in ["python", "node"] {
|
||||||
|
for &length in &lengths {
|
||||||
|
for &seed in &seeds {
|
||||||
|
for backend in ["tree", "bytecode"] {
|
||||||
|
for mode in ["reply", "request"] {
|
||||||
|
let out = directory();
|
||||||
|
let id = format!("{lang}-{length}-{seed}-{backend}-{mode}");
|
||||||
|
let path = out.join(format!("{id}.mq.md"));
|
||||||
|
let input = out.join(format!("{id}.input"));
|
||||||
|
let marker = out.join(format!("{id}.suffix"));
|
||||||
|
let q = |s: &str| serde_json::to_string(s).unwrap();
|
||||||
|
let code = if lang == "python" {
|
||||||
|
format!(
|
||||||
|
"from pathlib import Path\nn = 99\nint(Path({}).read_text())",
|
||||||
|
q(&input.display().to_string())
|
||||||
|
)
|
||||||
|
} else {
|
||||||
|
format!(
|
||||||
|
"n = 99; Number(require('fs').readFileSync({},'utf8'));",
|
||||||
|
q(&input.display().to_string())
|
||||||
|
)
|
||||||
|
};
|
||||||
|
let prefix=(0..length).map(|i|format!("**p{i} = > foreign.session_eval id=`s` source=\"n += 1; n\"**\n")).collect::<String>();
|
||||||
|
let source=format!("---\nmarkup: occlusion\nimport:\n foreign: {}\n fs: {}\n---\n# main\n**s = > foreign.session_open lang={}**\n**> foreign.session_set id=`s` name=\"n\" value={seed}**\n{prefix}**r = > foreign.session_eval id=`s` source={}**\n**> fs.write_text path={} text=\"suffix\"**\n*r*\n",root().join("lib/foreign.mq.md").display(),root().join("lib/fs.mq.md").display(),q(lang),q(&code),q(&marker.display().to_string()));
|
||||||
|
std::fs::write(&path, &source).unwrap();
|
||||||
|
std::fs::write(&input, "1").unwrap();
|
||||||
|
let module = crate::load::load_module(&path).unwrap();
|
||||||
|
let expected = if backend == "tree" {
|
||||||
|
let mut tree =
|
||||||
|
crate::interp::Interpreter::with_capture(Some(&path), false);
|
||||||
|
tree.run_module(&module).unwrap();
|
||||||
|
tree.application_evidence().1
|
||||||
|
} else {
|
||||||
|
let program =
|
||||||
|
crate::bytecode::compile_module(Some(&path), &module).unwrap();
|
||||||
|
let mut vm = crate::bytecode::Vm::with_capture(Some(&path));
|
||||||
|
vm.run(&program).unwrap();
|
||||||
|
vm.application_evidence().1
|
||||||
|
};
|
||||||
|
assert_eq!(std::fs::read_to_string(&marker).unwrap(), "suffix");
|
||||||
|
std::fs::remove_file(&marker).unwrap();
|
||||||
|
let actual_source = if mode == "request" {
|
||||||
|
source.replace(&q(&code), &q(&code.replace("n = 99", "n = 77")))
|
||||||
|
} else {
|
||||||
|
std::fs::write(&input, "2").unwrap();
|
||||||
|
source.clone()
|
||||||
|
};
|
||||||
|
std::fs::write(&path, &actual_source).unwrap();
|
||||||
|
let actual = crate::load::load_module(&path).unwrap();
|
||||||
|
let mut host = HostContext::for_capture(Some(&path), Default::default());
|
||||||
|
host.foreign_replay_expected = Some(expected.clone().into());
|
||||||
|
let (error, observed) = if backend == "tree" {
|
||||||
|
let mut tree =
|
||||||
|
crate::interp::Interpreter::with_capture(Some(&path), false)
|
||||||
|
.with_host(host);
|
||||||
|
let error = tree.run_module(&actual).err().map(|e| e.to_string());
|
||||||
|
(error, tree.causal_replay_evidence())
|
||||||
|
} else {
|
||||||
|
let program =
|
||||||
|
crate::bytecode::compile_module(Some(&path), &actual).unwrap();
|
||||||
|
let mut vm =
|
||||||
|
crate::bytecode::Vm::with_capture(Some(&path)).with_host(host);
|
||||||
|
let error = vm.run(&program).err().map(|e| e.to_string());
|
||||||
|
(error, vm.causal_replay_evidence())
|
||||||
|
};
|
||||||
|
let record = json!({"kind":"causal-stop","id":id,"language":lang,"prefix":length,"seed":seed,"backend":backend,"mode":mode,"expected":steps(&expected),"observed":observed,"error":error,"suffix_exists":marker.exists(),"source":actual_source,"source_sha256":format!("{:x}",Sha256::digest(actual_source.as_bytes()))});
|
||||||
|
std::fs::write(
|
||||||
|
out.join(format!("{id}.json")),
|
||||||
|
serde_json::to_vec_pretty(&record).unwrap(),
|
||||||
|
)
|
||||||
|
.unwrap();
|
||||||
|
assert!(
|
||||||
|
error.is_some(),
|
||||||
|
"{id}: replay divergence returned a soft result: {record}"
|
||||||
|
);
|
||||||
|
assert!(!marker.exists(), "{id}: host suffix ran after divergence");
|
||||||
|
assert_eq!(
|
||||||
|
observed["n"],
|
||||||
|
if mode == "reply" {
|
||||||
|
json!(99)
|
||||||
|
} else {
|
||||||
|
json!(seed + length as i64)
|
||||||
|
}
|
||||||
|
);
|
||||||
|
assert_eq!(observed["live"], 1);
|
||||||
|
assert_eq!(observed["journal"].as_array().unwrap().len(), length);
|
||||||
|
assert_eq!(
|
||||||
|
observed["protocol"].as_array().unwrap().len(),
|
||||||
|
length + if mode == "reply" { 2 } else { 1 }
|
||||||
|
);
|
||||||
|
count += 1;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
println!(
|
||||||
|
"CAUSAL_METRIC:{}",
|
||||||
|
json!({"cases":count,"document_runs":count*2})
|
||||||
|
);
|
||||||
|
}
|
||||||
+21
-4
@@ -109,6 +109,7 @@ pub fn type_of(v: &Value) -> &'static str {
|
|||||||
Value::Num(_) => "num",
|
Value::Num(_) => "num",
|
||||||
Value::Text(_) => "text",
|
Value::Text(_) => "text",
|
||||||
Value::Secret(_) => "secret",
|
Value::Secret(_) => "secret",
|
||||||
|
Value::Handle(_) => "handle",
|
||||||
Value::List(_) => "list",
|
Value::List(_) => "list",
|
||||||
Value::Map(_) => "map",
|
Value::Map(_) => "map",
|
||||||
Value::Formula(_) => "formula",
|
Value::Formula(_) => "formula",
|
||||||
@@ -127,20 +128,20 @@ fn instance_type_name(v: &Value) -> Option<String> {
|
|||||||
})
|
})
|
||||||
}
|
}
|
||||||
|
|
||||||
#[derive(Debug, Clone)]
|
#[derive(Debug, Clone, PartialEq, Eq)]
|
||||||
pub struct ParamContract {
|
pub struct ParamContract {
|
||||||
pub name: String,
|
pub name: String,
|
||||||
pub ty: Ty,
|
pub ty: Ty,
|
||||||
pub desc: String,
|
pub desc: String,
|
||||||
}
|
}
|
||||||
|
|
||||||
#[derive(Debug, Clone)]
|
#[derive(Debug, Clone, PartialEq, Eq)]
|
||||||
pub struct ReturnContract {
|
pub struct ReturnContract {
|
||||||
pub ty: Ty,
|
pub ty: Ty,
|
||||||
pub desc: String,
|
pub desc: String,
|
||||||
}
|
}
|
||||||
|
|
||||||
#[derive(Debug, Clone)]
|
#[derive(Debug, Clone, PartialEq, Eq)]
|
||||||
pub struct FieldContract {
|
pub struct FieldContract {
|
||||||
pub name: String,
|
pub name: String,
|
||||||
pub ty: Ty,
|
pub ty: Ty,
|
||||||
@@ -149,7 +150,7 @@ pub struct FieldContract {
|
|||||||
}
|
}
|
||||||
|
|
||||||
/// 一份契约(一个契约表块;同单元多表由 [`merge_contract`] 合并)。
|
/// 一份契约(一个契约表块;同单元多表由 [`merge_contract`] 合并)。
|
||||||
#[derive(Debug, Clone)]
|
#[derive(Debug, Clone, PartialEq, Eq)]
|
||||||
pub struct Contract {
|
pub struct Contract {
|
||||||
pub params: Vec<ParamContract>,
|
pub params: Vec<ParamContract>,
|
||||||
pub returns: Option<ReturnContract>,
|
pub returns: Option<ReturnContract>,
|
||||||
@@ -504,6 +505,22 @@ pub fn call_arg_diag(
|
|||||||
None
|
None
|
||||||
}
|
}
|
||||||
|
|
||||||
|
/// Argument blame belongs to the caller; contract evidence belongs to the
|
||||||
|
/// declaration. Import aliases must not relocate a contract into the caller.
|
||||||
|
pub fn call_arg_diag_in(
|
||||||
|
c: &Contract, unit: &str, bound: &HashMap<String, Value>,
|
||||||
|
call_site: &crate::diagnostics::SourceLocation,
|
||||||
|
declaration: &crate::diagnostics::SourceIdentity,
|
||||||
|
) -> Option<Diagnostic> {
|
||||||
|
let mut diag=call_arg_diag(c,unit,bound,call_site.source.path.as_deref(),call_site.span)?
|
||||||
|
.with_source(&call_site.source);
|
||||||
|
let old=c.anchor(call_site.source.path.as_deref());
|
||||||
|
let new=c.anchor(declaration.path.as_deref());
|
||||||
|
diag.doc_anchor=Some(new.clone());
|
||||||
|
diag.suggestion=diag.suggestion.map(|text|text.replace(&old,&new));
|
||||||
|
Some(diag)
|
||||||
|
}
|
||||||
|
|
||||||
/// 边界 2:返回值 vs 返回契约。
|
/// 边界 2:返回值 vs 返回契约。
|
||||||
pub fn return_diag(
|
pub fn return_diag(
|
||||||
c: &Contract,
|
c: &Contract,
|
||||||
|
|||||||
+86
-1
@@ -23,6 +23,58 @@ impl fmt::Display for Span {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
|
/// Identity of the exact text that was parsed, including recorded revisions.
|
||||||
|
/// A path is a label; the digest is never recomputed from a later disk version.
|
||||||
|
#[derive(Debug, Clone, Default, PartialEq, Eq)]
|
||||||
|
pub struct SourceIdentity {
|
||||||
|
pub path: Option<PathBuf>,
|
||||||
|
pub sha256: Option<String>,
|
||||||
|
}
|
||||||
|
|
||||||
|
impl SourceIdentity {
|
||||||
|
pub fn from_source(path: Option<&Path>, text: &str) -> Self {
|
||||||
|
use sha2::{Digest, Sha256};
|
||||||
|
Self {
|
||||||
|
path: path.map(Path::to_path_buf),
|
||||||
|
sha256: Some(format!("{:x}", Sha256::digest(text.as_bytes()))),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
pub fn at(&self, span: Span) -> SourceLocation {
|
||||||
|
SourceLocation {
|
||||||
|
source: self.clone(),
|
||||||
|
span,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[derive(Debug, Clone, PartialEq, Eq)]
|
||||||
|
pub struct SourceLocation {
|
||||||
|
pub source: SourceIdentity,
|
||||||
|
pub span: Span,
|
||||||
|
}
|
||||||
|
|
||||||
|
impl SourceLocation {
|
||||||
|
pub fn to_json(&self) -> serde_json::Value {
|
||||||
|
serde_json::json!({"file": self.source.path.as_ref().map(|p| display_path(p)),
|
||||||
|
"source_sha256": self.source.sha256, "line": self.span.line, "col": self.span.col})
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[derive(Debug, Clone, PartialEq, Eq)]
|
||||||
|
pub struct DiagnosticFrame {
|
||||||
|
pub function: String,
|
||||||
|
pub declaration: SourceLocation,
|
||||||
|
pub call_site: Option<SourceLocation>,
|
||||||
|
}
|
||||||
|
|
||||||
|
impl DiagnosticFrame {
|
||||||
|
pub fn to_json(&self) -> serde_json::Value {
|
||||||
|
serde_json::json!({"function": self.function, "declaration": self.declaration.to_json(),
|
||||||
|
"call_site": self.call_site.as_ref().map(SourceLocation::to_json)})
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
/// Format a path for user-facing diagnostics.
|
/// Format a path for user-facing diagnostics.
|
||||||
///
|
///
|
||||||
/// Strips the Windows extended-length prefix (`\\?\` / `\\?\UNC\`) that
|
/// Strips the Windows extended-length prefix (`\\?\` / `\\?\UNC\`) that
|
||||||
@@ -75,6 +127,9 @@ pub struct Diagnostic {
|
|||||||
pub doc_anchor: Option<String>,
|
pub doc_anchor: Option<String>,
|
||||||
pub doc_quote: Option<String>,
|
pub doc_quote: Option<String>,
|
||||||
pub contract_ref: Option<ContractRef>,
|
pub contract_ref: Option<ContractRef>,
|
||||||
|
pub source_sha256: Option<String>,
|
||||||
|
/// Ordered outermost to innermost; every site retains its own source.
|
||||||
|
pub frames: Vec<DiagnosticFrame>,
|
||||||
}
|
}
|
||||||
|
|
||||||
impl Diagnostic {
|
impl Diagnostic {
|
||||||
@@ -89,6 +144,8 @@ impl Diagnostic {
|
|||||||
doc_anchor: None,
|
doc_anchor: None,
|
||||||
doc_quote: None,
|
doc_quote: None,
|
||||||
contract_ref: None,
|
contract_ref: None,
|
||||||
|
source_sha256: None,
|
||||||
|
frames: Vec::new(),
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -101,6 +158,17 @@ impl Diagnostic {
|
|||||||
self
|
self
|
||||||
}
|
}
|
||||||
|
|
||||||
|
pub fn with_source(mut self, source: &SourceIdentity) -> Self {
|
||||||
|
self.path = source.path.clone();
|
||||||
|
self.source_sha256 = source.sha256.clone();
|
||||||
|
self
|
||||||
|
}
|
||||||
|
|
||||||
|
pub fn with_frames(mut self, frames: &[DiagnosticFrame]) -> Self {
|
||||||
|
self.frames = frames.to_vec();
|
||||||
|
self
|
||||||
|
}
|
||||||
|
|
||||||
pub fn with_severity(mut self, severity: Severity) -> Self {
|
pub fn with_severity(mut self, severity: Severity) -> Self {
|
||||||
self.severity = severity;
|
self.severity = severity;
|
||||||
self
|
self
|
||||||
@@ -132,10 +200,25 @@ impl Diagnostic {
|
|||||||
}
|
}
|
||||||
|
|
||||||
pub fn format_message(&self) -> String {
|
pub fn format_message(&self) -> String {
|
||||||
match &self.path {
|
let mut message = match &self.path {
|
||||||
Some(p) => format!("{}:{}: {}", display_path(p), self.span, self.message),
|
Some(p) => format!("{}:{}: {}", display_path(p), self.span, self.message),
|
||||||
None => format!("{}: {}", self.span, self.message),
|
None => format!("{}: {}", self.span, self.message),
|
||||||
|
};
|
||||||
|
for frame in self.frames.iter().rev() {
|
||||||
|
if let Some(site) = &frame.call_site {
|
||||||
|
let file = site
|
||||||
|
.source
|
||||||
|
.path
|
||||||
|
.as_ref()
|
||||||
|
.map(|p| display_path(p))
|
||||||
|
.unwrap_or_else(|| "<unknown>".into());
|
||||||
|
message.push_str(&format!(
|
||||||
|
"\n called {} from {}:{}",
|
||||||
|
frame.function, file, site.span
|
||||||
|
));
|
||||||
|
}
|
||||||
}
|
}
|
||||||
|
message
|
||||||
}
|
}
|
||||||
|
|
||||||
/// Machine-readable form(AI/MLSP 面;`run --json` 出口)。
|
/// Machine-readable form(AI/MLSP 面;`run --json` 出口)。
|
||||||
@@ -153,6 +236,8 @@ impl Diagnostic {
|
|||||||
"line": self.span.line,
|
"line": self.span.line,
|
||||||
"col": self.span.col,
|
"col": self.span.col,
|
||||||
},
|
},
|
||||||
|
"source_sha256": self.source_sha256,
|
||||||
|
"frames": self.frames.iter().map(DiagnosticFrame::to_json).collect::<Vec<_>>(),
|
||||||
"doc_anchor": self.doc_anchor,
|
"doc_anchor": self.doc_anchor,
|
||||||
"doc_quote": self.doc_quote,
|
"doc_quote": self.doc_quote,
|
||||||
"contract_ref": self.contract_ref.as_ref().map(|c| json!({
|
"contract_ref": self.contract_ref.as_ref().map(|c| json!({
|
||||||
|
|||||||
File diff suppressed because it is too large.
Load diff
+25
-6
@@ -220,6 +220,8 @@ pub enum HostFn {
|
|||||||
ForeignSessionInterrupt = 211,
|
ForeignSessionInterrupt = 211,
|
||||||
/// `<TAB>` M7: `access(集合, 键)` — polymorphic collection access (legacy index).
|
/// `<TAB>` M7: `access(集合, 键)` — polymorphic collection access (legacy index).
|
||||||
Access = 212,
|
Access = 212,
|
||||||
|
OracleJournal = 213,
|
||||||
|
OracleReplayCheck = 214,
|
||||||
}
|
}
|
||||||
|
|
||||||
/// Single source of truth for every host function. `<TAB>` slimming
|
/// Single source of truth for every host function. `<TAB>` slimming
|
||||||
@@ -438,6 +440,8 @@ pub const HOST_FN_TABLE: &[HostFnDef] = &[
|
|||||||
HostFnDef { id: 210, f: HostFn::ForeignSessionList, name: "host_foreign_session_list", required: &[], optional: &[] },
|
HostFnDef { id: 210, f: HostFn::ForeignSessionList, name: "host_foreign_session_list", required: &[], optional: &[] },
|
||||||
HostFnDef { id: 211, f: HostFn::ForeignSessionInterrupt, name: "host_foreign_session_interrupt", required: &["id"], optional: &[] },
|
HostFnDef { id: 211, f: HostFn::ForeignSessionInterrupt, name: "host_foreign_session_interrupt", required: &["id"], optional: &[] },
|
||||||
HostFnDef { id: 212, f: HostFn::Access, name: "host_access", required: &["value", "key"], optional: &[] },
|
HostFnDef { id: 212, f: HostFn::Access, name: "host_access", required: &["value", "key"], optional: &[] },
|
||||||
|
HostFnDef { id: 213, f: HostFn::OracleJournal, name: "host_oracle_journal", required: &[], optional: &[] },
|
||||||
|
HostFnDef { id: 214, f: HostFn::OracleReplayCheck, name: "host_oracle_replay_check", required: &["expected", "observed"], optional: &[] },
|
||||||
];
|
];
|
||||||
|
|
||||||
|
|
||||||
@@ -466,6 +470,8 @@ impl HostFn {
|
|||||||
"host_cwd" => Self::Cwd,
|
"host_cwd" => Self::Cwd,
|
||||||
"host_exit" => Self::Exit,
|
"host_exit" => Self::Exit,
|
||||||
"host_exec" => Self::Exec,
|
"host_exec" => Self::Exec,
|
||||||
|
"host_oracle_journal" => Self::OracleJournal,
|
||||||
|
"host_oracle_replay_check" => Self::OracleReplayCheck,
|
||||||
"host_json_parse" => Self::JsonParse,
|
"host_json_parse" => Self::JsonParse,
|
||||||
"host_json_stringify" => Self::JsonStringify,
|
"host_json_stringify" => Self::JsonStringify,
|
||||||
"host_json_get" => Self::JsonGet,
|
"host_json_get" => Self::JsonGet,
|
||||||
@@ -748,7 +754,13 @@ pub fn call_host(
|
|||||||
bound.get("args"),
|
bound.get("args"),
|
||||||
bound.get("capture"),
|
bound.get("capture"),
|
||||||
),
|
),
|
||||||
HostFn::JsonParse => json::parse(require(bound, "text")?),
|
HostFn::OracleJournal => Ok(Value::List(ctx.oracle_observations.clone())),
|
||||||
|
HostFn::OracleReplayCheck => super::oracle::replay_check(require(bound, "expected")?, require(bound, "observed")?),
|
||||||
|
HostFn::JsonParse => {
|
||||||
|
let value = json::parse(require(bound, "text")?)?;
|
||||||
|
super::oracle::append(ctx, "decode", &value)?;
|
||||||
|
Ok(value)
|
||||||
|
},
|
||||||
HostFn::JsonStringify => {
|
HostFn::JsonStringify => {
|
||||||
json::stringify(require(bound, "value")?, bound.get("indent"))
|
json::stringify(require(bound, "value")?, bound.get("indent"))
|
||||||
}
|
}
|
||||||
@@ -1127,7 +1139,7 @@ pub fn call_host(
|
|||||||
HostFn::ForeignSessionEval => {
|
HostFn::ForeignSessionEval => {
|
||||||
#[cfg(feature = "exec-host")]
|
#[cfg(feature = "exec-host")]
|
||||||
{
|
{
|
||||||
crate::host::foreign_session::eval_with_stdin(
|
let record = crate::host::foreign_session::eval_with_stdin(
|
||||||
ctx,
|
ctx,
|
||||||
require(bound, "id")?,
|
require(bound, "id")?,
|
||||||
bound.get("code"),
|
bound.get("code"),
|
||||||
@@ -1135,7 +1147,10 @@ pub fn call_host(
|
|||||||
bound.get("input"),
|
bound.get("input"),
|
||||||
bound.get("stdin").and_then(|v| v.reveal_text()),
|
bound.get("stdin").and_then(|v| v.reveal_text()),
|
||||||
bound.get("timeout"),
|
bound.get("timeout"),
|
||||||
)
|
)?;
|
||||||
|
let value = super::oracle::eval_observation(&record)?;
|
||||||
|
super::oracle::append(ctx, "eval", &value)?;
|
||||||
|
Ok(record)
|
||||||
}
|
}
|
||||||
#[cfg(not(feature = "exec-host"))]
|
#[cfg(not(feature = "exec-host"))]
|
||||||
{
|
{
|
||||||
@@ -1162,11 +1177,13 @@ pub fn call_host(
|
|||||||
HostFn::ForeignSessionGet => {
|
HostFn::ForeignSessionGet => {
|
||||||
#[cfg(feature = "exec-host")]
|
#[cfg(feature = "exec-host")]
|
||||||
{
|
{
|
||||||
crate::host::foreign_session::get(
|
let value = crate::host::foreign_session::get(
|
||||||
ctx,
|
ctx,
|
||||||
require(bound, "id")?,
|
require(bound, "id")?,
|
||||||
require(bound, "name")?,
|
require(bound, "name")?,
|
||||||
)
|
)?;
|
||||||
|
super::oracle::append(ctx, "get", &value)?;
|
||||||
|
Ok(value)
|
||||||
}
|
}
|
||||||
#[cfg(not(feature = "exec-host"))]
|
#[cfg(not(feature = "exec-host"))]
|
||||||
{
|
{
|
||||||
@@ -1177,7 +1194,9 @@ pub fn call_host(
|
|||||||
HostFn::ForeignSessionNames => {
|
HostFn::ForeignSessionNames => {
|
||||||
#[cfg(feature = "exec-host")]
|
#[cfg(feature = "exec-host")]
|
||||||
{
|
{
|
||||||
crate::host::foreign_session::names(ctx, require(bound, "id")?)
|
let value = crate::host::foreign_session::names(ctx, require(bound, "id")?)?;
|
||||||
|
super::oracle::append(ctx, "decode", &value)?;
|
||||||
|
Ok(value)
|
||||||
}
|
}
|
||||||
#[cfg(not(feature = "exec-host"))]
|
#[cfg(not(feature = "exec-host"))]
|
||||||
{
|
{
|
||||||
|
|||||||
+54
-55
@@ -15,7 +15,7 @@ use std::time::{Duration, Instant, SystemTime, UNIX_EPOCH};
|
|||||||
|
|
||||||
use crate::foreign::registry::{self, LangSpec};
|
use crate::foreign::registry::{self, LangSpec};
|
||||||
use crate::foreign::split_cmd_line;
|
use crate::foreign::split_cmd_line;
|
||||||
use crate::host::json::{json_to_value, value_to_json};
|
use crate::host::json::value_to_json;
|
||||||
use crate::host::{HostCaps, HostContext};
|
use crate::host::{HostCaps, HostContext};
|
||||||
use crate::value::{CodeBlock, Value};
|
use crate::value::{CodeBlock, Value};
|
||||||
|
|
||||||
@@ -158,6 +158,7 @@ pub(crate) struct Execution {
|
|||||||
pub lang: String,
|
pub lang: String,
|
||||||
pub cmd: String,
|
pub cmd: String,
|
||||||
pub script: String,
|
pub script: String,
|
||||||
|
pub diagnostic_source: String,
|
||||||
}
|
}
|
||||||
|
|
||||||
impl Execution {
|
impl Execution {
|
||||||
@@ -180,6 +181,7 @@ impl Execution {
|
|||||||
("result_error".into(), Value::Text(result_error)),
|
("result_error".into(), Value::Text(result_error)),
|
||||||
("error".into(), Value::Text(self.error.clone())),
|
("error".into(), Value::Text(self.error.clone())),
|
||||||
("script".into(), Value::Text(self.script.clone())),
|
("script".into(), Value::Text(self.script.clone())),
|
||||||
|
("diagnostic_source".into(), Value::Text(self.diagnostic_source.clone())),
|
||||||
("cached".into(), Value::Bool(false)),
|
("cached".into(), Value::Bool(false)),
|
||||||
])
|
])
|
||||||
}
|
}
|
||||||
@@ -588,10 +590,11 @@ fn prepare_invoke(args: &InvokeArgs<'_>) -> Result<PreparedInvoke, String> {
|
|||||||
let stdin = opt_text(args.stdin)?;
|
let stdin = opt_text(args.stdin)?;
|
||||||
let input_json = match args.input {
|
let input_json = match args.input {
|
||||||
None | Some(Value::None) => None,
|
None | Some(Value::None) => None,
|
||||||
Some(v) => Some(
|
Some(v) => {
|
||||||
serde_json::to_string(&value_to_json(v)?)
|
super::oracle::admit(v)?;
|
||||||
.map_err(|e| format!("input JSON encode: {e}"))?,
|
Some(serde_json::to_string(&value_to_json(v)?)
|
||||||
),
|
.map_err(|e| format!("input JSON encode: {e}"))?)
|
||||||
|
},
|
||||||
};
|
};
|
||||||
if stdin.is_some() && input_json.is_some() {
|
if stdin.is_some() && input_json.is_some() {
|
||||||
return Err("stdin and input are mutually exclusive".into());
|
return Err("stdin and input are mutually exclusive".into());
|
||||||
@@ -620,7 +623,7 @@ pub fn invoke(ctx: &mut HostContext, args: InvokeArgs<'_>) -> Result<Value, Stri
|
|||||||
ensure_config(ctx);
|
ensure_config(ctx);
|
||||||
let prepared = prepare_invoke(&args)?;
|
let prepared = prepare_invoke(&args)?;
|
||||||
let exec = execute_job(ctx, &prepared.job)?;
|
let exec = execute_job(ctx, &prepared.job)?;
|
||||||
let (result, result_error) = parse_output(&exec.stdout, &prepared.output);
|
let (result, result_error) = parse_output(&exec.stdout, &prepared.output)?;
|
||||||
Ok(exec.record(result, result_error))
|
Ok(exec.record(result, result_error))
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -636,13 +639,10 @@ pub fn call(ctx: &mut HostContext, args: InvokeArgs<'_>) -> Result<Value, String
|
|||||||
if exec.stdout.trim().is_empty() {
|
if exec.stdout.trim().is_empty() {
|
||||||
return Ok(Value::None);
|
return Ok(Value::None);
|
||||||
}
|
}
|
||||||
match serde_json::from_str::<serde_json::Value>(&exec.stdout) {
|
super::json::decode_text(&exec.stdout).map_err(|e| match e {
|
||||||
Ok(j) => json_to_value(&j),
|
super::json::DecodeError::Domain(e) => e,
|
||||||
Err(e) => Err(format!(
|
super::json::DecodeError::Syntax(e) => format!("foreign call: stdout is not JSON: {e}; stdout: {}", tail(exec.stdout.trim(), 512)),
|
||||||
"foreign call: stdout is not JSON: {e}; stdout: {}",
|
})
|
||||||
tail(exec.stdout.trim(), 512)
|
|
||||||
)),
|
|
||||||
}
|
|
||||||
}
|
}
|
||||||
|
|
||||||
fn present(v: Option<&Value>) -> Option<&Value> {
|
fn present(v: Option<&Value>) -> Option<&Value> {
|
||||||
@@ -752,17 +752,18 @@ fn error_record(ctx: &HostContext, job: &Job, error: String) -> Value {
|
|||||||
lang: job.lang.clone(),
|
lang: job.lang.clone(),
|
||||||
cmd: display_for_job(ctx, job, None),
|
cmd: display_for_job(ctx, job, None),
|
||||||
script: String::new(),
|
script: String::new(),
|
||||||
|
diagnostic_source: String::new(),
|
||||||
}
|
}
|
||||||
.record(Value::None, String::new())
|
.record(Value::None, String::new())
|
||||||
}
|
}
|
||||||
|
|
||||||
fn run_prepared(env: &ForeignEnv, items: Vec<PreparedMany>, concurrency: usize) -> Vec<(usize, Value)> {
|
fn run_prepared(env: &ForeignEnv, items: Vec<PreparedMany>, concurrency: usize) -> Result<Vec<(usize, Value)>, String> {
|
||||||
if items.is_empty() {
|
if items.is_empty() {
|
||||||
return Vec::new();
|
return Ok(Vec::new());
|
||||||
}
|
}
|
||||||
let workers = concurrency.max(1).min(items.len());
|
let workers = concurrency.max(1).min(items.len());
|
||||||
let queue = Arc::new(Mutex::new(VecDeque::from(items)));
|
let queue = Arc::new(Mutex::new(VecDeque::from(items)));
|
||||||
let results: Arc<Mutex<Vec<(usize, Value)>>> = Arc::new(Mutex::new(Vec::new()));
|
let results: Arc<Mutex<Vec<(usize, Result<Value, String>)>>> = Arc::new(Mutex::new(Vec::new()));
|
||||||
thread::scope(|scope| {
|
thread::scope(|scope| {
|
||||||
for _ in 0..workers {
|
for _ in 0..workers {
|
||||||
let queue = Arc::clone(&queue);
|
let queue = Arc::clone(&queue);
|
||||||
@@ -782,11 +783,10 @@ fn run_prepared(env: &ForeignEnv, items: Vec<PreparedMany>, concurrency: usize)
|
|||||||
execute_job(&ctx, &item.job)
|
execute_job(&ctx, &item.job)
|
||||||
})) {
|
})) {
|
||||||
Ok(Ok(exec)) => {
|
Ok(Ok(exec)) => {
|
||||||
let (result, result_error) = parse_output(&exec.stdout, &item.output);
|
parse_output(&exec.stdout, &item.output).map(|(result, error)| exec.record(result, error))
|
||||||
exec.record(result, result_error)
|
|
||||||
}
|
}
|
||||||
Ok(Err(e)) => error_record(&ctx, &item.job, e),
|
Ok(Err(e)) => Ok(error_record(&ctx, &item.job, e)),
|
||||||
Err(_) => error_record(&ctx, &item.job, "foreign worker panicked".into()),
|
Err(_) => Ok(error_record(&ctx, &item.job, "foreign worker panicked".into())),
|
||||||
};
|
};
|
||||||
if let Ok(mut out) = results.lock() {
|
if let Ok(mut out) = results.lock() {
|
||||||
out.push((item.idx, value));
|
out.push((item.idx, value));
|
||||||
@@ -799,7 +799,7 @@ fn run_prepared(env: &ForeignEnv, items: Vec<PreparedMany>, concurrency: usize)
|
|||||||
Err(shared) => shared.lock().map(|m| m.clone()).unwrap_or_default(),
|
Err(shared) => shared.lock().map(|m| m.clone()).unwrap_or_default(),
|
||||||
};
|
};
|
||||||
out.sort_by_key(|(i, _)| *i);
|
out.sort_by_key(|(i, _)| *i);
|
||||||
out
|
out.into_iter().map(|(i, result)| result.map(|value| (i, value)).map_err(|e| format!("foreign[{i}]: {e}"))).collect()
|
||||||
}
|
}
|
||||||
|
|
||||||
/// Build a prepared job for one `runs` item (code value or option map).
|
/// Build a prepared job for one `runs` item (code value or option map).
|
||||||
@@ -851,7 +851,7 @@ pub fn run_many(
|
|||||||
requested
|
requested
|
||||||
};
|
};
|
||||||
let env = ForeignEnv::from_ctx(ctx);
|
let env = ForeignEnv::from_ctx(ctx);
|
||||||
let results = run_prepared(&env, prepared, concurrency);
|
let results = run_prepared(&env, prepared, concurrency)?;
|
||||||
Ok(Value::List(results.into_iter().map(|(_, v)| v).collect()))
|
Ok(Value::List(results.into_iter().map(|(_, v)| v).collect()))
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -879,6 +879,7 @@ pub fn call_many(
|
|||||||
};
|
};
|
||||||
let mut prepared = Vec::with_capacity(n);
|
let mut prepared = Vec::with_capacity(n);
|
||||||
for (idx, input) in list.iter().enumerate() {
|
for (idx, input) in list.iter().enumerate() {
|
||||||
|
super::oracle::admit(input)?;
|
||||||
let json = serde_json::to_string(&value_to_json(input)?)
|
let json = serde_json::to_string(&value_to_json(input)?)
|
||||||
.map_err(|e| format!("call_many input JSON encode: {e}"))?;
|
.map_err(|e| format!("call_many input JSON encode: {e}"))?;
|
||||||
let mut job = base.job.clone();
|
let mut job = base.job.clone();
|
||||||
@@ -891,7 +892,7 @@ pub fn call_many(
|
|||||||
});
|
});
|
||||||
}
|
}
|
||||||
let env = ForeignEnv::from_ctx(ctx);
|
let env = ForeignEnv::from_ctx(ctx);
|
||||||
let records = run_prepared(&env, prepared, concurrency);
|
let records = run_prepared(&env, prepared, concurrency)?;
|
||||||
let mut results = Vec::with_capacity(records.len());
|
let mut results = Vec::with_capacity(records.len());
|
||||||
let mut errors = Vec::new();
|
let mut errors = Vec::new();
|
||||||
for (idx, record) in records {
|
for (idx, record) in records {
|
||||||
@@ -936,34 +937,15 @@ fn resolve_invoke_source(args: &InvokeArgs<'_>) -> Result<(String, String), Stri
|
|||||||
))
|
))
|
||||||
}
|
}
|
||||||
|
|
||||||
fn parse_output(stdout: &str, mode: &str) -> (Value, String) {
|
fn parse_output(stdout: &str, mode: &str) -> Result<(Value, String), String> {
|
||||||
match mode {
|
if mode == "text" { return Ok((Value::None, String::new())); }
|
||||||
"text" => (Value::None, String::new()),
|
if mode == "lines" { return Ok((Value::List(stdout.lines().map(|s| Value::Text(s.into())).collect()), String::new())); }
|
||||||
"lines" => (
|
if stdout.trim().is_empty() { return Ok((Value::None, String::new())); }
|
||||||
Value::List(stdout.lines().map(|l| Value::Text(l.to_string())).collect()),
|
match super::json::decode_text(stdout) {
|
||||||
String::new(),
|
Ok(v) => Ok((v, String::new())),
|
||||||
),
|
Err(super::json::DecodeError::Domain(e)) => Err(e),
|
||||||
"json" => {
|
Err(super::json::DecodeError::Syntax(e)) if mode == "json" => Ok((Value::None, format!("stdout is not JSON: {e}"))),
|
||||||
if stdout.trim().is_empty() {
|
Err(super::json::DecodeError::Syntax(_)) => Ok((Value::None, String::new())),
|
||||||
return (Value::None, String::new());
|
|
||||||
}
|
|
||||||
match serde_json::from_str::<serde_json::Value>(stdout) {
|
|
||||||
Ok(j) => match json_to_value(&j) {
|
|
||||||
Ok(v) => (v, String::new()),
|
|
||||||
Err(e) => (Value::None, e),
|
|
||||||
},
|
|
||||||
Err(e) => (Value::None, format!("stdout is not JSON: {e}")),
|
|
||||||
}
|
|
||||||
}
|
|
||||||
_ => {
|
|
||||||
if stdout.trim().is_empty() {
|
|
||||||
return (Value::None, String::new());
|
|
||||||
}
|
|
||||||
match serde_json::from_str::<serde_json::Value>(stdout) {
|
|
||||||
Ok(j) => (json_to_value(&j).unwrap_or(Value::None), String::new()),
|
|
||||||
Err(_) => (Value::None, String::new()),
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -1734,6 +1716,7 @@ fn execute_job(ctx: &HostContext, job: &Job) -> Result<Execution, String> {
|
|||||||
lang: job.lang.clone(),
|
lang: job.lang.clone(),
|
||||||
cmd: display_for_job(ctx, job, None),
|
cmd: display_for_job(ctx, job, None),
|
||||||
script: String::new(),
|
script: String::new(),
|
||||||
|
diagnostic_source: String::new(),
|
||||||
});
|
});
|
||||||
}
|
}
|
||||||
};
|
};
|
||||||
@@ -1803,6 +1786,7 @@ fn execute_job(ctx: &HostContext, job: &Job) -> Result<Execution, String> {
|
|||||||
lang: job.lang.clone(),
|
lang: job.lang.clone(),
|
||||||
cmd,
|
cmd,
|
||||||
script: script_keep,
|
script: script_keep,
|
||||||
|
diagnostic_source: script_path.display().to_string(),
|
||||||
})
|
})
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -1837,7 +1821,7 @@ pub fn invoke_for_view(
|
|||||||
cmd_override: cmd_override.map(str::to_string),
|
cmd_override: cmd_override.map(str::to_string),
|
||||||
};
|
};
|
||||||
let exec = execute_job(&ctx, &job)?;
|
let exec = execute_job(&ctx, &job)?;
|
||||||
let (result, result_error) = parse_output(&exec.stdout, "auto");
|
let (result, result_error) = parse_output(&exec.stdout, "auto")?;
|
||||||
Ok(exec.record(result, result_error))
|
Ok(exec.record(result, result_error))
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -1886,13 +1870,13 @@ mod tests {
|
|||||||
|
|
||||||
#[test]
|
#[test]
|
||||||
fn output_modes() {
|
fn output_modes() {
|
||||||
let (v, e) = parse_output("42", "auto");
|
let (v, e) = parse_output("42", "auto").unwrap();
|
||||||
assert!(e.is_empty());
|
assert!(e.is_empty());
|
||||||
assert_eq!(v, Value::Int(42));
|
assert_eq!(v, Value::Int(42));
|
||||||
let (v, e) = parse_output("a\nb\n", "lines");
|
let (v, e) = parse_output("a\nb\n", "lines").unwrap();
|
||||||
assert!(e.is_empty());
|
assert!(e.is_empty());
|
||||||
assert_eq!(v, Value::List(vec![Value::Text("a".into()), Value::Text("b".into())]));
|
assert_eq!(v, Value::List(vec![Value::Text("a".into()), Value::Text("b".into())]));
|
||||||
let (v, e) = parse_output("not json", "json");
|
let (v, e) = parse_output("not json", "json").unwrap();
|
||||||
assert!(v == Value::None);
|
assert!(v == Value::None);
|
||||||
assert!(!e.is_empty());
|
assert!(!e.is_empty());
|
||||||
}
|
}
|
||||||
@@ -1965,4 +1949,19 @@ mod tests {
|
|||||||
assert_eq!(map_get(&records[1], "ok"), Some(&Value::Bool(false)));
|
assert_eq!(map_get(&records[1], "ok"), Some(&Value::Bool(false)));
|
||||||
assert_eq!(map_get(&records[2], "stdout").and_then(|v| v.reveal_text()), Some("c\n"));
|
assert_eq!(map_get(&records[2], "stdout").and_then(|v| v.reveal_text()), Some("c\n"));
|
||||||
}
|
}
|
||||||
|
#[test]
|
||||||
|
fn structured_output_domain_errors_are_not_none_or_success_records() {
|
||||||
|
for mode in ["auto", "json"] {
|
||||||
|
for bad in ["9007199254740992", "9.007199254740992e15", "1e9999", r#"{"x":1,"x":2}"#, r#"{"a":[],"b":[1]}"#] {
|
||||||
|
assert!(parse_output(bad, mode).is_err(), "{mode}: {bad}");
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let ctx = HostContext::default();
|
||||||
|
let env = ForeignEnv::from_ctx(&ctx);
|
||||||
|
let items = (0..2).map(|idx| PreparedMany {
|
||||||
|
idx, job: Job::simple("python", "print('{\"x\":1,\"x\":2}')", None), output: "auto".into(),
|
||||||
|
}).collect();
|
||||||
|
assert!(run_prepared(&env, items, 2).unwrap_err().contains("duplicate"));
|
||||||
|
}
|
||||||
|
|
||||||
}
|
}
|
||||||
+583
-100
File diff suppressed because it is too large.
Load diff
@@ -0,0 +1,174 @@
|
|||||||
|
//! Concurrent control inputs are scoped to a single recorded document action.
|
||||||
|
//! Replay supplies their elapsed-time inputs, reobserves acceptance, and stops
|
||||||
|
//! on divergence; elapsed wall time is not a deterministic foreign-state oracle.
|
||||||
|
use crate::host::foreign_session::InterruptHandle;
|
||||||
|
use crate::value::Value;
|
||||||
|
use std::collections::BTreeMap;
|
||||||
|
use std::sync::{Arc, Condvar, Mutex};
|
||||||
|
use std::thread::JoinHandle;
|
||||||
|
use std::time::{Duration, Instant};
|
||||||
|
|
||||||
|
#[derive(Clone, Debug, PartialEq)]
|
||||||
|
pub(super) struct ControlEvent {
|
||||||
|
pub after_us: u64,
|
||||||
|
pub results: Vec<(String, Result<bool, String>)>,
|
||||||
|
}
|
||||||
|
impl ControlEvent {
|
||||||
|
pub fn value(&self) -> Value {
|
||||||
|
Value::Map(vec![
|
||||||
|
("after_us".into(), Value::Int(self.after_us as i64)),
|
||||||
|
(
|
||||||
|
"results".into(),
|
||||||
|
Value::List(
|
||||||
|
self.results
|
||||||
|
.iter()
|
||||||
|
.map(|(name, result)| {
|
||||||
|
Value::Map(vec![
|
||||||
|
("kernel".into(), Value::Text(name.clone())),
|
||||||
|
("accepted".into(), Value::Bool(result.is_ok())),
|
||||||
|
("active".into(), Value::Bool(matches!(result, Ok(true)))),
|
||||||
|
(
|
||||||
|
"error".into(),
|
||||||
|
Value::Text(result.as_ref().err().cloned().unwrap_or_default()),
|
||||||
|
),
|
||||||
|
])
|
||||||
|
})
|
||||||
|
.collect(),
|
||||||
|
),
|
||||||
|
),
|
||||||
|
])
|
||||||
|
}
|
||||||
|
}
|
||||||
|
#[derive(Default, Debug)]
|
||||||
|
struct State {
|
||||||
|
kernels: BTreeMap<String, InterruptHandle>,
|
||||||
|
generation: u64,
|
||||||
|
action: Option<(Instant, Vec<ControlEvent>)>,
|
||||||
|
}
|
||||||
|
#[derive(Default, Debug)]
|
||||||
|
struct Shared {
|
||||||
|
state: Mutex<State>,
|
||||||
|
changed: Condvar,
|
||||||
|
}
|
||||||
|
#[derive(Clone, Default, Debug)]
|
||||||
|
pub struct DocumentControl(Arc<Shared>);
|
||||||
|
|
||||||
|
impl DocumentControl {
|
||||||
|
pub(super) fn cancelled(&self) -> bool {
|
||||||
|
self.0
|
||||||
|
.state
|
||||||
|
.lock()
|
||||||
|
.unwrap()
|
||||||
|
.action
|
||||||
|
.as_ref()
|
||||||
|
.is_some_and(|(_, events)| !events.is_empty())
|
||||||
|
}
|
||||||
|
pub(super) fn register(&self, kernel: &str, handle: InterruptHandle) {
|
||||||
|
self.0
|
||||||
|
.state
|
||||||
|
.lock()
|
||||||
|
.unwrap()
|
||||||
|
.kernels
|
||||||
|
.insert(kernel.into(), handle);
|
||||||
|
}
|
||||||
|
pub(super) fn begin(&self, plan: Vec<ControlEvent>) -> Option<JoinHandle<()>> {
|
||||||
|
let generation = {
|
||||||
|
let mut state = self.0.state.lock().unwrap();
|
||||||
|
state.generation += 1;
|
||||||
|
state.action = Some((Instant::now(), Vec::new()));
|
||||||
|
state.generation
|
||||||
|
};
|
||||||
|
if plan.is_empty() {
|
||||||
|
return None;
|
||||||
|
}
|
||||||
|
let controller = self.clone();
|
||||||
|
Some(std::thread::spawn(move || {
|
||||||
|
for event in plan {
|
||||||
|
let mut state = controller.0.state.lock().unwrap();
|
||||||
|
loop {
|
||||||
|
if state.generation != generation || state.action.is_none() {
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
let elapsed = state.action.as_ref().unwrap().0.elapsed();
|
||||||
|
let remaining = Duration::from_micros(event.after_us).saturating_sub(elapsed);
|
||||||
|
if remaining.is_zero() {
|
||||||
|
break;
|
||||||
|
}
|
||||||
|
state = controller
|
||||||
|
.0
|
||||||
|
.changed
|
||||||
|
.wait_timeout(state, remaining.min(Duration::from_millis(200)))
|
||||||
|
.unwrap()
|
||||||
|
.0;
|
||||||
|
}
|
||||||
|
// Keep the action-generation check and signal under one lock.
|
||||||
|
let _ = Self::request_locked(&mut state, Some(event.after_us));
|
||||||
|
}
|
||||||
|
}))
|
||||||
|
}
|
||||||
|
pub(super) fn finish(&self, scheduler: Option<JoinHandle<()>>) -> Vec<ControlEvent> {
|
||||||
|
let events = self
|
||||||
|
.0
|
||||||
|
.state
|
||||||
|
.lock()
|
||||||
|
.unwrap()
|
||||||
|
.action
|
||||||
|
.take()
|
||||||
|
.map(|(_, events)| events)
|
||||||
|
.unwrap_or_default();
|
||||||
|
self.0.changed.notify_all();
|
||||||
|
if let Some(scheduler) = scheduler {
|
||||||
|
let _ = scheduler.join();
|
||||||
|
}
|
||||||
|
events
|
||||||
|
}
|
||||||
|
pub fn interrupt(&self) -> Result<Value, String> {
|
||||||
|
let mut state = self
|
||||||
|
.0
|
||||||
|
.state
|
||||||
|
.lock()
|
||||||
|
.map_err(|_| "document control lock poisoned")?;
|
||||||
|
Self::request_locked(&mut state, None).map(|event| event.value())
|
||||||
|
}
|
||||||
|
fn request_locked(
|
||||||
|
state: &mut State,
|
||||||
|
scheduled_us: Option<u64>,
|
||||||
|
) -> Result<ControlEvent, String> {
|
||||||
|
let start = state
|
||||||
|
.action
|
||||||
|
.as_ref()
|
||||||
|
.ok_or("no document action in flight")?
|
||||||
|
.0;
|
||||||
|
let after_us = scheduled_us
|
||||||
|
.unwrap_or_else(|| start.elapsed().as_micros().min(i64::MAX as u128) as u64);
|
||||||
|
let results = state
|
||||||
|
.kernels
|
||||||
|
.iter()
|
||||||
|
.filter(|(_, handle)| handle.is_live())
|
||||||
|
.map(|(name, handle)| (name.clone(), handle.request()))
|
||||||
|
.collect();
|
||||||
|
let event = ControlEvent { after_us, results };
|
||||||
|
state.action.as_mut().unwrap().1.push(event.clone());
|
||||||
|
Ok(event)
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[cfg(test)]
|
||||||
|
mod tests {
|
||||||
|
use super::*;
|
||||||
|
#[test]
|
||||||
|
fn completed_action_cancels_pending_scheduler_before_next_generation() {
|
||||||
|
let controller = DocumentControl::default();
|
||||||
|
let scheduler = controller.begin(vec![ControlEvent {
|
||||||
|
after_us: 60_000_000,
|
||||||
|
results: Vec::new(),
|
||||||
|
}]);
|
||||||
|
let start = Instant::now();
|
||||||
|
assert!(controller.finish(scheduler).is_empty());
|
||||||
|
assert!(start.elapsed() < Duration::from_secs(1));
|
||||||
|
assert!(controller.interrupt().is_err());
|
||||||
|
let next = controller.begin(Vec::new());
|
||||||
|
assert!(!controller.cancelled());
|
||||||
|
assert!(controller.finish(next).is_empty());
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,399 @@
|
|||||||
|
//! Lossless, typed, bottom-up sharing for complete history snapshots.
|
||||||
|
//! References always point backwards. Expansion costs and depth are checked
|
||||||
|
//! before building the expanded value, so a small DAG cannot expand unboundedly.
|
||||||
|
use crate::host::{json::value_to_json, oracle::admit};
|
||||||
|
use crate::value::Value;
|
||||||
|
use sha2::{Digest, Sha256};
|
||||||
|
use std::collections::{HashMap, HashSet};
|
||||||
|
|
||||||
|
const FORMAT: &str = "marqdo.history.dag";
|
||||||
|
const MAX_NODES: usize = 1_000_000;
|
||||||
|
const MAX_VALUES: usize = 8_000_000;
|
||||||
|
const MAX_BYTES: usize = 512 * 1024 * 1024;
|
||||||
|
const MAX_DEPTH: usize = 128;
|
||||||
|
|
||||||
|
fn text(s: &str) -> Value {
|
||||||
|
Value::Text(s.into())
|
||||||
|
}
|
||||||
|
fn list(v: &Value) -> Result<&[Value], String> {
|
||||||
|
if let Value::List(v) = v {
|
||||||
|
Ok(v)
|
||||||
|
} else {
|
||||||
|
Err("snapshot DAG: expected list".into())
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn string(v: &Value) -> Result<&str, String> {
|
||||||
|
if let Value::Text(v) = v {
|
||||||
|
Ok(v)
|
||||||
|
} else {
|
||||||
|
Err("snapshot DAG: expected text".into())
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn field<'a>(v: &'a Value, key: &str) -> Result<&'a Value, String> {
|
||||||
|
if let Value::Map(fields) = v {
|
||||||
|
fields
|
||||||
|
.iter()
|
||||||
|
.find(|(k, _)| k == key)
|
||||||
|
.map(|(_, v)| v)
|
||||||
|
.ok_or_else(|| format!("snapshot DAG: missing {key}"))
|
||||||
|
} else {
|
||||||
|
Err("snapshot DAG: expected object".into())
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn wire(v: &Value) -> Result<String, String> {
|
||||||
|
serde_json::to_string(&value_to_json(v)?).map_err(|e| e.to_string())
|
||||||
|
}
|
||||||
|
fn checksum(root: &Value, nodes: &Value) -> Result<String, String> {
|
||||||
|
Ok(format!(
|
||||||
|
"{:x}",
|
||||||
|
Sha256::digest(wire(&Value::List(vec![root.clone(), nodes.clone()]))?.as_bytes())
|
||||||
|
))
|
||||||
|
}
|
||||||
|
pub fn is_packed(v: &Value) -> bool {
|
||||||
|
field(v, "format").ok() == Some(&text(FORMAT))
|
||||||
|
}
|
||||||
|
|
||||||
|
pub fn pack(snapshot: &Value) -> Result<Value, String> {
|
||||||
|
fn intern(
|
||||||
|
v: &Value,
|
||||||
|
nodes: &mut Vec<Value>,
|
||||||
|
seen: &mut HashMap<String, usize>,
|
||||||
|
depth: usize,
|
||||||
|
) -> Result<usize, String> {
|
||||||
|
if depth > MAX_DEPTH {
|
||||||
|
return Err("snapshot DAG: depth budget exceeded".into());
|
||||||
|
}
|
||||||
|
let row = match v {
|
||||||
|
Value::None => vec![text("null")],
|
||||||
|
Value::Bool(v) => vec![text("bool"), Value::Bool(*v)],
|
||||||
|
Value::Int(v) => vec![text("int"), text(&v.to_string())],
|
||||||
|
Value::Num(v) => vec![text("float"), text(&format!("{:016x}", v.to_bits()))],
|
||||||
|
Value::Text(v) => vec![text("text"), text(v)],
|
||||||
|
Value::List(values) => {
|
||||||
|
let refs = values
|
||||||
|
.iter()
|
||||||
|
.map(|v| intern(v, nodes, seen, depth + 1).map(|i| Value::Int(i as i64)))
|
||||||
|
.collect::<Result<Vec<_>, _>>()?;
|
||||||
|
vec![text("list"), Value::List(refs)]
|
||||||
|
}
|
||||||
|
Value::Map(fields) => {
|
||||||
|
let refs = fields
|
||||||
|
.iter()
|
||||||
|
.map(|(k, v)| {
|
||||||
|
intern(v, nodes, seen, depth + 1)
|
||||||
|
.map(|i| Value::List(vec![text(k), Value::Int(i as i64)]))
|
||||||
|
})
|
||||||
|
.collect::<Result<Vec<_>, _>>()?;
|
||||||
|
vec![text("map"), Value::List(refs)]
|
||||||
|
}
|
||||||
|
_ => return Err("snapshot DAG: value outside V_safe".into()),
|
||||||
|
};
|
||||||
|
let row = Value::List(row);
|
||||||
|
let key = wire(&row)?;
|
||||||
|
if let Some(index) = seen.get(&key) {
|
||||||
|
return Ok(*index);
|
||||||
|
}
|
||||||
|
if nodes.len() >= MAX_NODES {
|
||||||
|
return Err("snapshot DAG: node budget exceeded".into());
|
||||||
|
}
|
||||||
|
let index = nodes.len();
|
||||||
|
nodes.push(row);
|
||||||
|
seen.insert(key, index);
|
||||||
|
Ok(index)
|
||||||
|
}
|
||||||
|
let mut nodes = Vec::new();
|
||||||
|
let root = intern(snapshot, &mut nodes, &mut HashMap::new(), 0)?;
|
||||||
|
admit(snapshot)?;
|
||||||
|
let nodes = Value::List(nodes);
|
||||||
|
let root = Value::Int(root as i64);
|
||||||
|
let hash = checksum(&root, &nodes)?;
|
||||||
|
let envelope = Value::Map(vec![
|
||||||
|
("format".into(), text(FORMAT)),
|
||||||
|
("version".into(), Value::Int(1)),
|
||||||
|
("root".into(), root),
|
||||||
|
("nodes".into(), nodes),
|
||||||
|
("sha256".into(), text(&hash)),
|
||||||
|
]);
|
||||||
|
// Apply exactly the decoder's resource limits to locally produced envelopes.
|
||||||
|
validate(&envelope)?;
|
||||||
|
Ok(envelope)
|
||||||
|
}
|
||||||
|
|
||||||
|
enum Node {
|
||||||
|
Atom(Value),
|
||||||
|
List(Vec<usize>),
|
||||||
|
Map(Vec<(String, usize)>),
|
||||||
|
}
|
||||||
|
impl Node {
|
||||||
|
fn refs(&self) -> Vec<usize> {
|
||||||
|
match self {
|
||||||
|
Self::Atom(_) => Vec::new(),
|
||||||
|
Self::List(v) => v.clone(),
|
||||||
|
Self::Map(v) => v.iter().map(|(_, i)| *i).collect(),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn index(v: &Value, before: usize) -> Result<usize, String> {
|
||||||
|
match v {
|
||||||
|
Value::Int(i) if *i >= 0 && (*i as u64) < before as u64 => Ok(*i as usize),
|
||||||
|
_ => Err("snapshot DAG: forward/cyclic/out-of-range reference".into()),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn validate(envelope: &Value) -> Result<(Vec<Node>, usize), String> {
|
||||||
|
let Value::Map(fields) = envelope else {
|
||||||
|
return Err("snapshot DAG: expected envelope".into());
|
||||||
|
};
|
||||||
|
let names: HashSet<_> = fields.iter().map(|(k, _)| k.as_str()).collect();
|
||||||
|
if fields.len() != 5
|
||||||
|
|| names != HashSet::from(["format", "version", "root", "nodes", "sha256"])
|
||||||
|
|| string(field(envelope, "format")?)? != FORMAT
|
||||||
|
|| field(envelope, "version")? != &Value::Int(1)
|
||||||
|
{
|
||||||
|
return Err("snapshot DAG: invalid envelope schema".into());
|
||||||
|
}
|
||||||
|
let rows = list(field(envelope, "nodes")?)?;
|
||||||
|
if rows.is_empty() || rows.len() > MAX_NODES {
|
||||||
|
return Err("snapshot DAG: node budget exceeded".into());
|
||||||
|
}
|
||||||
|
let root = index(field(envelope, "root")?, rows.len())?;
|
||||||
|
if root + 1 != rows.len() {
|
||||||
|
return Err("snapshot DAG: root must be last".into());
|
||||||
|
}
|
||||||
|
let expected = string(field(envelope, "sha256")?)?;
|
||||||
|
if expected != checksum(field(envelope, "root")?, field(envelope, "nodes")?)? {
|
||||||
|
return Err("snapshot DAG: checksum differs".into());
|
||||||
|
}
|
||||||
|
let mut nodes = Vec::new();
|
||||||
|
let mut costs: Vec<(usize, usize, usize)> = Vec::new();
|
||||||
|
let mut unique = HashSet::new();
|
||||||
|
for (i, raw) in rows.iter().enumerate() {
|
||||||
|
if !unique.insert(wire(raw)?) {
|
||||||
|
return Err("snapshot DAG: duplicate dictionary node".into());
|
||||||
|
}
|
||||||
|
let row = list(raw)?;
|
||||||
|
let tag = string(row.first().ok_or("snapshot DAG: empty node")?)?;
|
||||||
|
let node = match (tag, row) {
|
||||||
|
("null", [_]) => Node::Atom(Value::None),
|
||||||
|
("bool", [_, Value::Bool(v)]) => Node::Atom(Value::Bool(*v)),
|
||||||
|
("text", [_, Value::Text(v)]) => Node::Atom(text(v)),
|
||||||
|
("int", [_, Value::Text(v)]) => {
|
||||||
|
let n = v
|
||||||
|
.parse::<i64>()
|
||||||
|
.map_err(|_| "snapshot DAG: invalid integer")?;
|
||||||
|
if n.to_string() != *v {
|
||||||
|
return Err("snapshot DAG: noncanonical integer".into());
|
||||||
|
}
|
||||||
|
Node::Atom(Value::Int(n))
|
||||||
|
}
|
||||||
|
("float", [_, Value::Text(v)]) if v.len() == 16 => {
|
||||||
|
let bits =
|
||||||
|
u64::from_str_radix(v, 16).map_err(|_| "snapshot DAG: invalid float bits")?;
|
||||||
|
if format!("{bits:016x}") != *v {
|
||||||
|
return Err("snapshot DAG: noncanonical float bits".into());
|
||||||
|
}
|
||||||
|
Node::Atom(Value::Num(f64::from_bits(bits)))
|
||||||
|
}
|
||||||
|
("list", [_, refs]) => Node::List(
|
||||||
|
list(refs)?
|
||||||
|
.iter()
|
||||||
|
.map(|v| index(v, i))
|
||||||
|
.collect::<Result<_, _>>()?,
|
||||||
|
),
|
||||||
|
("map", [_, refs]) => {
|
||||||
|
let mut keys = HashSet::new();
|
||||||
|
let mut fields = Vec::new();
|
||||||
|
for pair in list(refs)? {
|
||||||
|
let [key, value] = list(pair)? else {
|
||||||
|
return Err("snapshot DAG: invalid map pair".into());
|
||||||
|
};
|
||||||
|
let key = string(key)?;
|
||||||
|
if !keys.insert(key) {
|
||||||
|
return Err("snapshot DAG: duplicate map key".into());
|
||||||
|
}
|
||||||
|
fields.push((key.into(), index(value, i)?));
|
||||||
|
}
|
||||||
|
Node::Map(fields)
|
||||||
|
}
|
||||||
|
_ => return Err("snapshot DAG: invalid node tag/payload".into()),
|
||||||
|
};
|
||||||
|
let mut values = 1usize;
|
||||||
|
let mut bytes = match &node {
|
||||||
|
Node::Atom(v) => {
|
||||||
|
admit(v)?;
|
||||||
|
match v {
|
||||||
|
Value::Text(s) => s
|
||||||
|
.len()
|
||||||
|
.checked_mul(6)
|
||||||
|
.and_then(|n| n.checked_add(2))
|
||||||
|
.ok_or("snapshot DAG: size overflow")?,
|
||||||
|
_ => 32,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Node::Map(v) => v
|
||||||
|
.iter()
|
||||||
|
.try_fold(2usize, |n, (k, _)| {
|
||||||
|
n.checked_add(k.len().checked_mul(6)?.checked_add(4)?)
|
||||||
|
})
|
||||||
|
.ok_or("snapshot DAG: size overflow")?,
|
||||||
|
Node::List(_) => 2,
|
||||||
|
};
|
||||||
|
let mut depth = 1;
|
||||||
|
for reference in node.refs() {
|
||||||
|
let (count, size, height) = costs[reference];
|
||||||
|
values = values
|
||||||
|
.checked_add(count)
|
||||||
|
.ok_or("snapshot DAG: expansion overflow")?;
|
||||||
|
bytes = bytes
|
||||||
|
.checked_add(size)
|
||||||
|
.and_then(|n| n.checked_add(1))
|
||||||
|
.ok_or("snapshot DAG: expansion overflow")?;
|
||||||
|
depth = depth.max(height + 1);
|
||||||
|
}
|
||||||
|
if values > MAX_VALUES || bytes > MAX_BYTES || depth > MAX_DEPTH {
|
||||||
|
return Err("snapshot DAG: expansion budget exceeded".into());
|
||||||
|
}
|
||||||
|
costs.push((values, bytes, depth));
|
||||||
|
nodes.push(node);
|
||||||
|
}
|
||||||
|
let mut reachable = HashSet::new();
|
||||||
|
let mut todo = vec![root];
|
||||||
|
while let Some(i) = todo.pop() {
|
||||||
|
if reachable.insert(i) {
|
||||||
|
todo.extend(nodes[i].refs());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
if reachable.len() != nodes.len() {
|
||||||
|
return Err("snapshot DAG: unreachable dictionary node".into());
|
||||||
|
}
|
||||||
|
Ok((nodes, root))
|
||||||
|
}
|
||||||
|
|
||||||
|
pub fn unpack(envelope: &Value) -> Result<Value, String> {
|
||||||
|
fn expand(nodes: &[Node], i: usize) -> Value {
|
||||||
|
match &nodes[i] {
|
||||||
|
Node::Atom(v) => v.clone(),
|
||||||
|
Node::List(refs) => Value::List(refs.iter().map(|i| expand(nodes, *i)).collect()),
|
||||||
|
Node::Map(fields) => Value::Map(
|
||||||
|
fields
|
||||||
|
.iter()
|
||||||
|
.map(|(k, i)| (k.clone(), expand(nodes, *i)))
|
||||||
|
.collect(),
|
||||||
|
),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let (nodes, root) = validate(envelope)?;
|
||||||
|
let value = expand(&nodes, root);
|
||||||
|
admit(&value)?;
|
||||||
|
Ok(value)
|
||||||
|
}
|
||||||
|
|
||||||
|
#[cfg(test)]
|
||||||
|
mod tests {
|
||||||
|
use super::*;
|
||||||
|
fn envelope(rows: Vec<Value>) -> Value {
|
||||||
|
let root = Value::Int(rows.len() as i64 - 1);
|
||||||
|
let nodes = Value::List(rows);
|
||||||
|
let hash = checksum(&root, &nodes).unwrap();
|
||||||
|
Value::Map(vec![
|
||||||
|
("format".into(), text(FORMAT)),
|
||||||
|
("version".into(), Value::Int(1)),
|
||||||
|
("root".into(), root),
|
||||||
|
("nodes".into(), nodes),
|
||||||
|
("sha256".into(), text(&hash)),
|
||||||
|
])
|
||||||
|
}
|
||||||
|
fn row(tag: &str, value: Value) -> Value {
|
||||||
|
Value::List(vec![text(tag), value])
|
||||||
|
}
|
||||||
|
#[test]
|
||||||
|
fn typed_roundtrip_preserves_order_float_bits_and_repeated_values() {
|
||||||
|
let shared = Value::Map(vec![
|
||||||
|
(
|
||||||
|
"z".into(),
|
||||||
|
Value::List(vec![
|
||||||
|
Value::None,
|
||||||
|
Value::Bool(true),
|
||||||
|
Value::Int(1),
|
||||||
|
Value::Num(-0.0),
|
||||||
|
Value::Num(1.25),
|
||||||
|
]),
|
||||||
|
),
|
||||||
|
("汉字".into(), text("🧪")),
|
||||||
|
]);
|
||||||
|
let input = Value::List(vec![shared; 128]);
|
||||||
|
let packed = pack(&input).unwrap();
|
||||||
|
let decoded_wire =
|
||||||
|
crate::host::json::parse(&crate::host::json::stringify(&packed, None).unwrap())
|
||||||
|
.unwrap();
|
||||||
|
let expanded = unpack(&decoded_wire).unwrap();
|
||||||
|
assert_eq!(input, expanded);
|
||||||
|
assert_eq!(wire(&input).unwrap(), wire(&expanded).unwrap());
|
||||||
|
let Value::List(ref xs) = expanded else {
|
||||||
|
panic!()
|
||||||
|
};
|
||||||
|
let Value::Map(ref fields) = xs[0] else {
|
||||||
|
panic!()
|
||||||
|
};
|
||||||
|
assert_eq!(fields[0].0, "z");
|
||||||
|
let Value::List(ref values) = fields[0].1 else {
|
||||||
|
panic!()
|
||||||
|
};
|
||||||
|
let Value::Num(number) = values[3] else {
|
||||||
|
panic!()
|
||||||
|
};
|
||||||
|
assert_eq!(number.to_bits(), (-0.0f64).to_bits());
|
||||||
|
assert!(list(field(&packed, "nodes").unwrap()).unwrap().len() < 20);
|
||||||
|
assert!(wire(&packed).unwrap().len() < wire(&input).unwrap().len());
|
||||||
|
}
|
||||||
|
#[test]
|
||||||
|
fn refuses_cycles_amplification_unreachable_duplicates_and_unsafe_atoms() {
|
||||||
|
let bad = [
|
||||||
|
envelope(vec![row("list", Value::List(vec![Value::Int(0)]))]),
|
||||||
|
envelope(vec![row("text", text("unused")), row("text", text("root"))]),
|
||||||
|
envelope(vec![row("text", text("same")), row("text", text("same"))]),
|
||||||
|
envelope(vec![row("int", text("9007199254740992"))]),
|
||||||
|
envelope(vec![row("float", text("7ff8000000000000"))]),
|
||||||
|
envelope(vec![row("int", text("00"))]),
|
||||||
|
];
|
||||||
|
for value in bad {
|
||||||
|
assert!(unpack(&value).is_err());
|
||||||
|
}
|
||||||
|
let mut rows = vec![row("text", text("x"))];
|
||||||
|
for n in 0..40 {
|
||||||
|
rows.push(row("list", Value::List(vec![Value::Int(n), Value::Int(n)])));
|
||||||
|
}
|
||||||
|
let error = unpack(&envelope(rows)).unwrap_err();
|
||||||
|
assert!(error.contains("budget"), "{error}");
|
||||||
|
let mut hash = pack(&Value::Int(1)).unwrap();
|
||||||
|
if let Value::Map(ref mut fields) = hash {
|
||||||
|
fields.iter_mut().find(|(k, _)| k == "sha256").unwrap().1 = text("bad");
|
||||||
|
}
|
||||||
|
assert!(unpack(&hash).unwrap_err().contains("checksum"));
|
||||||
|
}
|
||||||
|
#[test]
|
||||||
|
fn sharing_does_not_admit_ragged_columns_or_duplicate_keys() {
|
||||||
|
let ragged = Value::Map(vec![
|
||||||
|
("a".into(), Value::List(vec![Value::Int(1)])),
|
||||||
|
("b".into(), Value::List(Vec::new())),
|
||||||
|
]);
|
||||||
|
assert!(pack(&ragged).is_err());
|
||||||
|
let duplicate = Value::Map(vec![
|
||||||
|
("a".into(), Value::Int(1)),
|
||||||
|
("a".into(), Value::Int(2)),
|
||||||
|
]);
|
||||||
|
assert!(pack(&duplicate).is_err());
|
||||||
|
let value = envelope(vec![
|
||||||
|
row("int", text("1")),
|
||||||
|
row("list", Value::List(vec![Value::Int(0)])),
|
||||||
|
row("list", Value::List(Vec::new())),
|
||||||
|
row(
|
||||||
|
"map",
|
||||||
|
Value::List(vec![
|
||||||
|
Value::List(vec![text("a"), Value::Int(1)]),
|
||||||
|
Value::List(vec![text("b"), Value::Int(2)]),
|
||||||
|
]),
|
||||||
|
),
|
||||||
|
]);
|
||||||
|
assert!(unpack(&value).is_err());
|
||||||
|
}
|
||||||
|
}
|
||||||
File diff suppressed because it is too large.
Load diff
+533
-42
@@ -16,15 +16,59 @@ use crate::host::json::{json_to_value, value_to_json};
|
|||||||
use crate::host::HostContext;
|
use crate::host::HostContext;
|
||||||
use crate::value::Value;
|
use crate::value::Value;
|
||||||
|
|
||||||
|
mod control;
|
||||||
|
pub mod validation;
|
||||||
|
pub use control::InterruptHandle;
|
||||||
|
|
||||||
const SESSION_TIMEOUT_SECS: f64 = 10.0;
|
const SESSION_TIMEOUT_SECS: f64 = 10.0;
|
||||||
const MAX_SESSION_TIMEOUT_SECS: f64 = 3600.0;
|
const MAX_SESSION_TIMEOUT_SECS: f64 = 3600.0;
|
||||||
const MAX_PROCESS_STDERR: usize = 1_048_576;
|
const MAX_PROCESS_STDERR: usize = 1_048_576;
|
||||||
|
|
||||||
const PY_BOOTSTRAP: &str = r#"import sys, json, io, ast, traceback, contextlib
|
const PY_BOOTSTRAP: &str = r#"import sys, json, io, ast, traceback, contextlib, math, signal
|
||||||
_out = sys.stdout
|
_out = sys.stdout
|
||||||
|
_MAX_SAFE = 9007199254740991
|
||||||
|
def _sanitize(o):
|
||||||
|
if o is None or isinstance(o, bool):
|
||||||
|
return o
|
||||||
|
if isinstance(o, int):
|
||||||
|
if abs(o) > _MAX_SAFE:
|
||||||
|
raise ValueError("json: integer outside V_safe (±(2^53-1)): %s" % o)
|
||||||
|
return o
|
||||||
|
if isinstance(o, float):
|
||||||
|
if not math.isfinite(o):
|
||||||
|
raise ValueError("json: non-finite number outside V_safe")
|
||||||
|
if o.is_integer() and abs(o) > _MAX_SAFE:
|
||||||
|
raise ValueError("json: integer outside V_safe (±(2^53-1)): %s" % o)
|
||||||
|
return o
|
||||||
|
if isinstance(o, str):
|
||||||
|
return o
|
||||||
|
if isinstance(o, (list, tuple)):
|
||||||
|
return [_sanitize(x) for x in o]
|
||||||
|
if isinstance(o, dict):
|
||||||
|
if any(not isinstance(k, str) for k in o):
|
||||||
|
raise TypeError("not JSON-safe: object keys must be strings")
|
||||||
|
return {k: _sanitize(v) for k, v in o.items()}
|
||||||
|
raise TypeError("not JSON-safe: %s" % type(o).__name__)
|
||||||
def _send(o):
|
def _send(o):
|
||||||
_out.write(json.dumps(o, ensure_ascii=False, default=str) + "\n")
|
try:
|
||||||
|
line = json.dumps(_sanitize(o), ensure_ascii=False)
|
||||||
|
except Exception as e:
|
||||||
|
rid = o.get("id") if isinstance(o, dict) else None
|
||||||
|
line = json.dumps({
|
||||||
|
"id": rid, "ok": False,
|
||||||
|
"stdout": (o.get("stdout") if isinstance(o, dict) else "") or "",
|
||||||
|
"stderr": (o.get("stderr") if isinstance(o, dict) else "") or "",
|
||||||
|
"result": None, "error": str(e), "domain_error": True,
|
||||||
|
}, ensure_ascii=False)
|
||||||
|
_out.write(line + "\n")
|
||||||
_out.flush()
|
_out.flush()
|
||||||
|
_busy = False
|
||||||
|
def _interrupt(signum, frame):
|
||||||
|
global _busy
|
||||||
|
if _busy:
|
||||||
|
_busy = False
|
||||||
|
raise KeyboardInterrupt
|
||||||
|
signal.signal(signal.SIGINT, _interrupt)
|
||||||
_g = {"__name__": "__main__", "marqdo_input": None}
|
_g = {"__name__": "__main__", "marqdo_input": None}
|
||||||
for _line in sys.stdin:
|
for _line in sys.stdin:
|
||||||
_line = _line.strip()
|
_line = _line.strip()
|
||||||
@@ -60,6 +104,8 @@ for _line in sys.stdin:
|
|||||||
_out_buf = io.StringIO()
|
_out_buf = io.StringIO()
|
||||||
_err_buf = io.StringIO()
|
_err_buf = io.StringIO()
|
||||||
try:
|
try:
|
||||||
|
_busy = True
|
||||||
|
_send({"id": rid, "phase": "ready"})
|
||||||
_tree = ast.parse(_code, "<marqdo>")
|
_tree = ast.parse(_code, "<marqdo>")
|
||||||
_result = None
|
_result = None
|
||||||
with contextlib.redirect_stdout(_out_buf), contextlib.redirect_stderr(_err_buf):
|
with contextlib.redirect_stdout(_out_buf), contextlib.redirect_stderr(_err_buf):
|
||||||
@@ -70,10 +116,13 @@ for _line in sys.stdin:
|
|||||||
_result = eval(compile(ast.Expression(_last.value), "<marqdo>", "eval"), _g)
|
_result = eval(compile(ast.Expression(_last.value), "<marqdo>", "eval"), _g)
|
||||||
else:
|
else:
|
||||||
exec(compile(_tree, "<marqdo>", "exec"), _g)
|
exec(compile(_tree, "<marqdo>", "exec"), _g)
|
||||||
|
_busy = False
|
||||||
_send({"id": rid, "ok": True, "stdout": _out_buf.getvalue(), "stderr": _err_buf.getvalue(), "result": _result, "error": ""})
|
_send({"id": rid, "ok": True, "stdout": _out_buf.getvalue(), "stderr": _err_buf.getvalue(), "result": _result, "error": ""})
|
||||||
except BaseException:
|
except BaseException:
|
||||||
|
_busy = False
|
||||||
_send({"id": rid, "ok": False, "stdout": _out_buf.getvalue(), "stderr": _err_buf.getvalue(), "result": None, "error": traceback.format_exc(limit=8)})
|
_send({"id": rid, "ok": False, "stdout": _out_buf.getvalue(), "stderr": _err_buf.getvalue(), "result": None, "error": traceback.format_exc(limit=8)})
|
||||||
finally:
|
finally:
|
||||||
|
_busy = False
|
||||||
sys.stdin = _old_stdin
|
sys.stdin = _old_stdin
|
||||||
"#;
|
"#;
|
||||||
|
|
||||||
@@ -81,10 +130,67 @@ const JS_BOOTSTRAP: &str = r#"const readline = require("readline");
|
|||||||
const util = require("util");
|
const util = require("util");
|
||||||
const vm = require("vm");
|
const vm = require("vm");
|
||||||
const out = process.stdout.write.bind(process.stdout);
|
const out = process.stdout.write.bind(process.stdout);
|
||||||
|
process.on("SIGINT", () => {});
|
||||||
|
const MAX_SAFE = Number.MAX_SAFE_INTEGER;
|
||||||
globalThis.require = require;
|
globalThis.require = require;
|
||||||
const rl = readline.createInterface({ input: process.stdin, crlfDelay: Infinity });
|
const rl = readline.createInterface({ input: process.stdin, crlfDelay: Infinity });
|
||||||
function send(o) { out(JSON.stringify(o) + "\n"); }
|
function sanitize(v, active = new Set()) {
|
||||||
function toJSON(v) { try { return JSON.parse(JSON.stringify(v)); } catch (e) { return String(v); } }
|
if (v === null || typeof v === "boolean" || typeof v === "string") return v;
|
||||||
|
if (typeof v === "number") {
|
||||||
|
if (!Number.isFinite(v)) throw new Error("json: non-finite number outside V_safe");
|
||||||
|
if (Number.isInteger(v) && Math.abs(v) > MAX_SAFE)
|
||||||
|
throw new Error("json: integer outside V_safe (±(2^53-1)): " + v);
|
||||||
|
return v;
|
||||||
|
}
|
||||||
|
if (typeof v === "bigint") {
|
||||||
|
if (v > BigInt(MAX_SAFE) || v < -BigInt(MAX_SAFE))
|
||||||
|
throw new Error("json: integer outside V_safe (±(2^53-1)): " + v.toString());
|
||||||
|
return Number(v);
|
||||||
|
}
|
||||||
|
if (v && typeof v === "object") {
|
||||||
|
if (active.has(v)) throw new Error("not JSON-safe: cyclic value");
|
||||||
|
active.add(v);
|
||||||
|
try {
|
||||||
|
const keys = Reflect.ownKeys(v);
|
||||||
|
if (Array.isArray(v)) {
|
||||||
|
if (keys.length !== v.length + 1)
|
||||||
|
throw new Error("not JSON-safe: sparse array or extra array properties");
|
||||||
|
const rows = [];
|
||||||
|
for (let i = 0; i < v.length; i++) {
|
||||||
|
const d = Object.getOwnPropertyDescriptor(v, String(i));
|
||||||
|
if (!d || !d.enumerable || !("value" in d))
|
||||||
|
throw new Error("not JSON-safe: array accessor or missing element");
|
||||||
|
rows.push(sanitize(d.value, active));
|
||||||
|
}
|
||||||
|
return rows;
|
||||||
|
}
|
||||||
|
const prototype = Object.getPrototypeOf(v);
|
||||||
|
if (prototype !== Object.prototype && prototype !== null)
|
||||||
|
throw new Error("not JSON-safe: expected plain record");
|
||||||
|
const o = Object.create(null);
|
||||||
|
for (const k of keys) {
|
||||||
|
if (typeof k !== "string") throw new Error("not JSON-safe: symbol record key");
|
||||||
|
const d = Object.getOwnPropertyDescriptor(v, k);
|
||||||
|
if (!d || !d.enumerable || !("value" in d))
|
||||||
|
throw new Error("not JSON-safe: record accessor or hidden property");
|
||||||
|
o[k] = sanitize(d.value, active);
|
||||||
|
}
|
||||||
|
return o;
|
||||||
|
} finally { active.delete(v); }
|
||||||
|
}
|
||||||
|
throw new Error("not JSON-safe: " + (typeof v));
|
||||||
|
}
|
||||||
|
function send(o) {
|
||||||
|
try { out(JSON.stringify(sanitize(o)) + "\n"); }
|
||||||
|
catch (e) {
|
||||||
|
out(JSON.stringify({
|
||||||
|
id: o && o.id !== undefined ? o.id : null, ok: false,
|
||||||
|
stdout: (o && o.stdout) || "", stderr: (o && o.stderr) || "",
|
||||||
|
result: null, error: String(e && e.message ? e.message : e), domain_error: true
|
||||||
|
}) + "\n");
|
||||||
|
}
|
||||||
|
}
|
||||||
|
function toJSON(v) { return sanitize(v); }
|
||||||
async function capture(fn) {
|
async function capture(fn) {
|
||||||
const logs = [], errs = [];
|
const logs = [], errs = [];
|
||||||
const ow = process.stdout.write.bind(process.stdout);
|
const ow = process.stdout.write.bind(process.stdout);
|
||||||
@@ -109,7 +215,7 @@ rl.on("line", async (line) => {
|
|||||||
let result = null;
|
let result = null;
|
||||||
try { result = vm.runInThisContext(String(req.name), { filename: "<marqdo-get>" }); }
|
try { result = vm.runInThisContext(String(req.name), { filename: "<marqdo-get>" }); }
|
||||||
catch (e) { result = globalThis[req.name] === undefined ? null : globalThis[req.name]; }
|
catch (e) { result = globalThis[req.name] === undefined ? null : globalThis[req.name]; }
|
||||||
send({ id: rid, ok: true, stdout: "", stderr: "", result: toJSON(result), error: "" });
|
send({ id: rid, ok: true, stdout: "", stderr: "", result: result, error: "" });
|
||||||
return;
|
return;
|
||||||
}
|
}
|
||||||
if (op === "names") {
|
if (op === "names") {
|
||||||
@@ -130,15 +236,27 @@ rl.on("line", async (line) => {
|
|||||||
stdinPatched = true;
|
stdinPatched = true;
|
||||||
} catch (e) {}
|
} catch (e) {}
|
||||||
}
|
}
|
||||||
const cap = await capture(async () => vm.runInThisContext(req.code || "", { filename: "<marqdo>" }));
|
send({ id: rid, phase: "ready" });
|
||||||
|
const cap = await capture(async () => vm.runInThisContext(req.code || "", { filename: "<marqdo>", breakOnSigint: true }));
|
||||||
if (stdinPatched) {
|
if (stdinPatched) {
|
||||||
try { Object.defineProperty(process, "stdin", { value: oldStdin, configurable: true, writable: true }); } catch (e) {}
|
try { Object.defineProperty(process, "stdin", { value: oldStdin, configurable: true, writable: true }); } catch (e) {}
|
||||||
}
|
}
|
||||||
send({ id: rid, ok: !cap.error, stdout: cap.logs, stderr: cap.errs, result: toJSON(cap.result), error: cap.error });
|
send({ id: rid, ok: !cap.error, stdout: cap.logs, stderr: cap.errs, result: cap.result, error: cap.error });
|
||||||
});
|
});
|
||||||
"#;
|
"#;
|
||||||
|
|
||||||
|
/// Internal protocol evidence, distinct from admitted language observations.
|
||||||
|
/// Includes failed requests and post-execution domain refusals, so set/input
|
||||||
|
/// dependencies cannot disappear from the recorded history.
|
||||||
|
#[derive(Debug, Clone)]
|
||||||
|
pub struct ProtocolStep {
|
||||||
|
pub session: String,
|
||||||
|
pub request: serde_json::Value,
|
||||||
|
pub response: Result<serde_json::Value, String>,
|
||||||
|
}
|
||||||
|
|
||||||
pub struct Session {
|
pub struct Session {
|
||||||
|
pub interrupt_handle: InterruptHandle,
|
||||||
pub id: String,
|
pub id: String,
|
||||||
pub lang: String,
|
pub lang: String,
|
||||||
pub cmd: String,
|
pub cmd: String,
|
||||||
@@ -167,7 +285,11 @@ impl std::fmt::Debug for Session {
|
|||||||
|
|
||||||
impl Drop for Session {
|
impl Drop for Session {
|
||||||
fn drop(&mut self) {
|
fn drop(&mut self) {
|
||||||
let _ = self.child.kill();
|
if let Some(_pid) = self.interrupt_handle.retire() {
|
||||||
|
#[cfg(unix)]
|
||||||
|
unsafe { libc::kill(-(_pid as i32), libc::SIGKILL); }
|
||||||
|
let _ = self.child.kill();
|
||||||
|
}
|
||||||
let _ = self.child.wait();
|
let _ = self.child.wait();
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
@@ -182,6 +304,15 @@ fn opt_text(v: Option<&Value>) -> Result<Option<String>, String> {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
|
/// Session ids are opaque handles — text fabrications are refused.
|
||||||
|
fn as_session_id<'a>(id: &'a Value) -> Result<&'a str, String> {
|
||||||
|
match id {
|
||||||
|
Value::Handle(s) => Ok(s.as_str()),
|
||||||
|
Value::Text(_) => Err("session id must be a handle (not text)".into()),
|
||||||
|
_ => Err("session id must be a handle".into()),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
fn parse_timeout(v: Option<&Value>, default: f64) -> Result<Duration, String> {
|
fn parse_timeout(v: Option<&Value>, default: f64) -> Result<Duration, String> {
|
||||||
let secs = match v {
|
let secs = match v {
|
||||||
None | Some(Value::None) => default,
|
None | Some(Value::None) => default,
|
||||||
@@ -402,6 +533,7 @@ pub fn open(
|
|||||||
let started_ms = now_ms();
|
let started_ms = now_ms();
|
||||||
let cmd_display = argv[0].clone();
|
let cmd_display = argv[0].clone();
|
||||||
let session = Session {
|
let session = Session {
|
||||||
|
interrupt_handle: InterruptHandle::new(child.id()),
|
||||||
id: id.clone(),
|
id: id.clone(),
|
||||||
lang: canonical.clone(),
|
lang: canonical.clone(),
|
||||||
cmd: cmd_display.clone(),
|
cmd: cmd_display.clone(),
|
||||||
@@ -418,7 +550,7 @@ pub fn open(
|
|||||||
};
|
};
|
||||||
ctx.foreign_sessions.insert(id.clone(), session);
|
ctx.foreign_sessions.insert(id.clone(), session);
|
||||||
let _ = timeout;
|
let _ = timeout;
|
||||||
Ok(Value::Text(id))
|
Ok(Value::Handle(id))
|
||||||
}
|
}
|
||||||
|
|
||||||
fn session_dead_stderr(ctx: &HostContext, id: &str) -> String {
|
fn session_dead_stderr(ctx: &HostContext, id: &str) -> String {
|
||||||
@@ -453,7 +585,7 @@ pub fn eval_with_stdin(
|
|||||||
timeout: Option<&Value>,
|
timeout: Option<&Value>,
|
||||||
) -> Result<Value, String> {
|
) -> Result<Value, String> {
|
||||||
ensure_config(ctx);
|
ensure_config(ctx);
|
||||||
let id = as_text(id, "id")?.to_string();
|
let id = as_session_id(id)?.to_string();
|
||||||
if !ctx.foreign_sessions.contains_key(&id) {
|
if !ctx.foreign_sessions.contains_key(&id) {
|
||||||
return Err(format!("foreign session `{id}` not found"));
|
return Err(format!("foreign session `{id}` not found"));
|
||||||
}
|
}
|
||||||
@@ -479,7 +611,7 @@ pub fn eval_with_stdin(
|
|||||||
};
|
};
|
||||||
let input_json = match input {
|
let input_json = match input {
|
||||||
None | Some(Value::None) => serde_json::Value::Null,
|
None | Some(Value::None) => serde_json::Value::Null,
|
||||||
Some(v) => value_to_json(v)?,
|
Some(v) => { super::oracle::admit(v)?; value_to_json(v)? },
|
||||||
};
|
};
|
||||||
let default_timeout = ctx.foreign_sessions[&id].timeout.as_secs_f64();
|
let default_timeout = ctx.foreign_sessions[&id].timeout.as_secs_f64();
|
||||||
let dur = parse_timeout(timeout, default_timeout)?;
|
let dur = parse_timeout(timeout, default_timeout)?;
|
||||||
@@ -498,6 +630,9 @@ pub fn eval_with_stdin(
|
|||||||
let reply = match send_and_wait(ctx, &id, &request, dur) {
|
let reply = match send_and_wait(ctx, &id, &request, dur) {
|
||||||
Ok(r) => r,
|
Ok(r) => r,
|
||||||
Err(e) => {
|
Err(e) => {
|
||||||
|
// Replay divergence is a language-level stop, not process death or
|
||||||
|
// an ordinary failed-eval value. Keep the actual committed kernel.
|
||||||
|
if ctx.foreign_replay_divergence.is_some() { return Err(e); }
|
||||||
let timed_out = e.contains("timed out");
|
let timed_out = e.contains("timed out");
|
||||||
let stderr = session_dead_stderr(ctx, &id);
|
let stderr = session_dead_stderr(ctx, &id);
|
||||||
remove_session(ctx, &id);
|
remove_session(ctx, &id);
|
||||||
@@ -544,11 +679,16 @@ pub fn eval_with_stdin(
|
|||||||
.and_then(|v| v.as_str())
|
.and_then(|v| v.as_str())
|
||||||
.unwrap_or("")
|
.unwrap_or("")
|
||||||
.to_string();
|
.to_string();
|
||||||
|
// Ω ∉ V_safe is a language fault, not a soft cell failure.
|
||||||
|
if reply.get("domain_error").and_then(|v| v.as_bool()) == Some(true) {
|
||||||
|
return Err(error);
|
||||||
|
}
|
||||||
let result = reply
|
let result = reply
|
||||||
.get("result")
|
.get("result")
|
||||||
.map(json_to_value)
|
.map(json_to_value)
|
||||||
.transpose()?
|
.transpose()?
|
||||||
.unwrap_or(Value::None);
|
.unwrap_or(Value::None);
|
||||||
|
super::oracle::admit(&result)?;
|
||||||
Ok(record(
|
Ok(record(
|
||||||
Some(&id),
|
Some(&id),
|
||||||
&lang,
|
&lang,
|
||||||
@@ -577,13 +717,54 @@ fn send_and_wait(
|
|||||||
request: &serde_json::Value,
|
request: &serde_json::Value,
|
||||||
timeout: Duration,
|
timeout: Duration,
|
||||||
) -> Result<serde_json::Value, String> {
|
) -> Result<serde_json::Value, String> {
|
||||||
|
if ctx.foreign_replay_expected.is_some() {
|
||||||
|
if let Some(error) = &ctx.foreign_replay_divergence { return Err(error.clone()); }
|
||||||
|
}
|
||||||
|
let permit = validation::prepare(ctx.foreign_replay_expected.as_mut(), id, request)
|
||||||
|
.map_err(|failure| {
|
||||||
|
let error = failure.to_string();
|
||||||
|
ctx.foreign_replay_divergence = Some(error.clone());
|
||||||
|
error
|
||||||
|
})?;
|
||||||
|
let control = ctx.foreign_sessions.get(id).map(|s| s.interrupt_handle.clone());
|
||||||
|
if let Some(handle) = &control { handle.begin(request.get("op").and_then(|v| v.as_str()) == Some("eval")); }
|
||||||
|
let response = send_and_wait_inner(ctx, permit, timeout);
|
||||||
|
if let Some(handle) = control { handle.finish(); }
|
||||||
|
ctx.foreign_protocol_steps.push(ProtocolStep {
|
||||||
|
session: id.to_string(), request: request.clone(), response: response.clone(),
|
||||||
|
});
|
||||||
|
if let Some(steps) = &mut ctx.foreign_replay_expected {
|
||||||
|
if let Err(failure) = steps.accept_response(&response) {
|
||||||
|
let error = failure.to_string();
|
||||||
|
ctx.foreign_replay_divergence = Some(error.clone());
|
||||||
|
return Err(error);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
response
|
||||||
|
}
|
||||||
|
|
||||||
|
fn send_control(
|
||||||
|
ctx: &mut HostContext, id: &str, request: &serde_json::Value,
|
||||||
|
) -> Result<serde_json::Value, String> {
|
||||||
|
let response = send_and_wait(ctx, id, request, Duration::from_secs(10));
|
||||||
|
if response.is_err() && ctx.foreign_replay_divergence.is_none() { remove_session(ctx, id); }
|
||||||
|
response
|
||||||
|
}
|
||||||
|
|
||||||
|
fn send_and_wait_inner(
|
||||||
|
ctx: &mut HostContext,
|
||||||
|
permit: validation::DispatchPermit,
|
||||||
|
timeout: Duration,
|
||||||
|
) -> Result<serde_json::Value, String> {
|
||||||
|
let id = permit.session();
|
||||||
|
let request = permit.request();
|
||||||
let line = serde_json::to_string(request).map_err(|e| format!("session request: {e}"))?;
|
let line = serde_json::to_string(request).map_err(|e| format!("session request: {e}"))?;
|
||||||
{
|
{
|
||||||
let session = ctx
|
let session = ctx
|
||||||
.foreign_sessions
|
.foreign_sessions
|
||||||
.get_mut(id)
|
.get_mut(id)
|
||||||
.ok_or_else(|| format!("foreign session `{id}` not found"))?;
|
.ok_or_else(|| format!("foreign session `{id}` not found"))?;
|
||||||
if let Ok(Some(_)) = session.child.try_wait() {
|
if let Ok(Some(_)) = session.interrupt_handle.try_wait(&mut session.child) {
|
||||||
return Err("session process exited".into());
|
return Err("session process exited".into());
|
||||||
}
|
}
|
||||||
session
|
session
|
||||||
@@ -617,13 +798,18 @@ fn send_and_wait(
|
|||||||
if rid != 1 {
|
if rid != 1 {
|
||||||
continue;
|
continue;
|
||||||
}
|
}
|
||||||
|
if v.get("phase").and_then(|v| v.as_str()) == Some("ready") {
|
||||||
|
session.interrupt_handle.ready()?;
|
||||||
|
continue;
|
||||||
|
}
|
||||||
return Ok(v);
|
return Ok(v);
|
||||||
}
|
}
|
||||||
// Unexpected non-protocol output: keep waiting until the deadline.
|
// Unexpected non-protocol output: keep waiting until the deadline.
|
||||||
continue;
|
continue;
|
||||||
}
|
}
|
||||||
Err(mpsc::RecvTimeoutError::Timeout) => {
|
Err(mpsc::RecvTimeoutError::Timeout) => {
|
||||||
if let Ok(Some(_)) = session.child.try_wait() {
|
session.interrupt_handle.retry()?;
|
||||||
|
if let Ok(Some(_)) = session.interrupt_handle.try_wait(&mut session.child) {
|
||||||
return Err("session process exited".into());
|
return Err("session process exited".into());
|
||||||
}
|
}
|
||||||
continue;
|
continue;
|
||||||
@@ -637,11 +823,13 @@ fn send_and_wait(
|
|||||||
|
|
||||||
fn kill_session(ctx: &mut HostContext, id: &str) {
|
fn kill_session(ctx: &mut HostContext, id: &str) {
|
||||||
if let Some(mut s) = ctx.foreign_sessions.remove(id) {
|
if let Some(mut s) = ctx.foreign_sessions.remove(id) {
|
||||||
#[cfg(unix)]
|
if let Some(_pid) = s.interrupt_handle.retire() {
|
||||||
unsafe {
|
#[cfg(unix)]
|
||||||
libc::kill(-(s.child.id() as i32), libc::SIGKILL);
|
unsafe {
|
||||||
|
libc::kill(-(_pid as i32), libc::SIGKILL);
|
||||||
|
}
|
||||||
|
let _ = s.child.kill();
|
||||||
}
|
}
|
||||||
let _ = s.child.kill();
|
|
||||||
let _ = s.child.wait();
|
let _ = s.child.wait();
|
||||||
s.alive = false;
|
s.alive = false;
|
||||||
}
|
}
|
||||||
@@ -650,22 +838,12 @@ fn kill_session(ctx: &mut HostContext, id: &str) {
|
|||||||
/// Interrupt the current evaluation without destroying the kernel. Python
|
/// Interrupt the current evaluation without destroying the kernel. Python
|
||||||
/// reports KeyboardInterrupt through the normal result frame.
|
/// reports KeyboardInterrupt through the normal result frame.
|
||||||
pub fn interrupt(ctx: &mut HostContext, id: &Value) -> Result<Value, String> {
|
pub fn interrupt(ctx: &mut HostContext, id: &Value) -> Result<Value, String> {
|
||||||
let id = as_text(id, "id")?.to_string();
|
let id = as_session_id(id)?.to_string();
|
||||||
let session = ctx
|
let session = ctx
|
||||||
.foreign_sessions
|
.foreign_sessions
|
||||||
.get_mut(&id)
|
.get_mut(&id)
|
||||||
.ok_or_else(|| format!("foreign session `{id}` not found"))?;
|
.ok_or_else(|| format!("foreign session `{id}` not found"))?;
|
||||||
#[cfg(unix)]
|
session.interrupt_handle.request()?;
|
||||||
unsafe {
|
|
||||||
libc::kill(-(session.child.id() as i32), libc::SIGINT);
|
|
||||||
}
|
|
||||||
#[cfg(windows)]
|
|
||||||
{
|
|
||||||
let _ = Command::new("taskkill")
|
|
||||||
.args(["/PID", &session.child.id().to_string(), "/T", "/F"])
|
|
||||||
.output();
|
|
||||||
session.alive = false;
|
|
||||||
}
|
|
||||||
Ok(Value::Bool(true))
|
Ok(Value::Bool(true))
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -675,14 +853,18 @@ pub fn set(
|
|||||||
name: &Value,
|
name: &Value,
|
||||||
value: &Value,
|
value: &Value,
|
||||||
) -> Result<Value, String> {
|
) -> Result<Value, String> {
|
||||||
let id = as_text(id, "id")?.to_string();
|
let id = as_session_id(id)?.to_string();
|
||||||
|
if !ctx.foreign_sessions.contains_key(&id) {
|
||||||
|
return Err(format!("foreign session `{id}` not found"));
|
||||||
|
}
|
||||||
let name = as_text(name, "name")?.to_string();
|
let name = as_text(name, "name")?.to_string();
|
||||||
if !valid_name(&name) {
|
if !valid_name(&name) {
|
||||||
return Err("session_set: name must be an identifier".into());
|
return Err("session_set: name must be an identifier".into());
|
||||||
}
|
}
|
||||||
|
super::oracle::admit(value)?;
|
||||||
let json = value_to_json(value)?;
|
let json = value_to_json(value)?;
|
||||||
let request = serde_json::json!({"id": 1, "op": "set", "name": name, "value": json});
|
let request = serde_json::json!({"id": 1, "op": "set", "name": name, "value": json});
|
||||||
let reply = send_and_wait(ctx, &id, &request, Duration::from_secs(10))?;
|
let reply = send_control(ctx, &id, &request)?;
|
||||||
if reply.get("ok").and_then(|v| v.as_bool()).unwrap_or(false) {
|
if reply.get("ok").and_then(|v| v.as_bool()).unwrap_or(false) {
|
||||||
Ok(Value::None)
|
Ok(Value::None)
|
||||||
} else {
|
} else {
|
||||||
@@ -695,13 +877,16 @@ pub fn set(
|
|||||||
}
|
}
|
||||||
|
|
||||||
pub fn get(ctx: &mut HostContext, id: &Value, name: &Value) -> Result<Value, String> {
|
pub fn get(ctx: &mut HostContext, id: &Value, name: &Value) -> Result<Value, String> {
|
||||||
let id = as_text(id, "id")?.to_string();
|
let id = as_session_id(id)?.to_string();
|
||||||
|
if !ctx.foreign_sessions.contains_key(&id) {
|
||||||
|
return Err(format!("foreign session `{id}` not found"));
|
||||||
|
}
|
||||||
let name = as_text(name, "name")?.to_string();
|
let name = as_text(name, "name")?.to_string();
|
||||||
if !valid_name(&name) {
|
if !valid_name(&name) {
|
||||||
return Err("session_get: name must be an identifier".into());
|
return Err("session_get: name must be an identifier".into());
|
||||||
}
|
}
|
||||||
let request = serde_json::json!({"id": 1, "op": "get", "name": name});
|
let request = serde_json::json!({"id": 1, "op": "get", "name": name});
|
||||||
let reply = send_and_wait(ctx, &id, &request, Duration::from_secs(10))?;
|
let reply = send_control(ctx, &id, &request)?;
|
||||||
if !reply.get("ok").and_then(|v| v.as_bool()).unwrap_or(false) {
|
if !reply.get("ok").and_then(|v| v.as_bool()).unwrap_or(false) {
|
||||||
return Err(reply
|
return Err(reply
|
||||||
.get("error")
|
.get("error")
|
||||||
@@ -709,16 +894,21 @@ pub fn get(ctx: &mut HostContext, id: &Value, name: &Value) -> Result<Value, Str
|
|||||||
.unwrap_or("session_get failed")
|
.unwrap_or("session_get failed")
|
||||||
.to_string());
|
.to_string());
|
||||||
}
|
}
|
||||||
match reply.get("result") {
|
let value = match reply.get("result") {
|
||||||
Some(v) => json_to_value(v),
|
Some(v) => json_to_value(v),
|
||||||
None => Ok(Value::None),
|
None => Ok(Value::None),
|
||||||
}
|
}?;
|
||||||
|
super::oracle::admit(&value)?;
|
||||||
|
Ok(value)
|
||||||
}
|
}
|
||||||
|
|
||||||
pub fn names(ctx: &mut HostContext, id: &Value) -> Result<Value, String> {
|
pub fn names(ctx: &mut HostContext, id: &Value) -> Result<Value, String> {
|
||||||
let id = as_text(id, "id")?.to_string();
|
let id = as_session_id(id)?.to_string();
|
||||||
|
if !ctx.foreign_sessions.contains_key(&id) {
|
||||||
|
return Err(format!("foreign session `{id}` not found"));
|
||||||
|
}
|
||||||
let request = serde_json::json!({"id": 1, "op": "names"});
|
let request = serde_json::json!({"id": 1, "op": "names"});
|
||||||
let reply = send_and_wait(ctx, &id, &request, Duration::from_secs(10))?;
|
let reply = send_control(ctx, &id, &request)?;
|
||||||
if !reply.get("ok").and_then(|v| v.as_bool()).unwrap_or(false) {
|
if !reply.get("ok").and_then(|v| v.as_bool()).unwrap_or(false) {
|
||||||
return Err(reply
|
return Err(reply
|
||||||
.get("error")
|
.get("error")
|
||||||
@@ -733,10 +923,14 @@ pub fn names(ctx: &mut HostContext, id: &Value) -> Result<Value, String> {
|
|||||||
}
|
}
|
||||||
|
|
||||||
pub fn close(ctx: &mut HostContext, id: &Value) -> Result<Value, String> {
|
pub fn close(ctx: &mut HostContext, id: &Value) -> Result<Value, String> {
|
||||||
let id = as_text(id, "id")?.to_string();
|
let id = as_session_id(id)?.to_string();
|
||||||
let existed = ctx.foreign_sessions.contains_key(&id);
|
// Affine close: consuming an absent / already-closed handle is a fault
|
||||||
|
// (same surface as eval/set/get after close).
|
||||||
|
if !ctx.foreign_sessions.contains_key(&id) {
|
||||||
|
return Err(format!("foreign session `{id}` not found"));
|
||||||
|
}
|
||||||
kill_session(ctx, &id);
|
kill_session(ctx, &id);
|
||||||
Ok(Value::Bool(existed))
|
Ok(Value::Bool(true))
|
||||||
}
|
}
|
||||||
|
|
||||||
pub fn list(ctx: &HostContext) -> Result<Value, String> {
|
pub fn list(ctx: &HostContext) -> Result<Value, String> {
|
||||||
@@ -745,7 +939,7 @@ pub fn list(ctx: &HostContext) -> Result<Value, String> {
|
|||||||
let mut out = Vec::new();
|
let mut out = Vec::new();
|
||||||
for s in sessions {
|
for s in sessions {
|
||||||
out.push(Value::Map(vec![
|
out.push(Value::Map(vec![
|
||||||
("id".into(), Value::Text(s.id.clone())),
|
("id".into(), Value::Handle(s.id.clone())),
|
||||||
("lang".into(), Value::Text(s.lang.clone())),
|
("lang".into(), Value::Text(s.lang.clone())),
|
||||||
("cmd".into(), Value::Text(s.cmd.clone())),
|
("cmd".into(), Value::Text(s.cmd.clone())),
|
||||||
("evals".into(), Value::Int(s.evals as i64)),
|
("evals".into(), Value::Int(s.evals as i64)),
|
||||||
@@ -763,7 +957,7 @@ pub fn shutdown(ctx: &mut HostContext) {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
fn valid_name(name: &str) -> bool {
|
pub(crate) fn valid_name(name: &str) -> bool {
|
||||||
let mut chars = name.chars();
|
let mut chars = name.chars();
|
||||||
match chars.next() {
|
match chars.next() {
|
||||||
Some(c) if c == '_' || c.is_ascii_alphabetic() => {}
|
Some(c) if c == '_' || c.is_ascii_alphabetic() => {}
|
||||||
@@ -783,4 +977,301 @@ mod tests {
|
|||||||
assert!(!valid_name("1x"));
|
assert!(!valid_name("1x"));
|
||||||
assert!(!valid_name("a-b"));
|
assert!(!valid_name("a-b"));
|
||||||
}
|
}
|
||||||
|
#[test]
|
||||||
|
fn bridge_live_boundary_and_refusal_preserves_input_store() {
|
||||||
|
let edge = 9_007_199_254_740_991i64;
|
||||||
|
for lang in ["python", "node"] {
|
||||||
|
let mut ctx = HostContext::default();
|
||||||
|
let id = open(&mut ctx, &Value::Text(lang.into()), None, None, None, None).unwrap();
|
||||||
|
let name = Value::Text("payload".into());
|
||||||
|
for n in [i64::MIN, -edge-1, -edge, -edge+1, -1, 0, 1, edge-1, edge, edge+1, i64::MAX] {
|
||||||
|
set(&mut ctx, &id, &name, &Value::Int(17)).unwrap();
|
||||||
|
let input = Value::List(vec![Value::Text("中文🧪".into()), Value::List(vec![Value::Int(n)])]);
|
||||||
|
let result = set(&mut ctx, &id, &name, &input);
|
||||||
|
if (-edge..=edge).contains(&n) {
|
||||||
|
result.unwrap();
|
||||||
|
assert_eq!(get(&mut ctx, &id, &name).unwrap(), input, "{lang} {n}");
|
||||||
|
} else {
|
||||||
|
assert!(result.unwrap_err().contains("outside V_safe"));
|
||||||
|
assert_eq!(get(&mut ctx, &id, &name).unwrap(), Value::Int(17));
|
||||||
|
}
|
||||||
|
println!("E4 {lang} integer {n}: verified");
|
||||||
|
}
|
||||||
|
for source in if lang == "python" {
|
||||||
|
["2**53", "float('nan')", "float('inf')"]
|
||||||
|
} else { ["2**53", "NaN", "Infinity"] } {
|
||||||
|
let error = eval(&mut ctx, &id, None, Some(&Value::Text(source.into())), None, None).unwrap_err();
|
||||||
|
assert!(error.contains("outside V_safe"), "{lang} {source}: {error}");
|
||||||
|
// A refused response must remain a protocol response, not kill Node.
|
||||||
|
assert_eq!(get(&mut ctx, &id, &name).unwrap(), Value::Int(17));
|
||||||
|
println!("E4 {lang} response {source}: refused, session responsive");
|
||||||
|
}
|
||||||
|
let alias = id.clone();
|
||||||
|
close(&mut ctx, &id).unwrap();
|
||||||
|
// Missing handle wins over an invalid name and an OOD payload.
|
||||||
|
let err = set(&mut ctx, &alias, &Value::Text("bad-name".into()), &Value::Int(i64::MAX)).unwrap_err();
|
||||||
|
assert!(err.contains("not found"), "{err}");
|
||||||
|
assert!(get(&mut ctx, &alias, &name).is_err());
|
||||||
|
assert!(close(&mut ctx, &alias).is_err());
|
||||||
|
assert!(ctx.foreign_sessions.is_empty());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn generated_two_session_model_traces() {
|
||||||
|
for lang in ["python", "node"] {
|
||||||
|
let mut ctx = HostContext::default();
|
||||||
|
let mut ids = Vec::new();
|
||||||
|
let mut live = [true; 2];
|
||||||
|
let mut expected = [0i64; 2];
|
||||||
|
let name = Value::Text("counter".into());
|
||||||
|
for _ in 0..2 {
|
||||||
|
let id = open(&mut ctx, &Value::Text(lang.into()), None, None, None, None).unwrap();
|
||||||
|
set(&mut ctx, &id, &name, &Value::Int(0)).unwrap();
|
||||||
|
ids.push(id);
|
||||||
|
}
|
||||||
|
let mut seed = 0x52455155495245u64;
|
||||||
|
for step in 0..256 {
|
||||||
|
seed = seed.wrapping_mul(6364136223846793005).wrapping_add(1);
|
||||||
|
let slot = ((seed >> 32) & 1) as usize;
|
||||||
|
let op = (seed >> 40) % 5;
|
||||||
|
match op {
|
||||||
|
0 => {
|
||||||
|
let value = step as i64 - 128;
|
||||||
|
let result = set(&mut ctx, &ids[slot], &name, &Value::Int(value));
|
||||||
|
assert_eq!(result.is_ok(), live[slot]);
|
||||||
|
if live[slot] { expected[slot] = value; }
|
||||||
|
}
|
||||||
|
1 => {
|
||||||
|
let result = get(&mut ctx, &ids[slot], &name);
|
||||||
|
if live[slot] { assert_eq!(result.unwrap(), Value::Int(expected[slot])); }
|
||||||
|
else { assert!(result.unwrap_err().contains("not found")); }
|
||||||
|
}
|
||||||
|
2 => {
|
||||||
|
let src = if lang == "python" { "counter += 1\ncounter" } else { "counter += 1; counter" };
|
||||||
|
let result = eval(&mut ctx, &ids[slot], None, Some(&Value::Text(src.into())), None, None);
|
||||||
|
assert_eq!(result.is_ok(), live[slot]);
|
||||||
|
if live[slot] { expected[slot] += 1; }
|
||||||
|
}
|
||||||
|
3 => {
|
||||||
|
assert_eq!(close(&mut ctx, &ids[slot]).is_ok(), live[slot]);
|
||||||
|
live[slot] = false;
|
||||||
|
}
|
||||||
|
_ => {
|
||||||
|
if live[slot] { close(&mut ctx, &ids[slot]).unwrap(); }
|
||||||
|
let stale = ids[slot].clone();
|
||||||
|
ids[slot] = open(&mut ctx, &Value::Text(lang.into()), None, None, None, None).unwrap();
|
||||||
|
assert_ne!(stale, ids[slot]);
|
||||||
|
assert!(get(&mut ctx, &stale, &name).is_err());
|
||||||
|
set(&mut ctx, &ids[slot], &name, &Value::Int(0)).unwrap();
|
||||||
|
expected[slot] = 0;
|
||||||
|
live[slot] = true;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
// Independent model predicts every remaining store after every command.
|
||||||
|
for j in 0..2 {
|
||||||
|
assert_eq!(ctx.foreign_sessions.contains_key(as_session_id(&ids[j]).unwrap()), live[j]);
|
||||||
|
if live[j] { assert_eq!(get(&mut ctx, &ids[j], &name).unwrap(), Value::Int(expected[j]), "{lang} step {step} slot {j}"); }
|
||||||
|
}
|
||||||
|
}
|
||||||
|
shutdown(&mut ctx);
|
||||||
|
assert!(ctx.foreign_sessions.is_empty());
|
||||||
|
println!("E3 {lang}: seed 0x52455155495245, 256 commands verified");
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn failure_process_exit_timeout_and_reopen() {
|
||||||
|
for lang in ["python", "node"] {
|
||||||
|
let mut ctx = HostContext::default();
|
||||||
|
for source in if lang == "python" { ["import os; os._exit(7)", "while True: pass"] }
|
||||||
|
else { ["process.exit(7)", "while(true) {}"] } {
|
||||||
|
let id = open(&mut ctx, &Value::Text(lang.into()), None, None, None, None).unwrap();
|
||||||
|
let result = eval(&mut ctx, &id, None, Some(&Value::Text(source.into())), None, Some(&Value::Num(0.1)));
|
||||||
|
assert!(result.is_ok(), "process failure should be a failure record: {result:?}");
|
||||||
|
let Value::Map(m) = result.unwrap() else { panic!() };
|
||||||
|
assert!(m.iter().any(|(k,v)| k == "ok" && v == &Value::Bool(false)));
|
||||||
|
assert!(ctx.foreign_sessions.is_empty(), "dead session must be retired");
|
||||||
|
assert!(get(&mut ctx, &id, &Value::Text("x".into())).is_err());
|
||||||
|
println!("E5 {lang} {source}: recorded and retired");
|
||||||
|
}
|
||||||
|
let id = open(&mut ctx, &Value::Text(lang.into()), None, None, None, None).unwrap();
|
||||||
|
set(&mut ctx, &id, &Value::Text("x".into()), &Value::Int(41)).unwrap();
|
||||||
|
assert_eq!(get(&mut ctx, &id, &Value::Text("x".into())).unwrap(), Value::Int(41));
|
||||||
|
shutdown(&mut ctx);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn input_history_and_post_refusal_effects_are_preserved() {
|
||||||
|
for lang in ["python", "node"] {
|
||||||
|
let mut ctx = HostContext::default();
|
||||||
|
let id = open(&mut ctx, &Value::Text(lang.into()), None, None, None, None).unwrap();
|
||||||
|
let name = Value::Text("n".into());
|
||||||
|
set(&mut ctx, &id, &name, &Value::Int(1)).unwrap();
|
||||||
|
let code = if lang == "python" { "n += marqdo_input\nn" } else { "n += marqdo_input; n" };
|
||||||
|
let result = eval(&mut ctx, &id, None, Some(&Value::Text(code.into())), Some(&Value::Int(3)), None).unwrap();
|
||||||
|
let Value::Map(fields) = result else { panic!() };
|
||||||
|
assert_eq!(fields.iter().find(|(k,_)| k == "result").unwrap().1, Value::Int(4));
|
||||||
|
let sent = ctx.foreign_protocol_steps.last().unwrap();
|
||||||
|
assert_eq!(sent.session, as_session_id(&id).unwrap());
|
||||||
|
assert_eq!(sent.request["op"], "eval");
|
||||||
|
assert_eq!(sent.request["input"], 3);
|
||||||
|
assert_eq!(sent.request["code"], code);
|
||||||
|
let before = ctx.foreign_protocol_steps.len();
|
||||||
|
assert!(set(&mut ctx, &id, &name, &Value::Int(i64::MAX)).is_err());
|
||||||
|
assert_eq!(ctx.foreign_protocol_steps.len(), before, "invalid input must not query oracle");
|
||||||
|
assert_eq!(get(&mut ctx, &id, &name).unwrap(), Value::Int(4));
|
||||||
|
let bad = if lang == "python" { "n = 99\n2**53" } else { "n = 99; 2**53" };
|
||||||
|
assert!(eval(&mut ctx, &id, None, Some(&Value::Text(bad.into())), None, None).unwrap_err().contains("outside V_safe"));
|
||||||
|
let fault = ctx.foreign_protocol_steps.last().unwrap();
|
||||||
|
assert_eq!(fault.response.as_ref().unwrap()["domain_error"], true);
|
||||||
|
assert_eq!(get(&mut ctx, &id, &name).unwrap(), Value::Int(99), "foreign effects must not be claimed to roll back");
|
||||||
|
let ordinary_error = if lang == "python" { "raise ValueError('outside V_safe')" }
|
||||||
|
else { "throw new Error('outside V_safe')" };
|
||||||
|
let record = eval(&mut ctx, &id, None, Some(&Value::Text(ordinary_error.into())), None, None).unwrap();
|
||||||
|
let Value::Map(fields) = record else { panic!() };
|
||||||
|
assert_eq!(fields.iter().find(|(k,_)| k == "ok").unwrap().1, Value::Bool(false));
|
||||||
|
let unsupported = if lang == "python" { "object()" } else { "(function(){})" };
|
||||||
|
assert!(eval(&mut ctx, &id, None, Some(&Value::Text(unsupported.into())), None, None).unwrap_err().contains("not JSON-safe"));
|
||||||
|
assert_eq!(get(&mut ctx, &id, &name).unwrap(), Value::Int(99));
|
||||||
|
close(&mut ctx, &id).unwrap();
|
||||||
|
println!("E6 {lang}: complete inputs recorded; pre-send refusal has no request; post-send refusal retains effects; structured domain classification verified");
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn numeric_extension_policy_agrees_on_python_and_node() {
|
||||||
|
for lang in ["python", "node"] {
|
||||||
|
let mut ctx = HostContext::default();
|
||||||
|
let id = open(&mut ctx, &Value::Text(lang.into()), None, None, None, None).unwrap();
|
||||||
|
let key = Value::Text("number".into());
|
||||||
|
for value in [1.5, -0.0, 9_007_199_254_740_991.0, -9_007_199_254_740_991.0] {
|
||||||
|
set(&mut ctx, &id, &key, &Value::Num(value)).unwrap();
|
||||||
|
match get(&mut ctx, &id, &key).unwrap() {
|
||||||
|
Value::Num(n) => assert_eq!(n, value),
|
||||||
|
Value::Int(n) => assert_eq!(n as f64, value),
|
||||||
|
other => panic!("{lang}: {other:?}"),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
for value in [9_007_199_254_740_992.0, -9_007_199_254_740_992.0, 1e100] {
|
||||||
|
let before = ctx.foreign_protocol_steps.len();
|
||||||
|
assert!(set(&mut ctx, &id, &key, &Value::Num(value)).unwrap_err().contains("outside V_safe"));
|
||||||
|
assert_eq!(ctx.foreign_protocol_steps.len(), before);
|
||||||
|
}
|
||||||
|
let source = if lang == "python" { "float(2**53)" } else { "Number(2**53)" };
|
||||||
|
assert!(eval(&mut ctx, &id, None, Some(&Value::Text(source.into())), None, None).unwrap_err().contains("outside V_safe"));
|
||||||
|
close(&mut ctx, &id).unwrap();
|
||||||
|
println!("E7 {lang}: finite fractions admitted, integral float/scientific-notation bypass refused");
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn node_non_json_containers_and_lossy_properties_are_refused_without_coercion() {
|
||||||
|
let mut ctx = HostContext::default();
|
||||||
|
let id = open(&mut ctx, &Value::Text("node".into()), None, None, None, None).unwrap();
|
||||||
|
let expressions = [
|
||||||
|
"new Map([['k',1]])", "new Set([1,2])", "new Date(0)", "/x/",
|
||||||
|
"new Uint8Array([1,2])", "new Number(7)",
|
||||||
|
"Object.assign(Object.create({inherited:1}),{own:2})",
|
||||||
|
"Object.defineProperty({},'hidden',{value:7})", "({[Symbol('k')]:7})",
|
||||||
|
"Object.defineProperty({},'data',{enumerable:true,get(){retained=123;return 7}})",
|
||||||
|
"new Array(2)", "Object.assign([1,2],{tag:3})", "[undefined]",
|
||||||
|
"(()=>{var x={};x.self=x;return x;})()",
|
||||||
|
];
|
||||||
|
for expression in expressions {
|
||||||
|
let code = Value::Text(format!("retained = 99; {expression}"));
|
||||||
|
let result = eval(&mut ctx,&id,None,Some(&code),None,None);
|
||||||
|
assert!(result.as_ref().is_err_and(|e|e.contains("not JSON-safe")),"silently coerced {expression}: {result:?}");
|
||||||
|
let reply=ctx.foreign_protocol_steps.last().unwrap().response.as_ref().unwrap().clone();
|
||||||
|
assert_eq!(reply["domain_error"],serde_json::json!(true));
|
||||||
|
assert_eq!(get(&mut ctx,&id,&Value::Text("retained".into())).unwrap(),Value::Int(99),"getter must not run during refusal");
|
||||||
|
println!("NODE_DOMAIN_REFUSAL:{}",serde_json::json!({"expression":expression,"reply":reply.clone(),"retained":99}));
|
||||||
|
}
|
||||||
|
// Null prototypes, special string keys and shared acyclic subvalues remain records/lists.
|
||||||
|
let code=Value::Text("var item = Object.assign(Object.create(null),{constructor:7}); [item,item]".into());
|
||||||
|
let result=eval(&mut ctx,&id,None,Some(&code),None,None).unwrap();
|
||||||
|
let Value::Map(fields)=result else {panic!()};
|
||||||
|
let observed=&fields.iter().find(|(k,_)|k=="result").unwrap().1;
|
||||||
|
assert_eq!(observed,&Value::List(vec![Value::Map(vec![("constructor".into(),Value::Int(7))]);2]));
|
||||||
|
close(&mut ctx,&id).unwrap();
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn recursive_values_and_object_keys_cross_without_coercion() {
|
||||||
|
fn payload(seed: u64, depth: usize) -> Value {
|
||||||
|
if depth == 0 { return match seed % 4 {
|
||||||
|
0 => Value::None, 1 => Value::Bool(seed & 4 != 0),
|
||||||
|
2 => Value::Int((seed % 2001) as i64 - 1000),
|
||||||
|
_ => Value::Text(format!("中文🧪\\\"\n{}", seed % 10)),
|
||||||
|
}; }
|
||||||
|
match seed % 3 {
|
||||||
|
0 => Value::List(vec![payload(seed.wrapping_mul(17).wrapping_add(1), depth-1), payload(seed.wrapping_mul(31).wrapping_add(2), depth-1)]),
|
||||||
|
1 => Value::Map(vec![("data".into(), payload(seed.wrapping_mul(43).wrapping_add(3), depth-1)), ("tag".into(), Value::Text("record".into()))]),
|
||||||
|
_ => payload(seed, 0),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
for lang in ["python", "node"] {
|
||||||
|
let mut ctx = HostContext::default();
|
||||||
|
let id = open(&mut ctx, &Value::Text(lang.into()), None, None, None, None).unwrap();
|
||||||
|
let name = Value::Text("payload".into());
|
||||||
|
for seed in 0..64 {
|
||||||
|
let v = payload(seed, 4);
|
||||||
|
set(&mut ctx, &id, &name, &v).unwrap();
|
||||||
|
assert_eq!(get(&mut ctx, &id, &name).unwrap(), v, "{lang} seed {seed}");
|
||||||
|
}
|
||||||
|
let special = Value::Map(vec![
|
||||||
|
("__proto__".into(), Value::Map(vec![("polluted".into(), Value::Bool(true))])),
|
||||||
|
("constructor".into(), Value::Text("data".into())),
|
||||||
|
]);
|
||||||
|
set(&mut ctx, &id, &name, &special).unwrap();
|
||||||
|
assert_eq!(get(&mut ctx, &id, &name).unwrap(), special, "{lang} valid special keys lost");
|
||||||
|
for bad in [Value::Map(vec![("a".into(), Value::Int(1)), ("a".into(), Value::Int(2))]),
|
||||||
|
Value::Map(vec![("a".into(), Value::List(vec![])), ("b".into(), Value::List(vec![Value::Int(1)]))])] {
|
||||||
|
let before = ctx.foreign_protocol_steps.len();
|
||||||
|
assert!(set(&mut ctx, &id, &name, &bad).is_err());
|
||||||
|
assert_eq!(ctx.foreign_protocol_steps.len(), before);
|
||||||
|
assert_eq!(get(&mut ctx, &id, &name).unwrap(), special);
|
||||||
|
}
|
||||||
|
if lang == "python" {
|
||||||
|
let code = Value::Text("{1: 'integer key', '1': 'string key'}".into());
|
||||||
|
assert!(eval(&mut ctx, &id, None, Some(&code), None, None).unwrap_err().contains("keys must be strings"));
|
||||||
|
} else {
|
||||||
|
let code = Value::Text("typeof ({}).polluted === 'undefined'".into());
|
||||||
|
let Value::Map(m) = eval(&mut ctx, &id, None, Some(&code), None, None).unwrap() else { panic!() };
|
||||||
|
assert_eq!(m.iter().find(|(k,_)| k == "result").unwrap().1, Value::Bool(true));
|
||||||
|
}
|
||||||
|
close(&mut ctx, &id).unwrap();
|
||||||
|
println!("E8 {lang}: 64 nested round-trips, special keys preserved, invalid key/shape inputs refused without requests");
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[cfg(unix)]
|
||||||
|
#[test]
|
||||||
|
fn bootstrap_interrupts_busy_eval_and_preserves_idle_state(){
|
||||||
|
for lang in ["python","node"]{
|
||||||
|
let mut ctx=HostContext::default();let id=open(&mut ctx,&Value::Text(lang.into()),None,None,None,None).unwrap();
|
||||||
|
let name=Value::Text("n".into());set(&mut ctx,&id,&name,&Value::Int(8)).unwrap();
|
||||||
|
interrupt(&mut ctx,&id).unwrap();assert_eq!(get(&mut ctx,&id,&name).unwrap(),Value::Int(8));
|
||||||
|
let marker=ctx.cwd.join(format!("target/interrupt-marker-{}-{lang}",std::process::id()));let _=std::fs::remove_file(&marker);
|
||||||
|
let literal=serde_json::to_string(&marker.display().to_string()).unwrap();
|
||||||
|
let code=if lang=="python"{format!("with open({literal}, 'w') as marker:\n marker.write('ready')\nwhile True: pass")}
|
||||||
|
else{format!("require('fs').writeFileSync({literal}, 'ready'); while(true) {{}}")};
|
||||||
|
let pid=ctx.foreign_sessions[as_session_id(&id).unwrap()].child.id();let child_id=id.clone();
|
||||||
|
let worker=std::thread::spawn(move||{let out=eval(&mut ctx,&child_id,None,Some(&Value::Text(code)),None,Some(&Value::Num(3.0)));(ctx,out)});
|
||||||
|
let deadline=Instant::now()+Duration::from_secs(2);
|
||||||
|
while !marker.exists()&&Instant::now()<deadline{std::thread::sleep(Duration::from_millis(1));}
|
||||||
|
let ready=marker.exists();
|
||||||
|
if ready{assert_eq!(unsafe{libc::kill(-(pid as i32),libc::SIGINT)},0);}
|
||||||
|
let (mut ctx,out)=worker.join().unwrap();assert!(ready,"{lang}: code did not start");
|
||||||
|
let Value::Map(record)=out.unwrap() else{panic!()};
|
||||||
|
assert_eq!(record.iter().find(|(k,_)|k=="ok").unwrap().1,Value::Bool(false));
|
||||||
|
assert_eq!(record.iter().find(|(k,_)|k=="alive").unwrap().1,Value::Bool(true));
|
||||||
|
let error=record.iter().find(|(k,_)|k=="error").unwrap().1.as_display();
|
||||||
|
assert!(error.contains("KeyboardInterrupt")||error.contains("interrupted"),"{lang}: {error}");
|
||||||
|
assert_eq!(get(&mut ctx,&id,&name).unwrap(),Value::Int(8));close(&mut ctx,&id).unwrap();std::fs::remove_file(marker).unwrap();
|
||||||
|
println!("E10 {lang}: idle interrupt is safe; busy synchronous eval interrupted with kernel and store alive");
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
}
|
}
|
||||||
@@ -0,0 +1,204 @@
|
|||||||
|
//! An owned-process interrupt capability. Retirement precedes every child reap,
|
||||||
|
//! so a stale capability cannot signal a reused operating-system process id.
|
||||||
|
use std::sync::{Arc, Mutex};
|
||||||
|
|
||||||
|
#[derive(Debug, Default)]
|
||||||
|
struct State {
|
||||||
|
pid: Option<u32>,
|
||||||
|
evaluating: bool,
|
||||||
|
ready: bool,
|
||||||
|
requested: bool,
|
||||||
|
}
|
||||||
|
|
||||||
|
#[derive(Clone, Debug, Default)]
|
||||||
|
pub struct InterruptHandle(Arc<Mutex<State>>);
|
||||||
|
|
||||||
|
impl InterruptHandle {
|
||||||
|
pub(super) fn new(pid: u32) -> Self {
|
||||||
|
Self(Arc::new(Mutex::new(State {
|
||||||
|
pid: Some(pid),
|
||||||
|
..State::default()
|
||||||
|
})))
|
||||||
|
}
|
||||||
|
pub(super) fn retire(&self) -> Option<u32> {
|
||||||
|
if let Ok(mut state) = self.0.lock() {
|
||||||
|
let pid = state.pid.take();
|
||||||
|
state.evaluating = false;
|
||||||
|
pid
|
||||||
|
} else {
|
||||||
|
None
|
||||||
|
}
|
||||||
|
}
|
||||||
|
pub(super) fn try_wait(
|
||||||
|
&self,
|
||||||
|
child: &mut std::process::Child,
|
||||||
|
) -> std::io::Result<Option<std::process::ExitStatus>> {
|
||||||
|
let mut state = self.0.lock().unwrap();
|
||||||
|
let result = child.try_wait();
|
||||||
|
if matches!(result, Ok(Some(_))) {
|
||||||
|
state.pid = None;
|
||||||
|
state.evaluating = false;
|
||||||
|
}
|
||||||
|
result
|
||||||
|
}
|
||||||
|
pub(super) fn begin(&self, evaluating: bool) {
|
||||||
|
let mut state = self.0.lock().unwrap();
|
||||||
|
state.evaluating = evaluating;
|
||||||
|
state.ready = false;
|
||||||
|
state.requested = false;
|
||||||
|
}
|
||||||
|
pub(super) fn finish(&self) {
|
||||||
|
self.0.lock().unwrap().evaluating = false;
|
||||||
|
}
|
||||||
|
// SIGINT can arrive between a Node ready frame and installation of V8's
|
||||||
|
// breakOnSigint handler. Retry the same logical request while awaiting its
|
||||||
|
// response; never carry a retry into the next request or retired process.
|
||||||
|
pub(super) fn retry(&self) -> Result<(), String> {
|
||||||
|
let state = self.0.lock().map_err(|_| "interrupt lock poisoned")?;
|
||||||
|
if state.evaluating && state.ready && state.requested {
|
||||||
|
Self::signal(&state)?;
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
pub(super) fn ready(&self) -> Result<(), String> {
|
||||||
|
let mut state = self.0.lock().map_err(|_| "interrupt lock poisoned")?;
|
||||||
|
if state.ready {
|
||||||
|
return Ok(());
|
||||||
|
}
|
||||||
|
state.ready = true;
|
||||||
|
if state.requested {
|
||||||
|
Self::signal(&state)?;
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
pub fn is_live(&self) -> bool {
|
||||||
|
self.0.lock().is_ok_and(|s| s.pid.is_some())
|
||||||
|
}
|
||||||
|
|
||||||
|
/// False means idle; cancellation is coalesced within one evaluation.
|
||||||
|
/// Before the bootstrap's ready frame it is queued rather than sent into
|
||||||
|
/// interpreter startup or transport parsing.
|
||||||
|
pub fn request(&self) -> Result<bool, String> {
|
||||||
|
let mut state = self.0.lock().map_err(|_| "interrupt lock poisoned")?;
|
||||||
|
if state.pid.is_none() {
|
||||||
|
return Err("interrupt capability retired".into());
|
||||||
|
}
|
||||||
|
if !state.evaluating {
|
||||||
|
return Ok(false);
|
||||||
|
}
|
||||||
|
#[cfg(not(unix))]
|
||||||
|
return Err("non-destructive interrupt is unsupported on this platform".into());
|
||||||
|
if !state.requested {
|
||||||
|
if state.ready {
|
||||||
|
Self::signal(&state)?;
|
||||||
|
}
|
||||||
|
state.requested = true;
|
||||||
|
}
|
||||||
|
Ok(true)
|
||||||
|
}
|
||||||
|
fn signal(state: &State) -> Result<(), String> {
|
||||||
|
let pid = state.pid.ok_or("interrupt capability retired")?;
|
||||||
|
#[cfg(unix)]
|
||||||
|
{
|
||||||
|
if unsafe { libc::kill(-(pid as i32), libc::SIGINT) } != 0 {
|
||||||
|
return Err(format!(
|
||||||
|
"interrupt failed: {}",
|
||||||
|
std::io::Error::last_os_error()
|
||||||
|
));
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
#[cfg(not(unix))]
|
||||||
|
{
|
||||||
|
let _ = pid;
|
||||||
|
Err("non-destructive interrupt is unsupported on this platform".into())
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[cfg(all(test, unix))]
|
||||||
|
mod tests {
|
||||||
|
use crate::host::{foreign_session, HostContext};
|
||||||
|
use crate::value::Value;
|
||||||
|
#[test]
|
||||||
|
fn retired_interrupt_capability_cannot_reach_replacement_kernel() {
|
||||||
|
for language in ["python", "node"] {
|
||||||
|
let mut host = HostContext::default();
|
||||||
|
let lang = Value::Text(language.into());
|
||||||
|
let old = foreign_session::open(&mut host, &lang, None, None, None, None).unwrap();
|
||||||
|
let Value::Handle(id) = &old else { panic!() };
|
||||||
|
let control = host.foreign_sessions[id].interrupt_handle.clone();
|
||||||
|
assert!(!control.request().unwrap());
|
||||||
|
foreign_session::close(&mut host, &old).unwrap();
|
||||||
|
let new = foreign_session::open(&mut host, &lang, None, None, None, None).unwrap();
|
||||||
|
assert!(!control.is_live());
|
||||||
|
assert!(control.request().unwrap_err().contains("retired"));
|
||||||
|
foreign_session::set(&mut host, &new, &Value::Text("n".into()), &Value::Int(8))
|
||||||
|
.unwrap();
|
||||||
|
assert_eq!(
|
||||||
|
foreign_session::get(&mut host, &new, &Value::Text("n".into())).unwrap(),
|
||||||
|
Value::Int(8)
|
||||||
|
);
|
||||||
|
foreign_session::close(&mut host, &new).unwrap();
|
||||||
|
}
|
||||||
|
}
|
||||||
|
#[test]
|
||||||
|
fn cancellation_queued_during_bootstrap_reaches_busy_evaluation() {
|
||||||
|
use std::time::{Duration, Instant};
|
||||||
|
for language in ["python", "node"] {
|
||||||
|
let mut host = HostContext::default();
|
||||||
|
let id = foreign_session::open(
|
||||||
|
&mut host,
|
||||||
|
&Value::Text(language.into()),
|
||||||
|
None,
|
||||||
|
None,
|
||||||
|
None,
|
||||||
|
None,
|
||||||
|
)
|
||||||
|
.unwrap();
|
||||||
|
let Value::Handle(ref name) = id else {
|
||||||
|
panic!()
|
||||||
|
};
|
||||||
|
let control = host.foreign_sessions[name].interrupt_handle.clone();
|
||||||
|
let kernel = id.clone();
|
||||||
|
let code = if language == "python" {
|
||||||
|
"while True: pass"
|
||||||
|
} else {
|
||||||
|
"while(true) {}"
|
||||||
|
};
|
||||||
|
let worker = std::thread::spawn(move || {
|
||||||
|
let record = foreign_session::eval(
|
||||||
|
&mut host,
|
||||||
|
&kernel,
|
||||||
|
None,
|
||||||
|
Some(&Value::Text(code.into())),
|
||||||
|
None,
|
||||||
|
Some(&Value::Int(2)),
|
||||||
|
)
|
||||||
|
.unwrap();
|
||||||
|
(host, record)
|
||||||
|
});
|
||||||
|
let deadline = Instant::now() + Duration::from_secs(1);
|
||||||
|
while !control.0.lock().unwrap().evaluating && Instant::now() < deadline {
|
||||||
|
std::thread::yield_now();
|
||||||
|
}
|
||||||
|
assert!(control.request().unwrap());
|
||||||
|
assert!(
|
||||||
|
control.request().unwrap(),
|
||||||
|
"logical duplicates must coalesce"
|
||||||
|
);
|
||||||
|
let (mut host, record) = worker.join().unwrap();
|
||||||
|
let Value::Map(fields) = record else { panic!() };
|
||||||
|
assert_eq!(
|
||||||
|
fields.iter().find(|(k, _)| k == "timed_out").unwrap().1,
|
||||||
|
Value::Bool(false),
|
||||||
|
"{language}: {fields:?}"
|
||||||
|
);
|
||||||
|
assert_eq!(
|
||||||
|
fields.iter().find(|(k, _)| k == "alive").unwrap().1,
|
||||||
|
Value::Bool(true)
|
||||||
|
);
|
||||||
|
foreign_session::close(&mut host, &id).unwrap();
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,173 @@
|
|||||||
|
//! Production adapter to the executable Lean replay policy.
|
||||||
|
//! All replay decisions come from ReplayPolicy.Cursor, with no Rust fallback.
|
||||||
|
use super::ProtocolStep;
|
||||||
|
use serde_json::{json, Value};
|
||||||
|
use std::collections::VecDeque;
|
||||||
|
mod policy;
|
||||||
|
|
||||||
|
#[derive(Debug, Clone, Copy, PartialEq, Eq)]
|
||||||
|
pub enum DivergenceKind { Missing, Request, Reply, Surplus, Phase, Policy }
|
||||||
|
#[derive(Debug, Clone, PartialEq, Eq)]
|
||||||
|
pub struct Divergence {
|
||||||
|
pub kind: DivergenceKind,
|
||||||
|
pub matched_prefix: usize,
|
||||||
|
pub detail: Option<String>,
|
||||||
|
}
|
||||||
|
impl std::fmt::Display for Divergence {
|
||||||
|
fn fmt(&self, f: &mut std::fmt::Formatter<'_>) -> std::fmt::Result {
|
||||||
|
f.write_str(match self.kind {
|
||||||
|
DivergenceKind::Missing | DivergenceKind::Request => "replay: protocol request differs before dispatch",
|
||||||
|
DivergenceKind::Reply => "replay: protocol response differs",
|
||||||
|
DivergenceKind::Surplus => "replay: recorded execution prefix was not consumed",
|
||||||
|
DivergenceKind::Phase => "replay: invalid protocol validation phase",
|
||||||
|
DivergenceKind::Policy => "replay: verified policy unavailable",
|
||||||
|
})?;
|
||||||
|
if let Some(detail) = &self.detail { write!(f, ": {detail}")? }
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
}
|
||||||
|
#[derive(Debug)]
|
||||||
|
pub struct ReplayCursor {
|
||||||
|
client: Option<policy::Client>,
|
||||||
|
progress: (usize, usize),
|
||||||
|
stopped: Option<Divergence>,
|
||||||
|
}
|
||||||
|
impl From<VecDeque<ProtocolStep>> for ReplayCursor {
|
||||||
|
fn from(expected: VecDeque<ProtocolStep>) -> Self {
|
||||||
|
let count = expected.len();
|
||||||
|
match policy::Client::start(expected) {
|
||||||
|
Ok((client, reply)) if reply.allow && reply.matched == 0 && reply.remaining == count =>
|
||||||
|
Self { client: Some(client), progress: (0, count), stopped: None },
|
||||||
|
result => {
|
||||||
|
let detail = match result { Err(e) => e, Ok(_) => "invalid policy initialization".into() };
|
||||||
|
Self { client: None, progress: (0,count), stopped: Some(Divergence {
|
||||||
|
kind: DivergenceKind::Policy, matched_prefix: 0, detail: Some(detail) }) }
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
impl From<Vec<ProtocolStep>> for ReplayCursor {
|
||||||
|
fn from(expected: Vec<ProtocolStep>) -> Self { VecDeque::from(expected).into() }
|
||||||
|
}
|
||||||
|
/// Private construction, no Clone: actual dispatch consumes this snapshot.
|
||||||
|
pub(super) struct DispatchPermit { session: String, request: Value }
|
||||||
|
impl DispatchPermit {
|
||||||
|
pub(super) fn session(&self) -> &str { &self.session }
|
||||||
|
pub(super) fn request(&self) -> &Value { &self.request }
|
||||||
|
}
|
||||||
|
impl ReplayCursor {
|
||||||
|
fn unavailable(&mut self, detail: String) -> Divergence {
|
||||||
|
self.client.take();
|
||||||
|
let error = Divergence { kind: DivergenceKind::Policy, matched_prefix: self.progress.0, detail: Some(detail) };
|
||||||
|
self.stopped = Some(error.clone());
|
||||||
|
error
|
||||||
|
}
|
||||||
|
fn command(&mut self, command: Value) -> Result<(), Divergence> {
|
||||||
|
if let Some(error) = &self.stopped { return Err(error.clone()) }
|
||||||
|
let result = self.client.as_mut().ok_or_else(|| "no policy process".to_string())
|
||||||
|
.and_then(|client| client.exchange(command));
|
||||||
|
let reply = result.map_err(|e| self.unavailable(e))?;
|
||||||
|
self.progress = (reply.matched, reply.remaining);
|
||||||
|
if reply.allow { return Ok(()) }
|
||||||
|
let kind = match reply.reason.as_deref() {
|
||||||
|
Some("missing") => DivergenceKind::Missing,
|
||||||
|
Some("request") => DivergenceKind::Request,
|
||||||
|
Some("reply") => DivergenceKind::Reply,
|
||||||
|
Some("surplus") => DivergenceKind::Surplus,
|
||||||
|
Some("phase") => DivergenceKind::Phase,
|
||||||
|
_ => return Err(self.unavailable("unknown policy stop reason".into())),
|
||||||
|
};
|
||||||
|
let error = Divergence { kind, matched_prefix: reply.matched, detail: None };
|
||||||
|
self.stopped = Some(error.clone());
|
||||||
|
Err(error)
|
||||||
|
}
|
||||||
|
fn prepare(&mut self, session: &str, request: &Value) -> Result<DispatchPermit, Divergence> {
|
||||||
|
self.command(json!({"op":"prepare", "value":policy::request_key(session,request)}))?;
|
||||||
|
Ok(DispatchPermit { session: session.into(), request: request.clone() })
|
||||||
|
}
|
||||||
|
pub(super) fn accept_response(&mut self, response: &Result<Value,String>) -> Result<(), Divergence> {
|
||||||
|
self.command(json!({"op":"receive", "value":policy::response_key(response)}))
|
||||||
|
}
|
||||||
|
pub fn progress(&self) -> (usize,usize) { self.progress }
|
||||||
|
/// Called only at the outer action boundary; consumes the cursor.
|
||||||
|
pub fn finish(mut self) -> Result<(),Divergence> { self.command(json!({"op":"finish"})) }
|
||||||
|
}
|
||||||
|
pub(super) fn prepare(cursor: Option<&mut ReplayCursor>, session: &str, request: &Value)
|
||||||
|
-> Result<DispatchPermit,Divergence> {
|
||||||
|
if let Some(cursor) = cursor { return cursor.prepare(session,request) }
|
||||||
|
Ok(DispatchPermit { session: session.into(), request: request.clone() })
|
||||||
|
}
|
||||||
|
|
||||||
|
#[cfg(test)]
|
||||||
|
mod tests {
|
||||||
|
use super::*;
|
||||||
|
use serde_json::json;
|
||||||
|
fn step(reply: Result<Value, String>) -> ProtocolStep {
|
||||||
|
ProtocolStep {
|
||||||
|
session: "s".into(),
|
||||||
|
request: json!({"op":"get"}),
|
||||||
|
response: reply,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
#[test]
|
||||||
|
fn local_returns_and_ordinary_failures_preserve_residual_history() {
|
||||||
|
let mut cursor: ReplayCursor =
|
||||||
|
vec![step(Err("foreign failure".into())), step(Ok(json!(7)))].into();
|
||||||
|
assert_eq!(cursor.progress(), (0, 2));
|
||||||
|
let permit = cursor.prepare("s", &json!({"op":"get"})).unwrap();
|
||||||
|
assert_eq!(permit.session(), "s");
|
||||||
|
cursor
|
||||||
|
.accept_response(&Err("foreign failure".into()))
|
||||||
|
.unwrap();
|
||||||
|
assert_eq!(cursor.progress(), (1, 1));
|
||||||
|
cursor.prepare("s", &json!({"op":"get"})).unwrap();
|
||||||
|
cursor.accept_response(&Ok(json!(7))).unwrap();
|
||||||
|
cursor.finish().unwrap();
|
||||||
|
}
|
||||||
|
#[test]
|
||||||
|
fn divergence_is_sticky_and_matching_reply_cannot_revive_it() {
|
||||||
|
let mut cursor: ReplayCursor = vec![step(Ok(json!(7)))].into();
|
||||||
|
cursor.prepare("s", &json!({"op":"get"})).unwrap();
|
||||||
|
let first = cursor.accept_response(&Ok(json!(8))).unwrap_err();
|
||||||
|
assert_eq!(first.kind, DivergenceKind::Reply);
|
||||||
|
assert_eq!(
|
||||||
|
cursor.prepare("s", &json!({"op":"get"})).err().unwrap(),
|
||||||
|
first
|
||||||
|
);
|
||||||
|
assert_eq!(cursor.accept_response(&Ok(json!(7))).unwrap_err(), first);
|
||||||
|
assert_eq!(cursor.finish().unwrap_err(), first);
|
||||||
|
}
|
||||||
|
#[test]
|
||||||
|
fn permit_is_a_snapshot_and_phase_errors_fail_closed() {
|
||||||
|
let mut request = json!({"op":"get"});
|
||||||
|
let mut cursor: ReplayCursor = vec![step(Ok(json!(7)))].into();
|
||||||
|
let permit = cursor.prepare("s", &request).unwrap();
|
||||||
|
request["op"] = json!("write");
|
||||||
|
assert_ne!(permit.request(), &request);
|
||||||
|
assert_eq!(
|
||||||
|
cursor.prepare("s", permit.request()).err().unwrap().kind,
|
||||||
|
DivergenceKind::Phase
|
||||||
|
);
|
||||||
|
assert!(cursor.accept_response(&Ok(json!(7))).is_err());
|
||||||
|
}
|
||||||
|
#[test]
|
||||||
|
fn mismatching_and_missing_requests_never_issue_a_permit() {
|
||||||
|
let mut cursor: ReplayCursor = vec![step(Ok(json!(7)))].into();
|
||||||
|
let error = cursor
|
||||||
|
.prepare("other-session", &json!({"op":"get"}))
|
||||||
|
.err()
|
||||||
|
.unwrap();
|
||||||
|
assert_eq!(error.kind, DivergenceKind::Request);
|
||||||
|
assert_eq!(cursor.progress(), (0, 1));
|
||||||
|
assert_eq!(
|
||||||
|
cursor.prepare("s", &json!({"op":"get"})).err().unwrap(),
|
||||||
|
error
|
||||||
|
);
|
||||||
|
let mut empty: ReplayCursor = Vec::<ProtocolStep>::new().into();
|
||||||
|
assert_eq!(
|
||||||
|
empty.prepare("s", &json!({"op":"get"})).err().unwrap().kind,
|
||||||
|
DivergenceKind::Missing
|
||||||
|
);
|
||||||
|
assert!(empty.finish().is_err());
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,92 @@
|
|||||||
|
//! Transport for the executable Lean policy. This module makes no replay
|
||||||
|
//! acceptance decisions; malformed/unavailable policy responses fail closed.
|
||||||
|
use super::super::ProtocolStep;
|
||||||
|
use serde::Deserialize;
|
||||||
|
use serde_json::{json, Value};
|
||||||
|
use std::io::{BufRead, BufReader, Write};
|
||||||
|
use std::path::PathBuf;
|
||||||
|
use std::process::{Child, ChildStdin, Command, Stdio};
|
||||||
|
use std::sync::mpsc::{self, Receiver};
|
||||||
|
use std::time::Duration;
|
||||||
|
|
||||||
|
#[derive(Debug, Deserialize)]
|
||||||
|
#[serde(deny_unknown_fields)]
|
||||||
|
pub(super) struct Reply {
|
||||||
|
pub policy: String,
|
||||||
|
pub allow: bool,
|
||||||
|
pub matched: usize,
|
||||||
|
pub remaining: usize,
|
||||||
|
pub reason: Option<String>,
|
||||||
|
}
|
||||||
|
|
||||||
|
#[derive(Debug)]
|
||||||
|
pub(super) struct Client {
|
||||||
|
child: Child,
|
||||||
|
input: ChildStdin,
|
||||||
|
replies: Receiver<Result<Reply,String>>,
|
||||||
|
}
|
||||||
|
|
||||||
|
pub(super) fn request_key(session: &str, request: &Value) -> String {
|
||||||
|
serde_json::to_string(&(session,request.to_string())).expect("strings serialize")
|
||||||
|
}
|
||||||
|
pub(super) fn response_key(response: &Result<Value,String>) -> String {
|
||||||
|
serde_json::to_string(response).expect("protocol responses serialize")
|
||||||
|
}
|
||||||
|
|
||||||
|
fn executable() -> PathBuf {
|
||||||
|
if let Some(path) = std::env::var_os("MARQDO_REPLAY_POLICY") { return path.into() }
|
||||||
|
if let Ok(exe) = std::env::current_exe() {
|
||||||
|
if let Some(parent) = exe.parent() {
|
||||||
|
let adjacent = parent.join("marqdo-replay-policy");
|
||||||
|
if adjacent.is_file() { return adjacent }
|
||||||
|
}
|
||||||
|
}
|
||||||
|
PathBuf::from(env!("CARGO_MANIFEST_DIR"))
|
||||||
|
.join("verification/replay-policy/.lake/build/bin/replayPolicy")
|
||||||
|
}
|
||||||
|
|
||||||
|
impl Client {
|
||||||
|
pub(super) fn start(steps: impl IntoIterator<Item=ProtocolStep>) -> Result<(Self,Reply),String> {
|
||||||
|
let path=executable();
|
||||||
|
let mut child=Command::new(&path).stdin(Stdio::piped()).stdout(Stdio::piped())
|
||||||
|
.stderr(Stdio::null()).spawn().map_err(|e|format!("{}: {e}",path.display()))?;
|
||||||
|
let input=child.stdin.take().ok_or("policy stdin unavailable")?;
|
||||||
|
let output=child.stdout.take().ok_or("policy stdout unavailable")?;
|
||||||
|
let (sender,replies)=mpsc::channel();
|
||||||
|
std::thread::spawn(move || {
|
||||||
|
for line in BufReader::new(output).lines() {
|
||||||
|
let reply=line.map_err(|e|e.to_string())
|
||||||
|
.and_then(|line|serde_json::from_str(&line).map_err(|e|e.to_string()));
|
||||||
|
let failed=reply.is_err();
|
||||||
|
if sender.send(reply).is_err() || failed { break }
|
||||||
|
}
|
||||||
|
});
|
||||||
|
let steps: Vec<_>=steps.into_iter().map(|step|json!({
|
||||||
|
"q":request_key(&step.session,&step.request),"r":response_key(&step.response)
|
||||||
|
})).collect();
|
||||||
|
let mut client=Self {child,input,replies};
|
||||||
|
let reply=client.exchange(json!({"op":"init","steps":steps}))?;
|
||||||
|
Ok((client,reply))
|
||||||
|
}
|
||||||
|
|
||||||
|
pub(super) fn exchange(&mut self, command: Value) -> Result<Reply,String> {
|
||||||
|
serde_json::to_writer(&mut self.input,&command).map_err(|e|e.to_string())?;
|
||||||
|
self.input.write_all(b"\n").map_err(|e|e.to_string())?;
|
||||||
|
self.input.flush().map_err(|e|e.to_string())?;
|
||||||
|
let reply=self.replies.recv_timeout(Duration::from_secs(30))
|
||||||
|
.map_err(|e|format!("policy response: {e}"))??;
|
||||||
|
if reply.policy != include_str!(concat!(env!("CARGO_MANIFEST_DIR"), "/verification/replay-policy/POLICY-SHA256")).trim() {
|
||||||
|
return Err("policy executable does not match the compiled source identity".into())
|
||||||
|
}
|
||||||
|
if reply.allow == reply.reason.is_some() {
|
||||||
|
return Err("policy response has inconsistent verdict and reason".into())
|
||||||
|
}
|
||||||
|
Ok(reply)
|
||||||
|
}
|
||||||
|
}
|
||||||
|
impl Drop for Client {
|
||||||
|
fn drop(&mut self) {
|
||||||
|
let _=self.child.kill();
|
||||||
|
let _=self.child.wait();
|
||||||
|
}
|
||||||
|
}
|
||||||
+162
-8
@@ -16,14 +16,95 @@ fn ood_int_err(n: impl std::fmt::Display) -> String {
|
|||||||
format!("json: integer outside V_safe (±(2^53-1)): {n}")
|
format!("json: integer outside V_safe (±(2^53-1)): {n}")
|
||||||
}
|
}
|
||||||
|
|
||||||
|
/// The integer boundary is semantic, not a property of JSON spelling or the
|
||||||
|
/// host's Int/Num tag. Exponent notation must not bypass it.
|
||||||
|
fn checked_number(n: f64) -> Result<serde_json::Value, String> {
|
||||||
|
if !n.is_finite() { return Err("json: non-finite number outside V_safe".into()); }
|
||||||
|
if n.fract() == 0.0 && n.abs() > MAX_SAFE_INT as f64 { return Err(ood_int_err(n)); }
|
||||||
|
Ok(serde_json::Value::Number(serde_json::Number::from_f64(n)
|
||||||
|
.ok_or("json: non-finite number outside V_safe")?))
|
||||||
|
}
|
||||||
|
|
||||||
|
#[derive(Debug)]
|
||||||
|
pub(crate) enum DecodeError { Syntax(String), Domain(String) }
|
||||||
|
|
||||||
|
struct BoundaryValue(Value);
|
||||||
|
impl<'de> serde::Deserialize<'de> for BoundaryValue {
|
||||||
|
fn deserialize<D: serde::Deserializer<'de>>(de: D) -> Result<Self, D::Error> {
|
||||||
|
struct BoundaryVisitor;
|
||||||
|
impl<'de> serde::de::Visitor<'de> for BoundaryVisitor {
|
||||||
|
type Value = BoundaryValue;
|
||||||
|
fn expecting(&self, f: &mut std::fmt::Formatter) -> std::fmt::Result { f.write_str("a boundary JSON value") }
|
||||||
|
fn visit_unit<E: serde::de::Error>(self) -> Result<Self::Value,E> { Ok(BoundaryValue(Value::None)) }
|
||||||
|
fn visit_bool<E: serde::de::Error>(self, v: bool) -> Result<Self::Value,E> { Ok(BoundaryValue(Value::Bool(v))) }
|
||||||
|
fn visit_i64<E: serde::de::Error>(self, n: i64) -> Result<Self::Value,E> {
|
||||||
|
if !in_safe_int(n) { return Err(E::custom(ood_int_err(n))); }
|
||||||
|
Ok(BoundaryValue(Value::Int(n)))
|
||||||
|
}
|
||||||
|
fn visit_u64<E: serde::de::Error>(self, n: u64) -> Result<Self::Value,E> {
|
||||||
|
if n > MAX_SAFE_INT as u64 { return Err(E::custom(ood_int_err(n))); }
|
||||||
|
Ok(BoundaryValue(Value::Int(n as i64)))
|
||||||
|
}
|
||||||
|
fn visit_f64<E: serde::de::Error>(self, n: f64) -> Result<Self::Value,E> {
|
||||||
|
checked_number(n).map_err(E::custom)?;
|
||||||
|
Ok(BoundaryValue(Value::Num(n)))
|
||||||
|
}
|
||||||
|
fn visit_str<E: serde::de::Error>(self, v: &str) -> Result<Self::Value,E> { Ok(BoundaryValue(Value::Text(v.into()))) }
|
||||||
|
fn visit_string<E: serde::de::Error>(self, v: String) -> Result<Self::Value,E> { Ok(BoundaryValue(Value::Text(v))) }
|
||||||
|
fn visit_seq<A: serde::de::SeqAccess<'de>>(self, mut seq: A) -> Result<Self::Value,A::Error> {
|
||||||
|
let mut xs = Vec::new();
|
||||||
|
while let Some(BoundaryValue(v)) = seq.next_element()? { xs.push(v); }
|
||||||
|
Ok(BoundaryValue(Value::List(xs)))
|
||||||
|
}
|
||||||
|
fn visit_map<A: serde::de::MapAccess<'de>>(self, mut map: A) -> Result<Self::Value,A::Error> {
|
||||||
|
use serde::de::Error;
|
||||||
|
let mut fields = Vec::new();
|
||||||
|
let mut keys = std::collections::HashSet::new();
|
||||||
|
while let Some(key) = map.next_key::<String>()? {
|
||||||
|
if !keys.insert(key.clone()) { return Err(A::Error::custom("json: duplicate object key outside V_safe")); }
|
||||||
|
let BoundaryValue(v) = map.next_value()?;
|
||||||
|
fields.push((key, v));
|
||||||
|
}
|
||||||
|
// Preserve the pre-existing JSON object's canonical key order.
|
||||||
|
fields.sort_by(|a, b| a.0.cmp(&b.0));
|
||||||
|
let value = Value::Map(fields);
|
||||||
|
value_to_json(&value).map_err(A::Error::custom)?;
|
||||||
|
Ok(BoundaryValue(value))
|
||||||
|
}
|
||||||
|
}
|
||||||
|
de.deserialize_any(BoundaryVisitor)
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
pub(crate) fn decode_text(text: &str) -> Result<Value, DecodeError> {
|
||||||
|
use serde::Deserialize;
|
||||||
|
let classify = |error: serde_json::Error| {
|
||||||
|
let message = error.to_string();
|
||||||
|
// serde_json categorizes its own numeric-overflow diagnostic as Syntax.
|
||||||
|
// It is a domain refusal for a grammar-valid unbounded JSON number.
|
||||||
|
// Match this trusted decoder diagnostic, never foreign program output.
|
||||||
|
if message.starts_with("number out of range at line ") {
|
||||||
|
return DecodeError::Domain(format!("json: number outside V_safe: {message}"));
|
||||||
|
}
|
||||||
|
match error.classify() {
|
||||||
|
serde_json::error::Category::Data => DecodeError::Domain(message),
|
||||||
|
_ => DecodeError::Syntax(message),
|
||||||
|
}
|
||||||
|
};
|
||||||
|
let mut de = serde_json::Deserializer::from_str(text);
|
||||||
|
let value = BoundaryValue::deserialize(&mut de).map_err(classify)?;
|
||||||
|
de.end().map_err(classify)?;
|
||||||
|
Ok(value.0)
|
||||||
|
}
|
||||||
|
|
||||||
pub fn parse(text: &Value) -> Result<Value, String> {
|
pub fn parse(text: &Value) -> Result<Value, String> {
|
||||||
let s = match text {
|
let s = match text {
|
||||||
Value::Text(s) => s.as_str(),
|
Value::Text(s) => s.as_str(),
|
||||||
_ => return Err("json parse needs text".into()),
|
_ => return Err("json parse needs text".into()),
|
||||||
};
|
};
|
||||||
let v: serde_json::Value =
|
decode_text(s).map_err(|e| match e {
|
||||||
serde_json::from_str(s).map_err(|e| format!("json parse: {e}"))?;
|
DecodeError::Syntax(e) | DecodeError::Domain(e) => format!("json parse: {e}"),
|
||||||
json_to_value(&v)
|
})
|
||||||
}
|
}
|
||||||
|
|
||||||
pub fn stringify(value: &Value, indent: Option<&Value>) -> Result<Value, String> {
|
pub fn stringify(value: &Value, indent: Option<&Value>) -> Result<Value, String> {
|
||||||
@@ -93,6 +174,7 @@ pub(crate) fn json_to_value(v: &serde_json::Value) -> Result<Value, String> {
|
|||||||
return Err(ood_int_err(u));
|
return Err(ood_int_err(u));
|
||||||
} else if let Some(f) = n.as_f64() {
|
} else if let Some(f) = n.as_f64() {
|
||||||
// Host extension: non-integer JSON numbers → Num (not in Lean SafeVal).
|
// Host extension: non-integer JSON numbers → Num (not in Lean SafeVal).
|
||||||
|
checked_number(f)?;
|
||||||
Value::Num(f)
|
Value::Num(f)
|
||||||
} else {
|
} else {
|
||||||
return Err(format!("json: unsupported number: {n}"));
|
return Err(format!("json: unsupported number: {n}"));
|
||||||
@@ -126,9 +208,7 @@ pub(crate) fn value_to_json(v: &Value) -> Result<serde_json::Value, String> {
|
|||||||
}
|
}
|
||||||
serde_json::Value::Number((*n).into())
|
serde_json::Value::Number((*n).into())
|
||||||
}
|
}
|
||||||
Value::Num(n) => serde_json::Number::from_f64(*n)
|
Value::Num(n) => checked_number(*n)?,
|
||||||
.map(serde_json::Value::Number)
|
|
||||||
.unwrap_or(serde_json::Value::Null),
|
|
||||||
Value::Text(s) => serde_json::Value::String(s.clone()),
|
Value::Text(s) => serde_json::Value::String(s.clone()),
|
||||||
Value::List(xs) => {
|
Value::List(xs) => {
|
||||||
let mut arr = Vec::with_capacity(xs.len());
|
let mut arr = Vec::with_capacity(xs.len());
|
||||||
@@ -138,6 +218,22 @@ pub(crate) fn value_to_json(v: &Value) -> Result<serde_json::Value, String> {
|
|||||||
serde_json::Value::Array(arr)
|
serde_json::Value::Array(arr)
|
||||||
}
|
}
|
||||||
Value::Map(entries) => {
|
Value::Map(entries) => {
|
||||||
|
// Column-table maps (all fields lists): refuse unequal list lengths.
|
||||||
|
let list_lens: Vec<usize> = entries
|
||||||
|
.iter()
|
||||||
|
.filter_map(|(_, v)| match v {
|
||||||
|
Value::List(xs) => Some(xs.len()),
|
||||||
|
_ => None,
|
||||||
|
})
|
||||||
|
.collect();
|
||||||
|
if list_lens.len() == entries.len() && list_lens.len() >= 2 {
|
||||||
|
let n0 = list_lens[0];
|
||||||
|
if list_lens.iter().any(|&n| n != n0) {
|
||||||
|
return Err(
|
||||||
|
"json: table column arity mismatch (unequal list lengths)".into(),
|
||||||
|
);
|
||||||
|
}
|
||||||
|
}
|
||||||
let mut map = serde_json::Map::new();
|
let mut map = serde_json::Map::new();
|
||||||
for (k, v) in entries {
|
for (k, v) in entries {
|
||||||
map.insert(k.clone(), value_to_json(v)?);
|
map.insert(k.clone(), value_to_json(v)?);
|
||||||
@@ -153,7 +249,7 @@ pub(crate) fn value_to_json(v: &Value) -> Result<serde_json::Value, String> {
|
|||||||
cells.push(
|
cells.push(
|
||||||
serde_json::Number::from_f64(n)
|
serde_json::Number::from_f64(n)
|
||||||
.map(serde_json::Value::Number)
|
.map(serde_json::Value::Number)
|
||||||
.unwrap_or(serde_json::Value::Null),
|
.ok_or_else(|| "json: non-finite number outside V_safe".to_string())?,
|
||||||
);
|
);
|
||||||
}
|
}
|
||||||
arr.push(serde_json::Value::Array(cells));
|
arr.push(serde_json::Value::Array(cells));
|
||||||
@@ -165,7 +261,7 @@ pub(crate) fn value_to_json(v: &Value) -> Result<serde_json::Value, String> {
|
|||||||
if let crate::formula::Expr::Num(n) = s {
|
if let crate::formula::Expr::Num(n) = s {
|
||||||
serde_json::Number::from_f64(n)
|
serde_json::Number::from_f64(n)
|
||||||
.map(serde_json::Value::Number)
|
.map(serde_json::Value::Number)
|
||||||
.unwrap_or(serde_json::Value::Null)
|
.ok_or_else(|| "json: non-finite number outside V_safe".to_string())?
|
||||||
} else {
|
} else {
|
||||||
serde_json::Value::String(e.as_display())
|
serde_json::Value::String(e.as_display())
|
||||||
}
|
}
|
||||||
@@ -173,6 +269,9 @@ pub(crate) fn value_to_json(v: &Value) -> Result<serde_json::Value, String> {
|
|||||||
},
|
},
|
||||||
Value::Code(c) => serde_json::Value::String(c.source.clone()),
|
Value::Code(c) => serde_json::Value::String(c.source.clone()),
|
||||||
Value::Secret(_) => serde_json::Value::String("<secret>".into()),
|
Value::Secret(_) => serde_json::Value::String("<secret>".into()),
|
||||||
|
Value::Handle(_) => {
|
||||||
|
return Err("json: session handle cannot be serialized".into());
|
||||||
|
}
|
||||||
})
|
})
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -264,4 +363,59 @@ mod tests {
|
|||||||
let err = json_to_value(&j).unwrap_err();
|
let err = json_to_value(&j).unwrap_err();
|
||||||
assert!(err.contains("outside V_safe"), "{err}");
|
assert!(err.contains("outside V_safe"), "{err}");
|
||||||
}
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn refuse_session_handle_encode() {
|
||||||
|
let err = value_to_json(&Value::Handle("s1".into())).unwrap_err();
|
||||||
|
assert!(
|
||||||
|
err.contains("session handle cannot be serialized"),
|
||||||
|
"{err}"
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn refuse_unequal_column_table_encode() {
|
||||||
|
let ragged = Value::Map(vec![
|
||||||
|
("a".into(), Value::List(vec![Value::Int(1), Value::Int(2)])),
|
||||||
|
("b".into(), Value::List(vec![Value::Int(3)])),
|
||||||
|
]);
|
||||||
|
let err = value_to_json(&ragged).unwrap_err();
|
||||||
|
assert!(err.contains("arity mismatch"), "{err}");
|
||||||
|
}
|
||||||
|
#[test]
|
||||||
|
fn refuse_nonfinite_in_nested_payloads() {
|
||||||
|
for n in [f64::NAN, f64::INFINITY, f64::NEG_INFINITY] {
|
||||||
|
for v in [Value::Num(n), Value::List(vec![Value::Num(n)]),
|
||||||
|
Value::Map(vec![("x".into(), Value::Num(n))])] {
|
||||||
|
assert!(value_to_json(&v).unwrap_err().contains("outside V_safe"));
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn exponent_and_float_tags_cannot_bypass_integer_domain() {
|
||||||
|
for text in ["9007199254740992.0", "9.007199254740992e15", "1e100", "1e9999", "-9.007199254740992e15"] {
|
||||||
|
assert!(parse(&Value::Text(text.into())).unwrap_err().contains("outside V_safe"), "{text}");
|
||||||
|
}
|
||||||
|
for n in [9_007_199_254_740_992.0, -9_007_199_254_740_992.0, 1e100] {
|
||||||
|
assert!(value_to_json(&Value::List(vec![Value::Num(n)])).unwrap_err().contains("outside V_safe"));
|
||||||
|
}
|
||||||
|
for text in ["1.5", "-0.0", "9.007199254740991e15"] {
|
||||||
|
assert!(parse(&Value::Text(text.into())).is_ok(), "valid extension {text}");
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn strict_decode_refuses_duplicate_keys_and_ragged_columns() {
|
||||||
|
for text in [r#"{"a":1,"a":2}"#, r#"[{"x":null,"x":true}]"#,
|
||||||
|
r#"{"a":[1],"b":[2,3]}"#] {
|
||||||
|
assert!(matches!(decode_text(text), Err(DecodeError::Domain(_))), "{text}");
|
||||||
|
}
|
||||||
|
for text in [r#"{"a":[1],"b":"metadata"}"#, r#"{"a":[],"b":[]}"#,
|
||||||
|
r#"{"__proto__":{"safe":true},"constructor":"data"}"#] {
|
||||||
|
assert!(decode_text(text).is_ok(), "{text}");
|
||||||
|
}
|
||||||
|
assert!(matches!(decode_text("not JSON"), Err(DecodeError::Syntax(_))));
|
||||||
|
}
|
||||||
|
|
||||||
}
|
}
|
||||||
@@ -23,6 +23,7 @@ mod hash;
|
|||||||
mod html_ops;
|
mod html_ops;
|
||||||
pub(crate) mod json;
|
pub(crate) mod json;
|
||||||
mod log;
|
mod log;
|
||||||
|
pub(crate) mod oracle;
|
||||||
pub mod math;
|
pub mod math;
|
||||||
mod net;
|
mod net;
|
||||||
mod path;
|
mod path;
|
||||||
@@ -106,6 +107,7 @@ pub struct HostContext {
|
|||||||
/// LCG state for `random` / `random_int`.
|
/// LCG state for `random` / `random_int`.
|
||||||
pub rng: u64,
|
pub rng: u64,
|
||||||
pub plots: Vec<PlotArtifact>,
|
pub plots: Vec<PlotArtifact>,
|
||||||
|
pub oracle_observations: Vec<crate::value::Value>,
|
||||||
/// lang → interpreter argv (from `set_cmd`).
|
/// lang → interpreter argv (from `set_cmd`).
|
||||||
pub foreign_cmds: HashMap<String, Vec<String>>,
|
pub foreign_cmds: HashMap<String, Vec<String>>,
|
||||||
/// Process-local language registrations (`register` / `set_cmd`).
|
/// Process-local language registrations (`register` / `set_cmd`).
|
||||||
@@ -120,6 +122,12 @@ pub struct HostContext {
|
|||||||
/// Monotonic session id counter.
|
/// Monotonic session id counter.
|
||||||
#[cfg(feature = "exec-host")]
|
#[cfg(feature = "exec-host")]
|
||||||
pub foreign_session_seq: u64,
|
pub foreign_session_seq: u64,
|
||||||
|
#[cfg(feature = "exec-host")]
|
||||||
|
pub foreign_protocol_steps: Vec<foreign_session::ProtocolStep>,
|
||||||
|
#[cfg(feature = "exec-host")]
|
||||||
|
pub foreign_replay_expected: Option<foreign_session::validation::ReplayCursor>,
|
||||||
|
#[cfg(feature = "exec-host")]
|
||||||
|
pub foreign_replay_divergence: Option<String>,
|
||||||
/// Loaded native plugins (ABI v1/v2).
|
/// Loaded native plugins (ABI v1/v2).
|
||||||
pub plugins: PluginState,
|
pub plugins: PluginState,
|
||||||
/// Entry `.mq.md` source text (for ABI host_query / context injection).
|
/// Entry `.mq.md` source text (for ABI host_query / context injection).
|
||||||
@@ -154,6 +162,7 @@ impl Default for HostContext {
|
|||||||
sleep_limit_ms: Some(30_000),
|
sleep_limit_ms: Some(30_000),
|
||||||
rng: 0xC0FF_EE42_CAFE_BABE,
|
rng: 0xC0FF_EE42_CAFE_BABE,
|
||||||
plots: Vec::new(),
|
plots: Vec::new(),
|
||||||
|
oracle_observations: Vec::new(),
|
||||||
foreign_cmds: HashMap::new(),
|
foreign_cmds: HashMap::new(),
|
||||||
foreign_specs: HashMap::new(),
|
foreign_specs: HashMap::new(),
|
||||||
foreign_config_specs: HashMap::new(),
|
foreign_config_specs: HashMap::new(),
|
||||||
@@ -162,6 +171,12 @@ impl Default for HostContext {
|
|||||||
foreign_sessions: HashMap::new(),
|
foreign_sessions: HashMap::new(),
|
||||||
#[cfg(feature = "exec-host")]
|
#[cfg(feature = "exec-host")]
|
||||||
foreign_session_seq: 0,
|
foreign_session_seq: 0,
|
||||||
|
#[cfg(feature = "exec-host")]
|
||||||
|
foreign_protocol_steps: Vec::new(),
|
||||||
|
#[cfg(feature = "exec-host")]
|
||||||
|
foreign_replay_expected: None,
|
||||||
|
#[cfg(feature = "exec-host")]
|
||||||
|
foreign_replay_divergence: None,
|
||||||
plugins: PluginState::default(),
|
plugins: PluginState::default(),
|
||||||
entry_source: None,
|
entry_source: None,
|
||||||
entry_path: None,
|
entry_path: None,
|
||||||
|
|||||||
@@ -0,0 +1,136 @@
|
|||||||
|
//! Document-level observations, separate from process timing and execution logs.
|
||||||
|
use crate::value::Value;
|
||||||
|
use super::HostContext;
|
||||||
|
|
||||||
|
pub(crate) fn admit(value: &Value) -> Result<(), String> {
|
||||||
|
match value {
|
||||||
|
Value::None | Value::Bool(_) | Value::Text(_) => Ok(()),
|
||||||
|
Value::Int(_) => super::json::value_to_json(value).map(|_| ()),
|
||||||
|
Value::Num(_) => super::json::value_to_json(value).map(|_| ()),
|
||||||
|
Value::List(xs) => { for x in xs { admit(x)?; } Ok(()) }
|
||||||
|
Value::Map(xs) => {
|
||||||
|
super::json::value_to_json(value)?;
|
||||||
|
let mut keys = std::collections::HashSet::new();
|
||||||
|
for (key, x) in xs {
|
||||||
|
if !keys.insert(key) { return Err("oracle: duplicate record field".into()); }
|
||||||
|
admit(x)?;
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
_ => Err("oracle: value outside V_safe".into()),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
pub(crate) fn append(ctx: &mut HostContext, channel: &str, value: &Value) -> Result<(), String> {
|
||||||
|
admit(value)?;
|
||||||
|
ctx.oracle_observations.push(Value::Map(vec![
|
||||||
|
("index".into(), Value::Int(ctx.oracle_observations.len() as i64)),
|
||||||
|
("channel".into(), Value::Text(channel.into())),
|
||||||
|
("value".into(), value.clone()),
|
||||||
|
]));
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
|
||||||
|
/// Project a process result to its semantic observation. Success observes the
|
||||||
|
/// returned payload. Failure observes stable diagnostics, never elapsed time,
|
||||||
|
/// command paths or opaque handles. Both document and live runners use this.
|
||||||
|
pub(crate) fn eval_observation(record: &Value) -> Result<Value, String> {
|
||||||
|
let Value::Map(fields) = record else { return Err("oracle: expected eval record".into()) };
|
||||||
|
let get = |key: &str| fields.iter().find(|(k, _)| k == key).map(|(_,v)|v.clone()).unwrap_or(Value::None);
|
||||||
|
let value = match get("ok") {
|
||||||
|
Value::Bool(true) => get("result"),
|
||||||
|
Value::Bool(false) => {
|
||||||
|
let source = get("diagnostic_source");
|
||||||
|
Value::Map(["ok", "code", "stdout", "stderr", "error", "timed_out", "alive"]
|
||||||
|
.into_iter().map(|key| {
|
||||||
|
let value = get(key);
|
||||||
|
// Alpha-rename only this execution's allocated source path,
|
||||||
|
// only in diagnostics. Keep raw output and ordinary paths intact.
|
||||||
|
let value = match (key, value, &source) {
|
||||||
|
("stderr" | "error", Value::Text(text), Value::Text(path)) if !path.is_empty() =>
|
||||||
|
Value::Text(text.replace(path, "<foreign-source>")),
|
||||||
|
(_, value, _) => value,
|
||||||
|
};
|
||||||
|
(key.to_string(), value)
|
||||||
|
}).collect())
|
||||||
|
},
|
||||||
|
_ => return Err("oracle: eval record missing boolean ok".into()),
|
||||||
|
};
|
||||||
|
admit(&value)?;
|
||||||
|
Ok(value)
|
||||||
|
}
|
||||||
|
|
||||||
|
fn validate(journal: &Value) -> Result<&[Value], String> {
|
||||||
|
let Value::List(rows) = journal else { return Err("oracle journal must be a list".into()) };
|
||||||
|
for (i, row) in rows.iter().enumerate() {
|
||||||
|
let Value::Map(fields) = row else { return Err(format!("oracle step {i}: expected record")) };
|
||||||
|
if fields.len() != 3 { return Err(format!("oracle step {i}: expected index/channel/value")); }
|
||||||
|
let get = |k: &str| fields.iter().find(|(key,_)| key == k).map(|(_,v)|v);
|
||||||
|
if get("index") != Some(&Value::Int(i as i64)) { return Err(format!("oracle step {i}: invalid index")); }
|
||||||
|
if !matches!(get("channel"), Some(Value::Text(s)) if ["eval", "get", "decode"].contains(&s.as_str())) {
|
||||||
|
return Err(format!("oracle step {i}: invalid channel"));
|
||||||
|
}
|
||||||
|
admit(get("value").ok_or_else(|| format!("oracle step {i}: missing value"))?)?;
|
||||||
|
}
|
||||||
|
Ok(rows)
|
||||||
|
}
|
||||||
|
|
||||||
|
/// Pure structural equality on admitted journals; reports the least differing index.
|
||||||
|
pub(crate) fn replay_check(expected: &Value, observed: &Value) -> Result<Value, String> {
|
||||||
|
let a = validate(expected)?;
|
||||||
|
let b = validate(observed)?;
|
||||||
|
// Map field order is not part of record identity (matches JSON object semantics).
|
||||||
|
let canonical = |v: &Value| super::json::value_to_json(v);
|
||||||
|
let mut mismatch = None;
|
||||||
|
for i in 0..a.len().max(b.len()) {
|
||||||
|
if a.get(i).map(canonical).transpose()? != b.get(i).map(canonical).transpose()? {
|
||||||
|
mismatch = Some(i);
|
||||||
|
break;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let index = mismatch.map(|i| Value::Int(i as i64)).unwrap_or(Value::None);
|
||||||
|
Ok(Value::Map(vec![
|
||||||
|
("ok".into(), Value::Bool(mismatch.is_none())),
|
||||||
|
("index".into(), index),
|
||||||
|
("expected".into(), mismatch.and_then(|i| a.get(i)).cloned().unwrap_or(Value::None)),
|
||||||
|
("observed".into(), mismatch.and_then(|i| b.get(i)).cloned().unwrap_or(Value::None)),
|
||||||
|
]))
|
||||||
|
}
|
||||||
|
|
||||||
|
#[cfg(test)]
|
||||||
|
mod tests {
|
||||||
|
use super::*;
|
||||||
|
#[test]
|
||||||
|
fn oracle_journal_structural_mismatch_and_length() {
|
||||||
|
let mut ctx = HostContext::default();
|
||||||
|
append(&mut ctx, "eval", &Value::Int(3)).unwrap();
|
||||||
|
append(&mut ctx, "get", &Value::Int(2)).unwrap();
|
||||||
|
let journal = Value::List(ctx.oracle_observations.clone());
|
||||||
|
let result = replay_check(&journal, &journal).unwrap();
|
||||||
|
assert_eq!(super::super::json::get(&result, &Value::Text("ok".into())).unwrap(), Value::Bool(true));
|
||||||
|
let short = Value::List(ctx.oracle_observations[..1].to_vec());
|
||||||
|
let result = replay_check(&journal, &short).unwrap();
|
||||||
|
assert_eq!(super::super::json::get(&result, &Value::Text("index".into())).unwrap(), Value::Int(1));
|
||||||
|
assert!(append(&mut ctx, "eval", &Value::List(vec![Value::Handle("x".into())])).is_err());
|
||||||
|
let code = Value::Code(crate::value::CodeBlock { lang: "python".into(), source: "1".into() });
|
||||||
|
assert!(admit(&Value::List(vec![code])).is_err());
|
||||||
|
assert_eq!(ctx.oracle_observations.len(), 2);
|
||||||
|
}
|
||||||
|
#[test]
|
||||||
|
fn diagnostic_projection_renames_only_allocated_source_identity() {
|
||||||
|
let make = |path: &str, message: &str| Value::Map(vec![
|
||||||
|
("ok".into(), Value::Bool(false)),
|
||||||
|
("stderr".into(), Value::Text(format!("File {path}: {message}; input /data/original.csv"))),
|
||||||
|
("diagnostic_source".into(), Value::Text(path.into())),
|
||||||
|
]);
|
||||||
|
let a = make("/tmp/allocated-a.py", "ValueError");
|
||||||
|
let b = make("/tmp/allocated-b.py", "ValueError");
|
||||||
|
assert_ne!(a, b, "raw diagnostics must survive");
|
||||||
|
assert_eq!(eval_observation(&a).unwrap(), eval_observation(&b).unwrap());
|
||||||
|
let c = make("/tmp/allocated-b.py", "TypeError");
|
||||||
|
assert_ne!(eval_observation(&a).unwrap(), eval_observation(&c).unwrap());
|
||||||
|
let d = make("/tmp/allocated-b.py", "ValueError /data/changed.csv");
|
||||||
|
assert_ne!(eval_observation(&a).unwrap(), eval_observation(&d).unwrap());
|
||||||
|
}
|
||||||
|
|
||||||
|
}
|
||||||
@@ -194,6 +194,17 @@ impl Clone for PluginState {
|
|||||||
}
|
}
|
||||||
|
|
||||||
impl PluginState {
|
impl PluginState {
|
||||||
|
/// Exercise the real JSON/C ABI without loading an external shared library.
|
||||||
|
#[cfg(test)]
|
||||||
|
pub(crate) fn register_binding_probe(&mut self) {
|
||||||
|
unsafe extern "C" fn echo(args: *const c_char, out: *mut *mut c_char, _err: *mut *mut c_char) -> c_int {
|
||||||
|
if args.is_null() || out.is_null() { return 1; }
|
||||||
|
let Ok(input)=CStr::from_ptr(args).to_str() else { return 1; };
|
||||||
|
*out=host_strdup(input);
|
||||||
|
if (*out).is_null() {1} else {0}
|
||||||
|
}
|
||||||
|
self.fns.insert("binding_probe".into(),RegisteredFn{params:vec!["a".into(),"b".into()],fn_ptr:echo});
|
||||||
|
}
|
||||||
pub fn get(&self, name: &str) -> Option<&RegisteredFn> {
|
pub fn get(&self, name: &str) -> Option<&RegisteredFn> {
|
||||||
self.fns.get(name)
|
self.fns.get(name)
|
||||||
}
|
}
|
||||||
|
|||||||
+79
-85
@@ -1,107 +1,101 @@
|
|||||||
//! Object inheritance: `# Child = > Parent` validation and helpers.
|
//! Object inheritance: `# Child = > Parent` validation and helpers.
|
||||||
|
|
||||||
use std::collections::{HashMap, HashSet};
|
use std::collections::HashSet;
|
||||||
|
|
||||||
use anyhow::Result;
|
use anyhow::Result;
|
||||||
|
|
||||||
use crate::ast::{Function, Module};
|
use crate::ast::{Function, Module};
|
||||||
use crate::diagnostics::{Diagnostic, Span};
|
use crate::diagnostics::Diagnostic;
|
||||||
|
|
||||||
|
/// Import binding paths identify module instances, including repeated imports
|
||||||
|
/// of the same file under different bindings. The tree remains immutable.
|
||||||
|
pub(crate) fn module_namespace(root:&Module, wanted:&Module) -> Option<Vec<String>> {
|
||||||
|
if std::ptr::eq(root,wanted) { return Some(Vec::new()); }
|
||||||
|
let mut imports=root.import_modules.iter().collect::<Vec<_>>();
|
||||||
|
imports.sort_by_key(|(name,_)| *name);
|
||||||
|
for (bind,module) in imports {
|
||||||
|
if let Some(mut path)=module_namespace(module,wanted) {
|
||||||
|
path.insert(0,bind.clone()); return Some(path);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
None
|
||||||
|
}
|
||||||
|
|
||||||
|
pub(crate) fn object_at_namespace<'a>(root:&'a Module,path:&[String],name:&str) -> Option<(&'a Module,&'a Function)> {
|
||||||
|
let mut owner=root;
|
||||||
|
for segment in path { owner=owner.import_modules.get(segment)?; }
|
||||||
|
let object=owner.functions.iter().find(|fun|fun.is_object() && fun.name==name)?;
|
||||||
|
Some((owner,object))
|
||||||
|
}
|
||||||
|
|
||||||
|
/// Bare types prefer their defining module. An imported short-name binding
|
||||||
|
/// resolves its explicit path; a legacy imported bare name must be unique.
|
||||||
|
pub(crate) fn resolve_object<'a>(owner:&'a Module,name:&str) -> Result<(&'a Module,&'a Function),String> {
|
||||||
|
if let Some(alias)=owner.uses.iter().find(|binding|binding.bind==name) {
|
||||||
|
let Some((class,path))=alias.path.split_last() else { return Err("empty object alias".into()); };
|
||||||
|
return object_at_namespace(owner,path,class).ok_or_else(||format!("unknown object type `{name}`"));
|
||||||
|
}
|
||||||
|
if let Some(object)=owner.functions.iter().find(|fun|fun.is_object() && fun.name==name) { return Ok((owner,object)); }
|
||||||
|
fn imported<'a>(module:&'a Module,name:&str,out:&mut Vec<(&'a Module,&'a Function)>) {
|
||||||
|
let mut imports=module.import_modules.iter().collect::<Vec<_>>();imports.sort_by_key(|(name,_)|*name);
|
||||||
|
for (_,child) in imports {
|
||||||
|
out.extend(child.functions.iter().filter(|fun|fun.is_object() && fun.name==name).map(|fun|(child,fun)));
|
||||||
|
imported(child,name,out);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let mut candidates=Vec::new(); imported(owner,name,&mut candidates);
|
||||||
|
match candidates.as_slice() {
|
||||||
|
[only]=>Ok(*only),
|
||||||
|
[]=>Err(format!("unknown object type `{name}`")),
|
||||||
|
_=>Err(format!("ambiguous object type `{name}`; use an explicit import binding")),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
/// Validate that every object's `base` resolves and that the inheritance graph is acyclic.
|
/// Validate that every object's `base` resolves and that the inheritance graph is acyclic.
|
||||||
pub fn validate_inheritance(module: &Module) -> Result<()> {
|
pub fn validate_inheritance(module: &Module) -> Result<()> {
|
||||||
let mut by_name: HashMap<String, (Span, Option<String>)> = HashMap::new();
|
fn modules<'a>(module: &'a Module, out: &mut Vec<&'a Module>) {
|
||||||
collect_objects(module, &mut by_name);
|
out.push(module);
|
||||||
// Deterministic order: source line, then name (stable gold diagnostics).
|
let mut imports=module.import_modules.iter().collect::<Vec<_>>();
|
||||||
let mut names: Vec<String> = by_name.keys().cloned().collect();
|
imports.sort_by_key(|(name,_)| *name);
|
||||||
names.sort_by(|a, b| {
|
for (_, child) in imports { modules(child,out); }
|
||||||
let (sa, _) = &by_name[a];
|
|
||||||
let (sb, _) = &by_name[b];
|
|
||||||
sa.line.cmp(&sb.line).then_with(|| a.cmp(b))
|
|
||||||
});
|
|
||||||
|
|
||||||
for name in &names {
|
|
||||||
let (span, base) = &by_name[name];
|
|
||||||
let Some(base) = base else { continue };
|
|
||||||
if !by_name.contains_key(base) {
|
|
||||||
return Err(Diagnostic::new(
|
|
||||||
None,
|
|
||||||
*span,
|
|
||||||
format!("unknown base type `{base}` for object `{name}`"),
|
|
||||||
)
|
|
||||||
.into());
|
|
||||||
}
|
|
||||||
}
|
}
|
||||||
|
let mut all=Vec::new(); modules(module,&mut all);
|
||||||
for name in &names {
|
for owner in all {
|
||||||
let (span, base) = &by_name[name];
|
for object in owner.functions.iter().filter(|fun|fun.is_object()) {
|
||||||
if base.is_none() {
|
let mut current_owner=owner;
|
||||||
continue;
|
let mut current=object;
|
||||||
}
|
let mut seen=HashSet::new();
|
||||||
let mut path = Vec::new();
|
let mut chain=Vec::new();
|
||||||
let mut cur = name.clone();
|
loop {
|
||||||
loop {
|
chain.push(current.name.clone());
|
||||||
if path.iter().any(|p| p == &cur) {
|
if !seen.insert((current_owner as *const Module,current as *const Function)) {
|
||||||
path.push(cur);
|
return Err(Diagnostic::new(owner.source.path.as_deref(),object.span,
|
||||||
return Err(Diagnostic::new(
|
format!("cyclic inheritance involving `{}` ({})",object.name,chain.join(" → ")))
|
||||||
None,
|
.with_source(&owner.source).into());
|
||||||
*span,
|
}
|
||||||
format!(
|
let Some(base)=¤t.base else { break; };
|
||||||
"cyclic inheritance involving `{name}` ({})",
|
(current_owner,current)=resolve_object(current_owner,base).map_err(|message| {
|
||||||
path.join(" → ")
|
Diagnostic::new(current_owner.source.path.as_deref(),current.span,
|
||||||
),
|
format!("{} base type `{base}` for object `{}`: {message}",if message.starts_with("ambiguous") { "ambiguous" } else { "unknown" },current.name))
|
||||||
)
|
.with_source(¤t_owner.source)
|
||||||
.into());
|
})?;
|
||||||
}
|
}
|
||||||
path.push(cur.clone());
|
|
||||||
let Some((_, Some(next))) = by_name.get(&cur) else {
|
|
||||||
break;
|
|
||||||
};
|
|
||||||
cur = next.clone();
|
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
Ok(())
|
Ok(())
|
||||||
}
|
}
|
||||||
|
|
||||||
fn collect_objects(module: &Module, out: &mut HashMap<String, (Span, Option<String>)>) {
|
|
||||||
for fun in &module.functions {
|
|
||||||
if fun.is_object() {
|
|
||||||
out.entry(fun.name.clone())
|
|
||||||
.or_insert((fun.span, fun.base.clone()));
|
|
||||||
}
|
|
||||||
}
|
|
||||||
for lib in module.import_modules.values() {
|
|
||||||
collect_objects(lib, out);
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
/// Walk the base chain starting at `type_name` (inclusive).
|
/// Walk the base chain starting at `type_name` (inclusive).
|
||||||
pub fn inheritance_chain<'a>(module: &'a Module, type_name: &str) -> Vec<&'a Function> {
|
pub fn inheritance_chain<'a>(module: &'a Module, type_name: &str) -> Vec<&'a Function> {
|
||||||
let mut out = Vec::new();
|
let mut out=Vec::new();
|
||||||
let mut cur = type_name.to_string();
|
let Ok((mut owner,mut object))=resolve_object(module,type_name) else { return out; };
|
||||||
let mut seen = HashSet::new();
|
let mut seen=HashSet::new();
|
||||||
while seen.insert(cur.clone()) {
|
while seen.insert((owner as *const Module,object as *const Function)) {
|
||||||
let Some(obj) = find_object(module, &cur) else {
|
out.push(object);
|
||||||
break;
|
let Some(base)=&object.base else { break; };
|
||||||
};
|
let Ok(next)=resolve_object(owner,base) else { break; };
|
||||||
out.push(obj);
|
(owner,object)=next;
|
||||||
match &obj.base {
|
|
||||||
Some(b) => cur = b.clone(),
|
|
||||||
None => break,
|
|
||||||
}
|
|
||||||
}
|
}
|
||||||
out
|
out
|
||||||
}
|
}
|
||||||
|
|
||||||
fn find_object<'a>(module: &'a Module, name: &str) -> Option<&'a Function> {
|
|
||||||
module
|
|
||||||
.functions
|
|
||||||
.iter()
|
|
||||||
.find(|f| f.name == name && f.is_object())
|
|
||||||
.or_else(|| {
|
|
||||||
module.import_modules.values().find_map(|lib| {
|
|
||||||
lib.functions
|
|
||||||
.iter()
|
|
||||||
.find(|f| f.name == name && f.is_object())
|
|
||||||
})
|
|
||||||
})
|
|
||||||
}
|
|
||||||
+238
-237
@@ -6,7 +6,6 @@ use std::path::{Path, PathBuf};
|
|||||||
|
|
||||||
use crate::ast::{
|
use crate::ast::{
|
||||||
Arg, BinaryOp, CallExpr, Expr, Function, IndexKey, InterpPart, Literal, Module, Param, Stmt,
|
Arg, BinaryOp, CallExpr, Expr, Function, IndexKey, InterpPart, Literal, Module, Param, Stmt,
|
||||||
UnaryOp,
|
|
||||||
};
|
};
|
||||||
use crate::builtin::{
|
use crate::builtin::{
|
||||||
builtin_at, builtin_footnote_get, builtin_int, builtin_iter_items, builtin_join,
|
builtin_at, builtin_footnote_get, builtin_int, builtin_iter_items, builtin_join,
|
||||||
@@ -14,7 +13,7 @@ use crate::builtin::{
|
|||||||
builtin_type,
|
builtin_type,
|
||||||
};
|
};
|
||||||
use crate::debug::{emit_trace, DebugController};
|
use crate::debug::{emit_trace, DebugController};
|
||||||
use crate::diagnostics::{bail_at, Span};
|
use crate::diagnostics::{Diagnostic, DiagnosticFrame, SourceIdentity, Span};
|
||||||
use crate::host::{call_host, HostContext};
|
use crate::host::{call_host, HostContext};
|
||||||
use crate::input_feed::InputFeed;
|
use crate::input_feed::InputFeed;
|
||||||
use crate::capture::{
|
use crate::capture::{
|
||||||
@@ -39,6 +38,9 @@ pub struct Interpreter {
|
|||||||
/// Active loops: `(loop_id, iter_index_0based)`.
|
/// Active loops: `(loop_id, iter_index_0based)`.
|
||||||
loop_stack: Vec<(u32, u32)>,
|
loop_stack: Vec<(u32, u32)>,
|
||||||
current_span: Span,
|
current_span: Span,
|
||||||
|
current_source: SourceIdentity,
|
||||||
|
current_module: Option<*const Module>,
|
||||||
|
diagnostic_frames: Vec<DiagnosticFrame>,
|
||||||
input: InputFeed,
|
input: InputFeed,
|
||||||
host: HostContext,
|
host: HostContext,
|
||||||
debug: Option<Arc<DebugController>>,
|
debug: Option<Arc<DebugController>>,
|
||||||
@@ -100,6 +102,9 @@ impl Interpreter {
|
|||||||
next_loop_id: 1,
|
next_loop_id: 1,
|
||||||
loop_stack: Vec::new(),
|
loop_stack: Vec::new(),
|
||||||
current_span: Span::new(1, 1),
|
current_span: Span::new(1, 1),
|
||||||
|
current_source: SourceIdentity { path: path.map(Path::to_path_buf), sha256: None },
|
||||||
|
current_module: None,
|
||||||
|
diagnostic_frames: Vec::new(),
|
||||||
input: InputFeed::new(false, Vec::new()),
|
input: InputFeed::new(false, Vec::new()),
|
||||||
host: HostContext::for_run(path, Default::default(), Vec::new()),
|
host: HostContext::for_run(path, Default::default(), Vec::new()),
|
||||||
debug: None,
|
debug: None,
|
||||||
@@ -121,6 +126,9 @@ impl Interpreter {
|
|||||||
next_loop_id: 1,
|
next_loop_id: 1,
|
||||||
loop_stack: Vec::new(),
|
loop_stack: Vec::new(),
|
||||||
current_span: Span::new(1, 1),
|
current_span: Span::new(1, 1),
|
||||||
|
current_source: SourceIdentity { path: path.map(Path::to_path_buf), sha256: None },
|
||||||
|
current_module: None,
|
||||||
|
diagnostic_frames: Vec::new(),
|
||||||
input: InputFeed::new(true, Vec::new()),
|
input: InputFeed::new(true, Vec::new()),
|
||||||
host: HostContext::for_capture(path, Default::default()),
|
host: HostContext::for_capture(path, Default::default()),
|
||||||
debug: None,
|
debug: None,
|
||||||
@@ -147,14 +155,36 @@ impl Interpreter {
|
|||||||
std::mem::take(&mut self.host.plots)
|
std::mem::take(&mut self.host.plots)
|
||||||
}
|
}
|
||||||
|
|
||||||
|
#[cfg(all(test, feature = "exec-host"))]
|
||||||
|
pub(crate) fn foreign_source_evidence(&mut self) -> (Vec<Value>, Vec<Value>, Vec<crate::host::foreign_session::ProtocolStep>) {
|
||||||
|
crate::source_refinement_tests::boundary_evidence(&mut self.host)
|
||||||
|
}
|
||||||
|
|
||||||
|
#[cfg(all(test, feature = "exec-host"))]
|
||||||
|
pub(crate) fn application_evidence(&self) -> (Vec<Value>, Vec<crate::host::foreign_session::ProtocolStep>, usize) {
|
||||||
|
(self.host.oracle_observations.clone(), self.host.foreign_protocol_steps.clone(), self.host.foreign_sessions.len())
|
||||||
|
}
|
||||||
|
|
||||||
|
#[cfg(all(test, feature = "exec-host"))]
|
||||||
|
pub(crate) fn causal_replay_evidence(&mut self) -> serde_json::Value {
|
||||||
|
crate::causal_replay_tests::evidence(&mut self.host)
|
||||||
|
}
|
||||||
|
|
||||||
|
#[cfg(test)]
|
||||||
|
pub(crate) fn diagnostic_scope_state(&self) -> (SourceIdentity, usize, Vec<String>, Vec<u32>, bool) {
|
||||||
|
(self.current_source.clone(), self.diagnostic_frames.len(), self.host.call_stack.clone(),
|
||||||
|
self.host.call_site_lines.clone(), self.current_module.is_some())
|
||||||
|
}
|
||||||
|
|
||||||
fn err(&self, message: impl Into<String>) -> anyhow::Error {
|
fn err(&self, message: impl Into<String>) -> anyhow::Error {
|
||||||
bail_at(self.path.as_deref(), self.current_span, message)
|
Diagnostic::new(self.current_source.path.as_deref(), self.current_span, message)
|
||||||
|
.with_source(&self.current_source).with_frames(&self.diagnostic_frames).into()
|
||||||
}
|
}
|
||||||
|
|
||||||
fn err_code(&self, code: &str, message: impl Into<String>) -> anyhow::Error {
|
fn err_code(&self, code: &str, message: impl Into<String>) -> anyhow::Error {
|
||||||
anyhow::Error::new(
|
anyhow::Error::new(
|
||||||
crate::diagnostics::Diagnostic::new(self.path.as_deref(), self.current_span, message)
|
Diagnostic::new(self.current_source.path.as_deref(), self.current_span, message)
|
||||||
.with_code(code),
|
.with_source(&self.current_source).with_frames(&self.diagnostic_frames).with_code(code),
|
||||||
)
|
)
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -367,7 +397,11 @@ impl Interpreter {
|
|||||||
fun: &Function,
|
fun: &Function,
|
||||||
args: &[(String, Value)],
|
args: &[(String, Value)],
|
||||||
) -> Result<Value> {
|
) -> Result<Value> {
|
||||||
self.run_function(module, fun, Env::new(), args, false)
|
let previous=self.site_module;
|
||||||
|
self.site_module=Some(module as *const Module);
|
||||||
|
let result=self.run_function(module, fun, Env::new(), args, false);
|
||||||
|
self.site_module=previous;
|
||||||
|
result
|
||||||
}
|
}
|
||||||
|
|
||||||
/// Bind named arguments for an external call. Unknown names, missing
|
/// Bind named arguments for an external call. Unknown names, missing
|
||||||
@@ -377,6 +411,19 @@ impl Interpreter {
|
|||||||
module: &Module,
|
module: &Module,
|
||||||
fun: &Function,
|
fun: &Function,
|
||||||
args: &[(String, Value)],
|
args: &[(String, Value)],
|
||||||
|
) -> Result<Vec<(String, Value)>> {
|
||||||
|
let previous=self.site_module;
|
||||||
|
self.site_module=Some(module as *const Module);
|
||||||
|
let result=self.in_function_source(module, fun, |this| this.bind_external_args_inner(module, fun, args));
|
||||||
|
self.site_module=previous;
|
||||||
|
result
|
||||||
|
}
|
||||||
|
|
||||||
|
fn bind_external_args_inner(
|
||||||
|
&mut self,
|
||||||
|
module: &Module,
|
||||||
|
fun: &Function,
|
||||||
|
args: &[(String, Value)],
|
||||||
) -> Result<Vec<(String, Value)>> {
|
) -> Result<Vec<(String, Value)>> {
|
||||||
self.current_span = fun.span;
|
self.current_span = fun.span;
|
||||||
self.host.current_line = fun.span.line;
|
self.host.current_line = fun.span.line;
|
||||||
@@ -403,7 +450,9 @@ impl Interpreter {
|
|||||||
.collect();
|
.collect();
|
||||||
let mut env = Env::new();
|
let mut env = Env::new();
|
||||||
let bound = bind_function_args(self, module, fun, &mut env, &fun.params, &ev, false)
|
let bound = bind_function_args(self, module, fun, &mut env, &fun.params, &ev, false)
|
||||||
.map_err(|m| {
|
.map_err(|error| {
|
||||||
|
if Diagnostic::find(&error).is_some() { return error; }
|
||||||
|
let m = error.to_string();
|
||||||
if m.starts_with("missing argument") {
|
if m.starts_with("missing argument") {
|
||||||
self.err_code("call.missing_arg", m)
|
self.err_code("call.missing_arg", m)
|
||||||
} else if m.starts_with("duplicate named argument") {
|
} else if m.starts_with("duplicate named argument") {
|
||||||
@@ -417,7 +466,7 @@ impl Interpreter {
|
|||||||
c,
|
c,
|
||||||
&fun.name,
|
&fun.name,
|
||||||
&bound,
|
&bound,
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
fun.span,
|
fun.span,
|
||||||
) {
|
) {
|
||||||
return Err(d.into());
|
return Err(d.into());
|
||||||
@@ -432,6 +481,10 @@ impl Interpreter {
|
|||||||
Ok(out)
|
Ok(out)
|
||||||
}
|
}
|
||||||
|
|
||||||
|
fn argument_error(&self, error: anyhow::Error) -> anyhow::Error {
|
||||||
|
if Diagnostic::find(&error).is_some() { error } else { self.err(error.to_string()) }
|
||||||
|
}
|
||||||
|
|
||||||
/// Call a function using (and updating) [`Self::entry_bindings`] from `# main`.
|
/// Call a function using (and updating) [`Self::entry_bindings`] from `# main`.
|
||||||
/// Used by browser WASM sessions so handlers share state with the entry object.
|
/// Used by browser WASM sessions so handlers share state with the entry object.
|
||||||
pub fn invoke_in_entry(
|
pub fn invoke_in_entry(
|
||||||
@@ -688,6 +741,59 @@ impl Interpreter {
|
|||||||
}
|
}
|
||||||
|
|
||||||
fn run_function(
|
fn run_function(
|
||||||
|
&mut self,
|
||||||
|
module: &Module,
|
||||||
|
fun: &Function,
|
||||||
|
env: Env,
|
||||||
|
args: &[(String, Value)],
|
||||||
|
capture_entry_env: bool,
|
||||||
|
) -> Result<Value> {
|
||||||
|
self.in_function_source(module, fun, |this| {
|
||||||
|
this.run_function_inner(module, fun, env, args, capture_entry_env)
|
||||||
|
})
|
||||||
|
}
|
||||||
|
|
||||||
|
fn in_function_source<T>(
|
||||||
|
&mut self,
|
||||||
|
module: &Module,
|
||||||
|
fun: &Function,
|
||||||
|
run: impl FnOnce(&mut Self) -> Result<T>,
|
||||||
|
) -> Result<T> {
|
||||||
|
let mut source = module.source.clone();
|
||||||
|
if source.path.is_none() {
|
||||||
|
if self.diagnostic_frames.is_empty() {
|
||||||
|
source.path = self.path.clone();
|
||||||
|
} else if self.current_module == Some(module as *const Module) {
|
||||||
|
source.path = self.current_source.path.clone();
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let caller = (!self.diagnostic_frames.is_empty()).then(|| self.current_source.at(self.current_span));
|
||||||
|
let previous_source = std::mem::replace(&mut self.current_source, source);
|
||||||
|
let previous_module = self.current_module.replace(module as *const Module);
|
||||||
|
let previous_span = std::mem::replace(&mut self.current_span, fun.span);
|
||||||
|
let previous_line = self.host.current_line;
|
||||||
|
self.diagnostic_frames.push(DiagnosticFrame {
|
||||||
|
function: fun.name.clone(), declaration: self.current_source.at(fun.span), call_site: caller,
|
||||||
|
});
|
||||||
|
let result = run(self)
|
||||||
|
.map_err(|error| {
|
||||||
|
if let Some(mut diagnostic) = Diagnostic::find(&error).cloned() {
|
||||||
|
if diagnostic.source_sha256.is_none() && diagnostic.path == self.current_source.path {
|
||||||
|
diagnostic.source_sha256 = self.current_source.sha256.clone();
|
||||||
|
}
|
||||||
|
if diagnostic.frames.is_empty() { diagnostic.frames = self.diagnostic_frames.clone(); }
|
||||||
|
diagnostic.into()
|
||||||
|
} else { self.err(error.to_string()) }
|
||||||
|
});
|
||||||
|
self.diagnostic_frames.pop();
|
||||||
|
self.current_source = previous_source;
|
||||||
|
self.current_module = previous_module;
|
||||||
|
self.current_span = previous_span;
|
||||||
|
self.host.current_line = previous_line;
|
||||||
|
result
|
||||||
|
}
|
||||||
|
|
||||||
|
fn run_function_inner(
|
||||||
&mut self,
|
&mut self,
|
||||||
module: &Module,
|
module: &Module,
|
||||||
fun: &Function,
|
fun: &Function,
|
||||||
@@ -697,7 +803,7 @@ impl Interpreter {
|
|||||||
) -> Result<Value> {
|
) -> Result<Value> {
|
||||||
if self.trace {
|
if self.trace {
|
||||||
emit_trace(
|
emit_trace(
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
Some(fun.span),
|
Some(fun.span),
|
||||||
"enter_fn",
|
"enter_fn",
|
||||||
&[("fn", fun.name.as_str())],
|
&[("fn", fun.name.as_str())],
|
||||||
@@ -706,12 +812,23 @@ impl Interpreter {
|
|||||||
for (k, v) in args {
|
for (k, v) in args {
|
||||||
env.set(k.clone(), v.clone());
|
env.set(k.clone(), v.clone());
|
||||||
}
|
}
|
||||||
|
// Raw/named entry APIs and document metadata must use the same default
|
||||||
|
// semantics as ordinary calls. Already bound defaults are supplied
|
||||||
|
// values here and therefore never execute a second time.
|
||||||
|
let supplied=env.vars.iter().map(|(name,value)|EvArg::Named(name.clone(),value.clone())).collect::<Vec<_>>();
|
||||||
|
let completed=bind_function_args(self,module,fun,&mut env,&fun.params,&supplied,true)?;
|
||||||
|
for (name,value) in completed { env.set(name,value); }
|
||||||
for p in &fun.params {
|
for p in &fun.params {
|
||||||
if env.get(&p.name).is_none() {
|
if env.get(&p.name).is_none() {
|
||||||
env.set(p.name.clone(), Value::None);
|
env.set(p.name.clone(), Value::None);
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
|
if let Some(contract)=&fun.contract {
|
||||||
|
if let Some(diag)=crate::contract::call_arg_diag(contract,&fun.name,&env.vars,self.current_source.path.as_deref(),fun.span) {
|
||||||
|
return Err(diag.into());
|
||||||
|
}
|
||||||
|
}
|
||||||
let ret = Value::None;
|
let ret = Value::None;
|
||||||
self.push_view_call(fun, &env);
|
self.push_view_call(fun, &env);
|
||||||
self.host.push_call_frame(&fun.name);
|
self.host.push_call_frame(&fun.name);
|
||||||
@@ -732,7 +849,7 @@ impl Interpreter {
|
|||||||
if self.trace {
|
if self.trace {
|
||||||
let display = ret.as_display();
|
let display = ret.as_display();
|
||||||
emit_trace(
|
emit_trace(
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
Some(fun.span),
|
Some(fun.span),
|
||||||
"leave_fn",
|
"leave_fn",
|
||||||
&[("fn", fun.name.as_str()), ("value", display.as_str())],
|
&[("fn", fun.name.as_str()), ("value", display.as_str())],
|
||||||
@@ -762,7 +879,7 @@ impl Interpreter {
|
|||||||
// 契约边界 3(T2.2):表绑定 vs 字段契约。
|
// 契约边界 3(T2.2):表绑定 vs 字段契约。
|
||||||
if let Some(c) = fun.var_contracts.get(name) {
|
if let Some(c) = fun.var_contracts.get(name) {
|
||||||
if let Some(d) =
|
if let Some(d) =
|
||||||
crate::contract::fields_diag(c, name, &v, self.path.as_deref(), *span)
|
crate::contract::fields_diag(c, name, &v, self.current_source.path.as_deref(), *span)
|
||||||
{
|
{
|
||||||
return Err(d.into());
|
return Err(d.into());
|
||||||
}
|
}
|
||||||
@@ -770,7 +887,7 @@ impl Interpreter {
|
|||||||
if self.trace {
|
if self.trace {
|
||||||
let display = v.as_display();
|
let display = v.as_display();
|
||||||
emit_trace(
|
emit_trace(
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
Some(*span),
|
Some(*span),
|
||||||
"stmt",
|
"stmt",
|
||||||
&[
|
&[
|
||||||
@@ -801,7 +918,7 @@ impl Interpreter {
|
|||||||
// 契约边界 2(T2.2):返回值 vs 返回契约。
|
// 契约边界 2(T2.2):返回值 vs 返回契约。
|
||||||
if let Some(c) = &fun.contract {
|
if let Some(c) = &fun.contract {
|
||||||
if let Some(d) =
|
if let Some(d) =
|
||||||
crate::contract::return_diag(c, &fun.name, &v, self.path.as_deref(), *span)
|
crate::contract::return_diag(c, &fun.name, &v, self.current_source.path.as_deref(), *span)
|
||||||
{
|
{
|
||||||
return Err(d.into());
|
return Err(d.into());
|
||||||
}
|
}
|
||||||
@@ -809,7 +926,7 @@ impl Interpreter {
|
|||||||
if self.trace {
|
if self.trace {
|
||||||
let display = v.as_display();
|
let display = v.as_display();
|
||||||
emit_trace(
|
emit_trace(
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
Some(*span),
|
Some(*span),
|
||||||
"stmt",
|
"stmt",
|
||||||
&[("kind", "return"), ("value", display.as_str())],
|
&[("kind", "return"), ("value", display.as_str())],
|
||||||
@@ -833,7 +950,7 @@ impl Interpreter {
|
|||||||
self.current_span = *span;
|
self.current_span = *span;
|
||||||
if self.trace {
|
if self.trace {
|
||||||
emit_trace(
|
emit_trace(
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
Some(*span),
|
Some(*span),
|
||||||
"stmt",
|
"stmt",
|
||||||
&[("kind", "call"), ("callee", call.callee.as_str())],
|
&[("kind", "call"), ("callee", call.callee.as_str())],
|
||||||
@@ -865,7 +982,7 @@ impl Interpreter {
|
|||||||
self.current_span = *span;
|
self.current_span = *span;
|
||||||
if self.trace {
|
if self.trace {
|
||||||
emit_trace(
|
emit_trace(
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
Some(*span),
|
Some(*span),
|
||||||
"stmt",
|
"stmt",
|
||||||
&[("kind", "expr")],
|
&[("kind", "expr")],
|
||||||
@@ -901,7 +1018,7 @@ impl Interpreter {
|
|||||||
self.current_span = *span;
|
self.current_span = *span;
|
||||||
if self.trace {
|
if self.trace {
|
||||||
emit_trace(
|
emit_trace(
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
Some(*span),
|
Some(*span),
|
||||||
"stmt",
|
"stmt",
|
||||||
&[("kind", "branch")],
|
&[("kind", "branch")],
|
||||||
@@ -934,7 +1051,7 @@ impl Interpreter {
|
|||||||
self.current_span = *span;
|
self.current_span = *span;
|
||||||
if self.trace {
|
if self.trace {
|
||||||
emit_trace(
|
emit_trace(
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
Some(*span),
|
Some(*span),
|
||||||
"stmt",
|
"stmt",
|
||||||
&[("kind", "while")],
|
&[("kind", "while")],
|
||||||
@@ -946,7 +1063,10 @@ impl Interpreter {
|
|||||||
None
|
None
|
||||||
};
|
};
|
||||||
let mut guard = 0u32;
|
let mut guard = 0u32;
|
||||||
while self.eval_expr(module, fun, env, condition)?.truthy() {
|
loop {
|
||||||
|
self.current_span=*span;
|
||||||
|
self.host.current_line=span.line;
|
||||||
|
if !self.eval_expr(module,fun,env,condition)?.truthy(){break;}
|
||||||
guard += 1;
|
guard += 1;
|
||||||
if guard > 1_000_000 {
|
if guard > 1_000_000 {
|
||||||
return Err(self.err("while loop exceeded iteration limit"));
|
return Err(self.err("while loop exceeded iteration limit"));
|
||||||
@@ -984,7 +1104,7 @@ impl Interpreter {
|
|||||||
self.current_span = *span;
|
self.current_span = *span;
|
||||||
if self.trace {
|
if self.trace {
|
||||||
emit_trace(
|
emit_trace(
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
Some(*span),
|
Some(*span),
|
||||||
"stmt",
|
"stmt",
|
||||||
&[
|
&[
|
||||||
@@ -1113,15 +1233,8 @@ impl Interpreter {
|
|||||||
Ok(Value::Text(s))
|
Ok(Value::Text(s))
|
||||||
}
|
}
|
||||||
Expr::Unary { op, expr } => {
|
Expr::Unary { op, expr } => {
|
||||||
let v = self.eval_expr(module, fun, env, expr)?;
|
let value=self.eval_expr(module,fun,env,expr)?;
|
||||||
match op {
|
crate::builtin::eval_unary(*op,&value).map_err(|message|self.err(message))
|
||||||
UnaryOp::Not => Ok(Value::Bool(!v.truthy())),
|
|
||||||
UnaryOp::Neg => match v {
|
|
||||||
Value::Int(n) => Ok(Value::Int(-n)),
|
|
||||||
Value::Num(n) => Ok(Value::Num(-n)),
|
|
||||||
_ => Err(self.err("unary `-` needs int or num")),
|
|
||||||
},
|
|
||||||
}
|
|
||||||
}
|
}
|
||||||
Expr::Binary { op, left, right } => {
|
Expr::Binary { op, left, right } => {
|
||||||
let l = self.eval_expr(module, fun, env, left)?;
|
let l = self.eval_expr(module, fun, env, left)?;
|
||||||
@@ -1153,7 +1266,7 @@ impl Interpreter {
|
|||||||
{
|
{
|
||||||
return Ok(v);
|
return Ok(v);
|
||||||
}
|
}
|
||||||
eval_binary(*op, &l, &r).map_err(|e| self.err(e.to_string()))
|
crate::builtin::eval_binary(*op, &l, &r).map_err(|e| self.err(e.to_string()))
|
||||||
}
|
}
|
||||||
Expr::Call(call) => self.eval_call(module, fun, env, call),
|
Expr::Call(call) => self.eval_call(module, fun, env, call),
|
||||||
Expr::List(items) => {
|
Expr::List(items) => {
|
||||||
@@ -1182,7 +1295,7 @@ impl Interpreter {
|
|||||||
name,
|
name,
|
||||||
&key,
|
&key,
|
||||||
&Value::None,
|
&Value::None,
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
self.current_span,
|
self.current_span,
|
||||||
) {
|
) {
|
||||||
return Err(d.into());
|
return Err(d.into());
|
||||||
@@ -1197,7 +1310,7 @@ impl Interpreter {
|
|||||||
name,
|
name,
|
||||||
&key,
|
&key,
|
||||||
&out,
|
&out,
|
||||||
self.path.as_deref(),
|
self.current_source.path.as_deref(),
|
||||||
self.current_span,
|
self.current_span,
|
||||||
) {
|
) {
|
||||||
return Err(d.into());
|
return Err(d.into());
|
||||||
@@ -1359,21 +1472,21 @@ impl Interpreter {
|
|||||||
fn eval_bound_function_call(
|
fn eval_bound_function_call(
|
||||||
&mut self,
|
&mut self,
|
||||||
module: &Module,
|
module: &Module,
|
||||||
caller: &Function,
|
_caller: &Function,
|
||||||
env: &mut Env,
|
_env: &mut Env,
|
||||||
target: &Function,
|
target: &Function,
|
||||||
ev_args: &[EvArg],
|
ev_args: &[EvArg],
|
||||||
) -> Result<Value> {
|
) -> Result<Value> {
|
||||||
let bound =
|
let bound =
|
||||||
bind_function_args(self, module, caller, env, &target.params, ev_args, false)
|
bind_function_args(self, module, target, &mut Env::new(), &target.params, ev_args, false)
|
||||||
.map_err(|m| self.err(m))?;
|
.map_err(|e| self.argument_error(e))?;
|
||||||
if let Some(c) = &target.contract {
|
if let Some(c) = &target.contract {
|
||||||
if let Some(d) = crate::contract::call_arg_diag(
|
if let Some(d) = crate::contract::call_arg_diag_in(
|
||||||
c,
|
c,
|
||||||
&target.name,
|
&target.name,
|
||||||
&bound,
|
&bound,
|
||||||
self.path.as_deref(),
|
&self.current_source.at(self.current_span),
|
||||||
self.current_span,
|
&module.source,
|
||||||
) {
|
) {
|
||||||
return Err(d.into());
|
return Err(d.into());
|
||||||
}
|
}
|
||||||
@@ -1387,7 +1500,7 @@ impl Interpreter {
|
|||||||
self.host.pop_call_site_line();
|
self.host.pop_call_site_line();
|
||||||
let result = result?;
|
let result = result?;
|
||||||
if target.is_object() {
|
if target.is_object() {
|
||||||
Ok(tag_instance(&target.name, result))
|
Ok(crate::value::tag_instance(&target.name, &self.object_module_path(module), result))
|
||||||
} else {
|
} else {
|
||||||
Ok(result)
|
Ok(result)
|
||||||
}
|
}
|
||||||
@@ -1520,7 +1633,6 @@ impl Interpreter {
|
|||||||
ev_args: &[EvArg],
|
ev_args: &[EvArg],
|
||||||
) -> Result<Value> {
|
) -> Result<Value> {
|
||||||
let (lib, node) = locate_import_function(module, path).map_err(|m| self.err(m))?;
|
let (lib, node) = locate_import_function(module, path).map_err(|m| self.err(m))?;
|
||||||
let display = path.join(".");
|
|
||||||
|
|
||||||
let bound = {
|
let bound = {
|
||||||
let mut dummy_env = Env::new();
|
let mut dummy_env = Env::new();
|
||||||
@@ -1533,16 +1645,16 @@ impl Interpreter {
|
|||||||
ev_args,
|
ev_args,
|
||||||
false,
|
false,
|
||||||
)
|
)
|
||||||
.map_err(|m| self.err(m))?
|
.map_err(|e| self.argument_error(e))?
|
||||||
};
|
};
|
||||||
// 契约边界 1(T2.2):库路径调用的实参 vs 形参契约。
|
// 契约边界 1(T2.2):库路径调用的实参 vs 形参契约。
|
||||||
if let Some(c) = &node.contract {
|
if let Some(c) = &node.contract {
|
||||||
if let Some(d) = crate::contract::call_arg_diag(
|
if let Some(d) = crate::contract::call_arg_diag_in(
|
||||||
c,
|
c,
|
||||||
&display,
|
&node.name,
|
||||||
&bound,
|
&bound,
|
||||||
self.path.as_deref(),
|
&self.current_source.at(self.current_span),
|
||||||
self.current_span,
|
&lib.source,
|
||||||
) {
|
) {
|
||||||
return Err(d.into());
|
return Err(d.into());
|
||||||
}
|
}
|
||||||
@@ -1557,7 +1669,7 @@ impl Interpreter {
|
|||||||
self.host.pop_call_site_line();
|
self.host.pop_call_site_line();
|
||||||
let result = result?;
|
let result = result?;
|
||||||
if node.is_object() {
|
if node.is_object() {
|
||||||
Ok(tag_instance(&node.name, result))
|
Ok(crate::value::tag_instance(&node.name, &self.object_module_path(lib), result))
|
||||||
} else {
|
} else {
|
||||||
Ok(result)
|
Ok(result)
|
||||||
}
|
}
|
||||||
@@ -1566,7 +1678,7 @@ impl Interpreter {
|
|||||||
fn eval_method_call(
|
fn eval_method_call(
|
||||||
&mut self,
|
&mut self,
|
||||||
module: &Module,
|
module: &Module,
|
||||||
fun: &Function,
|
_fun: &Function,
|
||||||
env: &mut Env,
|
env: &mut Env,
|
||||||
recv_name: &str,
|
recv_name: &str,
|
||||||
method: &str,
|
method: &str,
|
||||||
@@ -1577,12 +1689,19 @@ impl Interpreter {
|
|||||||
.cloned()
|
.cloned()
|
||||||
.ok_or_else(|| self.err(format!("undefined variable `{recv_name}`")))?;
|
.ok_or_else(|| self.err(format!("undefined variable `{recv_name}`")))?;
|
||||||
let type_name = instance_type_name(&recv).map_err(|m| self.err(m))?;
|
let type_name = instance_type_name(&recv).map_err(|m| self.err(m))?;
|
||||||
if find_object_type(module, &type_name).is_none() {
|
// The active root is immutable for this invocation; site_module is
|
||||||
return Err(self.err(format!("unknown object type `{type_name}`")));
|
// installed/restored by the public run/call entry points.
|
||||||
}
|
let root=unsafe { self.site_module.map(|root| &*root) }.unwrap_or(module);
|
||||||
let (owner, _obj, target) = find_method_along_bases(module, &type_name, method)
|
let namespace=crate::value::instance_module(&recv).map_err(|m|self.err(m))?;
|
||||||
|
let (class_owner,class)=if let Some(namespace)=namespace {
|
||||||
|
crate::inherit::object_at_namespace(root,&namespace,&type_name)
|
||||||
|
.ok_or_else(||self.err(format!("unknown object type `{type_name}` in module `{}`",namespace.join("."))))?
|
||||||
|
} else {
|
||||||
|
crate::inherit::resolve_object(module,&type_name).map_err(|m|self.err(m))?
|
||||||
|
};
|
||||||
|
let (owner, _obj, target) = find_method_along_bases(class_owner, class, method)
|
||||||
.ok_or_else(|| {
|
.ok_or_else(|| {
|
||||||
let chain = crate::inherit::inheritance_chain(module, &type_name)
|
let chain = crate::inherit::inheritance_chain(class_owner, &type_name)
|
||||||
.into_iter()
|
.into_iter()
|
||||||
.map(|o| o.name.as_str())
|
.map(|o| o.name.as_str())
|
||||||
.collect::<Vec<_>>()
|
.collect::<Vec<_>>()
|
||||||
@@ -1591,16 +1710,19 @@ impl Interpreter {
|
|||||||
"unknown method `{type_name}.{method}` (searched {chain})"
|
"unknown method `{type_name}.{method}` (searched {chain})"
|
||||||
))
|
))
|
||||||
})?;
|
})?;
|
||||||
let bound = bind_function_args(self, module, fun, env, &target.params, ev_args, false)
|
let mut receiver_env = Env::new();
|
||||||
.map_err(|m| self.err(m))?;
|
receiver_env.set("self".into(), recv.clone());
|
||||||
|
receiver_env.set("自".into(), recv.clone());
|
||||||
|
let bound = bind_function_args(self, owner, target, &mut receiver_env, &target.params, ev_args, false)
|
||||||
|
.map_err(|e| self.argument_error(e))?;
|
||||||
// 契约边界 1(T2.2):方法调用的实参 vs 形参契约。
|
// 契约边界 1(T2.2):方法调用的实参 vs 形参契约。
|
||||||
if let Some(c) = &target.contract {
|
if let Some(c) = &target.contract {
|
||||||
if let Some(d) = crate::contract::call_arg_diag(
|
if let Some(d) = crate::contract::call_arg_diag_in(
|
||||||
c,
|
c,
|
||||||
&target.name,
|
&target.name,
|
||||||
&bound,
|
&bound,
|
||||||
self.path.as_deref(),
|
&self.current_source.at(self.current_span),
|
||||||
self.current_span,
|
&owner.source,
|
||||||
) {
|
) {
|
||||||
return Err(d.into());
|
return Err(d.into());
|
||||||
}
|
}
|
||||||
@@ -1616,11 +1738,16 @@ impl Interpreter {
|
|||||||
self.host.pop_call_site_line();
|
self.host.pop_call_site_line();
|
||||||
let result = result?;
|
let result = result?;
|
||||||
if crate::linalg_ops::is_matrix_value(&recv) {
|
if crate::linalg_ops::is_matrix_value(&recv) {
|
||||||
Ok(crate::linalg_ops::retag_matrix_like(&type_name, result))
|
Ok(crate::value::preserve_instance_module(&recv,crate::linalg_ops::retag_matrix_like(&type_name, result)))
|
||||||
} else {
|
} else {
|
||||||
Ok(result)
|
Ok(result)
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
|
fn object_module_path(&self, module:&Module) -> Vec<String> {
|
||||||
|
let root=unsafe { self.site_module.map(|root| &*root) }.unwrap_or(module);
|
||||||
|
crate::inherit::module_namespace(root,module).unwrap_or_default()
|
||||||
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
fn instance_type_name(v: &Value) -> std::result::Result<String, String> {
|
fn instance_type_name(v: &Value) -> std::result::Result<String, String> {
|
||||||
@@ -1637,23 +1764,6 @@ fn instance_type_name(v: &Value) -> std::result::Result<String, String> {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
fn tag_instance(type_name: &str, value: Value) -> Value {
|
|
||||||
match value {
|
|
||||||
Value::Map(mut entries) => {
|
|
||||||
// Always stamp the constructed type so explicit `` `self` = > Parent ``
|
|
||||||
// in a child constructor still yields the most specific `_type`.
|
|
||||||
entries.retain(|(k, _)| k != "_type");
|
|
||||||
entries.insert(0, ("_type".into(), Value::Text(type_name.into())));
|
|
||||||
Value::Map(entries)
|
|
||||||
}
|
|
||||||
Value::None => Value::Map(vec![("_type".into(), Value::Text(type_name.into()))]),
|
|
||||||
other => Value::Map(vec![
|
|
||||||
("_type".into(), Value::Text(type_name.into())),
|
|
||||||
("value".into(), other),
|
|
||||||
]),
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
/// `lib.member` / `lib.Type.member` against frontmatter imports. Does not execute.
|
/// `lib.member` / `lib.Type.member` against frontmatter imports. Does not execute.
|
||||||
pub(crate) fn locate_import_function<'a>(
|
pub(crate) fn locate_import_function<'a>(
|
||||||
module: &'a Module,
|
module: &'a Module,
|
||||||
@@ -1696,12 +1806,12 @@ pub(crate) fn locate_import_function<'a>(
|
|||||||
fn bind_function_args(
|
fn bind_function_args(
|
||||||
interp: &mut Interpreter,
|
interp: &mut Interpreter,
|
||||||
module: &Module,
|
module: &Module,
|
||||||
caller: &Function,
|
target: &Function,
|
||||||
caller_env: &mut Env,
|
initial_env: &mut Env,
|
||||||
params: &[Param],
|
params: &[Param],
|
||||||
args: &[EvArg],
|
args: &[EvArg],
|
||||||
allow_missing: bool,
|
allow_missing: bool,
|
||||||
) -> std::result::Result<HashMap<String, Value>, String> {
|
) -> Result<HashMap<String, Value>> {
|
||||||
let mut named: HashMap<String, Value> = HashMap::new();
|
let mut named: HashMap<String, Value> = HashMap::new();
|
||||||
let mut positionals = Vec::new();
|
let mut positionals = Vec::new();
|
||||||
for a in args {
|
for a in args {
|
||||||
@@ -1709,7 +1819,7 @@ fn bind_function_args(
|
|||||||
EvArg::Positional(v) => positionals.push(v.clone()),
|
EvArg::Positional(v) => positionals.push(v.clone()),
|
||||||
EvArg::Named(k, v) => {
|
EvArg::Named(k, v) => {
|
||||||
if named.contains_key(k) {
|
if named.contains_key(k) {
|
||||||
return Err(format!("duplicate named argument `{k}`"));
|
return Err(anyhow::anyhow!("duplicate named argument `{k}`"));
|
||||||
}
|
}
|
||||||
named.insert(k.clone(), v.clone());
|
named.insert(k.clone(), v.clone());
|
||||||
}
|
}
|
||||||
@@ -1719,6 +1829,13 @@ fn bind_function_args(
|
|||||||
let mut out: HashMap<String, Value> = HashMap::new();
|
let mut out: HashMap<String, Value> = HashMap::new();
|
||||||
let mut used_named = HashSet::new();
|
let mut used_named = HashSet::new();
|
||||||
let mut pos_i = 0usize;
|
let mut pos_i = 0usize;
|
||||||
|
let mut defaults_env = Env::new();
|
||||||
|
// Only an explicit receiver crosses into a method's default environment.
|
||||||
|
for name in ["self", "自"] {
|
||||||
|
if let Some(value) = initial_env.get(name) {
|
||||||
|
defaults_env.set(name.into(), value.clone());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
for p in params {
|
for p in params {
|
||||||
if let Some(v) = named.get(&p.name) {
|
if let Some(v) = named.get(&p.name) {
|
||||||
@@ -1727,26 +1844,44 @@ fn bind_function_args(
|
|||||||
} else if pos_i < positionals.len() {
|
} else if pos_i < positionals.len() {
|
||||||
out.insert(p.name.clone(), positionals[pos_i].clone());
|
out.insert(p.name.clone(), positionals[pos_i].clone());
|
||||||
pos_i += 1;
|
pos_i += 1;
|
||||||
} else if let Some(def) = &p.default {
|
} else if p.default.is_none() && !allow_missing {
|
||||||
let v = interp
|
return Err(anyhow::anyhow!("missing argument for parameter `{}`", p.name));
|
||||||
.eval_expr(module, caller, caller_env, def)
|
|
||||||
.map_err(|e| e.to_string())?;
|
|
||||||
out.insert(p.name.clone(), v);
|
|
||||||
} else if !allow_missing {
|
|
||||||
return Err(format!("missing argument for parameter `{}`", p.name));
|
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
if pos_i < positionals.len() {
|
if pos_i < positionals.len() {
|
||||||
return Err(format!(
|
return Err(anyhow::anyhow!("too many positional arguments ({} extra)", positionals.len() - pos_i));
|
||||||
"too many positional arguments ({} extra)",
|
|
||||||
positionals.len() - pos_i
|
|
||||||
));
|
|
||||||
}
|
}
|
||||||
|
|
||||||
for (k, v) in named {
|
for (k, v) in named {
|
||||||
if !used_named.contains(&k) && !out.contains_key(&k) {
|
if !used_named.contains(&k) && !out.contains_key(&k) { out.insert(k, v); }
|
||||||
out.insert(k, v);
|
}
|
||||||
|
for (name, value) in &out { defaults_env.set(name.clone(), value.clone()); }
|
||||||
|
for name in ["self", "自"] {
|
||||||
|
if let Some(value)=initial_env.get(name) { defaults_env.set(name.into(),value.clone()); }
|
||||||
|
}
|
||||||
|
for p in params {
|
||||||
|
if out.contains_key(&p.name) { continue; }
|
||||||
|
if let Some(def) = &p.default {
|
||||||
|
let mut evaluate=|this:&mut Interpreter| {
|
||||||
|
let previous_span=this.current_span;
|
||||||
|
let previous_line=this.host.current_line;
|
||||||
|
this.current_span=p.span;
|
||||||
|
this.host.current_line=p.span.line;
|
||||||
|
let result=this.eval_expr(module,target,&mut defaults_env,def);
|
||||||
|
this.current_span=previous_span;
|
||||||
|
this.host.current_line=previous_line;
|
||||||
|
result
|
||||||
|
};
|
||||||
|
let v = if interp.current_module == Some(module as *const Module)
|
||||||
|
&& interp.diagnostic_frames.last().is_some_and(|frame| frame.declaration.span == target.span)
|
||||||
|
{
|
||||||
|
evaluate(interp)?
|
||||||
|
} else {
|
||||||
|
interp.in_function_source(module, target, evaluate)?
|
||||||
|
};
|
||||||
|
out.insert(p.name.clone(), v);
|
||||||
|
}
|
||||||
|
if let Some(value) = out.get(&p.name) {
|
||||||
|
defaults_env.set(p.name.clone(), value.clone());
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -1759,50 +1894,9 @@ fn bind_args(
|
|||||||
args: &[EvArg],
|
args: &[EvArg],
|
||||||
allow_missing: bool,
|
allow_missing: bool,
|
||||||
) -> std::result::Result<HashMap<String, Value>, String> {
|
) -> std::result::Result<HashMap<String, Value>, String> {
|
||||||
let mut named: HashMap<String, Value> = HashMap::new();
|
let names=args.iter().map(|a|match a{EvArg::Positional(_)=>None,EvArg::Named(name,_)=>Some(name.clone())}).collect::<Vec<_>>();
|
||||||
let mut positionals = Vec::new();
|
let values=args.iter().map(|a|match a{EvArg::Positional(value)|EvArg::Named(_,value)=>value.clone()}).collect::<Vec<_>>();
|
||||||
for a in args {
|
crate::arguments::bind(params,&names,&values,allow_missing)
|
||||||
match a {
|
|
||||||
EvArg::Positional(v) => positionals.push(v.clone()),
|
|
||||||
EvArg::Named(k, v) => {
|
|
||||||
if named.contains_key(k) {
|
|
||||||
return Err(format!("duplicate named argument `{k}`"));
|
|
||||||
}
|
|
||||||
named.insert(k.clone(), v.clone());
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
let mut out: HashMap<String, Value> = HashMap::new();
|
|
||||||
let mut used_named = HashSet::new();
|
|
||||||
let mut pos_i = 0usize;
|
|
||||||
|
|
||||||
for p in params {
|
|
||||||
if let Some(v) = named.get(p) {
|
|
||||||
out.insert(p.clone(), v.clone());
|
|
||||||
used_named.insert(p.clone());
|
|
||||||
} else if pos_i < positionals.len() {
|
|
||||||
out.insert(p.clone(), positionals[pos_i].clone());
|
|
||||||
pos_i += 1;
|
|
||||||
} else if !allow_missing {
|
|
||||||
return Err(format!("missing argument for parameter `{p}`"));
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
if pos_i < positionals.len() {
|
|
||||||
return Err(format!(
|
|
||||||
"too many positional arguments ({} extra)",
|
|
||||||
positionals.len() - pos_i
|
|
||||||
));
|
|
||||||
}
|
|
||||||
|
|
||||||
for (k, v) in named {
|
|
||||||
if !used_named.contains(&k) && !out.contains_key(&k) {
|
|
||||||
out.insert(k, v);
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
Ok(out)
|
|
||||||
}
|
}
|
||||||
|
|
||||||
fn collect_decl_reads(expr: &Expr, out: &mut std::collections::HashSet<String>) {
|
fn collect_decl_reads(expr: &Expr, out: &mut std::collections::HashSet<String>) {
|
||||||
@@ -1870,49 +1964,21 @@ fn find_top<'a>(module: &'a Module, name: &str) -> Option<&'a Function> {
|
|||||||
}
|
}
|
||||||
|
|
||||||
/// Resolve `#` object type by name in the entry module or any imported library.
|
/// Resolve `#` object type by name in the entry module or any imported library.
|
||||||
fn find_object_type<'a>(module: &'a Module, name: &str) -> Option<(&'a Module, &'a Function)> {
|
|
||||||
fn search<'a>(
|
|
||||||
module: &'a Module,
|
|
||||||
name: &str,
|
|
||||||
seen: &mut std::collections::HashSet<*const Module>,
|
|
||||||
) -> Option<(&'a Module, &'a Function)> {
|
|
||||||
let key = module as *const Module;
|
|
||||||
if !seen.insert(key) {
|
|
||||||
return None;
|
|
||||||
}
|
|
||||||
if let Some(f) = module
|
|
||||||
.functions
|
|
||||||
.iter()
|
|
||||||
.find(|f| f.name == name && f.is_object())
|
|
||||||
{
|
|
||||||
return Some((module, f));
|
|
||||||
}
|
|
||||||
for lib in module.import_modules.values() {
|
|
||||||
if let Some(hit) = search(lib, name, seen) {
|
|
||||||
return Some(hit);
|
|
||||||
}
|
|
||||||
}
|
|
||||||
None
|
|
||||||
}
|
|
||||||
let mut seen = std::collections::HashSet::new();
|
|
||||||
search(module, name, &mut seen)
|
|
||||||
}
|
|
||||||
|
|
||||||
/// Resolve `` `obj`.method `` along the inheritance chain (`_type` first, then bases).
|
/// Resolve `` `obj`.method `` along the inheritance chain (`_type` first, then bases).
|
||||||
fn find_method_along_bases<'a>(
|
fn find_method_along_bases<'a>(
|
||||||
module: &'a Module,
|
module: &'a Module,
|
||||||
type_name: &str,
|
object: &'a Function,
|
||||||
method: &str,
|
method: &str,
|
||||||
) -> Option<(&'a Module, &'a Function, &'a Function)> {
|
) -> Option<(&'a Module, &'a Function, &'a Function)> {
|
||||||
let mut cur = type_name.to_string();
|
let mut owner=module;
|
||||||
|
let mut obj=object;
|
||||||
let mut seen = std::collections::HashSet::new();
|
let mut seen = std::collections::HashSet::new();
|
||||||
while seen.insert(cur.clone()) {
|
while seen.insert((owner as *const Module,obj as *const Function)) {
|
||||||
let (owner, obj) = find_object_type(module, &cur)?;
|
|
||||||
if let Some(target) = obj.children.iter().find(|c| c.name == method) {
|
if let Some(target) = obj.children.iter().find(|c| c.name == method) {
|
||||||
return Some((owner, obj, target));
|
return Some((owner, obj, target));
|
||||||
}
|
}
|
||||||
match &obj.base {
|
match &obj.base {
|
||||||
Some(b) => cur = b.clone(),
|
Some(base) => { (owner,obj)=crate::inherit::resolve_object(owner,base).ok()?; },
|
||||||
None => break,
|
None => break,
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
@@ -1964,71 +2030,6 @@ fn lit_to_value(lit: &Literal) -> Value {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
fn eval_binary(op: BinaryOp, l: &Value, r: &Value) -> Result<Value> {
|
|
||||||
match op {
|
|
||||||
BinaryOp::Add => match (l, r) {
|
|
||||||
(Value::Int(a), Value::Int(b)) => Ok(Value::Int(a + b)),
|
|
||||||
(Value::Num(a), Value::Num(b)) => Ok(Value::Num(a + b)),
|
|
||||||
(Value::Int(a), Value::Num(b)) => Ok(Value::Num(*a as f64 + b)),
|
|
||||||
(Value::Num(a), Value::Int(b)) => Ok(Value::Num(a + *b as f64)),
|
|
||||||
(Value::Text(a), Value::Text(b)) => Ok(Value::Text(format!("{a}{b}"))),
|
|
||||||
(Value::Text(a), Value::Secret(b)) => Ok(Value::Text(format!("{a}{b}"))),
|
|
||||||
(Value::Secret(a), Value::Text(b)) => Ok(Value::Text(format!("{a}{b}"))),
|
|
||||||
(Value::Secret(a), Value::Secret(b)) => Ok(Value::Text(format!("{a}{b}"))),
|
|
||||||
(Value::Text(a), b) => Ok(Value::Text(format!("{a}{}", b.as_display()))),
|
|
||||||
(a, Value::Text(b)) => Ok(Value::Text(format!("{}{b}", a.as_display()))),
|
|
||||||
_ => bail!("`+` needs ints, nums, or text"),
|
|
||||||
},
|
|
||||||
BinaryOp::Sub => match (l, r) {
|
|
||||||
(Value::Int(a), Value::Int(b)) => Ok(Value::Int(a - b)),
|
|
||||||
(Value::Num(a), Value::Num(b)) => Ok(Value::Num(a - b)),
|
|
||||||
(Value::Int(a), Value::Num(b)) => Ok(Value::Num(*a as f64 - b)),
|
|
||||||
(Value::Num(a), Value::Int(b)) => Ok(Value::Num(a - *b as f64)),
|
|
||||||
_ => bail!("`-` needs ints or nums"),
|
|
||||||
},
|
|
||||||
BinaryOp::Mul => match (l, r) {
|
|
||||||
(Value::Int(a), Value::Int(b)) => Ok(Value::Int(a * b)),
|
|
||||||
(Value::Num(a), Value::Num(b)) => Ok(Value::Num(a * b)),
|
|
||||||
(Value::Int(a), Value::Num(b)) => Ok(Value::Num(*a as f64 * b)),
|
|
||||||
(Value::Num(a), Value::Int(b)) => Ok(Value::Num(a * *b as f64)),
|
|
||||||
_ => bail!("`*` needs ints or nums"),
|
|
||||||
},
|
|
||||||
BinaryOp::Div => match (l, r) {
|
|
||||||
(Value::Int(_), Value::Int(0)) => bail!("division by zero"),
|
|
||||||
(Value::Int(a), Value::Int(b)) => Ok(Value::Int(a / b)),
|
|
||||||
(Value::Num(_), Value::Num(b)) if *b == 0.0 => bail!("division by zero"),
|
|
||||||
(Value::Int(_), Value::Num(b)) if *b == 0.0 => bail!("division by zero"),
|
|
||||||
(Value::Num(_), Value::Int(0)) => bail!("division by zero"),
|
|
||||||
(Value::Num(a), Value::Num(b)) => Ok(Value::Num(a / b)),
|
|
||||||
(Value::Int(a), Value::Num(b)) => Ok(Value::Num(*a as f64 / b)),
|
|
||||||
(Value::Num(a), Value::Int(b)) => Ok(Value::Num(a / *b as f64)),
|
|
||||||
_ => bail!("`/` needs ints or nums"),
|
|
||||||
},
|
|
||||||
BinaryOp::Eq => Ok(Value::Bool(l == r)),
|
|
||||||
BinaryOp::Ne => Ok(Value::Bool(l != r)),
|
|
||||||
BinaryOp::Lt => cmp_ord(l, r, |o| o.is_lt()),
|
|
||||||
BinaryOp::Le => cmp_ord(l, r, |o| o.is_le()),
|
|
||||||
BinaryOp::Gt => cmp_ord(l, r, |o| o.is_gt()),
|
|
||||||
BinaryOp::Ge => cmp_ord(l, r, |o| o.is_ge()),
|
|
||||||
BinaryOp::And | BinaryOp::Or => unreachable!("handled above"),
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
fn cmp_ord(l: &Value, r: &Value, f: impl Fn(std::cmp::Ordering) -> bool) -> Result<Value> {
|
|
||||||
match (l, r) {
|
|
||||||
(Value::Int(a), Value::Int(b)) => Ok(Value::Bool(f(a.cmp(b)))),
|
|
||||||
(Value::Num(a), Value::Num(b)) => Ok(Value::Bool(f(a.partial_cmp(b).unwrap_or(std::cmp::Ordering::Equal)))),
|
|
||||||
(Value::Int(a), Value::Num(b)) => {
|
|
||||||
Ok(Value::Bool(f((*a as f64).partial_cmp(b).unwrap_or(std::cmp::Ordering::Equal))))
|
|
||||||
}
|
|
||||||
(Value::Num(a), Value::Int(b)) => {
|
|
||||||
Ok(Value::Bool(f(a.partial_cmp(&(*b as f64)).unwrap_or(std::cmp::Ordering::Equal))))
|
|
||||||
}
|
|
||||||
(Value::Text(a), Value::Text(b)) => Ok(Value::Bool(f(a.cmp(b)))),
|
|
||||||
_ => bail!("comparison needs two ints/nums or two texts"),
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
fn brief_trace_val(v: &Value) -> String {
|
fn brief_trace_val(v: &Value) -> String {
|
||||||
let s = v.as_display();
|
let s = v.as_display();
|
||||||
if s.chars().count() > 24 {
|
if s.chars().count() > 24 {
|
||||||
|
|||||||
+11
@@ -4,6 +4,7 @@
|
|||||||
//! CLI also offers `view` for AST-backed browsing.
|
//! CLI also offers `view` for AST-backed browsing.
|
||||||
|
|
||||||
pub mod aliases;
|
pub mod aliases;
|
||||||
|
mod arguments;
|
||||||
pub mod artifact;
|
pub mod artifact;
|
||||||
pub mod label;
|
pub mod label;
|
||||||
pub mod migrate;
|
pub mod migrate;
|
||||||
@@ -45,6 +46,16 @@ pub mod project;
|
|||||||
pub mod repair;
|
pub mod repair;
|
||||||
pub mod sema;
|
pub mod sema;
|
||||||
pub mod value;
|
pub mod value;
|
||||||
|
#[cfg(all(test, feature = "exec-host"))]
|
||||||
|
mod source_refinement_tests;
|
||||||
|
#[cfg(all(test, feature = "exec-host"))]
|
||||||
|
mod application_tests;
|
||||||
|
#[cfg(all(test, feature = "exec-host"))]
|
||||||
|
mod causal_replay_tests;
|
||||||
|
#[cfg(test)]
|
||||||
|
mod source_map_tests;
|
||||||
|
#[cfg(test)]
|
||||||
|
mod frontend_elaboration_tests;
|
||||||
#[cfg(feature = "net-host")]
|
#[cfg(feature = "net-host")]
|
||||||
pub mod version_check;
|
pub mod version_check;
|
||||||
#[cfg(feature = "view")]
|
#[cfg(feature = "view")]
|
||||||
|
|||||||
+36
-2
@@ -26,10 +26,22 @@ pub fn load_module_with_ctx(path: &Path, ctx: &BindingContext) -> Result<Module>
|
|||||||
load_module_inner(path, &mut visited, ctx)
|
load_module_inner(path, &mut visited, ctx)
|
||||||
}
|
}
|
||||||
|
|
||||||
|
/// Load recorded entry text at its original path. Imports and metadata retain
|
||||||
|
/// normal file-relative resolution; the user's source file is never rewritten.
|
||||||
|
pub(crate) fn load_module_with_source(path: &Path, source: &str, ctx: &BindingContext) -> Result<Module> {
|
||||||
|
load_module_inner_source(path, &mut HashSet::new(), ctx, Some(source))
|
||||||
|
}
|
||||||
|
|
||||||
fn load_module_inner(
|
fn load_module_inner(
|
||||||
path: &Path,
|
path: &Path,
|
||||||
visited: &mut HashSet<PathBuf>,
|
visited: &mut HashSet<PathBuf>,
|
||||||
ctx: &BindingContext,
|
ctx: &BindingContext,
|
||||||
|
) -> Result<Module> {
|
||||||
|
load_module_inner_source(path, visited, ctx, None)
|
||||||
|
}
|
||||||
|
|
||||||
|
fn load_module_inner_source(
|
||||||
|
path: &Path, visited: &mut HashSet<PathBuf>, ctx: &BindingContext, source_override: Option<&str>,
|
||||||
) -> Result<Module> {
|
) -> Result<Module> {
|
||||||
let canon = path.canonicalize().unwrap_or_else(|_| path.to_path_buf());
|
let canon = path.canonicalize().unwrap_or_else(|_| path.to_path_buf());
|
||||||
if !visited.insert(canon.clone()) {
|
if !visited.insert(canon.clone()) {
|
||||||
@@ -37,11 +49,14 @@ fn load_module_inner(
|
|||||||
}
|
}
|
||||||
|
|
||||||
let result = (|| {
|
let result = (|| {
|
||||||
let source = read_module_source(path)
|
let source = match source_override {
|
||||||
.with_context(|| format!("failed to read {}", path.display()))?;
|
Some(source) => source.to_string(),
|
||||||
|
None => read_module_source(path).with_context(|| format!("failed to read {}", path.display()))?,
|
||||||
|
};
|
||||||
let markup = frontmatter_markup(&source);
|
let markup = frontmatter_markup(&source);
|
||||||
let mut module = crate::parse::expr::with_markup(markup, || parse_source(&source))
|
let mut module = crate::parse::expr::with_markup(markup, || parse_source(&source))
|
||||||
.map_err(|e| attach_path(path, e))?;
|
.map_err(|e| attach_path(path, e))?;
|
||||||
|
module.source.path = Some(path.to_path_buf());
|
||||||
|
|
||||||
// Resolve Artifact Metadata bindings (entry and imports share the same ctx).
|
// Resolve Artifact Metadata bindings (entry and imports share the same ctx).
|
||||||
let file_ctx = BindingContext {
|
let file_ctx = BindingContext {
|
||||||
@@ -343,6 +358,7 @@ fn load_module_from_source_inner(
|
|||||||
let markup = frontmatter_markup(source);
|
let markup = frontmatter_markup(source);
|
||||||
let mut module = crate::parse::expr::with_markup(markup, || parse_source(source))
|
let mut module = crate::parse::expr::with_markup(markup, || parse_source(source))
|
||||||
.map_err(|e| label_error(label, e))?;
|
.map_err(|e| label_error(label, e))?;
|
||||||
|
module.source.path = Some(PathBuf::from(label));
|
||||||
module.metadata = resolve_metadata(&module.metadata_raw, ctx, Span::new(1, 1))
|
module.metadata = resolve_metadata(&module.metadata_raw, ctx, Span::new(1, 1))
|
||||||
.map_err(|e| label_error(label, e))?;
|
.map_err(|e| label_error(label, e))?;
|
||||||
let imports = module.imports.clone();
|
let imports = module.imports.clone();
|
||||||
@@ -429,4 +445,22 @@ mod tests {
|
|||||||
"{msg}"
|
"{msg}"
|
||||||
);
|
);
|
||||||
}
|
}
|
||||||
|
#[test]
|
||||||
|
fn recorded_source_resolves_relative_imports_without_rewriting_files() {
|
||||||
|
let root=std::path::PathBuf::from(env!("CARGO_MANIFEST_DIR"));
|
||||||
|
let dir=root.join(format!("target/load-recorded-{}-{}",std::process::id(),std::time::SystemTime::now().duration_since(std::time::UNIX_EPOCH).unwrap().as_nanos()));
|
||||||
|
std::fs::create_dir_all(&dir).unwrap();let entry=dir.join("main.mq.md");
|
||||||
|
let original="# main\n\n> print text=original\n";
|
||||||
|
std::fs::write(&entry,original).unwrap();std::fs::write(dir.join("dep.mq.md"),"# helper\n\n> print text=dependency\n").unwrap();
|
||||||
|
let recorded="---\nimport:\n dep: dep.mq.md\n---\n# main\n\n> print text=recorded\n";
|
||||||
|
let ctx=BindingContext::from_binds(&[],cwd_for_path(Some(&entry)));
|
||||||
|
let module=load_module_with_source(&entry,recorded,&ctx).unwrap();
|
||||||
|
assert!(module.import_modules.contains_key("dep"));
|
||||||
|
assert_eq!(std::fs::read_to_string(&entry).unwrap(),original);
|
||||||
|
let cyclic="---\nimport:\n again: main.mq.md\n---\n# main\n";
|
||||||
|
assert!(load_module_with_source(&entry,cyclic,&ctx).unwrap_err().to_string().contains("circular import"));
|
||||||
|
assert_eq!(std::fs::read_to_string(&entry).unwrap(),original);
|
||||||
|
std::fs::remove_dir_all(dir).unwrap();
|
||||||
|
}
|
||||||
|
|
||||||
}
|
}
|
||||||
@@ -508,6 +508,20 @@ impl<'a> Parser<'a> {
|
|||||||
});
|
});
|
||||||
}
|
}
|
||||||
if self.eat("-") {
|
if self.eat("-") {
|
||||||
|
// The magnitude of i64::MIN is not itself a positive i64 literal.
|
||||||
|
// Recognize its signed token before recursively parsing a unary
|
||||||
|
// operand; decimal literals keep their floating-point type.
|
||||||
|
let start = self.i;
|
||||||
|
self.skip_ws();
|
||||||
|
let digits = self.rest().bytes().take_while(u8::is_ascii_digit).count();
|
||||||
|
let end = self.i + digits;
|
||||||
|
if &self.src[self.i..end] == "9223372036854775808"
|
||||||
|
&& !self.src[end..].starts_with(['.', 'e', 'E'])
|
||||||
|
{
|
||||||
|
self.i = end;
|
||||||
|
return Ok(Expr::Literal(Literal::Int(i64::MIN)));
|
||||||
|
}
|
||||||
|
self.i = start;
|
||||||
let expr = self.parse_unary()?;
|
let expr = self.parse_unary()?;
|
||||||
return Ok(Expr::Unary {
|
return Ok(Expr::Unary {
|
||||||
op: UnaryOp::Neg,
|
op: UnaryOp::Neg,
|
||||||
|
|||||||
+42
-6
@@ -26,7 +26,9 @@ use crate::parse::expr::parse_expr as parse_expr_str;
|
|||||||
/// Parse full source (with optional frontmatter) into a module AST.
|
/// Parse full source (with optional frontmatter) into a module AST.
|
||||||
pub fn parse_source(source: &str) -> Result<Module> {
|
pub fn parse_source(source: &str) -> Result<Module> {
|
||||||
let lines = classify_source(source);
|
let lines = classify_source(source);
|
||||||
parse_classified(&lines)
|
let mut module = parse_classified(&lines)?;
|
||||||
|
module.source = crate::diagnostics::SourceIdentity::from_source(None, source);
|
||||||
|
Ok(module)
|
||||||
}
|
}
|
||||||
|
|
||||||
pub fn parse_classified(lines: &[ClassifiedLine]) -> Result<Module> {
|
pub fn parse_classified(lines: &[ClassifiedLine]) -> Result<Module> {
|
||||||
@@ -63,14 +65,17 @@ pub fn parse_classified(lines: &[ClassifiedLine]) -> Result<Module> {
|
|||||||
bail!("import bind `{}` conflicts with top-level name", u.bind);
|
bail!("import bind `{}` conflicts with top-level name", u.bind);
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
Ok(Module {
|
let module=Module {
|
||||||
|
source: Default::default(),
|
||||||
imports,
|
imports,
|
||||||
uses,
|
uses,
|
||||||
functions,
|
functions,
|
||||||
import_modules: std::collections::HashMap::new(),
|
import_modules: std::collections::HashMap::new(),
|
||||||
metadata_raw,
|
metadata_raw,
|
||||||
metadata: Vec::new(),
|
metadata: Vec::new(),
|
||||||
})
|
};
|
||||||
|
crate::ast::validate_parameters(&module)?;
|
||||||
|
Ok(module)
|
||||||
}
|
}
|
||||||
|
|
||||||
struct Cursor<'a> {
|
struct Cursor<'a> {
|
||||||
@@ -320,7 +325,7 @@ impl<'a> Cursor<'a> {
|
|||||||
if self.peek_is_prose() {
|
if self.peek_is_prose() {
|
||||||
break;
|
break;
|
||||||
}
|
}
|
||||||
if let Some(param) = parse_param_line(trimmed) {
|
if let Some(param) = parse_param_line(trimmed, Span::new(l.line_no,1)) {
|
||||||
if fun.body.is_empty() {
|
if fun.body.is_empty() {
|
||||||
fun.params.push(param);
|
fun.params.push(param);
|
||||||
self.bump();
|
self.bump();
|
||||||
@@ -891,6 +896,24 @@ impl<'a> Cursor<'a> {
|
|||||||
if !header_done {
|
if !header_done {
|
||||||
bail!("expected GFM table after empty assignment");
|
bail!("expected GFM table after empty assignment");
|
||||||
}
|
}
|
||||||
|
// Strong / Surface: unequal row arity is stuck — no silent pad/truncate.
|
||||||
|
for (line_no, cells) in &data_rows {
|
||||||
|
if cells.len() != header.len() {
|
||||||
|
return Err(Diagnostic::new(
|
||||||
|
None,
|
||||||
|
Span {
|
||||||
|
line: *line_no,
|
||||||
|
col: 1,
|
||||||
|
},
|
||||||
|
format!(
|
||||||
|
"table row arity mismatch: expected {} columns, got {}",
|
||||||
|
header.len(),
|
||||||
|
cells.len()
|
||||||
|
),
|
||||||
|
)
|
||||||
|
.into());
|
||||||
|
}
|
||||||
|
}
|
||||||
let row_oriented = header
|
let row_oriented = header
|
||||||
.first()
|
.first()
|
||||||
.map(|h| is_row_table_marker(h))
|
.map(|h| is_row_table_marker(h))
|
||||||
@@ -1260,7 +1283,7 @@ fn parse_backtick_ident(s: &str) -> Option<String> {
|
|||||||
Some(name.to_string())
|
Some(name.to_string())
|
||||||
}
|
}
|
||||||
|
|
||||||
fn parse_param_line(trimmed: &str) -> Option<crate::ast::Param> {
|
fn parse_param_line(trimmed: &str, span:Span) -> Option<crate::ast::Param> {
|
||||||
use crate::ast::Param;
|
use crate::ast::Param;
|
||||||
let rest = trimmed.strip_prefix('+')?.trim();
|
let rest = trimmed.strip_prefix('+')?.trim();
|
||||||
if rest.is_empty() || !rest.starts_with('`') {
|
if rest.is_empty() || !rest.starts_with('`') {
|
||||||
@@ -1285,6 +1308,7 @@ fn parse_param_line(trimmed: &str) -> Option<crate::ast::Param> {
|
|||||||
};
|
};
|
||||||
Some(Param {
|
Some(Param {
|
||||||
name,
|
name,
|
||||||
|
span,
|
||||||
default,
|
default,
|
||||||
inferred: false,
|
inferred: false,
|
||||||
})
|
})
|
||||||
@@ -2086,6 +2110,17 @@ fn merge_inferred_params(
|
|||||||
let mut needs_input = HashSet::new();
|
let mut needs_input = HashSet::new();
|
||||||
let mut bound = HashSet::new();
|
let mut bound = HashSet::new();
|
||||||
let mut assign_decls = Vec::new();
|
let mut assign_decls = Vec::new();
|
||||||
|
// Defaults execute before the body. Reads used only there still require
|
||||||
|
// declared inputs; later body assignments cannot satisfy those reads.
|
||||||
|
for param in &fun.params {
|
||||||
|
if let Some(default)=¶m.default { collect_reads_expr(default,&mut needs_input); }
|
||||||
|
}
|
||||||
|
for (_,default,_) in prose_decls {
|
||||||
|
if let Some(default)=default {
|
||||||
|
let parsed=parse_expr_prefer_var(default).or_else(|_|parse_value_or_interp(default))?;
|
||||||
|
collect_reads_expr(&parsed,&mut needs_input);
|
||||||
|
}
|
||||||
|
}
|
||||||
collect_names_needing_input(
|
collect_names_needing_input(
|
||||||
&fun.body,
|
&fun.body,
|
||||||
&mut bound,
|
&mut bound,
|
||||||
@@ -2113,7 +2148,7 @@ fn merge_inferred_params(
|
|||||||
}
|
}
|
||||||
events.sort_by_key(|e| (e.0, e.1));
|
events.sort_by_key(|e| (e.0, e.1));
|
||||||
|
|
||||||
for (_line, _ord, name, default_txt) in events {
|
for (line, _ord, name, default_txt) in events {
|
||||||
if name == "self" || name == "自" {
|
if name == "self" || name == "自" {
|
||||||
continue;
|
continue;
|
||||||
}
|
}
|
||||||
@@ -2135,6 +2170,7 @@ fn merge_inferred_params(
|
|||||||
};
|
};
|
||||||
fun.params.push(Param {
|
fun.params.push(Param {
|
||||||
name,
|
name,
|
||||||
|
span:Span::new(line,1),
|
||||||
default,
|
default,
|
||||||
inferred: true,
|
inferred: true,
|
||||||
});
|
});
|
||||||
|
|||||||
+6
-192
@@ -5,8 +5,6 @@
|
|||||||
//! dynamics are marked separately.
|
//! dynamics are marked separately.
|
||||||
|
|
||||||
use crate::ast::{CallExpr, Function, Module};
|
use crate::ast::{CallExpr, Function, Module};
|
||||||
use crate::diagnostics::Span;
|
|
||||||
use crate::host::HostFn;
|
|
||||||
|
|
||||||
/// Why a call site is not a static BoundCall.
|
/// Why a call site is not a static BoundCall.
|
||||||
#[derive(Debug, Clone, Copy, PartialEq, Eq)]
|
#[derive(Debug, Clone, Copy, PartialEq, Eq)]
|
||||||
@@ -26,31 +24,7 @@ impl DynamicReason {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
/// Runtime resolution shared by Tree (and mirrored by Bytecode rules).
|
pub type ExecTarget<'a> = super::resolution::Target<&'a Function, &'a Module>;
|
||||||
#[derive(Debug)]
|
|
||||||
pub enum ExecTarget<'a> {
|
|
||||||
/// Function in the calling module (or nested children).
|
|
||||||
Local(&'a Function),
|
|
||||||
/// `bind.member…` through `module.import_modules`.
|
|
||||||
Import {
|
|
||||||
bind: String,
|
|
||||||
lib: &'a Module,
|
|
||||||
fun: &'a Function,
|
|
||||||
path: Vec<String>,
|
|
||||||
},
|
|
||||||
Builtin(&'static str),
|
|
||||||
Host(HostFn),
|
|
||||||
/// Plugin / method / call_fn — not a static BoundCall.
|
|
||||||
Dynamic {
|
|
||||||
reason: DynamicReason,
|
|
||||||
name: String,
|
|
||||||
},
|
|
||||||
Unresolved {
|
|
||||||
message: String,
|
|
||||||
#[allow(dead_code)]
|
|
||||||
span_hint: Option<Span>,
|
|
||||||
},
|
|
||||||
}
|
|
||||||
|
|
||||||
pub fn call_display(call: &CallExpr) -> String {
|
pub fn call_display(call: &CallExpr) -> String {
|
||||||
if let Some(path) = &call.path {
|
if let Some(path) = &call.path {
|
||||||
@@ -62,172 +36,12 @@ pub fn call_display(call: &CallExpr) -> String {
|
|||||||
call.callee.clone()
|
call.callee.clone()
|
||||||
}
|
}
|
||||||
|
|
||||||
fn find_in_children<'a>(fun: &'a Function, name: &str) -> Option<&'a Function> {
|
/// Same-module bare names never search imports.
|
||||||
for child in &fun.children {
|
pub fn lookup_local<'a>(module: &'a Module, current: &'a Function, name: &str) -> Option<&'a Function> {
|
||||||
if child.name == name {
|
super::resolution::lookup(&super::resolution::AstView::default(), &module, current, name)
|
||||||
return Some(child);
|
|
||||||
}
|
|
||||||
if let Some(f) = find_in_children(child, name) {
|
|
||||||
return Some(f);
|
|
||||||
}
|
|
||||||
}
|
|
||||||
None
|
|
||||||
}
|
}
|
||||||
|
pub fn resolve_for_exec<'a>(module: &'a Module, current: &'a Function, call: &CallExpr) -> ExecTarget<'a> {
|
||||||
/// Same-module bare-name lookup (never searches imports).
|
super::resolution::resolve(&super::resolution::AstView::default(), &module, current, call)
|
||||||
pub fn lookup_local<'a>(
|
|
||||||
module: &'a Module,
|
|
||||||
current: &'a Function,
|
|
||||||
name: &str,
|
|
||||||
) -> Option<&'a Function> {
|
|
||||||
if let Some(f) = find_in_children(current, name) {
|
|
||||||
return Some(f);
|
|
||||||
}
|
|
||||||
module.functions.iter().find(|f| f.name == name)
|
|
||||||
}
|
|
||||||
|
|
||||||
fn walk_path<'a>(lib: &'a Module, path: &[String]) -> Result<&'a Function, String> {
|
|
||||||
let display = path.join(".");
|
|
||||||
if path.is_empty() {
|
|
||||||
return Err("empty knowledge path".into());
|
|
||||||
}
|
|
||||||
let mut parent_is_object = false;
|
|
||||||
let mut node = lib
|
|
||||||
.functions
|
|
||||||
.iter()
|
|
||||||
.find(|f| f.name == path[0])
|
|
||||||
.ok_or_else(|| format!("unknown `{display}`"))?;
|
|
||||||
for seg in &path[1..] {
|
|
||||||
parent_is_object = node.is_object();
|
|
||||||
node = node
|
|
||||||
.children
|
|
||||||
.iter()
|
|
||||||
.find(|c| c.name == *seg)
|
|
||||||
.ok_or_else(|| format!("unknown `{display}`"))?;
|
|
||||||
}
|
|
||||||
if parent_is_object && node.level != 1 && crate::ast::function_uses_receiver(node) {
|
|
||||||
return Err(format!(
|
|
||||||
"`{display}` is an instance method; call it as `var`.{}",
|
|
||||||
node.name
|
|
||||||
));
|
|
||||||
}
|
|
||||||
Ok(node)
|
|
||||||
}
|
|
||||||
|
|
||||||
fn resolve_import_path<'a>(module: &'a Module, path: &[String]) -> ExecTarget<'a> {
|
|
||||||
let display = path.join(".");
|
|
||||||
if path.len() < 2 {
|
|
||||||
return ExecTarget::Unresolved {
|
|
||||||
message: format!("library path `{display}`: need at least `lib.member`"),
|
|
||||||
span_hint: None,
|
|
||||||
};
|
|
||||||
}
|
|
||||||
let bind = &path[0];
|
|
||||||
let Some(lib) = module.import_modules.get(bind) else {
|
|
||||||
return ExecTarget::Unresolved {
|
|
||||||
message: format!("unknown library `{bind}` (import it in frontmatter)"),
|
|
||||||
span_hint: None,
|
|
||||||
};
|
|
||||||
};
|
|
||||||
match walk_path(lib, &path[1..]) {
|
|
||||||
Ok(fun) => ExecTarget::Import {
|
|
||||||
bind: bind.clone(),
|
|
||||||
lib,
|
|
||||||
fun,
|
|
||||||
path: path.to_vec(),
|
|
||||||
},
|
|
||||||
Err(message) => ExecTarget::Unresolved {
|
|
||||||
message,
|
|
||||||
span_hint: None,
|
|
||||||
},
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
/// Resolve a call for execution. Import bare-name leakage is forbidden (G02).
|
|
||||||
pub fn resolve_for_exec<'a>(
|
|
||||||
module: &'a Module,
|
|
||||||
current: &'a Function,
|
|
||||||
call: &CallExpr,
|
|
||||||
) -> ExecTarget<'a> {
|
|
||||||
if call.receiver.is_some() {
|
|
||||||
return ExecTarget::Dynamic {
|
|
||||||
reason: DynamicReason::MethodReceiver,
|
|
||||||
name: call_display(call),
|
|
||||||
};
|
|
||||||
}
|
|
||||||
|
|
||||||
if let Some(path) = &call.path {
|
|
||||||
if module.import_modules.contains_key(&path[0]) {
|
|
||||||
return resolve_import_path(module, path);
|
|
||||||
}
|
|
||||||
// Same-module definition-tree path (`Type.member` / nested), BoundCall.
|
|
||||||
if path.len() >= 2 {
|
|
||||||
match walk_path(module, path) {
|
|
||||||
Ok(fun) => return ExecTarget::Local(fun),
|
|
||||||
Err(_) if path.len() == 2 => {
|
|
||||||
// Possible local-variable method; caller checks env.
|
|
||||||
return ExecTarget::Dynamic {
|
|
||||||
reason: DynamicReason::MethodReceiver,
|
|
||||||
name: call_display(call),
|
|
||||||
};
|
|
||||||
}
|
|
||||||
Err(message) => {
|
|
||||||
return ExecTarget::Unresolved {
|
|
||||||
message,
|
|
||||||
span_hint: None,
|
|
||||||
};
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
return ExecTarget::Unresolved {
|
|
||||||
message: format!(
|
|
||||||
"library path `{}`: need at least `lib.member`",
|
|
||||||
path.join(".")
|
|
||||||
),
|
|
||||||
span_hint: None,
|
|
||||||
};
|
|
||||||
}
|
|
||||||
|
|
||||||
if let Some(u) = module.uses.iter().find(|u| u.bind == call.callee) {
|
|
||||||
return resolve_import_path(module, &u.path);
|
|
||||||
}
|
|
||||||
|
|
||||||
match call.callee.as_str() {
|
|
||||||
"print" | "input" | "len" | "str" | "int" | "type" | "trim" | "split" | "join" | "at" => {
|
|
||||||
return ExecTarget::Builtin(match call.callee.as_str() {
|
|
||||||
"print" => "print",
|
|
||||||
"input" => "input",
|
|
||||||
"len" => "len",
|
|
||||||
"str" => "str",
|
|
||||||
"int" => "int",
|
|
||||||
"type" => "type",
|
|
||||||
"trim" => "trim",
|
|
||||||
"split" => "split",
|
|
||||||
"join" => "join",
|
|
||||||
"at" => "at",
|
|
||||||
_ => unreachable!(),
|
|
||||||
});
|
|
||||||
}
|
|
||||||
"call_fn" => {
|
|
||||||
return ExecTarget::Dynamic {
|
|
||||||
reason: DynamicReason::CallFn,
|
|
||||||
name: "call_fn".into(),
|
|
||||||
};
|
|
||||||
}
|
|
||||||
other if HostFn::from_name(other).is_some() => {
|
|
||||||
return ExecTarget::Host(HostFn::from_name(other).unwrap());
|
|
||||||
}
|
|
||||||
_ => {}
|
|
||||||
}
|
|
||||||
|
|
||||||
if let Some(fun) = lookup_local(module, current, &call.callee) {
|
|
||||||
return ExecTarget::Local(fun);
|
|
||||||
}
|
|
||||||
|
|
||||||
ExecTarget::Dynamic {
|
|
||||||
reason: DynamicReason::Plugin,
|
|
||||||
name: call.callee.clone(),
|
|
||||||
}
|
|
||||||
}
|
}
|
||||||
|
|
||||||
pub fn is_static_bound(target: &ExecTarget<'_>) -> bool {
|
pub fn is_static_bound(target: &ExecTarget<'_>) -> bool {
|
||||||
|
|||||||
@@ -857,6 +857,11 @@ fn collect_call_sites(function: &Function) -> Vec<(usize, CallExpr, u32)> {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
// Omitted arguments execute these expressions before the body. Leaving
|
||||||
|
// them out lets the pure-call policy miss both direct and transitive effects.
|
||||||
|
for param in &function.params {
|
||||||
|
if let Some(default) = ¶m.default { expr(default, function.span.line, &mut calls); }
|
||||||
|
}
|
||||||
statements(&function.body, &mut calls);
|
statements(&function.body, &mut calls);
|
||||||
calls
|
calls
|
||||||
}
|
}
|
||||||
|
|||||||
@@ -5,6 +5,7 @@
|
|||||||
//! the meaning of the same source text.
|
//! the meaning of the same source text.
|
||||||
|
|
||||||
pub mod bind;
|
pub mod bind;
|
||||||
|
pub(crate) mod resolution;
|
||||||
pub mod extract;
|
pub mod extract;
|
||||||
pub mod ir;
|
pub mod ir;
|
||||||
pub mod lock;
|
pub mod lock;
|
||||||
|
|||||||
@@ -0,0 +1,254 @@
|
|||||||
|
//! Ordered declaration lookup, independent of the declaration representation.
|
||||||
|
use super::bind::{call_display, DynamicReason};
|
||||||
|
use crate::{ast::CallExpr, diagnostics::Span, host::HostFn};
|
||||||
|
|
||||||
|
pub(crate) trait NameView {
|
||||||
|
type Function: Copy;
|
||||||
|
type Module: Clone;
|
||||||
|
fn roots(&self, module: &Self::Module) -> Vec<Self::Function>;
|
||||||
|
fn children(&self, function: Self::Function) -> Vec<Self::Function>;
|
||||||
|
fn parent(&self, module: &Self::Module, function: Self::Function) -> Option<Self::Function>;
|
||||||
|
fn same(&self, left: Self::Function, right: Self::Function) -> bool;
|
||||||
|
fn name(&self, function: Self::Function) -> String;
|
||||||
|
fn level(&self, function: Self::Function) -> u8;
|
||||||
|
fn is_object(&self, function: Self::Function) -> bool;
|
||||||
|
fn uses_receiver(&self, function: Self::Function) -> bool;
|
||||||
|
fn import(&self, module: &Self::Module, name: &str) -> Option<Self::Module>;
|
||||||
|
fn used_path(&self, module: &Self::Module, name: &str) -> Option<Vec<String>>;
|
||||||
|
}
|
||||||
|
#[derive(Debug)]
|
||||||
|
pub enum Target<F, M> {
|
||||||
|
Local(F),
|
||||||
|
Import {
|
||||||
|
bind: String,
|
||||||
|
lib: M,
|
||||||
|
fun: F,
|
||||||
|
path: Vec<String>,
|
||||||
|
},
|
||||||
|
Builtin(&'static str),
|
||||||
|
Host(HostFn),
|
||||||
|
Dynamic {
|
||||||
|
reason: DynamicReason,
|
||||||
|
name: String,
|
||||||
|
},
|
||||||
|
Unresolved {
|
||||||
|
message: String,
|
||||||
|
span_hint: Option<Span>,
|
||||||
|
},
|
||||||
|
}
|
||||||
|
fn ancestors<V: NameView>(
|
||||||
|
view: &V,
|
||||||
|
nodes: Vec<V::Function>,
|
||||||
|
current: V::Function,
|
||||||
|
path: &mut Vec<V::Function>,
|
||||||
|
) -> bool {
|
||||||
|
for node in nodes {
|
||||||
|
if view.same(node, current) {
|
||||||
|
return true;
|
||||||
|
}
|
||||||
|
path.push(node);
|
||||||
|
if ancestors(view, view.children(node), current, path) {
|
||||||
|
return true;
|
||||||
|
}
|
||||||
|
path.pop();
|
||||||
|
}
|
||||||
|
false
|
||||||
|
}
|
||||||
|
pub(crate) fn lookup<V: NameView>(
|
||||||
|
view: &V,
|
||||||
|
module: &V::Module,
|
||||||
|
current: V::Function,
|
||||||
|
name: &str,
|
||||||
|
) -> Option<V::Function> {
|
||||||
|
let mut cursor = Some(current);
|
||||||
|
while let Some(node) = cursor {
|
||||||
|
if let Some(f) = view
|
||||||
|
.children(node)
|
||||||
|
.into_iter()
|
||||||
|
.find(|f| view.name(*f) == name)
|
||||||
|
{
|
||||||
|
return Some(f);
|
||||||
|
}
|
||||||
|
cursor = view.parent(module, node);
|
||||||
|
}
|
||||||
|
view.roots(module)
|
||||||
|
.into_iter()
|
||||||
|
.find(|f| view.name(*f) == name)
|
||||||
|
}
|
||||||
|
fn walk<V: NameView>(view: &V, module: &V::Module, path: &[String]) -> Result<V::Function, String> {
|
||||||
|
let display = path.join(".");
|
||||||
|
let first = path.first().ok_or("empty knowledge path")?;
|
||||||
|
let mut node = view
|
||||||
|
.roots(module)
|
||||||
|
.into_iter()
|
||||||
|
.find(|f| view.name(*f) == *first)
|
||||||
|
.ok_or_else(|| format!("unknown `{display}`"))?;
|
||||||
|
let mut parent_is_object = false;
|
||||||
|
for segment in &path[1..] {
|
||||||
|
parent_is_object = view.is_object(node);
|
||||||
|
node = view
|
||||||
|
.children(node)
|
||||||
|
.into_iter()
|
||||||
|
.find(|f| view.name(*f) == *segment)
|
||||||
|
.ok_or_else(|| format!("unknown `{display}`"))?;
|
||||||
|
}
|
||||||
|
if parent_is_object && view.level(node) != 1 && view.uses_receiver(node) {
|
||||||
|
return Err(format!(
|
||||||
|
"`{display}` is an instance method; call it as `var`.{}",
|
||||||
|
view.name(node)
|
||||||
|
));
|
||||||
|
}
|
||||||
|
Ok(node)
|
||||||
|
}
|
||||||
|
fn imported<V: NameView>(
|
||||||
|
view: &V,
|
||||||
|
module: &V::Module,
|
||||||
|
path: &[String],
|
||||||
|
) -> Target<V::Function, V::Module> {
|
||||||
|
let unresolved = |message| Target::Unresolved {
|
||||||
|
message,
|
||||||
|
span_hint: None,
|
||||||
|
};
|
||||||
|
if path.len() < 2 {
|
||||||
|
return unresolved(format!(
|
||||||
|
"library path `{}`: need at least `lib.member`",
|
||||||
|
path.join(".")
|
||||||
|
));
|
||||||
|
}
|
||||||
|
let bind = &path[0];
|
||||||
|
let Some(lib) = view.import(module, bind) else {
|
||||||
|
return unresolved(format!(
|
||||||
|
"unknown library `{bind}` (import it in frontmatter)"
|
||||||
|
));
|
||||||
|
};
|
||||||
|
match walk(view, &lib, &path[1..]) {
|
||||||
|
Ok(fun) => Target::Import {
|
||||||
|
bind: bind.clone(),
|
||||||
|
lib,
|
||||||
|
fun,
|
||||||
|
path: path.to_vec(),
|
||||||
|
},
|
||||||
|
Err(message) => unresolved(message),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
pub(crate) fn resolve<V: NameView>(
|
||||||
|
view: &V,
|
||||||
|
module: &V::Module,
|
||||||
|
current: V::Function,
|
||||||
|
call: &CallExpr,
|
||||||
|
) -> Target<V::Function, V::Module> {
|
||||||
|
if call.receiver.is_some() {
|
||||||
|
return Target::Dynamic {
|
||||||
|
reason: DynamicReason::MethodReceiver,
|
||||||
|
name: call_display(call),
|
||||||
|
};
|
||||||
|
}
|
||||||
|
if let Some(path) = &call.path {
|
||||||
|
if path
|
||||||
|
.first()
|
||||||
|
.is_some_and(|p| view.import(module, p).is_some())
|
||||||
|
{
|
||||||
|
return imported(view, module, path);
|
||||||
|
}
|
||||||
|
if path.len() >= 2 {
|
||||||
|
return match walk(view, module, path) {
|
||||||
|
Ok(fun) => Target::Local(fun),
|
||||||
|
Err(_) if path.len() == 2 => Target::Dynamic {
|
||||||
|
reason: DynamicReason::MethodReceiver,
|
||||||
|
name: call_display(call),
|
||||||
|
},
|
||||||
|
Err(message) => Target::Unresolved {
|
||||||
|
message,
|
||||||
|
span_hint: None,
|
||||||
|
},
|
||||||
|
};
|
||||||
|
}
|
||||||
|
return Target::Unresolved {
|
||||||
|
message: format!(
|
||||||
|
"library path `{}`: need at least `lib.member`",
|
||||||
|
path.join(".")
|
||||||
|
),
|
||||||
|
span_hint: None,
|
||||||
|
};
|
||||||
|
}
|
||||||
|
if let Some(path) = view.used_path(module, &call.callee) {
|
||||||
|
return imported(view, module, &path);
|
||||||
|
}
|
||||||
|
if crate::arguments::builtin_signature(&call.callee).is_some() {
|
||||||
|
if call.callee == "call_fn" {
|
||||||
|
return Target::Dynamic {
|
||||||
|
reason: DynamicReason::CallFn,
|
||||||
|
name: "call_fn".into(),
|
||||||
|
};
|
||||||
|
}
|
||||||
|
let name = match call.callee.as_str() {
|
||||||
|
"print" => "print",
|
||||||
|
"input" => "input",
|
||||||
|
"len" => "len",
|
||||||
|
"str" => "str",
|
||||||
|
"int" => "int",
|
||||||
|
"type" => "type",
|
||||||
|
"trim" => "trim",
|
||||||
|
"split" => "split",
|
||||||
|
"join" => "join",
|
||||||
|
"at" => "at",
|
||||||
|
_ => unreachable!(),
|
||||||
|
};
|
||||||
|
return Target::Builtin(name);
|
||||||
|
}
|
||||||
|
if let Some(host) = HostFn::from_name(&call.callee) {
|
||||||
|
return Target::Host(host);
|
||||||
|
}
|
||||||
|
if let Some(fun) = lookup(view, module, current, &call.callee) {
|
||||||
|
return Target::Local(fun);
|
||||||
|
}
|
||||||
|
Target::Dynamic {
|
||||||
|
reason: DynamicReason::Plugin,
|
||||||
|
name: call.callee.clone(),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[derive(Default)]
|
||||||
|
pub(crate) struct AstView<'a>(std::marker::PhantomData<&'a crate::ast::Module>);
|
||||||
|
impl<'a> NameView for AstView<'a> {
|
||||||
|
type Function = &'a crate::ast::Function;
|
||||||
|
type Module = &'a crate::ast::Module;
|
||||||
|
fn roots(&self, m: &Self::Module) -> Vec<Self::Function> {
|
||||||
|
m.functions.iter().collect()
|
||||||
|
}
|
||||||
|
fn children(&self, f: Self::Function) -> Vec<Self::Function> {
|
||||||
|
f.children.iter().collect()
|
||||||
|
}
|
||||||
|
fn parent(&self, m: &Self::Module, f: Self::Function) -> Option<Self::Function> {
|
||||||
|
let mut path = Vec::new();
|
||||||
|
if ancestors(self, self.roots(m), f, &mut path) {
|
||||||
|
path.last().copied()
|
||||||
|
} else {
|
||||||
|
None
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn same(&self, a: Self::Function, b: Self::Function) -> bool {
|
||||||
|
std::ptr::eq(a, b)
|
||||||
|
}
|
||||||
|
fn name(&self, f: Self::Function) -> String {
|
||||||
|
f.name.clone()
|
||||||
|
}
|
||||||
|
fn level(&self, f: Self::Function) -> u8 {
|
||||||
|
f.level
|
||||||
|
}
|
||||||
|
fn is_object(&self, f: Self::Function) -> bool {
|
||||||
|
f.is_object()
|
||||||
|
}
|
||||||
|
fn uses_receiver(&self, f: Self::Function) -> bool {
|
||||||
|
crate::ast::function_uses_receiver(f)
|
||||||
|
}
|
||||||
|
fn import(&self, m: &Self::Module, name: &str) -> Option<Self::Module> {
|
||||||
|
m.import_modules.get(name)
|
||||||
|
}
|
||||||
|
fn used_path(&self, m: &Self::Module, name: &str) -> Option<Vec<String>> {
|
||||||
|
m.uses
|
||||||
|
.iter()
|
||||||
|
.find(|u| u.bind == name)
|
||||||
|
.map(|u| u.path.clone())
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,577 @@
|
|||||||
|
use crate::diagnostics::{Diagnostic, Span};
|
||||||
|
use crate::{
|
||||||
|
bytecode::{compile_module, Vm},
|
||||||
|
interp::Interpreter,
|
||||||
|
load::load_module,
|
||||||
|
value::Value,
|
||||||
|
};
|
||||||
|
use serde_json::json;
|
||||||
|
use sha2::{Digest, Sha256};
|
||||||
|
use std::path::{Path, PathBuf};
|
||||||
|
|
||||||
|
fn digest(text: &str) -> String {
|
||||||
|
format!("{:x}", Sha256::digest(text.as_bytes()))
|
||||||
|
}
|
||||||
|
fn line(text: &str, marker: &str) -> u32 {
|
||||||
|
text.lines()
|
||||||
|
.position(|s| s.contains(marker))
|
||||||
|
.expect("oracle marker") as u32
|
||||||
|
+ 1
|
||||||
|
}
|
||||||
|
fn root(label: &str) -> PathBuf {
|
||||||
|
let dir = PathBuf::from(env!("CARGO_MANIFEST_DIR"))
|
||||||
|
.join("target/source-map")
|
||||||
|
.join(format!("{label}-{}", std::process::id()));
|
||||||
|
std::fs::create_dir_all(&dir).unwrap();
|
||||||
|
dir
|
||||||
|
}
|
||||||
|
fn save(path: &Path, text: &str) {
|
||||||
|
std::fs::create_dir_all(path.parent().unwrap()).unwrap();
|
||||||
|
std::fs::write(path, text).unwrap();
|
||||||
|
}
|
||||||
|
fn source(key: &str, path: &Path, text: &str) -> serde_json::Value {
|
||||||
|
json!({"key":key,"path":path,"text":text,"virtual":!path.is_absolute()})
|
||||||
|
}
|
||||||
|
fn site(key: &str, marker: &str) -> serde_json::Value {
|
||||||
|
json!({"source":key,"marker":marker})
|
||||||
|
}
|
||||||
|
fn frame(
|
||||||
|
name: &str,
|
||||||
|
declaration: serde_json::Value,
|
||||||
|
call_site: Option<serde_json::Value>,
|
||||||
|
) -> serde_json::Value {
|
||||||
|
json!({"function":name,"declaration":declaration,"call_site":call_site})
|
||||||
|
}
|
||||||
|
fn record(
|
||||||
|
id: &str,
|
||||||
|
backend: &str,
|
||||||
|
diagnostic: &Diagnostic,
|
||||||
|
sources: Vec<serde_json::Value>,
|
||||||
|
origin: serde_json::Value,
|
||||||
|
frames: Vec<serde_json::Value>,
|
||||||
|
) {
|
||||||
|
if let Some(directory) = std::env::var_os("MARQDO_SOURCE_MAP_DIR") {
|
||||||
|
let directory = PathBuf::from(directory);
|
||||||
|
std::fs::create_dir_all(&directory).unwrap();
|
||||||
|
std::fs::write(
|
||||||
|
directory.join(format!("{id}-{backend}.json")),
|
||||||
|
serde_json::to_vec_pretty(
|
||||||
|
&json!({"version":1,"id":id,"backend":backend,"sources":sources,
|
||||||
|
"expected":{"origin":origin,"frames":frames},"diagnostic":diagnostic.to_json()}),
|
||||||
|
)
|
||||||
|
.unwrap(),
|
||||||
|
)
|
||||||
|
.unwrap();
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn assert_site(site: &crate::diagnostics::SourceLocation, path: &Path, text: &str, expected: u32) {
|
||||||
|
assert_eq!(
|
||||||
|
site.source.path.as_deref().unwrap().canonicalize().unwrap(),
|
||||||
|
path.canonicalize().unwrap()
|
||||||
|
);
|
||||||
|
assert_eq!(site.source.sha256.as_deref(), Some(digest(text).as_str()));
|
||||||
|
assert_eq!(site.span, Span::new(expected, 1));
|
||||||
|
}
|
||||||
|
fn assert_origin(d: &Diagnostic, path: &Path, text: &str, expected: u32) {
|
||||||
|
assert_eq!(
|
||||||
|
d.path.as_deref().unwrap().canonicalize().unwrap(),
|
||||||
|
path.canonicalize().unwrap()
|
||||||
|
);
|
||||||
|
assert_eq!(d.source_sha256.as_deref(), Some(digest(text).as_str()));
|
||||||
|
assert_eq!(d.span, Span::new(expected, 1));
|
||||||
|
assert!(d.message.contains("division by zero"), "{d}");
|
||||||
|
assert_eq!(d.to_json()["source_sha256"], json!(digest(text)));
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn external_argument_binding_uses_target_declaration_source() {
|
||||||
|
let dir = root("external-binding");
|
||||||
|
let entry = dir.join("entry.mq.md");
|
||||||
|
let target = dir.join("target.mq.md");
|
||||||
|
let leaf = dir.join("leaf.mq.md");
|
||||||
|
let main = "# main\n*7*\n";
|
||||||
|
let text = "---\nimport:\n leaf: leaf.mq.md\n---\n\n\n## required\n + `x`\n*x*\n\n## defaulted\n + `x`=> leaf.explode\n*x*\n";
|
||||||
|
let leaf_text = "\n\n\n## explode\n**bad = 1 / 0**\n*bad*\n";
|
||||||
|
save(&entry, main);
|
||||||
|
save(&target, text);
|
||||||
|
save(&leaf, leaf_text);
|
||||||
|
let module = load_module(&target).unwrap();
|
||||||
|
let mut tree = Interpreter::with_capture(Some(&entry), false);
|
||||||
|
let before = tree.diagnostic_scope_state();
|
||||||
|
for name in ["required", "defaulted"] {
|
||||||
|
let fun = module.functions.iter().find(|f| f.name == name).unwrap();
|
||||||
|
let error = tree.bind_external_args(&module, fun, &[]).unwrap_err();
|
||||||
|
let d = Diagnostic::find(&error).unwrap();
|
||||||
|
assert_eq!(tree.diagnostic_scope_state(), before);
|
||||||
|
let expected_frames = if name == "required" {
|
||||||
|
assert_eq!(d.code, "call.missing_arg");
|
||||||
|
assert_eq!(d.path.as_deref(), Some(target.as_path()));
|
||||||
|
assert_eq!(d.source_sha256.as_deref(), Some(digest(text).as_str()));
|
||||||
|
assert_eq!(d.span, fun.span);
|
||||||
|
vec![frame("required", site("target", "## required"), None)]
|
||||||
|
} else {
|
||||||
|
assert_origin(d, &leaf, leaf_text, line(leaf_text, "**bad"));
|
||||||
|
vec![
|
||||||
|
frame("defaulted", site("target", "## defaulted"), None),
|
||||||
|
frame(
|
||||||
|
"explode",
|
||||||
|
site("leaf", "## explode"),
|
||||||
|
Some(site("target", "+ `x`=> leaf.explode")),
|
||||||
|
),
|
||||||
|
]
|
||||||
|
};
|
||||||
|
record(
|
||||||
|
&format!("external-binding-{name}"),
|
||||||
|
"tree",
|
||||||
|
d,
|
||||||
|
vec![
|
||||||
|
source("entry", &entry, main),
|
||||||
|
source("target", &target, text),
|
||||||
|
source("leaf", &leaf, leaf_text),
|
||||||
|
],
|
||||||
|
if name == "required" {
|
||||||
|
site("target", "## required")
|
||||||
|
} else {
|
||||||
|
site("leaf", "**bad")
|
||||||
|
},
|
||||||
|
expected_frames,
|
||||||
|
);
|
||||||
|
let first = d.to_json();
|
||||||
|
let bound = tree
|
||||||
|
.bind_external_args(&module, fun, &[("x".into(), Value::Int(7))])
|
||||||
|
.unwrap();
|
||||||
|
assert_eq!(bound, vec![("x".into(), Value::Int(7))]);
|
||||||
|
assert_eq!(tree.diagnostic_scope_state(), before);
|
||||||
|
let again = tree.bind_external_args(&module, fun, &[]).unwrap_err();
|
||||||
|
assert_eq!(Diagnostic::find(&again).unwrap().to_json(), first);
|
||||||
|
assert_eq!(tree.diagnostic_scope_state(), before);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn imported_source_identity_frames_and_reuse_match_on_both_backends() {
|
||||||
|
let root = root("imports");
|
||||||
|
let mut count = 0;
|
||||||
|
for pad in [0, 4, 17] {
|
||||||
|
for crlf in [false, true] {
|
||||||
|
for side in ["left", "right"] {
|
||||||
|
let dir = root.join(format!("{pad}-{crlf}-{side}"));
|
||||||
|
let basename = if pad == 17 {
|
||||||
|
"共同源.mq.md"
|
||||||
|
} else {
|
||||||
|
"shared.mq.md"
|
||||||
|
};
|
||||||
|
let left = dir.join("left").join(basename);
|
||||||
|
let right = dir.join("right").join(basename);
|
||||||
|
let middle = dir.join("middle.mq.md");
|
||||||
|
let entry = dir.join("entry.mq.md");
|
||||||
|
let lf = |s: String| if crlf { s.replace('\n', "\r\n") } else { s };
|
||||||
|
let leaf_a = lf(format!(
|
||||||
|
"源位置验证 🧪\n{}## explode\n**bad = 1 / 0**\n*bad*\n\n## good\n*7*\n",
|
||||||
|
"\n".repeat(pad)
|
||||||
|
));
|
||||||
|
let leaf_b = if pad == 4 {
|
||||||
|
leaf_a.clone()
|
||||||
|
} else {
|
||||||
|
lf(format!(
|
||||||
|
"{}## explode\n\n**bad = 1 / 0**\n*bad*\n\n## good\n*7*\n",
|
||||||
|
"\n".repeat(pad + 3)
|
||||||
|
))
|
||||||
|
};
|
||||||
|
save(&left, &leaf_a);
|
||||||
|
save(&right, &leaf_b);
|
||||||
|
let mid=lf(format!("---\nmarkup: occlusion\nimport:\n leaf: {side}/{basename}\n---\n## relay\n**answer = > leaf.explode**\n*answer*\n"));
|
||||||
|
let main=lf("---\nmarkup: occlusion\nimport:\n mid: middle.mq.md\n---\n# main\n**answer = > mid.relay**\n*answer*\n".into());
|
||||||
|
save(&middle, &mid);
|
||||||
|
save(&entry, &main);
|
||||||
|
let module = load_module(&entry).unwrap();
|
||||||
|
let (leaf_path, leaf) = if side == "left" {
|
||||||
|
(&left, &leaf_a)
|
||||||
|
} else {
|
||||||
|
(&right, &leaf_b)
|
||||||
|
};
|
||||||
|
let leaf_module = &module.import_modules["mid"].import_modules["leaf"];
|
||||||
|
let program = compile_module(Some(&entry), &module).unwrap();
|
||||||
|
// Dependencies are private, so API calls compile that module
|
||||||
|
// directly rather than assuming transitive re-exports.
|
||||||
|
let good_code =
|
||||||
|
crate::bytecode::compile_for_call(Some(leaf_path), leaf_module).unwrap();
|
||||||
|
let good_fid = good_code.path_index[&vec!["good".into()]];
|
||||||
|
for backend in ["tree", "bytecode"] {
|
||||||
|
let host = || {
|
||||||
|
let mut h =
|
||||||
|
crate::host::HostContext::for_capture(Some(&entry), Default::default());
|
||||||
|
h.call_stack.push("outside-source-entry".into());
|
||||||
|
h.call_site_lines.push(99);
|
||||||
|
h
|
||||||
|
};
|
||||||
|
let mut tree = Interpreter::with_capture(Some(&entry), false).with_host(host());
|
||||||
|
let mut vm = Vm::with_capture(Some(&entry)).with_host(host());
|
||||||
|
let before_tree = tree.diagnostic_scope_state();
|
||||||
|
let before_vm = vm.diagnostic_scope_state();
|
||||||
|
let err = if backend == "tree" {
|
||||||
|
tree.run_module(&module)
|
||||||
|
} else {
|
||||||
|
vm.run(&program)
|
||||||
|
}
|
||||||
|
.unwrap_err();
|
||||||
|
let diagnostic = Diagnostic::find(&err).unwrap();
|
||||||
|
assert_origin(diagnostic, leaf_path, leaf, line(leaf, "**bad"));
|
||||||
|
assert_eq!(diagnostic.frames.len(), 3);
|
||||||
|
assert_eq!(
|
||||||
|
diagnostic
|
||||||
|
.frames
|
||||||
|
.iter()
|
||||||
|
.map(|f| f.function.as_str())
|
||||||
|
.collect::<Vec<_>>(),
|
||||||
|
["main", "relay", "explode"]
|
||||||
|
);
|
||||||
|
assert!(diagnostic.frames[0].call_site.is_none());
|
||||||
|
assert_site(
|
||||||
|
diagnostic.frames[1].call_site.as_ref().unwrap(),
|
||||||
|
&entry,
|
||||||
|
&main,
|
||||||
|
line(&main, "**answer"),
|
||||||
|
);
|
||||||
|
assert_site(
|
||||||
|
diagnostic.frames[2].call_site.as_ref().unwrap(),
|
||||||
|
&middle,
|
||||||
|
&mid,
|
||||||
|
line(&mid, "**answer"),
|
||||||
|
);
|
||||||
|
assert_site(
|
||||||
|
&diagnostic.frames[2].declaration,
|
||||||
|
leaf_path,
|
||||||
|
leaf,
|
||||||
|
line(leaf, "## explode"),
|
||||||
|
);
|
||||||
|
assert_eq!(tree.diagnostic_scope_state(), before_tree);
|
||||||
|
assert_eq!(vm.diagnostic_scope_state(), before_vm);
|
||||||
|
record(
|
||||||
|
&format!("imports-{pad}-{crlf}-{side}"),
|
||||||
|
backend,
|
||||||
|
diagnostic,
|
||||||
|
vec![
|
||||||
|
source("entry", &entry, &main),
|
||||||
|
source("middle", &middle, &mid),
|
||||||
|
source("leaf", leaf_path, leaf),
|
||||||
|
],
|
||||||
|
site("leaf", "**bad"),
|
||||||
|
vec![
|
||||||
|
frame("main", site("entry", "# main"), None),
|
||||||
|
frame(
|
||||||
|
"relay",
|
||||||
|
site("middle", "## relay"),
|
||||||
|
Some(site("entry", "**answer")),
|
||||||
|
),
|
||||||
|
frame(
|
||||||
|
"explode",
|
||||||
|
site("leaf", "## explode"),
|
||||||
|
Some(site("middle", "**answer")),
|
||||||
|
),
|
||||||
|
],
|
||||||
|
);
|
||||||
|
let expected = diagnostic.to_json();
|
||||||
|
let good = if backend == "tree" {
|
||||||
|
tree.invoke_function(leaf_module, "good", &[])
|
||||||
|
} else {
|
||||||
|
vm.call_function(&good_code, good_fid, &[])
|
||||||
|
}
|
||||||
|
.unwrap();
|
||||||
|
assert_eq!(good, Value::Int(7));
|
||||||
|
let again = if backend == "tree" {
|
||||||
|
tree.run_module(&module)
|
||||||
|
} else {
|
||||||
|
vm.run(&program)
|
||||||
|
}
|
||||||
|
.unwrap_err();
|
||||||
|
assert_eq!(
|
||||||
|
Diagnostic::find(&again).unwrap().to_json(),
|
||||||
|
expected,
|
||||||
|
"stale caller leaked after reuse"
|
||||||
|
);
|
||||||
|
assert_eq!(tree.diagnostic_scope_state(), before_tree);
|
||||||
|
assert_eq!(vm.diagnostic_scope_state(), before_vm);
|
||||||
|
count += 1;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
println!(
|
||||||
|
"SOURCE_MAP_METRIC:{}",
|
||||||
|
json!({"kind":"imports","cases":count,"correct":true})
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn source_revision_is_loaded_text_not_later_disk_contents() {
|
||||||
|
let root = root("revision");
|
||||||
|
let lib = root.join("shared.mq.md");
|
||||||
|
let entry = root.join("entry.mq.md");
|
||||||
|
let first = "## explode\n**bad = 1 / 0**\n*bad*\n";
|
||||||
|
let second = "\n\n\n\n\n## explode\n**bad = 1 / 0**\n*bad*\n";
|
||||||
|
let main="---\nmarkup: occlusion\nimport:\n lib: shared.mq.md\n---\n# main\n**answer = > lib.explode**\n*answer*\n";
|
||||||
|
save(&entry, main);
|
||||||
|
save(&lib, first);
|
||||||
|
let old = load_module(&entry).unwrap();
|
||||||
|
let old_code = compile_module(Some(&entry), &old).unwrap();
|
||||||
|
save(&lib, second);
|
||||||
|
let new = load_module(&entry).unwrap();
|
||||||
|
let new_code = compile_module(Some(&entry), &new).unwrap();
|
||||||
|
for (revision, module, code, text) in [
|
||||||
|
("old", &old, &old_code, first),
|
||||||
|
("new", &new, &new_code, second),
|
||||||
|
] {
|
||||||
|
let mut tree = Interpreter::with_capture(Some(&entry), false);
|
||||||
|
let mut vm = Vm::with_capture(Some(&entry));
|
||||||
|
for (backend, error) in [
|
||||||
|
("tree", tree.run_module(module).unwrap_err()),
|
||||||
|
("bytecode", vm.run(code).unwrap_err()),
|
||||||
|
] {
|
||||||
|
let d = Diagnostic::find(&error).unwrap();
|
||||||
|
assert_origin(d, &lib, text, line(text, "**bad"));
|
||||||
|
assert_site(
|
||||||
|
d.frames[1].call_site.as_ref().unwrap(),
|
||||||
|
&entry,
|
||||||
|
main,
|
||||||
|
line(main, "**answer"),
|
||||||
|
);
|
||||||
|
record(
|
||||||
|
&format!("revision-{revision}"),
|
||||||
|
backend,
|
||||||
|
d,
|
||||||
|
vec![source("entry", &entry, main), source("leaf", &lib, text)],
|
||||||
|
site("leaf", "**bad"),
|
||||||
|
vec![
|
||||||
|
frame("main", site("entry", "# main"), None),
|
||||||
|
frame(
|
||||||
|
"explode",
|
||||||
|
site("leaf", "## explode"),
|
||||||
|
Some(site("entry", "**answer")),
|
||||||
|
),
|
||||||
|
],
|
||||||
|
);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
#[cfg(feature = "exec-host")]
|
||||||
|
fn foreign_boundary_diagnostics_keep_library_origin_and_real_user_call_site() {
|
||||||
|
let root = root("foreign");
|
||||||
|
let lib = PathBuf::from(env!("CARGO_MANIFEST_DIR")).join("lib/foreign.mq.md");
|
||||||
|
let library = std::fs::read_to_string(&lib).unwrap();
|
||||||
|
let mut count = 0;
|
||||||
|
for lang in ["python", "node"] {
|
||||||
|
for output in [false, true] {
|
||||||
|
let entry = root.join(format!("{lang}-{output}.mq.md"));
|
||||||
|
let action = if output {
|
||||||
|
"**> foreign.session_eval id=`s` source=\"n = 99; 9007199254740992\"**"
|
||||||
|
} else {
|
||||||
|
"**> foreign.session_set id=`s` name=\"n\" value=`s`**"
|
||||||
|
};
|
||||||
|
let main=format!("---\nmarkup: occlusion\nimport:\n foreign: {}\n---\n# main\n**s = > foreign.session_open lang=\"{lang}\"**\n**> foreign.session_set id=`s` name=\"n\" value=1**\n{action}\n",lib.display());
|
||||||
|
save(&entry, &main);
|
||||||
|
let module = load_module(&entry).unwrap();
|
||||||
|
let program = compile_module(Some(&entry), &module).unwrap();
|
||||||
|
let expected_function = if output {
|
||||||
|
"session_eval"
|
||||||
|
} else {
|
||||||
|
"session_set"
|
||||||
|
};
|
||||||
|
let expected_primitive = if output {
|
||||||
|
"host_foreign_session_eval"
|
||||||
|
} else {
|
||||||
|
"host_foreign_session_set"
|
||||||
|
};
|
||||||
|
for backend in ["tree", "bytecode"] {
|
||||||
|
let mut tree = Interpreter::with_capture(Some(&entry), false);
|
||||||
|
let mut vm = Vm::with_capture(Some(&entry));
|
||||||
|
let error = if backend == "tree" {
|
||||||
|
tree.run_module(&module)
|
||||||
|
} else {
|
||||||
|
vm.run(&program)
|
||||||
|
}
|
||||||
|
.unwrap_err();
|
||||||
|
let d = Diagnostic::find(&error).unwrap();
|
||||||
|
assert!(d.message.contains("outside V_safe"));
|
||||||
|
assert_eq!(
|
||||||
|
d.path.as_ref().unwrap().canonicalize().unwrap(),
|
||||||
|
lib.canonicalize().unwrap()
|
||||||
|
);
|
||||||
|
assert_eq!(d.source_sha256, Some(digest(&library)));
|
||||||
|
assert_eq!(d.span.line, line(&library, expected_primitive));
|
||||||
|
let last_frame = d.frames.last().unwrap();
|
||||||
|
assert_eq!(last_frame.function, expected_function);
|
||||||
|
assert_site(
|
||||||
|
last_frame.call_site.as_ref().unwrap(),
|
||||||
|
&entry,
|
||||||
|
&main,
|
||||||
|
line(&main, action),
|
||||||
|
);
|
||||||
|
assert!(d.format_message().contains(&format!(
|
||||||
|
"{}:{}:1",
|
||||||
|
entry.display(),
|
||||||
|
line(&main, action)
|
||||||
|
)));
|
||||||
|
let (_, values, _) = if backend == "tree" {
|
||||||
|
tree.foreign_source_evidence()
|
||||||
|
} else {
|
||||||
|
vm.foreign_source_evidence()
|
||||||
|
};
|
||||||
|
assert_eq!(values, vec![Value::Int(if output { 99 } else { 1 })]);
|
||||||
|
record(
|
||||||
|
&format!("foreign-{lang}-{output}"),
|
||||||
|
backend,
|
||||||
|
d,
|
||||||
|
vec![
|
||||||
|
source("entry", &entry, &main),
|
||||||
|
source("foreign", &lib, &library),
|
||||||
|
],
|
||||||
|
site("foreign", expected_primitive),
|
||||||
|
vec![
|
||||||
|
frame("main", site("entry", "# main"), None),
|
||||||
|
frame(
|
||||||
|
expected_function,
|
||||||
|
site("foreign", &format!("## {expected_function}")),
|
||||||
|
Some(site("entry", action)),
|
||||||
|
),
|
||||||
|
],
|
||||||
|
);
|
||||||
|
count += 1;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
println!(
|
||||||
|
"SOURCE_MAP_METRIC:{}",
|
||||||
|
json!({"kind":"foreign","cases":count,"correct":true})
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn memory_dynamic_and_method_calls_keep_their_own_sources() {
|
||||||
|
let directory = root("entry-kinds");
|
||||||
|
let memory="---\nmarkup: occlusion\nimport:\n json: lib/json.mq.md\n---\n# main\n**bad = > json.parse text=not-json**\n";
|
||||||
|
let module = crate::load::load_module_from_source(memory).unwrap();
|
||||||
|
let json_text = crate::embedded_lib::read_file("json.mq.md").unwrap();
|
||||||
|
let code = compile_module(None, &module).unwrap();
|
||||||
|
let dynamic="# main\n**name = \"explode\"**\n> call_fn name=`name`\n\n## explode\n**bad = 1 / 0**\n*bad*\n";
|
||||||
|
let dynamic_path = directory.join("dynamic.mq.md");
|
||||||
|
save(&dynamic_path, dynamic);
|
||||||
|
let dynamic_module = load_module(&dynamic_path).unwrap();
|
||||||
|
let dynamic_code = compile_module(Some(&dynamic_path), &dynamic_module).unwrap();
|
||||||
|
let object_path = directory.join("object.mq.md");
|
||||||
|
let json_path = PathBuf::from(env!("CARGO_MANIFEST_DIR")).join("lib/json.mq.md");
|
||||||
|
let object=format!("---\nmarkup: occlusion\nimport:\n json: {}\n---\n# Counter\n**state = > json.parse text={{\"n\":1}}**\n*state*\n\n## fail\n**saved = `self`**\n**bad = 1 / 0**\n*bad*\n",json_path.display());
|
||||||
|
save(&object_path, &object);
|
||||||
|
let entry_path = directory.join("method.mq.md");
|
||||||
|
let method="---\nmarkup: occlusion\nimport:\n obj: object.mq.md\n---\n# main\n**c = > obj.Counter**\n> `c`.fail\n";
|
||||||
|
save(&entry_path, method);
|
||||||
|
let method_module = load_module(&entry_path).unwrap();
|
||||||
|
let method_code = compile_module(Some(&entry_path), &method_module).unwrap();
|
||||||
|
for backend in ["tree", "bytecode"] {
|
||||||
|
let error = if backend == "tree" {
|
||||||
|
Interpreter::with_capture(None, false).run_module(&module)
|
||||||
|
} else {
|
||||||
|
Vm::with_capture(None).run(&code)
|
||||||
|
}
|
||||||
|
.unwrap_err();
|
||||||
|
let d = Diagnostic::find(&error).unwrap();
|
||||||
|
assert_eq!(d.path.as_deref(), Some(Path::new("lib/json.mq.md")));
|
||||||
|
assert_eq!(d.source_sha256, Some(digest(&json_text)));
|
||||||
|
assert_eq!(d.span.line, line(&json_text, "host_json_parse"));
|
||||||
|
assert_eq!(
|
||||||
|
d.frames
|
||||||
|
.last()
|
||||||
|
.unwrap()
|
||||||
|
.call_site
|
||||||
|
.as_ref()
|
||||||
|
.unwrap()
|
||||||
|
.source
|
||||||
|
.path
|
||||||
|
.as_deref(),
|
||||||
|
Some(Path::new("<memory>"))
|
||||||
|
);
|
||||||
|
record(
|
||||||
|
"memory",
|
||||||
|
backend,
|
||||||
|
d,
|
||||||
|
vec![
|
||||||
|
source("entry", Path::new("<memory>"), memory),
|
||||||
|
source("json", Path::new("lib/json.mq.md"), &json_text),
|
||||||
|
],
|
||||||
|
site("json", "host_json_parse"),
|
||||||
|
vec![
|
||||||
|
frame("main", site("entry", "# main"), None),
|
||||||
|
frame(
|
||||||
|
"parse",
|
||||||
|
site("json", "## parse"),
|
||||||
|
Some(site("entry", "**bad")),
|
||||||
|
),
|
||||||
|
],
|
||||||
|
);
|
||||||
|
let error = if backend == "tree" {
|
||||||
|
Interpreter::with_capture(Some(&dynamic_path), false).run_module(&dynamic_module)
|
||||||
|
} else {
|
||||||
|
Vm::with_capture(Some(&dynamic_path)).run(&dynamic_code)
|
||||||
|
}
|
||||||
|
.unwrap_err();
|
||||||
|
let d = Diagnostic::find(&error).unwrap();
|
||||||
|
assert_origin(d, &dynamic_path, dynamic, line(dynamic, "**bad"));
|
||||||
|
assert_eq!(d.frames.last().unwrap().function, "explode");
|
||||||
|
assert_site(
|
||||||
|
d.frames.last().unwrap().call_site.as_ref().unwrap(),
|
||||||
|
&dynamic_path,
|
||||||
|
dynamic,
|
||||||
|
line(dynamic, "> call_fn"),
|
||||||
|
);
|
||||||
|
record(
|
||||||
|
"dynamic",
|
||||||
|
backend,
|
||||||
|
d,
|
||||||
|
vec![source("entry", &dynamic_path, dynamic)],
|
||||||
|
site("entry", "**bad"),
|
||||||
|
vec![
|
||||||
|
frame("main", site("entry", "# main"), None),
|
||||||
|
frame(
|
||||||
|
"explode",
|
||||||
|
site("entry", "## explode"),
|
||||||
|
Some(site("entry", "> call_fn")),
|
||||||
|
),
|
||||||
|
],
|
||||||
|
);
|
||||||
|
let error = if backend == "tree" {
|
||||||
|
Interpreter::with_capture(Some(&entry_path), false).run_module(&method_module)
|
||||||
|
} else {
|
||||||
|
Vm::with_capture(Some(&entry_path)).run(&method_code)
|
||||||
|
}
|
||||||
|
.unwrap_err();
|
||||||
|
let d = Diagnostic::find(&error).unwrap();
|
||||||
|
assert_origin(d, &object_path, &object, line(&object, "**bad"));
|
||||||
|
assert_eq!(d.frames.last().unwrap().function, "fail");
|
||||||
|
assert_site(
|
||||||
|
d.frames.last().unwrap().call_site.as_ref().unwrap(),
|
||||||
|
&entry_path,
|
||||||
|
method,
|
||||||
|
line(method, "> `c`.fail"),
|
||||||
|
);
|
||||||
|
record(
|
||||||
|
"method",
|
||||||
|
backend,
|
||||||
|
d,
|
||||||
|
vec![
|
||||||
|
source("entry", &entry_path, method),
|
||||||
|
source("object", &object_path, &object),
|
||||||
|
],
|
||||||
|
site("object", "**bad"),
|
||||||
|
vec![
|
||||||
|
frame("main", site("entry", "# main"), None),
|
||||||
|
frame(
|
||||||
|
"fail",
|
||||||
|
site("object", "## fail"),
|
||||||
|
Some(site("entry", "> `c`.fail")),
|
||||||
|
),
|
||||||
|
],
|
||||||
|
);
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -0,0 +1,452 @@
|
|||||||
|
//! Export the actual loaded AST and independently observe both real backends.
|
||||||
|
//! Unsupported AST constructs are errors, never omitted or normalized to no-op.
|
||||||
|
use crate::ast::{Arg, BinaryOp, CallExpr, Expr, Function, Literal, Module, Stmt};
|
||||||
|
use crate::host::{foreign_session, json::value_to_json, HostContext};
|
||||||
|
use crate::value::Value;
|
||||||
|
use serde_json::{json, Value as Json};
|
||||||
|
use sha2::{Digest, Sha256};
|
||||||
|
use std::path::PathBuf;
|
||||||
|
|
||||||
|
pub(crate) fn boundary_evidence(
|
||||||
|
ctx: &mut HostContext,
|
||||||
|
) -> (Vec<Value>, Vec<Value>, Vec<foreign_session::ProtocolStep>) {
|
||||||
|
let observations = ctx.oracle_observations.clone();
|
||||||
|
let protocol = ctx.foreign_protocol_steps.clone();
|
||||||
|
let mut ids = ctx.foreign_sessions.keys().cloned().collect::<Vec<_>>();
|
||||||
|
ids.sort();
|
||||||
|
// These verification reads bypass the document observation API. They occur
|
||||||
|
// only after its journal was captured, and never alter that journal.
|
||||||
|
let values = ids
|
||||||
|
.iter()
|
||||||
|
.map(|id| {
|
||||||
|
foreign_session::get(ctx, &Value::Handle(id.clone()), &Value::Text("n".into())).unwrap()
|
||||||
|
})
|
||||||
|
.collect();
|
||||||
|
assert_eq!(observations, ctx.oracle_observations);
|
||||||
|
(observations, values, protocol)
|
||||||
|
}
|
||||||
|
|
||||||
|
fn expr(e: &Expr) -> Result<Json, String> {
|
||||||
|
Ok(match e {
|
||||||
|
Expr::Literal(Literal::None) => json!(["literal", null]),
|
||||||
|
Expr::Literal(Literal::Bool(b)) => json!(["literal", b]),
|
||||||
|
Expr::Literal(Literal::Int(n)) => json!(["literal", n]),
|
||||||
|
Expr::Literal(Literal::Text(s)) => json!(["literal", s]),
|
||||||
|
Expr::Var(name) => json!(["var", name]),
|
||||||
|
Expr::Binary { op, left, right } => {
|
||||||
|
let tag = match op {
|
||||||
|
BinaryOp::Add => "add",
|
||||||
|
BinaryOp::Sub => "sub",
|
||||||
|
BinaryOp::Lt => "lt",
|
||||||
|
_ => return Err(format!("unsupported source binary op {op:?}")),
|
||||||
|
};
|
||||||
|
json!([tag, expr(left)?, expr(right)?])
|
||||||
|
}
|
||||||
|
_ => return Err(format!("unsupported source expression {e:?}")),
|
||||||
|
})
|
||||||
|
}
|
||||||
|
|
||||||
|
fn call(c: &CallExpr, dest: Option<&str>, defs: &[&Function]) -> Result<Json, String> {
|
||||||
|
if c.receiver.is_some() || !c.pre_modifiers.is_empty() {
|
||||||
|
return Err("unsupported receiver/modifiers".into());
|
||||||
|
}
|
||||||
|
if let Some(path) = &c.path {
|
||||||
|
if path.len() != 2 || path[0] != "foreign" {
|
||||||
|
return Err(format!("unsupported library path {path:?}"));
|
||||||
|
}
|
||||||
|
let mut args = std::collections::BTreeMap::new();
|
||||||
|
for a in &c.args {
|
||||||
|
let Arg::Named { name, value } = a else {
|
||||||
|
return Err("foreign primitive needs named arguments".into());
|
||||||
|
};
|
||||||
|
if args.insert(name.as_str(), value).is_some() {
|
||||||
|
return Err("duplicate argument".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let allowed: &[&str] = match path[1].as_str() {
|
||||||
|
"session_open" => &["lang"],
|
||||||
|
"session_set" => &["id", "name", "value"],
|
||||||
|
"session_get" => &["id", "name"],
|
||||||
|
"session_eval" => &["id", "source", "input", "stdin"],
|
||||||
|
"session_close" => &["id"],
|
||||||
|
_ => return Err(format!("unsupported primitive {path:?}")),
|
||||||
|
};
|
||||||
|
if args.keys().any(|k| !allowed.contains(k)) {
|
||||||
|
return Err("unsupported primitive option".into());
|
||||||
|
}
|
||||||
|
let arg = |name: &str| {
|
||||||
|
args.get(name)
|
||||||
|
.copied()
|
||||||
|
.ok_or_else(|| format!("missing {name}"))
|
||||||
|
};
|
||||||
|
let name = || match arg("name")? {
|
||||||
|
Expr::Literal(Literal::Text(s)) => Ok(s.clone()),
|
||||||
|
_ => Err("dynamic binding name unsupported".to_string()),
|
||||||
|
};
|
||||||
|
match path[1].as_str() {
|
||||||
|
"session_open" => Ok(json!([
|
||||||
|
"open",
|
||||||
|
dest.ok_or("open destination required")?,
|
||||||
|
expr(arg("lang")?)?
|
||||||
|
])),
|
||||||
|
"session_get" => Ok(json!([
|
||||||
|
"get",
|
||||||
|
dest.ok_or("get destination required")?,
|
||||||
|
expr(arg("id")?)?,
|
||||||
|
name()?
|
||||||
|
])),
|
||||||
|
_ if dest.is_some() => {
|
||||||
|
Err("assigned set/eval/close record requires a richer adapter".into())
|
||||||
|
}
|
||||||
|
"session_set" => Ok(json!([
|
||||||
|
"set",
|
||||||
|
expr(arg("id")?)?,
|
||||||
|
name()?,
|
||||||
|
expr(arg("value")?)?
|
||||||
|
])),
|
||||||
|
"session_eval" => Ok(json!([
|
||||||
|
"eval",
|
||||||
|
expr(arg("id")?)?,
|
||||||
|
expr(arg("source")?)?,
|
||||||
|
args.get("input")
|
||||||
|
.map(|v| expr(v))
|
||||||
|
.transpose()?
|
||||||
|
.unwrap_or(json!(["literal", null])),
|
||||||
|
args.get("stdin").map(|v| expr(v)).transpose()?
|
||||||
|
])),
|
||||||
|
"session_close" => Ok(json!(["close", expr(arg("id")?)?])),
|
||||||
|
_ => unreachable!(),
|
||||||
|
}
|
||||||
|
} else {
|
||||||
|
let f = defs
|
||||||
|
.iter()
|
||||||
|
.find(|f| f.name == c.callee)
|
||||||
|
.ok_or_else(|| format!("unknown function {}", c.callee))?;
|
||||||
|
let mut values = std::collections::BTreeMap::new();
|
||||||
|
let mut positional = 0;
|
||||||
|
for a in &c.args {
|
||||||
|
let (name, value) = match a {
|
||||||
|
Arg::Named { name, value } => (name.as_str(), value),
|
||||||
|
Arg::Positional(value) => {
|
||||||
|
let p = f.params.get(positional).ok_or("too many arguments")?;
|
||||||
|
positional += 1;
|
||||||
|
(p.name.as_str(), value)
|
||||||
|
}
|
||||||
|
};
|
||||||
|
if !f.params.iter().any(|p| p.name == name) || values.insert(name, value).is_some() {
|
||||||
|
return Err("invalid call argument".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let ordered = f
|
||||||
|
.params
|
||||||
|
.iter()
|
||||||
|
.map(|p| expr(values.get(p.name.as_str()).ok_or("missing parameter")?))
|
||||||
|
.collect::<Result<Vec<_>, _>>()?;
|
||||||
|
Ok(json!(["call", dest, c.callee, ordered]))
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
fn block(body: &[Stmt], defs: &[&Function]) -> Result<Vec<Json>, String> {
|
||||||
|
body.iter()
|
||||||
|
.map(|s| {
|
||||||
|
Ok(match s {
|
||||||
|
Stmt::Assign {
|
||||||
|
name,
|
||||||
|
value: Expr::Call(c),
|
||||||
|
..
|
||||||
|
} => call(c, Some(name), defs)?,
|
||||||
|
Stmt::Assign { name, value, .. } => json!(["assign", name, expr(value)?]),
|
||||||
|
Stmt::Return { value, .. } => json!(["return", expr(value)?]),
|
||||||
|
Stmt::Call { call: c, .. } => call(c, None, defs)?,
|
||||||
|
Stmt::While {
|
||||||
|
condition, body, ..
|
||||||
|
} => json!(["while", expr(condition)?, block(body, defs)?]),
|
||||||
|
Stmt::Branch { arms, .. } => {
|
||||||
|
let mut rest = Vec::new();
|
||||||
|
for (i, arm) in arms.iter().enumerate().rev() {
|
||||||
|
let body = block(&arm.body, defs)?;
|
||||||
|
if let Some(condition) = &arm.condition {
|
||||||
|
rest = vec![json!(["if", expr(condition)?, body, rest])];
|
||||||
|
} else {
|
||||||
|
if i != arms.len() - 1 {
|
||||||
|
return Err("nonterminal else".into());
|
||||||
|
}
|
||||||
|
rest = body;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
if rest.len() != 1 || rest[0][0] != "if" {
|
||||||
|
return Err("branch needs condition".into());
|
||||||
|
}
|
||||||
|
rest.pop().unwrap()
|
||||||
|
}
|
||||||
|
_ => return Err(format!("unsupported source statement {s:?}")),
|
||||||
|
})
|
||||||
|
})
|
||||||
|
.collect()
|
||||||
|
}
|
||||||
|
|
||||||
|
fn source_ir(module: &Module) -> Result<Json, String> {
|
||||||
|
if module.functions.len() != 1 || !module.uses.is_empty() {
|
||||||
|
return Err("module needs the declared single-entry adapter".into());
|
||||||
|
}
|
||||||
|
let main = module
|
||||||
|
.functions
|
||||||
|
.iter()
|
||||||
|
.find(|f| f.name == "main")
|
||||||
|
.ok_or("missing main")?;
|
||||||
|
let defs = main.children.iter().collect::<Vec<_>>();
|
||||||
|
if !main.params.is_empty() {
|
||||||
|
return Err("entry parameters need an explicit environment adapter".into());
|
||||||
|
}
|
||||||
|
let mut seen = std::collections::HashSet::new();
|
||||||
|
for f in &defs {
|
||||||
|
if !seen.insert(&f.name)
|
||||||
|
|| !f.children.is_empty()
|
||||||
|
|| f.params.iter().any(|p| p.default.is_some())
|
||||||
|
{
|
||||||
|
return Err("unsupported function scope/default".into());
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let functions = defs.iter().map(|f| Ok(json!({"name":f.name,"params":f.params.iter().map(|p|p.name.clone()).collect::<Vec<_>>(),"body":block(&f.body,&defs)?}))).collect::<Result<Vec<_>,String>>()?;
|
||||||
|
let initial = module
|
||||||
|
.metadata
|
||||||
|
.iter()
|
||||||
|
.map(|(name, value)| {
|
||||||
|
if !matches!(
|
||||||
|
value,
|
||||||
|
Value::None | Value::Bool(_) | Value::Int(_) | Value::Text(_)
|
||||||
|
) {
|
||||||
|
return Err("non-scalar metadata needs an explicit initial-value adapter".into());
|
||||||
|
}
|
||||||
|
Ok(json!([name, value_to_json(value)?]))
|
||||||
|
})
|
||||||
|
.collect::<Result<Vec<_>, String>>()?;
|
||||||
|
Ok(json!({"initial":initial,"entry":block(&main.body,&defs)?,"functions":functions}))
|
||||||
|
}
|
||||||
|
|
||||||
|
fn source(lang: &str, seed: i64, rounds: usize, scenario: &str) -> String {
|
||||||
|
let increment = "n += 1; n";
|
||||||
|
let bad = "n = 99; 9007199254740992";
|
||||||
|
let stdin = if scenario == "explicit_empty_stdin" {
|
||||||
|
" stdin=\"\""
|
||||||
|
} else {
|
||||||
|
""
|
||||||
|
};
|
||||||
|
let condition = if scenario == "else_branch" {
|
||||||
|
seed - 1
|
||||||
|
} else {
|
||||||
|
seed + 1
|
||||||
|
};
|
||||||
|
let function = match scenario {
|
||||||
|
"recursive" => "advance_rec",
|
||||||
|
"early_return" => "early",
|
||||||
|
_ => "adjust",
|
||||||
|
};
|
||||||
|
let failure = match scenario {
|
||||||
|
"closed_get" => "**> foreign.session_close id=`alias`**\n**lost = > foreign.session_get id=`alias` name=\"n\"**".into(),
|
||||||
|
"copy_handle" => "**> foreign.session_set id=`a` name=\"n\" value=`b`**".into(),
|
||||||
|
"closed_copy" => "**> foreign.session_close id=`alias`**\n**> foreign.session_set id=`alias` name=\"n\" value=`b`**".into(),
|
||||||
|
"wide_input" => "**> foreign.session_set id=`a` name=\"n\" value=9007199254740992**".into(),
|
||||||
|
"wide_output" => format!("**> foreign.session_eval id=`a` source=\"{bad}\"**"),
|
||||||
|
_ => String::new(),
|
||||||
|
};
|
||||||
|
format!(
|
||||||
|
r#"---
|
||||||
|
markup: occlusion
|
||||||
|
import:
|
||||||
|
foreign: lib/foreign.mq.md
|
||||||
|
---
|
||||||
|
# main
|
||||||
|
**a = > foreign.session_open lang="{lang}"**
|
||||||
|
**b = > foreign.session_open lang="{lang}"**
|
||||||
|
**> foreign.session_set id=`a` name="n" value={seed}**
|
||||||
|
**> foreign.session_set id=`b` name="n" value=100**
|
||||||
|
**alias = `a`**
|
||||||
|
**counter = 777**
|
||||||
|
**before = > foreign.session_get id=`a` name="n"**
|
||||||
|
{failure}
|
||||||
|
|
||||||
|
1. `before` < {condition}
|
||||||
|
**answer = > {function} s=`alias` rounds={rounds}**
|
||||||
|
2. *
|
||||||
|
**> foreign.session_set id=`a` name="n" value={else_value}**
|
||||||
|
|
||||||
|
**after = > foreign.session_get id=`a` name="n"**
|
||||||
|
**peer = > foreign.session_get id=`b` name="n"**
|
||||||
|
**> foreign.session_close id=`alias`**
|
||||||
|
**c = > foreign.session_open lang="{lang}"**
|
||||||
|
**> foreign.session_set id=`c` name="n" value=7**
|
||||||
|
**fresh = > foreign.session_get id=`c` name="n"**
|
||||||
|
**> foreign.session_close id=`b`**
|
||||||
|
**> foreign.session_close id=`c`**
|
||||||
|
**total = after + peer + fresh + counter**
|
||||||
|
*total*
|
||||||
|
|
||||||
|
## adjust
|
||||||
|
+ `s`
|
||||||
|
+ `rounds`
|
||||||
|
**counter = 0**
|
||||||
|
- `counter` < `rounds`
|
||||||
|
> bump s=`s`
|
||||||
|
**counter = counter + 1**
|
||||||
|
|
||||||
|
**answer = > foreign.session_get id=`s` name="n"**
|
||||||
|
*answer*
|
||||||
|
|
||||||
|
## bump
|
||||||
|
+ `s`
|
||||||
|
> foreign.session_eval id=`s` source="{increment}"{stdin}
|
||||||
|
|
||||||
|
## advance_rec
|
||||||
|
+ `s`
|
||||||
|
+ `rounds`
|
||||||
|
1. 0 < `rounds`
|
||||||
|
> bump s=`s`
|
||||||
|
**remaining = rounds - 1**
|
||||||
|
**answer = > advance_rec s=`s` rounds=`remaining`**
|
||||||
|
*answer*
|
||||||
|
2. *
|
||||||
|
**answer = > foreign.session_get id=`s` name="n"**
|
||||||
|
*answer*
|
||||||
|
|
||||||
|
## early
|
||||||
|
+ `s`
|
||||||
|
+ `rounds`
|
||||||
|
**counter = 0**
|
||||||
|
- `counter` < `rounds`
|
||||||
|
**answer = > foreign.session_get id=`s` name="n"**
|
||||||
|
*answer*
|
||||||
|
|
||||||
|
**answer = > foreign.session_get id=`s` name="n"**
|
||||||
|
*answer*
|
||||||
|
"#,
|
||||||
|
else_value = seed + 20
|
||||||
|
)
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn parsed_source_control_matches_independent_oracles_on_both_backends() {
|
||||||
|
let root = PathBuf::from(env!("CARGO_MANIFEST_DIR"));
|
||||||
|
let out = std::env::var_os("MARQDO_SOURCE_ARTIFACT_DIR")
|
||||||
|
.map(PathBuf::from)
|
||||||
|
.unwrap_or_else(|| root.join("target/source-refinement"));
|
||||||
|
std::fs::create_dir_all(&out).unwrap();
|
||||||
|
let seeds = std::env::var("MARQDO_SOURCE_SEEDS")
|
||||||
|
.unwrap_or("3".into())
|
||||||
|
.split(',')
|
||||||
|
.map(|x| x.parse::<i64>().unwrap())
|
||||||
|
.collect::<Vec<_>>();
|
||||||
|
let lengths = std::env::var("MARQDO_SOURCE_ROUNDS")
|
||||||
|
.unwrap_or("0,3".into())
|
||||||
|
.split(',')
|
||||||
|
.map(|x| x.parse::<usize>().unwrap())
|
||||||
|
.collect::<Vec<_>>();
|
||||||
|
let scenarios = [
|
||||||
|
"normal",
|
||||||
|
"recursive",
|
||||||
|
"early_return",
|
||||||
|
"else_branch",
|
||||||
|
"closed_get",
|
||||||
|
"copy_handle",
|
||||||
|
"closed_copy",
|
||||||
|
"wide_input",
|
||||||
|
"wide_output",
|
||||||
|
"explicit_empty_stdin",
|
||||||
|
];
|
||||||
|
let mut count = 0;
|
||||||
|
for lang in ["python", "node"] {
|
||||||
|
for &seed in &seeds {
|
||||||
|
for &rounds in &lengths {
|
||||||
|
for scenario in scenarios {
|
||||||
|
let id = format!("{lang}-{seed}-{rounds}-{scenario}");
|
||||||
|
let text = source(lang, seed, rounds, scenario);
|
||||||
|
// Absolute import is only a fixture location; the actual module is loaded.
|
||||||
|
let text = text.replace(
|
||||||
|
"foreign: lib/foreign.mq.md",
|
||||||
|
&format!("foreign: {}", root.join("lib/foreign.mq.md").display()),
|
||||||
|
);
|
||||||
|
let path = out.join(format!("{id}.mq.md"));
|
||||||
|
std::fs::write(&path, &text).unwrap();
|
||||||
|
let module = crate::load::load_module(&path).unwrap();
|
||||||
|
let ir = source_ir(&module).unwrap_or_else(|e| panic!("{id}: AST export: {e}"));
|
||||||
|
let mut executions = Vec::new();
|
||||||
|
for backend in ["tree", "bytecode"] {
|
||||||
|
let (result, journal, values, protocol) = if backend == "tree" {
|
||||||
|
let mut interpreter =
|
||||||
|
crate::interp::Interpreter::with_capture(Some(&path), false);
|
||||||
|
let result = interpreter.run_module(&module);
|
||||||
|
let (journal, values, protocol) = interpreter.foreign_source_evidence();
|
||||||
|
assert!(interpreter.captured_stdout.is_empty(), "unexpected stdout");
|
||||||
|
(result, journal, values, protocol)
|
||||||
|
} else {
|
||||||
|
let code =
|
||||||
|
crate::bytecode::compile_module(Some(&path), &module).unwrap();
|
||||||
|
let mut vm = crate::bytecode::Vm::with_capture(Some(&path));
|
||||||
|
let result = vm.run(&code);
|
||||||
|
let (journal, values, protocol) = vm.foreign_source_evidence();
|
||||||
|
assert!(vm.captured_stdout.is_empty(), "unexpected stdout");
|
||||||
|
(result, journal, values, protocol)
|
||||||
|
};
|
||||||
|
let failure = matches!(
|
||||||
|
scenario,
|
||||||
|
"closed_get"
|
||||||
|
| "copy_handle"
|
||||||
|
| "closed_copy"
|
||||||
|
| "wide_input"
|
||||||
|
| "wide_output"
|
||||||
|
);
|
||||||
|
assert_eq!(result.is_err(), failure, "{id} {backend}: {result:?}");
|
||||||
|
if !failure {
|
||||||
|
let expected = seed
|
||||||
|
+ if scenario == "early_return" {
|
||||||
|
0
|
||||||
|
} else if scenario == "else_branch" {
|
||||||
|
20
|
||||||
|
} else {
|
||||||
|
rounds as i64
|
||||||
|
};
|
||||||
|
assert_eq!(
|
||||||
|
result.as_ref().unwrap(),
|
||||||
|
&Value::Int(expected + 884),
|
||||||
|
"{id} {backend}"
|
||||||
|
);
|
||||||
|
}
|
||||||
|
let error = result.as_ref().err().map(|e| e.to_string());
|
||||||
|
let diagnostic = result.as_ref().err().and_then(crate::diagnostics::Diagnostic::find).map(crate::diagnostics::Diagnostic::to_json);
|
||||||
|
let fault = if let Some(e) = &error {
|
||||||
|
if e.contains("not found") {
|
||||||
|
"unknown"
|
||||||
|
} else if e.contains("outside V_safe")
|
||||||
|
|| e.contains("cannot be serialized")
|
||||||
|
{
|
||||||
|
if protocol.last().is_some_and(|p| {
|
||||||
|
p.response.as_ref().is_ok_and(|reply| {
|
||||||
|
reply.get("domain_error").and_then(Json::as_bool)
|
||||||
|
== Some(true)
|
||||||
|
})
|
||||||
|
}) {
|
||||||
|
"outputDomain"
|
||||||
|
} else {
|
||||||
|
"inputDomain"
|
||||||
|
}
|
||||||
|
} else {
|
||||||
|
panic!("{id} {backend}: unclassified error {e}")
|
||||||
|
}
|
||||||
|
} else {
|
||||||
|
"none"
|
||||||
|
};
|
||||||
|
let protocol = protocol.iter().map(|p| json!({"session":p.session,"request":p.request,"response":p.response})).collect::<Vec<_>>();
|
||||||
|
executions.push(json!({"backend":backend,"ok":result.is_ok(),"result":result.ok().map(|v|value_to_json(&v).unwrap()),"error":error,"fault":fault,"protocol":protocol,"diagnostic":diagnostic,
|
||||||
|
"journal":value_to_json(&Value::List(journal)).unwrap(),"live_values":value_to_json(&Value::List(values)).unwrap()}));
|
||||||
|
}
|
||||||
|
std::fs::write(out.join(format!("{id}.json")),serde_json::to_vec_pretty(&json!({"version":1,"id":id,"language":lang,"seed":seed,"rounds":rounds,"scenario":scenario,"source_sha256":format!("{:x}",Sha256::digest(text.as_bytes())),"ast":ir,"executions":executions})).unwrap()).unwrap();
|
||||||
|
count += 1;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
println!(
|
||||||
|
"SOURCE_METRIC:{}",
|
||||||
|
json!({"cases":count,"executions":count*2,"scenarios":scenarios,"correct":true})
|
||||||
|
);
|
||||||
|
}
|
||||||
@@ -4,6 +4,44 @@ use std::fmt;
|
|||||||
|
|
||||||
use crate::formula::Expr as FormulaExpr;
|
use crate::formula::Expr as FormulaExpr;
|
||||||
|
|
||||||
|
/// An object's defining module instance, expressed as import binding segments.
|
||||||
|
/// This is ordinary copied data, not an unforgeable session capability.
|
||||||
|
pub(crate) const OBJECT_MODULE_KEY: &str = "_type_module";
|
||||||
|
|
||||||
|
pub(crate) fn instance_module(value: &Value) -> Result<Option<Vec<String>>, String> {
|
||||||
|
let Value::Map(fields) = value else { return Ok(None); };
|
||||||
|
let Some((_, module)) = fields.iter().find(|(key, _)| key == OBJECT_MODULE_KEY) else { return Ok(None); };
|
||||||
|
let Value::List(segments) = module else { return Err("object module tag must be a list of text segments".into()); };
|
||||||
|
segments.iter().map(|segment| match segment {
|
||||||
|
Value::Text(name) => Ok(name.clone()),
|
||||||
|
_ => Err("object module tag must be a list of text segments".into()),
|
||||||
|
}).collect::<Result<Vec<_>,_>>().map(Some)
|
||||||
|
}
|
||||||
|
|
||||||
|
pub(crate) fn tag_instance(type_name: &str, module: &[String], value: Value) -> Value {
|
||||||
|
let mut fields = match value {
|
||||||
|
Value::Map(fields) => fields,
|
||||||
|
Value::None => Vec::new(),
|
||||||
|
other => vec![("value".into(),other)],
|
||||||
|
};
|
||||||
|
fields.retain(|(key,_)| key != "_type" && key != OBJECT_MODULE_KEY);
|
||||||
|
fields.insert(0,("_type".into(),Value::Text(type_name.into())));
|
||||||
|
fields.insert(1,(OBJECT_MODULE_KEY.into(),Value::List(module.iter().cloned().map(Value::Text).collect())));
|
||||||
|
Value::Map(fields)
|
||||||
|
}
|
||||||
|
|
||||||
|
pub(crate) fn preserve_instance_module(receiver: &Value, value: Value) -> Value {
|
||||||
|
let Ok(Some(module)) = instance_module(receiver) else { return value; };
|
||||||
|
match value {
|
||||||
|
Value::Map(mut fields) => {
|
||||||
|
fields.retain(|(key,_)| key != OBJECT_MODULE_KEY);
|
||||||
|
fields.insert(1.min(fields.len()),(OBJECT_MODULE_KEY.into(),Value::List(module.into_iter().map(Value::Text).collect())));
|
||||||
|
Value::Map(fields)
|
||||||
|
}
|
||||||
|
other => other,
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
/// Bound Markdown code fence (`type` → `code`).
|
/// Bound Markdown code fence (`type` → `code`).
|
||||||
#[derive(Debug, Clone, PartialEq, Eq)]
|
#[derive(Debug, Clone, PartialEq, Eq)]
|
||||||
pub struct CodeBlock {
|
pub struct CodeBlock {
|
||||||
@@ -29,6 +67,8 @@ pub enum Value {
|
|||||||
Code(CodeBlock),
|
Code(CodeBlock),
|
||||||
/// Sensitive text from `${secret.*}` — Display shows `<secret>`; reveal on Text concat.
|
/// Sensitive text from `${secret.*}` — Display shows `<secret>`; reveal on Text concat.
|
||||||
Secret(String),
|
Secret(String),
|
||||||
|
/// Opaque foreign-session handle. Not JSON-serializable; not printable structure.
|
||||||
|
Handle(String),
|
||||||
}
|
}
|
||||||
|
|
||||||
impl Value {
|
impl Value {
|
||||||
@@ -40,6 +80,7 @@ impl Value {
|
|||||||
Value::Num(n) => *n != 0.0 && !n.is_nan(),
|
Value::Num(n) => *n != 0.0 && !n.is_nan(),
|
||||||
Value::Text(s) => !s.is_empty(),
|
Value::Text(s) => !s.is_empty(),
|
||||||
Value::Secret(s) => !s.is_empty(),
|
Value::Secret(s) => !s.is_empty(),
|
||||||
|
Value::Handle(s) => !s.is_empty(),
|
||||||
Value::List(xs) => !xs.is_empty(),
|
Value::List(xs) => !xs.is_empty(),
|
||||||
Value::Map(xs) => !xs.is_empty(),
|
Value::Map(xs) => !xs.is_empty(),
|
||||||
Value::Formula(_) => true,
|
Value::Formula(_) => true,
|
||||||
@@ -64,6 +105,7 @@ impl Value {
|
|||||||
Value::Num(n) => crate::formula::format_num(*n),
|
Value::Num(n) => crate::formula::format_num(*n),
|
||||||
Value::Text(s) => s.clone(),
|
Value::Text(s) => s.clone(),
|
||||||
Value::Secret(_) => "<secret>".into(),
|
Value::Secret(_) => "<secret>".into(),
|
||||||
|
Value::Handle(_) => "<handle>".into(),
|
||||||
Value::List(xs) => {
|
Value::List(xs) => {
|
||||||
let parts: Vec<String> = xs.iter().map(|v| v.as_display()).collect();
|
let parts: Vec<String> = xs.iter().map(|v| v.as_display()).collect();
|
||||||
format!("[{}]", parts.join(", "))
|
format!("[{}]", parts.join(", "))
|
||||||
@@ -71,6 +113,7 @@ impl Value {
|
|||||||
Value::Map(pairs) => {
|
Value::Map(pairs) => {
|
||||||
let parts: Vec<String> = pairs
|
let parts: Vec<String> = pairs
|
||||||
.iter()
|
.iter()
|
||||||
|
.filter(|(key,_)| key != OBJECT_MODULE_KEY)
|
||||||
.map(|(k, v)| format!("{k}: {}", v.as_display()))
|
.map(|(k, v)| format!("{k}: {}", v.as_display()))
|
||||||
.collect();
|
.collect();
|
||||||
format!("{{{}}}", parts.join(", "))
|
format!("{{{}}}", parts.join(", "))
|
||||||
|
|||||||
@@ -199,6 +199,7 @@ const API_ROUTES: &[(&str, ApiRoute)] = &[
|
|||||||
("/api/session/snapshot/export", ApiRoute::Notebook(notebook_api::api_export_snapshot)),
|
("/api/session/snapshot/export", ApiRoute::Notebook(notebook_api::api_export_snapshot)),
|
||||||
("/api/session/snapshot/import", ApiRoute::Notebook(notebook_api::api_import_snapshot)),
|
("/api/session/snapshot/import", ApiRoute::Notebook(notebook_api::api_import_snapshot)),
|
||||||
("/api/session/snapshot/replay", ApiRoute::Notebook(notebook_api::api_replay_snapshot)),
|
("/api/session/snapshot/replay", ApiRoute::Notebook(notebook_api::api_replay_snapshot)),
|
||||||
|
("/api/session/snapshot/replay_check", ApiRoute::Notebook(notebook_api::api_replay_check)),
|
||||||
("/api/session/plan/assign", ApiRoute::Notebook(notebook_api::api_plan_assign)),
|
("/api/session/plan/assign", ApiRoute::Notebook(notebook_api::api_plan_assign)),
|
||||||
("/api/session/plan/add", ApiRoute::Notebook(notebook_api::api_plan_add)),
|
("/api/session/plan/add", ApiRoute::Notebook(notebook_api::api_plan_add)),
|
||||||
("/api/session/plan/remove", ApiRoute::Notebook(notebook_api::api_plan_remove)),
|
("/api/session/plan/remove", ApiRoute::Notebook(notebook_api::api_plan_remove)),
|
||||||
@@ -216,6 +217,7 @@ const API_ROUTES: &[(&str, ApiRoute)] = &[
|
|||||||
("/api/session/state/push", ApiRoute::Notebook(notebook_api::api_state_push)),
|
("/api/session/state/push", ApiRoute::Notebook(notebook_api::api_state_push)),
|
||||||
("/api/session/state/pull", ApiRoute::Notebook(notebook_api::api_state_pull)),
|
("/api/session/state/pull", ApiRoute::Notebook(notebook_api::api_state_pull)),
|
||||||
("/api/session/journal", ApiRoute::Notebook(notebook_api::api_journal)),
|
("/api/session/journal", ApiRoute::Notebook(notebook_api::api_journal)),
|
||||||
|
("/api/session/oracle_journal", ApiRoute::Notebook(notebook_api::api_oracle_journal)),
|
||||||
("/api/debug/start", ApiRoute::Notebook(debug_api::api_debug_start)),
|
("/api/debug/start", ApiRoute::Notebook(debug_api::api_debug_start)),
|
||||||
("/api/debug/continue", ApiRoute::Action(crate::debug::DebugAction::Continue)),
|
("/api/debug/continue", ApiRoute::Action(crate::debug::DebugAction::Continue)),
|
||||||
("/api/debug/step", ApiRoute::Action(crate::debug::DebugAction::Step)),
|
("/api/debug/step", ApiRoute::Action(crate::debug::DebugAction::Step)),
|
||||||
|
|||||||
+199
-15
@@ -1,15 +1,40 @@
|
|||||||
//! Live-view notebook session APIs.
|
//! Live-view notebook session APIs.
|
||||||
|
|
||||||
|
#[cfg(all(test, unix))]
|
||||||
|
mod interrupt_http_tests;
|
||||||
|
|
||||||
use std::collections::HashMap;
|
use std::collections::HashMap;
|
||||||
use std::path::{Path, PathBuf};
|
use std::path::{Path, PathBuf};
|
||||||
use std::sync::{Arc, Mutex, OnceLock};
|
use std::sync::{Arc, Mutex, OnceLock, MutexGuard, TryLockError};
|
||||||
|
use std::sync::atomic::{AtomicBool, Ordering};
|
||||||
|
|
||||||
use crate::host::json::{json_to_value, value_to_json};
|
use crate::host::json::{json_to_value, value_to_json};
|
||||||
use crate::host::foreign_doc::DocumentSession;
|
use crate::host::foreign_doc::DocumentSession;
|
||||||
use crate::value::Value;
|
use crate::value::Value;
|
||||||
|
|
||||||
fn sessions() -> &'static Mutex<HashMap<String, Arc<Mutex<DocumentSession>>>> {
|
struct ApiSession {
|
||||||
static S: OnceLock<Mutex<HashMap<String, Arc<Mutex<DocumentSession>>>>> = OnceLock::new();
|
closed: AtomicBool,
|
||||||
|
document: OnceLock<Result<Mutex<DocumentSession>, String>>,
|
||||||
|
control: crate::host::foreign_doc::DocumentControl,
|
||||||
|
}
|
||||||
|
impl ApiSession {
|
||||||
|
fn mutex(&self) -> Result<&Mutex<DocumentSession>, String> {
|
||||||
|
// `OnceLock::wait` needs Rust ≥1.84; MSRV is 1.81 — poll until init.
|
||||||
|
loop {
|
||||||
|
match self.document.get() {
|
||||||
|
Some(slot) => return slot.as_ref().map_err(Clone::clone),
|
||||||
|
None => std::thread::yield_now(),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn lock(&self) -> Result<MutexGuard<'_, DocumentSession>, String> {
|
||||||
|
let guard = self.mutex()?.lock().map_err(|_| "session lock poisoned".to_string())?;
|
||||||
|
if self.closed.load(Ordering::Acquire) { return Err("session closed".into()); }
|
||||||
|
Ok(guard)
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn sessions() -> &'static Mutex<HashMap<String, Arc<ApiSession>>> {
|
||||||
|
static S: OnceLock<Mutex<HashMap<String, Arc<ApiSession>>>> = OnceLock::new();
|
||||||
S.get_or_init(|| Mutex::new(HashMap::new()))
|
S.get_or_init(|| Mutex::new(HashMap::new()))
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -17,7 +42,7 @@ fn body_value(body: &str) -> serde_json::Value {
|
|||||||
serde_json::from_str(body).unwrap_or(serde_json::Value::Null)
|
serde_json::from_str(body).unwrap_or(serde_json::Value::Null)
|
||||||
}
|
}
|
||||||
|
|
||||||
fn path_of(root: &Path, v: &serde_json::Value) -> Result<(String, PathBuf), String> {
|
fn requested_path(root: &Path, v: &serde_json::Value) -> Result<(String, PathBuf), String> {
|
||||||
let rel = v
|
let rel = v
|
||||||
.get("path")
|
.get("path")
|
||||||
.and_then(|p| p.as_str())
|
.and_then(|p| p.as_str())
|
||||||
@@ -28,21 +53,37 @@ fn path_of(root: &Path, v: &serde_json::Value) -> Result<(String, PathBuf), Stri
|
|||||||
return Err("missing path".into());
|
return Err("missing path".into());
|
||||||
}
|
}
|
||||||
let abs = root.join(rel.replace('/', std::path::MAIN_SEPARATOR_STR));
|
let abs = root.join(rel.replace('/', std::path::MAIN_SEPARATOR_STR));
|
||||||
|
Ok((rel, abs))
|
||||||
|
}
|
||||||
|
|
||||||
|
fn path_of(root: &Path, v: &serde_json::Value) -> Result<(String, PathBuf), String> {
|
||||||
|
let (rel, abs) = requested_path(root, v)?;
|
||||||
if !abs.is_file() {
|
if !abs.is_file() {
|
||||||
return Err(format!("file not found: {rel}"));
|
return Err(format!("file not found: {rel}"));
|
||||||
}
|
}
|
||||||
Ok((rel, abs))
|
Ok((rel, abs))
|
||||||
}
|
}
|
||||||
|
|
||||||
fn get_or_open(root: &Path, abs: &Path) -> Result<Arc<Mutex<DocumentSession>>, String> {
|
fn get_or_open(root: &Path, abs: &Path) -> Result<Arc<ApiSession>, String> {
|
||||||
let key = abs.display().to_string();
|
let key = abs.display().to_string();
|
||||||
let mut map = sessions().lock().map_err(|_| "session lock poisoned".to_string())?;
|
let arc = {
|
||||||
if let Some(s) = map.get(&key) {
|
let mut map = sessions().lock().map_err(|_| "session lock poisoned".to_string())?;
|
||||||
return Ok(Arc::clone(s));
|
Arc::clone(map.entry(key.clone()).or_insert_with(|| Arc::new(ApiSession {
|
||||||
|
closed: AtomicBool::new(false),
|
||||||
|
control: Default::default(), document: OnceLock::new(),
|
||||||
|
})))
|
||||||
|
};
|
||||||
|
// Kernel startup may block. It must never hold the registry lock needed by
|
||||||
|
// interrupt requests for an unrelated already-running document.
|
||||||
|
let initialized = arc.document.get_or_init(|| DocumentSession::open(abs, root).map(|mut session| {
|
||||||
|
session.adopt_control(arc.control.clone());
|
||||||
|
Mutex::new(session)
|
||||||
|
}));
|
||||||
|
if let Err(error) = initialized {
|
||||||
|
let mut map = sessions().lock().map_err(|_| "session lock poisoned".to_string())?;
|
||||||
|
if map.get(&key).is_some_and(|old| Arc::ptr_eq(old, &arc)) { map.remove(&key); }
|
||||||
|
return Err(error.clone());
|
||||||
}
|
}
|
||||||
let session = DocumentSession::open(abs, root)?;
|
|
||||||
let arc = Arc::new(Mutex::new(session));
|
|
||||||
map.insert(key, Arc::clone(&arc));
|
|
||||||
Ok(arc)
|
Ok(arc)
|
||||||
}
|
}
|
||||||
|
|
||||||
@@ -137,6 +178,7 @@ pub fn api_close(root: &Path, body: &str) -> serde_json::Value {
|
|||||||
.and_then(|mut m| m.remove(&key));
|
.and_then(|mut m| m.remove(&key));
|
||||||
if let Some(arc) = removed {
|
if let Some(arc) = removed {
|
||||||
if let Ok(mut s) = arc.lock() {
|
if let Ok(mut s) = arc.lock() {
|
||||||
|
arc.closed.store(true, Ordering::Release);
|
||||||
s.close();
|
s.close();
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
@@ -181,17 +223,54 @@ pub fn api_persist_cell(root: &Path, body: &str) -> serde_json::Value {
|
|||||||
}
|
}
|
||||||
|
|
||||||
pub fn api_interrupt(root: &Path, body: &str) -> serde_json::Value {
|
pub fn api_interrupt(root: &Path, body: &str) -> serde_json::Value {
|
||||||
with_session(root, body, "interrupted", |s| s.interrupt())
|
let v = body_value(body);
|
||||||
|
// A control request addresses an existing loaded session. It neither reads
|
||||||
|
// the source again nor creates a process as a side effect of cancellation.
|
||||||
|
let (_, abs) = match requested_path(root, &v) { Ok(p) => p, Err(e) => return err(e) };
|
||||||
|
let session = match sessions().lock() {
|
||||||
|
Ok(map) => match map.get(&abs.display().to_string()) { Some(s) => s.clone(), None => return err("no open session".into()) },
|
||||||
|
Err(_) => return err("session lock poisoned".into()),
|
||||||
|
};
|
||||||
|
if session.closed.load(Ordering::Acquire) { return err("session closed".into()); }
|
||||||
|
let mutex = match session.document.get() {
|
||||||
|
Some(Ok(mutex)) => mutex, Some(Err(error)) => return err(error.clone()),
|
||||||
|
None => return err("session is still opening; no evaluation is active".into()),
|
||||||
|
};
|
||||||
|
let result = match mutex.try_lock() {
|
||||||
|
Ok(mut document) => if session.closed.load(Ordering::Acquire) { err("session closed".into()) } else { match document.interrupt() {
|
||||||
|
Ok(value) => ok_session(&document, serde_json::json!({ "interrupted": json_value(&value), "in_flight": false })),
|
||||||
|
Err(error) => err(error),
|
||||||
|
} },
|
||||||
|
Err(TryLockError::WouldBlock) => match session.control.interrupt() {
|
||||||
|
Ok(value) => {
|
||||||
|
let receipt = json_value(&value);
|
||||||
|
let accepted = receipt["results"].as_array().is_some_and(|rows| rows.iter().all(|row| row["accepted"] == true));
|
||||||
|
if accepted { serde_json::json!({ "ok": true, "interrupted": receipt, "in_flight": true }) }
|
||||||
|
else { serde_json::json!({ "ok": false, "error": "interrupt delivery failed", "interrupted": receipt, "in_flight": true }) }
|
||||||
|
},
|
||||||
|
Err(error) => err(error),
|
||||||
|
},
|
||||||
|
Err(TryLockError::Poisoned(_)) => err("session lock poisoned".into()),
|
||||||
|
};
|
||||||
|
result
|
||||||
}
|
}
|
||||||
|
|
||||||
pub fn api_export_snapshot(root: &Path, body: &str) -> serde_json::Value {
|
pub fn api_export_snapshot(root: &Path, body: &str) -> serde_json::Value {
|
||||||
with_session(root, body, "snapshot", |s| s.export_snapshot())
|
let v = body_value(body);
|
||||||
|
let compact = match v.get("compact") { None | Some(serde_json::Value::Bool(false)) => false,
|
||||||
|
Some(serde_json::Value::Bool(true)) => true, _ => return err("compact must be boolean".into()) };
|
||||||
|
with_session(root, body, "snapshot", |s| {
|
||||||
|
let snapshot = s.export_snapshot()?;
|
||||||
|
if compact { crate::host::foreign_doc::packing::pack(&snapshot) } else { Ok(snapshot) }
|
||||||
|
})
|
||||||
}
|
}
|
||||||
|
|
||||||
pub fn api_import_snapshot(root: &Path, body: &str) -> serde_json::Value {
|
pub fn api_import_snapshot(root: &Path, body: &str) -> serde_json::Value {
|
||||||
let v = body_value(body);
|
let v = body_value(body);
|
||||||
let snapshot = v.get("snapshot").cloned().unwrap_or(serde_json::Value::Null);
|
let snapshot = v.get("snapshot").cloned().unwrap_or(serde_json::Value::Null);
|
||||||
let snapshot = match json_to_value(&snapshot) {
|
let snapshot = match json_to_value(&snapshot).and_then(|value| if crate::host::foreign_doc::packing::is_packed(&value) {
|
||||||
|
crate::host::foreign_doc::packing::unpack(&value)
|
||||||
|
} else { Ok(value) }) {
|
||||||
Ok(v) => v,
|
Ok(v) => v,
|
||||||
Err(e) => return err(e),
|
Err(e) => return err(e),
|
||||||
};
|
};
|
||||||
@@ -201,13 +280,40 @@ pub fn api_import_snapshot(root: &Path, body: &str) -> serde_json::Value {
|
|||||||
pub fn api_replay_snapshot(root: &Path, body: &str) -> serde_json::Value {
|
pub fn api_replay_snapshot(root: &Path, body: &str) -> serde_json::Value {
|
||||||
let v = body_value(body);
|
let v = body_value(body);
|
||||||
let snapshot = v.get("snapshot").cloned().unwrap_or(serde_json::Value::Null);
|
let snapshot = v.get("snapshot").cloned().unwrap_or(serde_json::Value::Null);
|
||||||
let snapshot = match json_to_value(&snapshot) {
|
let snapshot = match json_to_value(&snapshot).and_then(|value| if crate::host::foreign_doc::packing::is_packed(&value) {
|
||||||
|
crate::host::foreign_doc::packing::unpack(&value)
|
||||||
|
} else { Ok(value) }) {
|
||||||
Ok(v) => v,
|
Ok(v) => v,
|
||||||
Err(e) => return err(e),
|
Err(e) => return err(e),
|
||||||
};
|
};
|
||||||
with_session(root, body, "replay", |s| s.replay_snapshot(&snapshot))
|
with_session(root, body, "replay", |s| s.replay_snapshot(&snapshot))
|
||||||
}
|
}
|
||||||
|
|
||||||
|
pub fn api_replay_check(root: &Path, body: &str) -> serde_json::Value {
|
||||||
|
// Decode before serde_json::Value can overwrite duplicate recording fields.
|
||||||
|
let request = match crate::host::json::parse(&Value::Text(body.to_string())) {
|
||||||
|
Ok(value) => value,
|
||||||
|
Err(error) => return err(error),
|
||||||
|
};
|
||||||
|
let v = match value_to_json(&request) { Ok(v) => v, Err(e) => return err(e) };
|
||||||
|
let (_, abs) = match path_of(root, &v) { Ok(path) => path, Err(e) => return err(e) };
|
||||||
|
let Value::Map(fields) = request else { return err("request must be a map".into()) };
|
||||||
|
let Some((_, snapshot)) = fields.iter().find(|(k,_)| k == "snapshot") else { return err("missing snapshot".into()) };
|
||||||
|
let check = match DocumentSession::check_snapshot_isolated(&abs, root, snapshot) {
|
||||||
|
Ok(check) => check, Err(error) => return err(error),
|
||||||
|
};
|
||||||
|
let existing = match sessions().lock() {
|
||||||
|
Ok(map) => map.get(&abs.display().to_string()).cloned(),
|
||||||
|
Err(_) => return err("session lock poisoned".into()),
|
||||||
|
};
|
||||||
|
let extra = serde_json::json!({"replay_check": json_value(&check)});
|
||||||
|
if let Some(arc) = existing {
|
||||||
|
match arc.lock() { Ok(session) => ok_session(&session, extra), Err(_) => err("session lock poisoned".into()) }
|
||||||
|
} else {
|
||||||
|
serde_json::json!({"ok": true, "replay_check": json_value(&check)})
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
pub fn api_clear_cell(root: &Path, body: &str) -> serde_json::Value {
|
pub fn api_clear_cell(root: &Path, body: &str) -> serde_json::Value {
|
||||||
let v = body_value(body);
|
let v = body_value(body);
|
||||||
let cell = v.get("cell").and_then(|x| x.as_str()).unwrap_or("");
|
let cell = v.get("cell").and_then(|x| x.as_str()).unwrap_or("");
|
||||||
@@ -352,6 +458,10 @@ pub fn api_journal(root: &Path, body: &str) -> serde_json::Value {
|
|||||||
with_session(root, body, "journal", |s| Ok(s.journal_json()))
|
with_session(root, body, "journal", |s| Ok(s.journal_json()))
|
||||||
}
|
}
|
||||||
|
|
||||||
|
pub fn api_oracle_journal(root: &Path, body: &str) -> serde_json::Value {
|
||||||
|
with_session(root, body, "oracle_journal", |s| Ok(s.oracle_journal_json()))
|
||||||
|
}
|
||||||
|
|
||||||
#[cfg(test)]
|
#[cfg(test)]
|
||||||
mod tests {
|
mod tests {
|
||||||
use super::*;
|
use super::*;
|
||||||
@@ -429,3 +539,77 @@ mod tests {
|
|||||||
let _ = api_close(&root, open_body());
|
let _ = api_close(&root, open_body());
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
|
#[cfg(test)]
|
||||||
|
mod replay_api_tests {
|
||||||
|
use super::*;
|
||||||
|
#[test]
|
||||||
|
fn closed_api_session_cannot_be_reactivated_after_path_reopen() {
|
||||||
|
let root = PathBuf::from(env!("CARGO_MANIFEST_DIR"));
|
||||||
|
let relative = format!("target/api-close-capability-{}.mq.md", std::process::id());
|
||||||
|
let path = root.join(&relative);
|
||||||
|
std::fs::write(&path, "---\nimport:\n foreign: lib/foreign.mq.md\n---\n# main\n\n`会话` = > foreign.session\n\n`a` =\n```python\nn = 1\n```\n").unwrap();
|
||||||
|
let old = get_or_open(&root, &path).unwrap();
|
||||||
|
old.lock().unwrap().run_all(false).unwrap();
|
||||||
|
let body = serde_json::json!({"path": relative}).to_string();
|
||||||
|
assert_eq!(api_close(&root, &body)["ok"], true);
|
||||||
|
let fresh = get_or_open(&root, &path).unwrap();
|
||||||
|
assert!(!Arc::ptr_eq(&old, &fresh));
|
||||||
|
assert!(old.lock().is_err());
|
||||||
|
fresh.lock().unwrap().run_all(false).unwrap();
|
||||||
|
assert_eq!(api_close(&root, &body)["ok"], true);
|
||||||
|
std::fs::remove_file(path).unwrap();
|
||||||
|
}
|
||||||
|
#[test]
|
||||||
|
fn strict_replay_endpoint_uses_isolation_and_preserves_warm_session() {
|
||||||
|
let root=PathBuf::from(env!("CARGO_MANIFEST_DIR"));
|
||||||
|
let relative=format!("target/api-replay-isolated-{}.mq.md",std::process::id());let path=root.join(&relative);
|
||||||
|
std::fs::write(&path,"---\nimport:\n foreign: lib/foreign.mq.md\n---\n# main\n\n`会话` = > foreign.session\n\n`a` =\n```python\nstate = globals().get('state',0) + 1\nprint(state)\n```\n").unwrap();
|
||||||
|
let arc=get_or_open(&root,&path).unwrap();
|
||||||
|
let (snapshot,kernel)={let mut live=arc.lock().unwrap();live.run_all(false).unwrap();let snapshot=live.export_snapshot().unwrap();let kernel=live.cells[0].kernel.clone();live.set_value(&kernel,"state",Value::Int(99)).unwrap();(snapshot,kernel)};
|
||||||
|
let before={let live=arc.lock().unwrap();live.summary()};
|
||||||
|
let body=serde_json::json!({"path":relative,"snapshot":value_to_json(&snapshot).unwrap()}).to_string();
|
||||||
|
let response=api_replay_check(&root,&body);
|
||||||
|
assert_eq!(response["ok"],true,"{response}");assert_eq!(response["replay_check"]["ok"],true,"{response}");
|
||||||
|
assert_eq!(arc.lock().unwrap().summary(),before,"verification mutated live state");
|
||||||
|
let duplicate=body.replacen("\"snapshot\":", "\"snapshot\":null,\"snapshot\":",1);
|
||||||
|
let bad=api_replay_check(&root,&duplicate);assert_eq!(bad["ok"],false);assert!(bad["error"].as_str().unwrap().contains("duplicate"));
|
||||||
|
assert_eq!(arc.lock().unwrap().summary(),before);
|
||||||
|
assert_eq!(arc.lock().unwrap().pull_value(&kernel,"state").unwrap(),Value::Int(99),"isolated verification reset the user's actual kernel");
|
||||||
|
sessions().lock().unwrap().remove(&path.display().to_string());arc.lock().unwrap().close();std::fs::remove_file(path).unwrap();
|
||||||
|
}
|
||||||
|
#[cfg(unix)]
|
||||||
|
#[test]
|
||||||
|
fn malformed_replay_does_not_start_declared_seed_kernel() {
|
||||||
|
use std::os::unix::fs::PermissionsExt;
|
||||||
|
let root=PathBuf::from(env!("CARGO_MANIFEST_DIR"));let pid=std::process::id();
|
||||||
|
let relative=format!("target/api-replay-seeded-{pid}.mq.md");let path=root.join(&relative);
|
||||||
|
let wrapper=root.join(format!("target/api-replay-wrapper-{pid}.py"));let marker=root.join(format!("target/api-replay-marker-{pid}"));
|
||||||
|
let marker_literal=serde_json::to_string(&marker.display().to_string()).unwrap();
|
||||||
|
let script=format!("#!/usr/bin/python3\nimport os,sys\nfrom pathlib import Path\nPath({marker_literal}).write_text('started')\nos.execv(sys.executable,[sys.executable]+sys.argv[1:])\n");
|
||||||
|
std::fs::write(&wrapper,script).unwrap();std::fs::set_permissions(&wrapper,std::fs::Permissions::from_mode(0o755)).unwrap();
|
||||||
|
let command=serde_json::to_string(&wrapper.display().to_string()).unwrap();
|
||||||
|
let source=format!("---\nimport:\n foreign: lib/foreign.mq.md\n---\n# main\n\n`kernels` =\n| 名称 | 语言 | 命令 |\n|---|---|---|\n| py | python | {command} |\n\n`units` =\n| 单元 | 内核 |\n|---|---|\n| a | py |\n\n`initial` =\n| 内核 | 名称 | 值 |\n|---|---|---|\n| py | n | 1 |\n\n`会话` = > foreign.session kernels=`kernels` cells=`units` values=`initial`\n\n`a` =\n```python\nprint(n)\n```\n");
|
||||||
|
std::fs::write(&path,source).unwrap();let mut recording=DocumentSession::open(&path,&root).unwrap();
|
||||||
|
recording.run_all(false).unwrap();let snapshot=recording.export_snapshot().unwrap();recording.close();assert!(marker.exists());std::fs::remove_file(&marker).unwrap();
|
||||||
|
let valid=value_to_json(&snapshot).unwrap();let mut malformed=valid.clone();malformed["actions"].as_array_mut().unwrap().pop();
|
||||||
|
let cold = api_interrupt(&root, &serde_json::json!({"path":relative}).to_string());
|
||||||
|
assert_eq!(cold["ok"], false); assert!(!marker.exists(), "cold interrupt started a kernel");
|
||||||
|
let body=serde_json::json!({"path":relative,"snapshot":malformed}).to_string();let response=api_replay_check(&root,&body);
|
||||||
|
assert_eq!(response["ok"],false,"{response}");assert!(!marker.exists(),"malformed suffix started a seed kernel before preflight");
|
||||||
|
assert!(!sessions().lock().unwrap().contains_key(&path.display().to_string()));
|
||||||
|
let packed = crate::host::foreign_doc::packing::pack(&snapshot).unwrap();
|
||||||
|
let mut corrupt = value_to_json(&packed).unwrap(); corrupt["sha256"] = "bad".into();
|
||||||
|
let response = api_replay_check(&root, &serde_json::json!({"path":relative,"snapshot":corrupt}).to_string());
|
||||||
|
assert_eq!(response["ok"], false); assert!(!marker.exists(), "corrupt DAG started a seed kernel");
|
||||||
|
let mut controls = valid.clone();
|
||||||
|
controls["actions"][0]["controls"] = serde_json::json!([{"after_us":-1,"results":[]}]);
|
||||||
|
let response = api_replay_check(&root, &serde_json::json!({"path":relative,"snapshot":controls}).to_string());
|
||||||
|
assert_eq!(response["ok"], false); assert!(!marker.exists(), "invalid control started a seed kernel");
|
||||||
|
let response=api_replay_check(&root,&serde_json::json!({"path":relative,"snapshot":valid}).to_string());
|
||||||
|
assert_eq!(response["replay_check"]["ok"],true,"{response}");assert!(marker.exists());
|
||||||
|
assert!(!sessions().lock().unwrap().contains_key(&path.display().to_string()));
|
||||||
|
std::fs::remove_file(path).unwrap();std::fs::remove_file(wrapper).unwrap();std::fs::remove_file(marker).unwrap();
|
||||||
|
}
|
||||||
|
|
||||||
|
}
|
||||||
@@ -0,0 +1,296 @@
|
|||||||
|
use super::*;
|
||||||
|
use std::io::{Read, Write};
|
||||||
|
use std::net::{SocketAddr, TcpStream};
|
||||||
|
use std::sync::atomic::{AtomicBool, Ordering};
|
||||||
|
use std::time::{Duration, Instant, SystemTime, UNIX_EPOCH};
|
||||||
|
|
||||||
|
struct HttpServer {
|
||||||
|
addr: SocketAddr,
|
||||||
|
stop: Arc<AtomicBool>,
|
||||||
|
thread: Option<std::thread::JoinHandle<()>>,
|
||||||
|
}
|
||||||
|
impl HttpServer {
|
||||||
|
fn start(root: &Path) -> Self {
|
||||||
|
let root = Arc::new(crate::view::build_root(root).unwrap());
|
||||||
|
let server = tiny_http::Server::http("127.0.0.1:0").unwrap();
|
||||||
|
let addr = server.server_addr().to_ip().unwrap();
|
||||||
|
let stop = Arc::new(AtomicBool::new(false));
|
||||||
|
let stopping = stop.clone();
|
||||||
|
let thread = std::thread::spawn(move || {
|
||||||
|
let mut workers = Vec::new();
|
||||||
|
while !stopping.load(Ordering::SeqCst) {
|
||||||
|
if let Some(request) = server.recv_timeout(Duration::from_millis(50)).unwrap() {
|
||||||
|
let root = root.clone();
|
||||||
|
workers.push(std::thread::spawn(move || {
|
||||||
|
crate::view::handle(&root, request)
|
||||||
|
}));
|
||||||
|
}
|
||||||
|
}
|
||||||
|
for worker in workers {
|
||||||
|
let _ = worker.join();
|
||||||
|
}
|
||||||
|
});
|
||||||
|
Self {
|
||||||
|
addr,
|
||||||
|
stop,
|
||||||
|
thread: Some(thread),
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
impl Drop for HttpServer {
|
||||||
|
fn drop(&mut self) {
|
||||||
|
self.stop.store(true, Ordering::SeqCst);
|
||||||
|
if let Some(thread) = self.thread.take() {
|
||||||
|
let _ = thread.join();
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
fn post(addr: SocketAddr, endpoint: &str, body: &serde_json::Value) -> serde_json::Value {
|
||||||
|
let bytes = body.to_string();
|
||||||
|
let mut stream = TcpStream::connect(addr).unwrap();
|
||||||
|
stream
|
||||||
|
.set_read_timeout(Some(Duration::from_secs(20)))
|
||||||
|
.unwrap();
|
||||||
|
write!(stream, "POST /api/session/{endpoint} HTTP/1.1\r\nHost: localhost\r\nConnection: close\r\nContent-Type: application/json\r\nContent-Length: {}\r\n\r\n{bytes}", bytes.len()).unwrap();
|
||||||
|
let mut response = String::new();
|
||||||
|
stream.read_to_string(&mut response).unwrap();
|
||||||
|
let (_, body) = response.split_once("\r\n\r\n").unwrap();
|
||||||
|
serde_json::from_str(body).unwrap_or_else(|e| panic!("{endpoint}: {e}: {response}"))
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn real_http_interrupt_preserves_store_stops_batch_and_replays_control_input() {
|
||||||
|
let root = PathBuf::from(env!("CARGO_MANIFEST_DIR"));
|
||||||
|
let server = HttpServer::start(&root);
|
||||||
|
let repeats: usize = std::env::var("MARQDO_CANCEL_REPEATS")
|
||||||
|
.map(|s| s.parse().unwrap())
|
||||||
|
.unwrap_or(1);
|
||||||
|
assert!(repeats > 0);
|
||||||
|
for language in ["python", "node"] {
|
||||||
|
for mode in ["cell/run", "cell/step", "run_all"] {
|
||||||
|
for trial in 0..repeats {
|
||||||
|
let id = format!(
|
||||||
|
"{}-{}-{language}",
|
||||||
|
std::process::id(),
|
||||||
|
SystemTime::now()
|
||||||
|
.duration_since(UNIX_EPOCH)
|
||||||
|
.unwrap()
|
||||||
|
.as_nanos()
|
||||||
|
);
|
||||||
|
let relative = format!("target/http-cancel-{id}.mq.md");
|
||||||
|
let path = root.join(&relative);
|
||||||
|
let marker = root.join(format!("target/http-cancel-started-{id}"));
|
||||||
|
let suffix = root.join(format!("target/http-cancel-suffix-{id}"));
|
||||||
|
let marker_literal = serde_json::to_string(&marker.display().to_string()).unwrap();
|
||||||
|
let suffix_literal = serde_json::to_string(&suffix.display().to_string()).unwrap();
|
||||||
|
let (busy, after) = if language == "python" {
|
||||||
|
(format!("n = 99\nopen({marker_literal}, 'w').write('started')\nwhile True: pass"),
|
||||||
|
format!("open({suffix_literal}, 'w').write('unexpected')\nn = 100"))
|
||||||
|
} else {
|
||||||
|
(format!("n = 99; require('fs').writeFileSync({marker_literal}, 'started'); while (true) {{}}"),
|
||||||
|
format!("require('fs').writeFileSync({suffix_literal}, 'unexpected'); n = 100;"))
|
||||||
|
};
|
||||||
|
let source = format!("---\nimport:\n foreign: lib/foreign.mq.md\n---\n# main\n\n`kernels` =\n| 名称 | 语言 |\n|---|---|\n| worker | {language} |\n\n`units` =\n| 单元 | 内核 |\n|---|---|\n| busy | worker |\n| after | worker |\n\n`initial` =\n| 内核 | 名称 | 值 |\n|---|---|---|\n| worker | n | 1 |\n\n`会话` = > foreign.session kernels=`kernels` cells=`units` values=`initial`\n\n`busy` =\n```{language}\n{busy}\n```\n\n`after` =\n```{language}\n{after}\n```\n");
|
||||||
|
std::fs::write(&path, &source).unwrap();
|
||||||
|
let body = serde_json::json!({"path": relative});
|
||||||
|
assert_eq!(post(server.addr, "open", &body)["ok"], true);
|
||||||
|
let addr = server.addr;
|
||||||
|
let mut running_body = body.clone();
|
||||||
|
if mode == "cell/run" {
|
||||||
|
running_body["cell"] = "busy".into();
|
||||||
|
}
|
||||||
|
let runner = std::thread::spawn(move || post(addr, mode, &running_body));
|
||||||
|
let deadline = Instant::now() + Duration::from_secs(3);
|
||||||
|
while !marker.exists() && Instant::now() < deadline {
|
||||||
|
std::thread::sleep(Duration::from_millis(2));
|
||||||
|
}
|
||||||
|
assert!(
|
||||||
|
marker.exists(),
|
||||||
|
"{language}: evaluation never reached its side effect"
|
||||||
|
);
|
||||||
|
let slow_open = if language == "python" && mode == "run_all" && trial == 0 {
|
||||||
|
let slow_relative = format!("target/http-slow-open-{id}.mq.md");
|
||||||
|
let slow_path = root.join(&slow_relative);
|
||||||
|
let wrapper = root.join(format!("target/http-slow-wrapper-{id}.py"));
|
||||||
|
let started = root.join(format!("target/http-slow-started-{id}"));
|
||||||
|
let literal = serde_json::to_string(&started.display().to_string()).unwrap();
|
||||||
|
std::fs::write(&wrapper, format!("import os,sys,time\nfrom pathlib import Path\nPath({literal}).write_text('opening')\ntime.sleep(2)\nos.execv(sys.executable,[sys.executable]+sys.argv[1:])\n")).unwrap();
|
||||||
|
let command =
|
||||||
|
serde_json::to_string(&format!("python3 {}", wrapper.display())).unwrap();
|
||||||
|
std::fs::write(&slow_path, format!("---\nimport:\n foreign: lib/foreign.mq.md\n---\n# main\n\n`kernels` =\n| 名称 | 语言 | 命令 |\n|---|---|---|\n| slow | python | {command} |\n\n`initial` =\n| 内核 | 名称 | 值 |\n|---|---|---|\n| slow | n | 1 |\n\n`会话` = > foreign.session kernels=`kernels` values=`initial`\n")).unwrap();
|
||||||
|
let slow_body = serde_json::json!({"path":slow_relative});
|
||||||
|
let opening_body = slow_body.clone();
|
||||||
|
let opener = std::thread::spawn(move || post(addr, "open", &opening_body));
|
||||||
|
let deadline = Instant::now() + Duration::from_secs(3);
|
||||||
|
while !started.exists() && Instant::now() < deadline {
|
||||||
|
std::thread::sleep(Duration::from_millis(2));
|
||||||
|
}
|
||||||
|
assert!(started.exists(), "unrelated slow kernel never started");
|
||||||
|
let start = Instant::now();
|
||||||
|
let pending = post(addr, "interrupt", &slow_body);
|
||||||
|
assert_eq!(pending["ok"], false, "{pending}");
|
||||||
|
assert!(
|
||||||
|
start.elapsed() < Duration::from_secs(1),
|
||||||
|
"control waited for initialization"
|
||||||
|
);
|
||||||
|
Some((opener, slow_body, slow_path, wrapper, started))
|
||||||
|
} else {
|
||||||
|
None
|
||||||
|
};
|
||||||
|
std::thread::sleep(Duration::from_millis([0, 5, 25, 50][trial % 4]));
|
||||||
|
let removed_source = language == "node" && mode == "cell/run" && trial == 0;
|
||||||
|
if removed_source {
|
||||||
|
std::fs::remove_file(&path).unwrap();
|
||||||
|
}
|
||||||
|
let start = Instant::now();
|
||||||
|
let interrupted = post(server.addr, "interrupt", &body);
|
||||||
|
let latency = start.elapsed();
|
||||||
|
assert!(
|
||||||
|
latency < Duration::from_secs(1),
|
||||||
|
"interrupt queued behind execution: {latency:?}"
|
||||||
|
);
|
||||||
|
assert_eq!(interrupted["ok"], true, "{interrupted}");
|
||||||
|
assert_eq!(interrupted["in_flight"], true, "{interrupted}");
|
||||||
|
assert_eq!(
|
||||||
|
interrupted["interrupted"]["results"][0]["active"], true,
|
||||||
|
"{interrupted}"
|
||||||
|
);
|
||||||
|
let run = runner.join().unwrap();
|
||||||
|
let completion_latency = start.elapsed();
|
||||||
|
assert!(
|
||||||
|
completion_latency < Duration::from_secs(1),
|
||||||
|
"cancel did not finish execution promptly: {completion_latency:?}"
|
||||||
|
);
|
||||||
|
if removed_source {
|
||||||
|
std::fs::write(&path, &source).unwrap();
|
||||||
|
}
|
||||||
|
if let Some((opener, slow_body, slow_path, wrapper, started)) = slow_open {
|
||||||
|
assert_eq!(opener.join().unwrap()["ok"], true);
|
||||||
|
assert_eq!(post(server.addr, "close", &slow_body)["ok"], true);
|
||||||
|
for file in [slow_path, wrapper, started] {
|
||||||
|
std::fs::remove_file(file).unwrap();
|
||||||
|
}
|
||||||
|
}
|
||||||
|
let record = if mode == "run_all" {
|
||||||
|
assert_eq!(run["summary"]["cancelled"], true, "{run}");
|
||||||
|
assert_eq!(run["summary"]["ran"], 1, "{run}");
|
||||||
|
assert_eq!(run["summary"]["remaining"], 1, "{run}");
|
||||||
|
&run["summary"]["records"][0]
|
||||||
|
} else {
|
||||||
|
&run["record"]
|
||||||
|
};
|
||||||
|
assert_eq!(record["ok"], false, "{run}");
|
||||||
|
assert_eq!(record["timed_out"], false, "{run}");
|
||||||
|
assert_eq!(record["alive"], true, "{run}");
|
||||||
|
assert!(
|
||||||
|
!suffix.exists(),
|
||||||
|
"cancelled batch executed its dependent suffix"
|
||||||
|
);
|
||||||
|
let pull = serde_json::json!({"path":relative,"kernel":"worker","name":"n"});
|
||||||
|
assert_eq!(post(server.addr, "state/pull", &pull)["value"], 99);
|
||||||
|
let exported = post(server.addr, "snapshot/export", &body);
|
||||||
|
let snapshot = &exported["snapshot"];
|
||||||
|
assert_eq!(snapshot["version"], 5);
|
||||||
|
let controls: Vec<_> = snapshot["actions"]
|
||||||
|
.as_array()
|
||||||
|
.unwrap()
|
||||||
|
.iter()
|
||||||
|
.filter(|a| a.get("controls").is_some())
|
||||||
|
.collect();
|
||||||
|
assert_eq!(controls.len(), 1);
|
||||||
|
assert_eq!(
|
||||||
|
controls[0]["kind"],
|
||||||
|
match mode {
|
||||||
|
"cell/run" => "cell",
|
||||||
|
"cell/step" => "step",
|
||||||
|
_ => "run_all",
|
||||||
|
}
|
||||||
|
);
|
||||||
|
assert_eq!(controls[0]["controls"].as_array().unwrap().len(), 1);
|
||||||
|
let replay = post(
|
||||||
|
server.addr,
|
||||||
|
"snapshot/replay_check",
|
||||||
|
&serde_json::json!({"path":relative,"snapshot":snapshot}),
|
||||||
|
);
|
||||||
|
assert_eq!(replay["replay_check"]["ok"], true,
|
||||||
|
"{language}: expected snapshot={snapshot}; actual replay={replay}");
|
||||||
|
assert!(!suffix.exists(), "replay executed a cancelled suffix");
|
||||||
|
let compact = post(
|
||||||
|
server.addr,
|
||||||
|
"snapshot/export",
|
||||||
|
&serde_json::json!({"path":relative,"compact":true}),
|
||||||
|
);
|
||||||
|
assert_eq!(
|
||||||
|
compact["snapshot"]["format"], "marqdo.history.dag",
|
||||||
|
"{compact}"
|
||||||
|
);
|
||||||
|
let replay_compact = post(
|
||||||
|
server.addr,
|
||||||
|
"snapshot/replay_check",
|
||||||
|
&serde_json::json!({"path":relative,"snapshot":compact["snapshot"]}),
|
||||||
|
);
|
||||||
|
assert_eq!(
|
||||||
|
replay_compact["replay_check"]["ok"], true,
|
||||||
|
"expected snapshot={snapshot}; actual compact replay={replay_compact}"
|
||||||
|
);
|
||||||
|
let mut corrupt = compact["snapshot"].clone();
|
||||||
|
corrupt["sha256"] = "bad".into();
|
||||||
|
let rejected = post(
|
||||||
|
server.addr,
|
||||||
|
"snapshot/replay_check",
|
||||||
|
&serde_json::json!({"path":relative,"snapshot":corrupt}),
|
||||||
|
);
|
||||||
|
assert_eq!(rejected["ok"], false, "{rejected}");
|
||||||
|
// A malformed cancellation suffix must fail before any replay executes.
|
||||||
|
for mutation in ["time", "receipt", "duplicate", "version"] {
|
||||||
|
let mut bad = snapshot.clone();
|
||||||
|
let index = bad["actions"]
|
||||||
|
.as_array()
|
||||||
|
.unwrap()
|
||||||
|
.iter()
|
||||||
|
.position(|a| a.get("controls").is_some())
|
||||||
|
.unwrap();
|
||||||
|
match mutation {
|
||||||
|
"time" => bad["actions"][index]["controls"][0]["after_us"] = (-1).into(),
|
||||||
|
"receipt" => {
|
||||||
|
bad["actions"][index]["controls"][0]["results"][0]["accepted"] =
|
||||||
|
false.into()
|
||||||
|
}
|
||||||
|
"duplicate" => {
|
||||||
|
let row = bad["actions"][index]["controls"][0]["results"][0].clone();
|
||||||
|
bad["actions"][index]["controls"][0]["results"]
|
||||||
|
.as_array_mut()
|
||||||
|
.unwrap()
|
||||||
|
.push(row);
|
||||||
|
}
|
||||||
|
_ => bad["version"] = 4.into(),
|
||||||
|
}
|
||||||
|
let rejected = post(
|
||||||
|
server.addr,
|
||||||
|
"snapshot/replay_check",
|
||||||
|
&serde_json::json!({"path":relative,"snapshot":bad}),
|
||||||
|
);
|
||||||
|
assert_eq!(rejected["ok"], false, "{mutation}: {rejected}");
|
||||||
|
}
|
||||||
|
assert_eq!(
|
||||||
|
post(server.addr, "state/pull", &pull)["value"],
|
||||||
|
99,
|
||||||
|
"checker disturbed warm state"
|
||||||
|
);
|
||||||
|
assert_eq!(post(server.addr, "close", &body)["ok"], true);
|
||||||
|
println!("E11 {language} {mode} trial {trial}: real HTTP interrupt {:?}, retained n=99, skipped suffix, control-input replay and four malformed histories verified", latency);
|
||||||
|
println!(
|
||||||
|
"CONTROL_METRIC:{}",
|
||||||
|
serde_json::json!({
|
||||||
|
"language": language, "mode": mode, "trial": trial,
|
||||||
|
"ack_ns": latency.as_nanos(), "completion_ns": completion_latency.as_nanos(),
|
||||||
|
"expected_store": 99, "plain_replay": true, "compact_replay": true,
|
||||||
|
"malformed_histories": 5, "correct": true
|
||||||
|
})
|
||||||
|
);
|
||||||
|
std::fs::remove_file(path).unwrap();
|
||||||
|
std::fs::remove_file(marker).unwrap();
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
@@ -542,6 +542,7 @@ fn value_kind_label(v: &crate::value::Value) -> String {
|
|||||||
Value::Num(_) => "num".into(),
|
Value::Num(_) => "num".into(),
|
||||||
Value::Text(_) => "text".into(),
|
Value::Text(_) => "text".into(),
|
||||||
Value::Secret(_) => "secret".into(),
|
Value::Secret(_) => "secret".into(),
|
||||||
|
Value::Handle(_) => "handle".into(),
|
||||||
Value::Formula(crate::formula::Expr::Matrix { rows, .. }) => {
|
Value::Formula(crate::formula::Expr::Matrix { rows, .. }) => {
|
||||||
format!("formula · {}×{}", rows.len(), rows.first().map(|r| r.len()).unwrap_or(0))
|
format!("formula · {}×{}", rows.len(), rows.first().map(|r| r.len()).unwrap_or(0))
|
||||||
}
|
}
|
||||||
|
|||||||
File diff suppressed because it is too large.
Load diff
@@ -0,0 +1,34 @@
|
|||||||
|
# Application composition corpus
|
||||||
|
|
||||||
|
Four authored tasks exercise the actual document loader, tree/bytecode evaluators
|
||||||
|
and interactive history API. Each has separate Python and Node implementations
|
||||||
|
of the producer and consumer. `CASES.json` is the eight-case regression subset;
|
||||||
|
the reviewer driver generates 80 size/seed/direction instances before execution.
|
||||||
|
They are four application families, not 80 independent real-user applications.
|
||||||
|
|
||||||
|
- Invoice ledger: discard void rows, first-posted invoice deduplication, integer
|
||||||
|
cents/discount accounting, signed refunds with floor division, regional totals.
|
||||||
|
- Routes: minimum nonnegative parallel edge, zero-cost edges, disconnected nodes
|
||||||
|
and weighted single-source distances. Python uses heap-based Dijkstra, Node a
|
||||||
|
linear frontier; independent reference uses SQL and all-pairs Floyd-Warshall.
|
||||||
|
- Concordance: NFC plus **ASCII** lowercase, explicit space/tab/LF/CR/NBSP
|
||||||
|
separators, occurrence/document frequencies, UTF-8 byte order. This is not
|
||||||
|
Unicode full case folding. Wide IDs remain strings; special object-key text,
|
||||||
|
combining marks, BMP and astral characters are included.
|
||||||
|
- Wine: UCI red-wine CSV, exact decimal density/pH scaling to integers and
|
||||||
|
quality-group count/sum/min/max. Full input contains 1599 rows; no predictor
|
||||||
|
accuracy or general machine-learning performance is claimed.
|
||||||
|
|
||||||
|
Independent SQL/Fraction/Floyd references live in the reviewer experiment
|
||||||
|
`application_cases.py`; no foreign program output supplies expected answers.
|
||||||
|
The raw/public-data digest, citation, license and retrieval source are preserved
|
||||||
|
in `data/PROVENANCE.json`. Wine Quality is by Cortez, Cerdeira, Almeida, Matos and
|
||||||
|
Reis (2009), UCI, DOI 10.24432/C56S3T, CC BY 4.0. CSV text fixture generation
|
||||||
|
normalizes physical line endings and uses the requested first N data rows.
|
||||||
|
|
||||||
|
The composition copies input into a producer, gets a normalized value, copies it
|
||||||
|
into the consumer, records an expected ordinary exception after saving `answer`,
|
||||||
|
recovers it, replaces the consumer's bridge with null, verifies the producer's
|
||||||
|
copy and answer remain, and closes both sessions. Interactive recordings repeat
|
||||||
|
these actions and strictly replay both raw and losslessly packed history.
|
||||||
|
Native and independent checks distinguish explicit null from display stdout.
|
||||||
@@ -0,0 +1,10 @@
|
|||||||
|
var index = new Map();
|
||||||
|
for (var row of bridge) {
|
||||||
|
for (var word of row.tokens) {
|
||||||
|
var value = index.get(word) || {count:0,docs:new Set()};
|
||||||
|
value.count++; value.docs.add(row.id); index.set(word,value);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
var answer = [...index].sort((a,b)=>Buffer.compare(Buffer.from(a[0]),Buffer.from(b[0])))
|
||||||
|
.map(([word,v])=>({word,occurrences:v.count,documents:v.docs.size}));
|
||||||
|
answer;
|
||||||
@@ -0,0 +1,10 @@
|
|||||||
|
from collections import Counter, defaultdict
|
||||||
|
occurrences = Counter()
|
||||||
|
documents = defaultdict(set)
|
||||||
|
for row in bridge:
|
||||||
|
for word in row['tokens']:
|
||||||
|
occurrences[word] += 1
|
||||||
|
documents[word].add(row['id'])
|
||||||
|
answer = [{'word':word,'occurrences':occurrences[word],'documents':len(documents[word])}
|
||||||
|
for word in sorted(occurrences,key=lambda s:s.encode('utf-8'))]
|
||||||
|
answer
|
||||||
@@ -0,0 +1,3 @@
|
|||||||
|
var bridge = data.map(row=>({id:row.id,tokens:row.text.normalize('NFC').replace(/[A-Z]/g,c=>c.toLowerCase()).split(/[ \n\t\r\u00a0]+/).filter(t=>t.length)}));
|
||||||
|
bridge.sort((a,b)=>Buffer.compare(Buffer.from(a.id),Buffer.from(b.id)));
|
||||||
|
bridge;
|
||||||
@@ -0,0 +1,6 @@
|
|||||||
|
import re, unicodedata
|
||||||
|
ascii_lower = str.maketrans('ABCDEFGHIJKLMNOPQRSTUVWXYZ','abcdefghijklmnopqrstuvwxyz')
|
||||||
|
bridge = [{'id': row['id'], 'tokens': [t for t in re.split('[ \n\t\r\u00a0]+',unicodedata.normalize('NFC',row['text']).translate(ascii_lower)) if t]}
|
||||||
|
for row in data]
|
||||||
|
bridge.sort(key=lambda row:row['id'].encode('utf-8'))
|
||||||
|
bridge
|
||||||
@@ -0,0 +1,21 @@
|
|||||||
|
{
|
||||||
|
"source": "https://archive.ics.uci.edu/static/public/186/wine+quality.zip",
|
||||||
|
"landing_page": "https://archive.ics.uci.edu/dataset/186/wine%2Bquality",
|
||||||
|
"doi": "10.24432/C56S3T",
|
||||||
|
"authors": [
|
||||||
|
"Paulo Cortez",
|
||||||
|
"A. Cerdeira",
|
||||||
|
"F. Almeida",
|
||||||
|
"T. Matos",
|
||||||
|
"J. Reis"
|
||||||
|
],
|
||||||
|
"year": 2009,
|
||||||
|
"license": "CC BY 4.0",
|
||||||
|
"license_url": "https://creativecommons.org/licenses/by/4.0/",
|
||||||
|
"retrieved": "2026-11-03",
|
||||||
|
"files": {
|
||||||
|
"winequality.names": "15d215e73b39105952380fd487e4ce1bf5a6b83a425abb285c2ec55193d3ca92",
|
||||||
|
"winequality-red.csv": "4a402cf041b025d4566d954c3b9ba8635a3a8a01e039005d97d6a710278cf05e",
|
||||||
|
"wine-quality.zip": "3ed56667f4b828242bd732d7d1dd7f2861e54432239d7fa63877014cbb0304d4"
|
||||||
|
}
|
||||||
|
}
|
||||||
Binary file not shown.
File diff suppressed because it is too large.
Load diff
@@ -0,0 +1,72 @@
|
|||||||
|
Citation Request:
|
||||||
|
This dataset is public available for research. The details are described in [Cortez et al., 2009].
|
||||||
|
Please include this citation if you plan to use this database:
|
||||||
|
|
||||||
|
P. Cortez, A. Cerdeira, F. Almeida, T. Matos and J. Reis.
|
||||||
|
Modeling wine preferences by data mining from physicochemical properties.
|
||||||
|
In Decision Support Systems, Elsevier, 47(4):547-553. ISSN: 0167-9236.
|
||||||
|
|
||||||
|
Available at: [@Elsevier] http://dx.doi.org/10.1016/j.dss.2009.05.016
|
||||||
|
[Pre-press (pdf)] http://www3.dsi.uminho.pt/pcortez/winequality09.pdf
|
||||||
|
[bib] http://www3.dsi.uminho.pt/pcortez/dss09.bib
|
||||||
|
|
||||||
|
1. Title: Wine Quality
|
||||||
|
|
||||||
|
2. Sources
|
||||||
|
Created by: Paulo Cortez (Univ. Minho), Antonio Cerdeira, Fernando Almeida, Telmo Matos and Jose Reis (CVRVV) @ 2009
|
||||||
|
|
||||||
|
3. Past Usage:
|
||||||
|
|
||||||
|
P. Cortez, A. Cerdeira, F. Almeida, T. Matos and J. Reis.
|
||||||
|
Modeling wine preferences by data mining from physicochemical properties.
|
||||||
|
In Decision Support Systems, Elsevier, 47(4):547-553. ISSN: 0167-9236.
|
||||||
|
|
||||||
|
In the above reference, two datasets were created, using red and white wine samples.
|
||||||
|
The inputs include objective tests (e.g. PH values) and the output is based on sensory data
|
||||||
|
(median of at least 3 evaluations made by wine experts). Each expert graded the wine quality
|
||||||
|
between 0 (very bad) and 10 (very excellent). Several data mining methods were applied to model
|
||||||
|
these datasets under a regression approach. The support vector machine model achieved the
|
||||||
|
best results. Several metrics were computed: MAD, confusion matrix for a fixed error tolerance (T),
|
||||||
|
etc. Also, we plot the relative importances of the input variables (as measured by a sensitivity
|
||||||
|
analysis procedure).
|
||||||
|
|
||||||
|
4. Relevant Information:
|
||||||
|
|
||||||
|
The two datasets are related to red and white variants of the Portuguese "Vinho Verde" wine.
|
||||||
|
For more details, consult: http://www.vinhoverde.pt/en/ or the reference [Cortez et al., 2009].
|
||||||
|
Due to privacy and logistic issues, only physicochemical (inputs) and sensory (the output) variables
|
||||||
|
are available (e.g. there is no data about grape types, wine brand, wine selling price, etc.).
|
||||||
|
|
||||||
|
These datasets can be viewed as classification or regression tasks.
|
||||||
|
The classes are ordered and not balanced (e.g. there are munch more normal wines than
|
||||||
|
excellent or poor ones). Outlier detection algorithms could be used to detect the few excellent
|
||||||
|
or poor wines. Also, we are not sure if all input variables are relevant. So
|
||||||
|
it could be interesting to test feature selection methods.
|
||||||
|
|
||||||
|
5. Number of Instances: red wine - 1599; white wine - 4898.
|
||||||
|
|
||||||
|
6. Number of Attributes: 11 + output attribute
|
||||||
|
|
||||||
|
Note: several of the attributes may be correlated, thus it makes sense to apply some sort of
|
||||||
|
feature selection.
|
||||||
|
|
||||||
|
7. Attribute information:
|
||||||
|
|
||||||
|
For more information, read [Cortez et al., 2009].
|
||||||
|
|
||||||
|
Input variables (based on physicochemical tests):
|
||||||
|
1 - fixed acidity
|
||||||
|
2 - volatile acidity
|
||||||
|
3 - citric acid
|
||||||
|
4 - residual sugar
|
||||||
|
5 - chlorides
|
||||||
|
6 - free sulfur dioxide
|
||||||
|
7 - total sulfur dioxide
|
||||||
|
8 - density
|
||||||
|
9 - pH
|
||||||
|
10 - sulphates
|
||||||
|
11 - alcohol
|
||||||
|
Output variable (based on sensory data):
|
||||||
|
12 - quality (score between 0 and 10)
|
||||||
|
|
||||||
|
8. Missing Attribute Values: None
|
||||||
@@ -0,0 +1,10 @@
|
|||||||
|
var totals = new Map();
|
||||||
|
for (var row of bridge) {
|
||||||
|
var value = totals.get(row.region) || [0, 0];
|
||||||
|
value[0] += 1;
|
||||||
|
value[1] += Math.floor(row.units * row.cents * (10000-row.discount) / 10000);
|
||||||
|
totals.set(row.region, value);
|
||||||
|
}
|
||||||
|
var answer = [...totals].sort((a,b) => Buffer.compare(Buffer.from(a[0]),Buffer.from(b[0])))
|
||||||
|
.map(([region, value]) => ({region, invoices: value[0], net_cents: value[1]}));
|
||||||
|
answer;
|
||||||
@@ -0,0 +1,8 @@
|
|||||||
|
from collections import defaultdict
|
||||||
|
totals = defaultdict(lambda: [0, 0])
|
||||||
|
for row in bridge:
|
||||||
|
totals[row['region']][0] += 1
|
||||||
|
totals[row['region']][1] += row['units'] * row['cents'] * (10000-row['discount']) // 10000
|
||||||
|
answer = [{'region': k, 'invoices': v[0], 'net_cents': v[1]}
|
||||||
|
for k, v in sorted(totals.items(), key=lambda kv: kv[0].encode('utf-8'))]
|
||||||
|
answer
|
||||||
@@ -0,0 +1,10 @@
|
|||||||
|
var seen = new Set();
|
||||||
|
var bridge = [];
|
||||||
|
for (var row of data) {
|
||||||
|
if (row.status === 'posted' && !seen.has(row.id)) {
|
||||||
|
seen.add(row.id);
|
||||||
|
bridge.push({id: row.id, region: row.region, units: row.units, cents: row.cents, discount: row.discount});
|
||||||
|
}
|
||||||
|
}
|
||||||
|
bridge.sort((a, b) => Buffer.compare(Buffer.from(a.id), Buffer.from(b.id)));
|
||||||
|
bridge;
|
||||||
@@ -0,0 +1,8 @@
|
|||||||
|
seen = set()
|
||||||
|
bridge = []
|
||||||
|
for row in data:
|
||||||
|
if row['status'] == 'posted' and row['id'] not in seen:
|
||||||
|
seen.add(row['id'])
|
||||||
|
bridge.append({k: row[k] for k in ('id', 'region', 'units', 'cents', 'discount')})
|
||||||
|
bridge.sort(key=lambda r: r['id'].encode('utf-8'))
|
||||||
|
bridge
|
||||||
@@ -0,0 +1,14 @@
|
|||||||
|
var distance = new Map(bridge.nodes.map(n=>[n,Infinity]));
|
||||||
|
distance.set(bridge.source,0);
|
||||||
|
var unvisited = new Set(bridge.nodes);
|
||||||
|
while (unvisited.size) {
|
||||||
|
var best = [...unvisited].reduce((a,b)=>distance.get(a)<=distance.get(b)?a:b);
|
||||||
|
unvisited.delete(best);
|
||||||
|
if (!Number.isFinite(distance.get(best))) break;
|
||||||
|
for (var edge of bridge.edges) {
|
||||||
|
if (edge.from === best && distance.get(best)+edge.weight < distance.get(edge.to))
|
||||||
|
distance.set(edge.to,distance.get(best)+edge.weight);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
var answer = bridge.nodes.map(node=>({node,distance:Number.isFinite(distance.get(node))?distance.get(node):null}));
|
||||||
|
answer;
|
||||||
@@ -0,0 +1,17 @@
|
|||||||
|
import heapq
|
||||||
|
adjacency = {node: [] for node in bridge['nodes']}
|
||||||
|
for edge in bridge['edges']:
|
||||||
|
adjacency[edge['from']].append((edge['to'], edge['weight']))
|
||||||
|
distance = {bridge['source']: 0}
|
||||||
|
pending = [(0, bridge['source'])]
|
||||||
|
while pending:
|
||||||
|
cost, node = heapq.heappop(pending)
|
||||||
|
if distance[node] != cost:
|
||||||
|
continue
|
||||||
|
for target, weight in adjacency[node]:
|
||||||
|
candidate = cost + weight
|
||||||
|
if target not in distance or candidate < distance[target]:
|
||||||
|
distance[target] = candidate
|
||||||
|
heapq.heappush(pending, (candidate, target))
|
||||||
|
answer = [{'node': n, 'distance': distance.get(n)} for n in bridge['nodes']]
|
||||||
|
answer
|
||||||
@@ -0,0 +1,11 @@
|
|||||||
|
var minimum = new Map();
|
||||||
|
for (var edge of data.edges) {
|
||||||
|
if (edge.weight >= 0) {
|
||||||
|
var key = JSON.stringify([edge.from, edge.to]);
|
||||||
|
minimum.set(key, Math.min(minimum.has(key) ? minimum.get(key) : edge.weight, edge.weight));
|
||||||
|
}
|
||||||
|
}
|
||||||
|
var edges = [...minimum].map(([key,weight]) => ({from: JSON.parse(key)[0], to: JSON.parse(key)[1], weight}));
|
||||||
|
edges.sort((a,b) => Buffer.compare(Buffer.from(a.from),Buffer.from(b.from)) || Buffer.compare(Buffer.from(a.to),Buffer.from(b.to)));
|
||||||
|
var bridge = {source:data.source, nodes:[...data.nodes].sort((a,b)=>Buffer.compare(Buffer.from(a),Buffer.from(b))), edges};
|
||||||
|
bridge;
|
||||||
@@ -0,0 +1,8 @@
|
|||||||
|
minimum = {}
|
||||||
|
for edge in data['edges']:
|
||||||
|
if edge['weight'] >= 0:
|
||||||
|
key = (edge['from'], edge['to'])
|
||||||
|
minimum[key] = min(minimum.get(key, edge['weight']), edge['weight'])
|
||||||
|
bridge = {'source': data['source'], 'nodes': sorted(data['nodes'], key=lambda n:n.encode('utf-8')),
|
||||||
|
'edges': [{'from': a, 'to': b, 'weight': w} for (a,b), w in sorted(minimum.items(), key=lambda kv: (kv[0][0].encode('utf-8'), kv[0][1].encode('utf-8')))]}
|
||||||
|
bridge
|
||||||
@@ -0,0 +1,9 @@
|
|||||||
|
var groups = new Map();
|
||||||
|
for (var row of bridge) {
|
||||||
|
var g=groups.get(row.quality) || {quality:row.quality,count:0,sum_density_ppm:0,min_ph_cent:row.ph_cent,max_ph_cent:row.ph_cent};
|
||||||
|
g.count++;g.sum_density_ppm+=row.density_ppm;
|
||||||
|
g.min_ph_cent=Math.min(g.min_ph_cent,row.ph_cent);g.max_ph_cent=Math.max(g.max_ph_cent,row.ph_cent);
|
||||||
|
groups.set(row.quality,g);
|
||||||
|
}
|
||||||
|
var answer=[...groups.values()].sort((a,b)=>a.quality-b.quality);
|
||||||
|
answer;
|
||||||
@@ -0,0 +1,7 @@
|
|||||||
|
from itertools import groupby
|
||||||
|
answer = []
|
||||||
|
for quality, group in groupby(sorted(bridge,key=lambda r:r['quality']),key=lambda r:r['quality']):
|
||||||
|
rows = list(group)
|
||||||
|
answer.append({'quality':quality,'count':len(rows),'sum_density_ppm':sum(r['density_ppm'] for r in rows),
|
||||||
|
'min_ph_cent':min(r['ph_cent'] for r in rows),'max_ph_cent':max(r['ph_cent'] for r in rows)})
|
||||||
|
answer
|
||||||
@@ -0,0 +1,13 @@
|
|||||||
|
function scaledDecimal(s, digits) {
|
||||||
|
var parts = s.split('.');
|
||||||
|
var tail = parts.length > 1 ? parts[1] : '';
|
||||||
|
if (tail.length > digits) throw Error('unsupported decimal precision');
|
||||||
|
return Number(parts[0])*10**digits + Number(tail.padEnd(digits,'0'));
|
||||||
|
}
|
||||||
|
var lines = data.trim().split(/\r?\n/);
|
||||||
|
var header = lines[0].split(';').map(s=>s.replaceAll('"',''));
|
||||||
|
var bridge = lines.slice(1).map(line=>{
|
||||||
|
var fields=line.split(';');
|
||||||
|
return {quality:Number(fields[header.indexOf('quality')]),density_ppm:scaledDecimal(fields[header.indexOf('density')],6),ph_cent:scaledDecimal(fields[header.indexOf('pH')],2)};
|
||||||
|
});
|
||||||
|
bridge;
|
||||||
@@ -0,0 +1,5 @@
|
|||||||
|
import csv, io
|
||||||
|
from decimal import Decimal
|
||||||
|
bridge = [{'quality':int(row['quality']), 'density_ppm':int(Decimal(row['density'])*1000000), 'ph_cent':int(Decimal(row['pH'])*100)}
|
||||||
|
for row in csv.DictReader(io.StringIO(data),delimiter=';')]
|
||||||
|
bridge
|
||||||
@@ -0,0 +1,11 @@
|
|||||||
|
---
|
||||||
|
markup: occlusion
|
||||||
|
title: Private grandchildren are not in the enclosing scope
|
||||||
|
---
|
||||||
|
# main
|
||||||
|
> concealed
|
||||||
|
|
||||||
|
## outer
|
||||||
|
|
||||||
|
### concealed
|
||||||
|
*1*
|
||||||
@@ -0,0 +1,15 @@
|
|||||||
|
---
|
||||||
|
markup: occlusion
|
||||||
|
title: table row arity mismatch is a fault
|
||||||
|
---
|
||||||
|
|
||||||
|
# main
|
||||||
|
|
||||||
|
`t` =
|
||||||
|
|
||||||
|
| a | b |
|
||||||
|
|---|---|
|
||||||
|
| 1 | 2 |
|
||||||
|
| 3 |
|
||||||
|
|
||||||
|
> print text=`t`
|
||||||
+162
-13
@@ -45,14 +45,18 @@ fn run_with_env(args: &[&str], env: &[(&str, &str)]) -> (i32, String, String) {
|
|||||||
}
|
}
|
||||||
|
|
||||||
fn assert_out(path: &str, expect: &str) {
|
fn assert_out(path: &str, expect: &str) {
|
||||||
let (code, stdout, stderr) = run(&["run", path]);
|
for backend in ["tree", "bytecode"] {
|
||||||
assert_eq!(code, 0, "{path} stderr={stderr}");
|
let (code, stdout, stderr) = run(&["run", path, "--backend", backend]);
|
||||||
assert_eq!(stdout.trim_end(), expect.trim_end(), "{path}");
|
assert_eq!(code, 0, "{path} {backend} stderr={stderr}");
|
||||||
|
assert_eq!(stdout.trim_end(), expect.trim_end(), "{path} {backend}");
|
||||||
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
fn assert_run_ok(path: &str) {
|
fn assert_run_ok(path: &str) {
|
||||||
let (code, _stdout, stderr) = run(&["run", path]);
|
for backend in ["tree", "bytecode"] {
|
||||||
assert_eq!(code, 0, "{path} stderr={stderr}");
|
let (code, _stdout, stderr) = run(&["run", path, "--backend", backend]);
|
||||||
|
assert_eq!(code, 0, "{path} {backend} stderr={stderr}");
|
||||||
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
/// Skip live LLM/agent tests when no real API key is configured.
|
/// Skip live LLM/agent tests when no real API key is configured.
|
||||||
@@ -189,6 +193,21 @@ fn assert_err(path: &str, line_col: &str, substr: &str) {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
|
/// Imported faults have an actual library origin and a separate authored call site.
|
||||||
|
fn assert_import_err(path: &str, library: &str, origin: &str, caller: &str, substr: &str) {
|
||||||
|
for backend in ["tree", "bytecode"] {
|
||||||
|
let (code, stdout, stderr) = run(&["run", path, "--backend", backend]);
|
||||||
|
assert_ne!(code, 0, "{path} backend={backend} unexpectedly succeeded stdout={stdout}");
|
||||||
|
let origin = format!("{library}:{origin}:");
|
||||||
|
assert!(stderr.lines().next().unwrap_or("").contains(&origin),
|
||||||
|
"{path} backend={backend} missing actual library origin {origin:?}: {stderr}");
|
||||||
|
let caller = format!(" from {path}:{caller}");
|
||||||
|
assert!(stderr.lines().skip(1).any(|line| line.starts_with(" called ") && line.ends_with(&caller)),
|
||||||
|
"{path} backend={backend} missing authored call site {caller:?}: {stderr}");
|
||||||
|
assert!(stderr.contains(substr), "{path} backend={backend} stderr missing {substr:?}: {stderr}");
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
/// Like [`assert_out`], but sets a dummy OpenAI key so offline LLM/agent paths
|
/// Like [`assert_out`], but sets a dummy OpenAI key so offline LLM/agent paths
|
||||||
/// that only check for the env var (no live HTTP) can proceed.
|
/// that only check for the env var (no live HTTP) can proceed.
|
||||||
/// Also points `MARQDO_EXT` at the repo `ext/` so tests do not pick up a stale
|
/// Also points `MARQDO_EXT` at the repo `ext/` so tests do not pick up a stale
|
||||||
@@ -827,6 +846,15 @@ fn error_bad_arity() {
|
|||||||
);
|
);
|
||||||
}
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn error_table_arity() {
|
||||||
|
assert_err(
|
||||||
|
"tests/errors/table-arity.mq.md",
|
||||||
|
"13:1",
|
||||||
|
"table row arity mismatch",
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
#[test]
|
#[test]
|
||||||
fn error_syntax_bad_line() {
|
fn error_syntax_bad_line() {
|
||||||
assert_err(
|
assert_err(
|
||||||
@@ -1219,7 +1247,7 @@ fn bytecode_paragraph_comment() {
|
|||||||
|
|
||||||
#[test]
|
#[test]
|
||||||
fn trace_eval_json_tree() {
|
fn trace_eval_json_tree() {
|
||||||
let (code, stdout, stderr) = run(&["run", "tests/structure/hello.mq.md", "--trace-eval"]);
|
let (code, stdout, stderr) = run(&["run", "tests/structure/hello.mq.md", "--backend", "tree", "--trace-eval"]);
|
||||||
assert_eq!(code, 0, "{stderr}");
|
assert_eq!(code, 0, "{stderr}");
|
||||||
assert_eq!(stdout.trim_end(), "Hello World!");
|
assert_eq!(stdout.trim_end(), "Hello World!");
|
||||||
assert!(stderr.contains("\"event\":\"enter_fn\""), "{stderr}");
|
assert!(stderr.contains("\"event\":\"enter_fn\""), "{stderr}");
|
||||||
@@ -1228,6 +1256,21 @@ fn trace_eval_json_tree() {
|
|||||||
assert!(stderr.contains("\"event\":\"leave_fn\""), "{stderr}");
|
assert!(stderr.contains("\"event\":\"leave_fn\""), "{stderr}");
|
||||||
}
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn structure_self_method_paths_are_instance_methods() {
|
||||||
|
assert_out("tests/structure/self-method-paths.mq.md", "41\n41\n7");
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn structure_lexical_siblings_recursion_and_shadowing() {
|
||||||
|
assert_out("tests/structure/lexical-sibling-calls.mq.md", "120\n41\n99");
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn error_lexical_private_descendant_is_not_visible() {
|
||||||
|
assert_err("tests/errors/lexical-private-descendant.mq.md", "6:1", "unknown function `concealed`");
|
||||||
|
}
|
||||||
|
|
||||||
#[test]
|
#[test]
|
||||||
fn trace_eval_json_bytecode() {
|
fn trace_eval_json_bytecode() {
|
||||||
let (code, stdout, stderr) = run(&[
|
let (code, stdout, stderr) = run(&[
|
||||||
@@ -1875,19 +1918,23 @@ fn lib_json_vsafe_string_ok() {
|
|||||||
|
|
||||||
#[test]
|
#[test]
|
||||||
fn lib_json_vsafe_refuse() {
|
fn lib_json_vsafe_refuse() {
|
||||||
// Span points at lib/json.mq.md `parse` body while path stays the caller file.
|
// Check both the actual library body and the user call, without mixing them.
|
||||||
assert_err(
|
assert_import_err(
|
||||||
"tests/lib/json-vsafe-refuse.mq.md",
|
"tests/lib/json-vsafe-refuse.mq.md",
|
||||||
|
"lib/json.mq.md",
|
||||||
"16:1",
|
"16:1",
|
||||||
|
"10:1",
|
||||||
"json: integer outside V_safe",
|
"json: integer outside V_safe",
|
||||||
);
|
);
|
||||||
}
|
}
|
||||||
|
|
||||||
#[test]
|
#[test]
|
||||||
fn lib_json_vsafe_stringify_refuse() {
|
fn lib_json_vsafe_stringify_refuse() {
|
||||||
assert_err(
|
assert_import_err(
|
||||||
"tests/lib/json-vsafe-stringify-refuse.mq.md",
|
"tests/lib/json-vsafe-stringify-refuse.mq.md",
|
||||||
|
"lib/json.mq.md",
|
||||||
"24:1",
|
"24:1",
|
||||||
|
"11:1",
|
||||||
"json: integer outside V_safe",
|
"json: integer outside V_safe",
|
||||||
);
|
);
|
||||||
}
|
}
|
||||||
@@ -3621,22 +3668,122 @@ fn lib_foreign_session_vsafe_refuse() {
|
|||||||
return;
|
return;
|
||||||
}
|
}
|
||||||
// Span points at lib/foreign.mq.md session_set body.
|
// Span points at lib/foreign.mq.md session_set body.
|
||||||
assert_err(
|
assert_import_err(
|
||||||
"tests/lib/foreign-session-vsafe-refuse.mq.md",
|
"tests/lib/foreign-session-vsafe-refuse.mq.md",
|
||||||
"206:1",
|
"lib/foreign.mq.md",
|
||||||
|
"207:1",
|
||||||
|
"12:1",
|
||||||
"json: integer outside V_safe",
|
"json: integer outside V_safe",
|
||||||
);
|
);
|
||||||
}
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn lib_foreign_session_use_after_close() {
|
||||||
|
if !node_available() {
|
||||||
|
eprintln!("skip lib_foreign_session_use_after_close: no node on PATH");
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
assert_import_err(
|
||||||
|
"tests/lib/foreign-session-use-after-close.mq.md",
|
||||||
|
"lib/foreign.mq.md",
|
||||||
|
"198:1",
|
||||||
|
"12:1",
|
||||||
|
"foreign session",
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn lib_foreign_session_double_close() {
|
||||||
|
if !node_available() {
|
||||||
|
eprintln!("skip lib_foreign_session_double_close: no node on PATH");
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
assert_import_err(
|
||||||
|
"tests/lib/foreign-session-double-close.mq.md",
|
||||||
|
"lib/foreign.mq.md",
|
||||||
|
"231:1",
|
||||||
|
"12:1",
|
||||||
|
"foreign session",
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn lib_foreign_session_use_before_open() {
|
||||||
|
// Text fabrication is refused before registry lookup (opaque handle discipline).
|
||||||
|
assert_import_err(
|
||||||
|
"tests/lib/foreign-session-use-before-open.mq.md",
|
||||||
|
"lib/foreign.mq.md",
|
||||||
|
"198:1",
|
||||||
|
"10:1",
|
||||||
|
"session id must be a handle",
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn lib_foreign_session_handle_no_serialize() {
|
||||||
|
if !node_available() {
|
||||||
|
eprintln!("skip lib_foreign_session_handle_no_serialize: no node on PATH");
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
assert_import_err(
|
||||||
|
"tests/lib/foreign-session-handle-no-serialize.mq.md",
|
||||||
|
"lib/json.mq.md",
|
||||||
|
"24:1",
|
||||||
|
"12:1",
|
||||||
|
"session handle cannot be serialized",
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn lib_foreign_session_result_vsafe_refuse() {
|
||||||
|
if !python_available() {
|
||||||
|
eprintln!("skip lib_foreign_session_result_vsafe_refuse: no python on PATH");
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
assert_import_err(
|
||||||
|
"tests/lib/foreign-session-result-vsafe-refuse.mq.md",
|
||||||
|
"lib/foreign.mq.md",
|
||||||
|
"198:1",
|
||||||
|
"11:1",
|
||||||
|
"json: integer outside V_safe",
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn lib_foreign_session_isolation() {
|
||||||
|
if !node_available() {
|
||||||
|
eprintln!("skip lib_foreign_session_isolation: no node on PATH");
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
assert_out("tests/lib/foreign-session-isolation.mq.md", "41\nFalse");
|
||||||
|
}
|
||||||
|
|
||||||
|
#[test]
|
||||||
|
fn lib_foreign_session_cold_replay_empty() {
|
||||||
|
if !node_available() {
|
||||||
|
eprintln!("skip lib_foreign_session_cold_replay_empty: no node on PATH");
|
||||||
|
return;
|
||||||
|
}
|
||||||
|
assert_import_err(
|
||||||
|
"tests/lib/foreign-session-cold-replay-empty.mq.md",
|
||||||
|
"lib/foreign.mq.md",
|
||||||
|
"198:1",
|
||||||
|
"13:1",
|
||||||
|
"foreign session",
|
||||||
|
);
|
||||||
|
}
|
||||||
|
|
||||||
#[test]
|
#[test]
|
||||||
fn lib_foreign_vsafe_refuse() {
|
fn lib_foreign_vsafe_refuse() {
|
||||||
if !python_available() {
|
if !python_available() {
|
||||||
eprintln!("skip lib_foreign_vsafe_refuse: no python on PATH");
|
eprintln!("skip lib_foreign_vsafe_refuse: no python on PATH");
|
||||||
return;
|
return;
|
||||||
}
|
}
|
||||||
assert_err(
|
assert_import_err(
|
||||||
"tests/lib/foreign-vsafe-refuse.mq.md",
|
"tests/lib/foreign-vsafe-refuse.mq.md",
|
||||||
|
"lib/json.mq.md",
|
||||||
"16:1",
|
"16:1",
|
||||||
|
"21:1",
|
||||||
"json: integer outside V_safe",
|
"json: integer outside V_safe",
|
||||||
);
|
);
|
||||||
}
|
}
|
||||||
@@ -3647,9 +3794,11 @@ fn lib_foreign_vsafe_postarith_refuse() {
|
|||||||
eprintln!("skip lib_foreign_vsafe_postarith_refuse: no python on PATH");
|
eprintln!("skip lib_foreign_vsafe_postarith_refuse: no python on PATH");
|
||||||
return;
|
return;
|
||||||
}
|
}
|
||||||
assert_err(
|
assert_import_err(
|
||||||
"tests/lib/foreign-vsafe-postarith-refuse.mq.md",
|
"tests/lib/foreign-vsafe-postarith-refuse.mq.md",
|
||||||
|
"lib/json.mq.md",
|
||||||
"16:1",
|
"16:1",
|
||||||
|
"22:1",
|
||||||
"json: integer outside V_safe",
|
"json: integer outside V_safe",
|
||||||
);
|
);
|
||||||
}
|
}
|
||||||
|
|||||||
@@ -0,0 +1,15 @@
|
|||||||
|
---
|
||||||
|
markup: occlusion
|
||||||
|
title: code values are not copied foreign payloads
|
||||||
|
import:
|
||||||
|
foreign: lib/foreign.mq.md
|
||||||
|
---
|
||||||
|
|
||||||
|
# main
|
||||||
|
|
||||||
|
`payload` =
|
||||||
|
```python
|
||||||
|
1
|
||||||
|
```
|
||||||
|
|
||||||
|
**> foreign.invoke lang="python" source="print('unexpected')" input=`payload`**
|
||||||
@@ -0,0 +1,17 @@
|
|||||||
|
---
|
||||||
|
markup: occlusion
|
||||||
|
title: failed foreign responses remain observable values
|
||||||
|
import:
|
||||||
|
foreign: lib/foreign.mq.md
|
||||||
|
---
|
||||||
|
|
||||||
|
# main
|
||||||
|
|
||||||
|
**s = > foreign.session_open lang="python"**
|
||||||
|
**> foreign.session_eval id=`s` source="raise ValueError('outside V_safe')"**
|
||||||
|
**j = > foreign.oracle_journal**
|
||||||
|
**> print text=[channel](access(access(`j`, 1), "channel"))**
|
||||||
|
**> print text=[ok](access(access(access(`j`, 1), "value"), "ok"))**
|
||||||
|
**> foreign.session_eval id=`s` source="import os; os._exit(7)"**
|
||||||
|
**later = > foreign.oracle_journal**
|
||||||
|
**> print text=[alive](access(access(access(`later`, 2), "value"), "alive"))**
|
||||||
@@ -0,0 +1,23 @@
|
|||||||
|
---
|
||||||
|
markup: occlusion
|
||||||
|
title: document oracle journal is a first-class value
|
||||||
|
import:
|
||||||
|
foreign: lib/foreign.mq.md
|
||||||
|
json: lib/json.mq.md
|
||||||
|
---
|
||||||
|
|
||||||
|
# main
|
||||||
|
|
||||||
|
**s = > foreign.session_open lang="python"**
|
||||||
|
**> foreign.session_set id=`s` name="n" value=2**
|
||||||
|
**> foreign.session_eval id=`s` source="n + 1"**
|
||||||
|
**> foreign.session_get id=`s` name="n"**
|
||||||
|
**> foreign.session_close id=`s`**
|
||||||
|
**j = > foreign.oracle_journal**
|
||||||
|
**same = > foreign.replay_check expected=`j` observed=`j`**
|
||||||
|
**> print text=[ok](access(`same`, "ok"))**
|
||||||
|
**> json.parse text="3"**
|
||||||
|
**later = > foreign.oracle_journal**
|
||||||
|
**changed = > foreign.replay_check expected=`j` observed=`later`**
|
||||||
|
**> print text=[ok](access(`changed`, "ok"))**
|
||||||
|
**> print text=[index](access(`changed`, "index"))**
|
||||||
@@ -0,0 +1,16 @@
|
|||||||
|
---
|
||||||
|
markup: occlusion
|
||||||
|
title: explicit names response is a decode observation
|
||||||
|
import:
|
||||||
|
foreign: lib/foreign.mq.md
|
||||||
|
---
|
||||||
|
|
||||||
|
# main
|
||||||
|
|
||||||
|
**s = > foreign.session_open lang="python"**
|
||||||
|
**> foreign.session_set id=`s` name="zzz" value=7**
|
||||||
|
**> foreign.session_names id=`s`**
|
||||||
|
**j = > foreign.oracle_journal**
|
||||||
|
**> print text=[channel](access(access(`j`, 1), "channel"))**
|
||||||
|
**> print text=[name](access(access(access(`j`, 1), "value"), 2))**
|
||||||
|
**> foreign.session_close id=`s`**
|
||||||
@@ -0,0 +1,13 @@
|
|||||||
|
---
|
||||||
|
markup: occlusion
|
||||||
|
title: closed handle cannot be reused across a later step
|
||||||
|
import:
|
||||||
|
foreign: lib/foreign.mq.md
|
||||||
|
---
|
||||||
|
|
||||||
|
# main
|
||||||
|
|
||||||
|
**会话 = > foreign.session_open lang="node" timeout=30**
|
||||||
|
**> foreign.session_eval id=`会话` source="var x = 1"**
|
||||||
|
**> foreign.session_close id=`会话`**
|
||||||
|
**> foreign.session_eval id=`会话` source="x"**
|
||||||
@@ -0,0 +1,16 @@
|
|||||||
|
---
|
||||||
|
markup: occlusion
|
||||||
|
title: persistent sessions enforce the same code payload refusal
|
||||||
|
import:
|
||||||
|
foreign: lib/foreign.mq.md
|
||||||
|
---
|
||||||
|
|
||||||
|
# main
|
||||||
|
|
||||||
|
`payload` =
|
||||||
|
```python
|
||||||
|
1
|
||||||
|
```
|
||||||
|
|
||||||
|
**s = > foreign.session_open lang="python"**
|
||||||
|
**> foreign.session_set id=`s` name="payload" value=`payload`**
|
||||||
@@ -0,0 +1,12 @@
|
|||||||
|
---
|
||||||
|
markup: occlusion
|
||||||
|
title: foreign session double-close is a fault
|
||||||
|
import:
|
||||||
|
foreign: lib/foreign.mq.md
|
||||||
|
---
|
||||||
|
|
||||||
|
# main
|
||||||
|
|
||||||
|
**会话 = > foreign.session_open lang="node" timeout=30**
|
||||||
|
**> foreign.session_close id=`会话`**
|
||||||
|
**> foreign.session_close id=`会话`**
|
||||||
@@ -0,0 +1,13 @@
|
|||||||
|
---
|
||||||
|
markup: occlusion
|
||||||
|
title: foreign session handle cannot cross JSON bridge
|
||||||
|
import:
|
||||||
|
foreign: lib/foreign.mq.md
|
||||||
|
json: lib/json.mq.md
|
||||||
|
---
|
||||||
|
|
||||||
|
# main
|
||||||
|
|
||||||
|
**会话 = > foreign.session_open lang="node" timeout=30**
|
||||||
|
**> json.stringify value=`会话`**
|
||||||
|
**> foreign.session_close id=`会话`**
|
||||||
Loaded 100 of 119 files, more files were not shown because too many files have changed in this diff.
Show more
Reference in new issue
Block a user