test(p4): prove row-store/columnar table equivalence
- Add semantic fixture 72: a .mq.md columnar List/Map table store, converted, sorted and filtered; compare headers/cells with the T0 row Table via a cell-wise helper (Table == is not structural in this language version). - Teach the direct-runtime semantic harness to resolve entry std: imports. - Update ADR-0032, P4 status, docs/changelog/evidence; semantic goldens 72. Gate: fmt, clippy -D warnings, 430 tests passed.
This commit is contained in:
1 parent
e981168d92
commit
b020904199
9 files changed
+359
-5
No files matched your search
+7
-3
@@ -72,7 +72,7 @@ This is still a **local VM lane**, not a self-hosted GitHub Actions security URL
|
||||
| 2 | Cross-platform strict `cfg` | **Fixed locally; native CI UNVERIFIED** | `#[cfg]` dispatch + non-Linux regression test |
|
||||
| 3 | Strict probe→launch race | **Fixed locally; GitHub Linux CI UNVERIFIED** | fail-closed CLI contract + probe-OK/launch-EAGAIN seam test |
|
||||
| 4 | Parallel security matrix isolation | **Fixed** | unique paths + helper `OnceLock`; 7/7 in parallel workspace run |
|
||||
| 5 | Markdown/power/control-flow corpus | **Done locally** | 160 AST, 71 semantic, 52 compile-negative, 21 runtime-negative fixtures |
|
||||
| 5 | Markdown/power/control-flow corpus | **Done locally** | 160 AST, 72 semantic, 52 compile-negative, 21 runtime-negative fixtures |
|
||||
| 6 | Condition header + source spans | **Fixed** | executable tails rejected; literal-inside-backtick mapping tests |
|
||||
| 7 | Independent Tool consumers | **Done locally** | `sample-view`/`sample-knowledge`/`sample-proof` E2E test |
|
||||
| 8 | lock v3 reproducibility | **Implemented; tamper test added** | `package_env` PASS |
|
||||
@@ -87,7 +87,7 @@ This is still a **local VM lane**, not a self-hosted GitHub Actions security URL
|
||||
|
||||
- Frozen Markdown profile `marqdo.md.v1` with 160 AST goldens and explicit
|
||||
CRLF byte semantics.
|
||||
- Native Rust interpreter with 71 semantic goldens, 52 compile-error fixtures,
|
||||
- Native Rust interpreter with 72 semantic goldens, 52 compile-error fixtures,
|
||||
and runtime error source attribution.
|
||||
- Native `**` power is pinned end-to-end: right associativity, unary-minus
|
||||
precedence, parentheses, float negative exponents, branch/loop conditions,
|
||||
@@ -147,6 +147,8 @@ This is still a **local VM lane**, not a self-hosted GitHub Actions security URL
|
||||
providers register additional resource kinds without parser/runtime/HostOp
|
||||
changes; project-mode + name grant required; pure/strict refuse provider
|
||||
kinds; C/Worker transport remains open.
|
||||
- Cross-storage table equivalence (P4, ADR-0032): fixture 72 compares T0 row
|
||||
Table results with a `.mq.md` columnar List/Map store for sort/filter.
|
||||
- Table stdlib algorithms (CM-A08, ADR-0032): `stdlib/data/table.mq.md`
|
||||
provides select/filter/sort/append/set/join/group/`转GFM` over the logical
|
||||
`Value::Table`; inputs are never mutated; GFM AST laziness and physical T0
|
||||
@@ -203,7 +205,7 @@ behavior. This table records only what is in this tree now.
|
||||
| P1 Memory + place assignment | **Implemented locally** | `Value::Memory`, run-scoped `MemoryStore` (64 KiB pages, 64 MiB total / 16 MiB region), `memory.new/size/grow`, `m[i]` read, `m[i] = byte`; semantic fixtures 45–47, runtime negatives 13–18, `examples/memory-buffer.mq.md`; evidence [`evidence/2026-11-20-memory-p1.md`](evidence/2026-11-20-memory-p1.md) |
|
||||
| P2 Marqdo-written allocator/data structures + minimal structure observation | **PASS (local pure lane); external stdlib repo publication pending** | `.mq.md`-only evidence: bump allocator with u32 codec, linked list, failed-allocation atomicity (48–50); CM-A04 structure primitives and a table filter (51–54, ADR-0023); a first-fit free-list allocator with block reuse, splitting, address-adjacent coalescing and `Result` maps (55, ADR-0024), a `Memory`-backed binary tree with recursive insert/in-order traversal (56), a `.mq.md` CSV row splitter (57), an open-addressing hash table with linear probing, update and `hash.full` (58), a `.mq.md` UTF-8 encoder over `Memory` (59), a validating UTF-8 decoder rejecting truncated, bad-continuation and surrogate/overlong input (60), a `Memory`-backed graph adjacency list (61), a recursive JSON parser for nested arrays/objects, strings with escapes, integers, booleans, null and error Results (62), a `Memory`-backed stack bytecode VM with PUSH/ADD/MUL/JMP/JZ/HALT (63), big-endian 16/32/64-bit plus LEB128 integer codecs (64), a `.mq.md` table sort rebuilding a new table from `table.row/columns/cell` (65), a table join (67), a quoted/escaped CSV row parser (68), table group (69), and an Int matrix multiply (70); the first-fit allocator also detects double free (`alloc.double_free`). Evidence: [`memory-p2-closure`](evidence/2026-11-20-memory-p2-closure.md), [`structure-api-p2`](evidence/2026-11-20-structure-api-p2.md), [`result-and-free-list-p2`](evidence/2026-11-20-result-and-free-list-p2.md). Local gate PASS: `crates/cli/tests/p2_closure.rs` runs 20 C01–C06/C11/C12 fixtures plus the stdlib table self-test in `--mode pure` (no foreign/plugin/import grants), scans sources for foreign/plugin/import shortcuts and compares value/stdout to goldens; evidence [`p2-closure-gate`](evidence/2026-11-20-p2-closure-gate.md). The bundled `stdlib/` tree, `std:` imports, digest verification, Analysis identity and frozen-CLI closure test are implemented (ADR-0028). Remaining outside C01–C12: publication as a separate external stdlib repository, and no remote CI URL. |
|
||||
| P3 Resource/Stream ABI | **PARTIAL** | ADR-0025/0026 CM-A06 slices: opaque `Resource`, `resource.open/read/write/close`, stdout write in pure/project, granted project-file read and buffered project-file write in project, EOF/closed/handle errors, wire/host rejection; strict permits only stdio/stdout and refuses file/network resources. Fixture 66 + CLI/host tests. CM-A07 **Compat-C** is implemented: when a program calls `打印/print`, the loader injects the bundled `stdlib/io.mq.md` and the runtime routes to `io.写值` (all 15 value types, UTF-8 via `Memory`, `resource.write(stdout)`); `HostOp::Print` and the legacy `Value::display()` print path are removed, and a missing bundle fails with `kernel.unavailable`. Strict permits only the existing stdio console channel. Still missing: directories, network, generic provider registry, Table storage, strict file/network resources. |
|
||||
| P4 Table logical/physical migration | **PARTIAL** | ADR-0032/CM-A08: `Value::Table` logical semantics unchanged (T0 `Vec<Vec<Value>>`); `stdlib/data/table.mq.md` provides select/filter/sort/append/set/join/group/`转GFM` as value-returning `.mq.md` functions with input immutability. GFM rendering is covered; no T1/T2/T3 physical storage, column store, cross-storage implementation or Memory-backed table. |
|
||||
| P4 Table logical/physical migration | **PARTIAL** | ADR-0032/CM-A08: `Value::Table` logical semantics unchanged (T0 `Vec<Vec<Value>>`); `stdlib/data/table.mq.md` provides select/filter/sort/append/set/join/group/`转GFM` as value-returning `.mq.md` functions with input immutability. GFM rendering and cross-storage equivalence (fixture 72: row Table vs `.mq.md` columnar store, same headers/rows/cells) are covered. No T1/T2/T3 physical storage, native column store, zero-copy views or Memory-backed table yet. |
|
||||
| P5 third-party Provider / TCP / HTTP | **PARTIAL** | `stdlib/net/http.mq.md` + semantic fixture 71 implement HTTP/1.1 status/header/chunked parsing and request construction in `.mq.md`; `http_over_tcp.rs` runs a local HTTP exchange over `resource.open("tcp",...)`; no host HTTP/TLS and no external network test. ADR-0034 blocking TCP resource endpoint (`resource.open("tcp", "<ip>:<port>", ["read","write"])`, exact IP grant, project-only, 5s timeouts; loopback host+CLI tests). ADR-0033 in-process `ResourceProvider` v1: explicitly trusted providers register by kind, project-mode only, gated by `Capabilities.allow_resource_provider`, using the existing `resource.*`/`Result` ABI; a mock read/write provider is tested. No C/Worker provider transport, host DNS/TLS/HTTP implementation, UDP, clock/random/process/device providers, or provider package installation. |
|
||||
| P6 performance / native backends | **NOT IMPLEMENTED** | no bytecode/JIT/GPU/QPU work |
|
||||
|
||||
@@ -248,6 +250,8 @@ user-written allocator is explicitly **not** claimed.
|
||||
- [`evidence/2026-11-20-tcp-endpoint.md`](evidence/2026-11-20-tcp-endpoint.md)
|
||||
— ADR-0034 blocking TCP endpoint, IP grants, DNS refusal, loopback host/CLI
|
||||
echo tests.
|
||||
- [`evidence/2026-11-20-table-cross-storage.md`](evidence/2026-11-20-table-cross-storage.md)
|
||||
— P4 row-store Table vs `.mq.md` columnar store equivalence for sort/filter.
|
||||
- [`evidence/2026-11-20-http-over-tcp.md`](evidence/2026-11-20-http-over-tcp.md)
|
||||
— P5/C10 `.mq.md` HTTP framing over a loopback TCP stream, stdlib module and
|
||||
end-to-end client test.
|
||||
|
||||
@@ -65,6 +65,10 @@ through the verified `std:` bundle and its digest.
|
||||
their existing behavior; `表` still validates row width.
|
||||
* Table source spans and document addresses are unchanged; a rebuilt Table is
|
||||
a logical value, not a rewrite of the source document.
|
||||
* Cross-storage compatibility: a `.mq.md` columnar representation (List/Map of
|
||||
columns) must produce the same headers/rows/cells as the T0 row-store Table
|
||||
for the supported operations (fixture 72). This does not migrate the Rust
|
||||
storage; it proves the logical contract is storage-independent.
|
||||
|
||||
### 4. What is deliberately not done
|
||||
|
||||
|
||||
@@ -0,0 +1,47 @@
|
||||
# RFC-CM P4 evidence: cross-storage table equivalence
|
||||
|
||||
Date: 2026-11-20 (Asia/Shanghai)
|
||||
Repository: `marqdo-cli`
|
||||
Baseline: `e981168` plus this step's changes.
|
||||
Decision record: [ADR-0032](../adr/0032-table-logical-value-and-stdlib-algorithms.md)
|
||||
Related: [CM-A08 table](2026-11-20-table-cm-a08.md), [STATUS §5](../STATUS.md).
|
||||
Scope: logical Table (row store T0) vs a `.mq.md` columnar store.
|
||||
|
||||
## Fixture
|
||||
|
||||
`tests/conformance/semantics/72-table-columnar.mq.md`:
|
||||
|
||||
* `列存 = {列: [...], 数据: [[column0...], [column1...]]}` is a columnar
|
||||
representation built from List/Map;
|
||||
* `转表` converts columnar -> logical `Table`;
|
||||
* `列存排序` sorts the columnar representation by index order without a Table
|
||||
value; `列存过滤` filters columns by retained indices;
|
||||
* the same operations run on the logical Table via `std:data/table`;
|
||||
* `表相等` compares headers + every cell (Table `==` is not structural in this
|
||||
language version, so the fixture compares cells explicitly).
|
||||
|
||||
Result:
|
||||
|
||||
```json
|
||||
[true, true, true]
|
||||
```
|
||||
|
||||
i.e. conversion is lossless, and sorted/filtered outputs are identical between
|
||||
the row-store Table and the columnar `.mq.md` representation.
|
||||
|
||||
## What this proves / does not prove
|
||||
|
||||
Proves: C06 algorithms are defined by logical Table semantics, not by the
|
||||
current `Vec<Vec<Value>>` layout; a columnar `.mq.md` implementation can produce
|
||||
the same observable result without changing the GFM AST or Rust runtime.
|
||||
|
||||
Does not prove or implement: T1 controlled storage interface, T2 native column
|
||||
store, T3 Memory-backed numeric columns, zero-copy views, or production
|
||||
performance. Those remain P6/future work; the current Rust T0 storage is
|
||||
unchanged.
|
||||
|
||||
## Gate
|
||||
|
||||
Local container: fixture passes via `conformance_semantics` and the full
|
||||
workspace gate; GFM rendering (`转GFM`) is covered by
|
||||
`crates/cli/tests/stdlib_table.rs`.
|
||||
Reference in new issue
Block a user