feat(stdlib): add HTTP framing over TCP and close P5 C10 locally

- Add stdlib/net/http.mq.md: status/header/chunked response parsing and request
  construction in .mq.md; no host HTTP/TLS implementation.
- Add stdlib/tests/http.mq.md and an end-to-end loopback test that sends a GET
  over resource.open("tcp"), reads bytes, parses the response and returns
  status/content-type/body.
- Update ADR-0034, status/spec/README/changelog and evidence; refresh the
  bundle digest.

Gate: fmt, clippy -D warnings, 430 tests passed.
This commit is contained in:
cflmy committed 2026-11-20 23:13:06 +08:00
1 parent 0d4dc1da03
commit e981168d92
11 files changed
+486 -4

No files matched your search

+8 -1
View File
@@ -136,6 +136,10 @@ This is still a **local VM lane**, not a self-hosted GitHub Actions security URL
PluginHandle `plugin/export` are read-only observation members (host id
private); `stdlib/format.mq.md` reproduces builtin `打印`/`repr` for all 15
value types, including Formula/Code/FunctionRef and Code UTF-8 byte length.
- HTTP framing and client (P5/C10): `stdlib/net/http.mq.md` parses status,
headers and `Transfer-Encoding: chunked`, builds requests, and an end-to-end
test parses a loopback TCP response; fixture 71 pins the same logic. No host
HTTP/TLS implementation.
- Blocking TCP endpoint (P5 first slice, ADR-0034): project-mode
`resource.open("tcp", ip:port, ["read","write"])` with exact IP grant and
timeouts; no DNS/TLS/UDP/server sockets; strict/pure refuse. CLI `--allow-net`.
@@ -200,7 +204,7 @@ behavior. This table records only what is in this tree now.
| P2 Marqdo-written allocator/data structures + minimal structure observation | **PASS (local pure lane); external stdlib repo publication pending** | `.mq.md`-only evidence: bump allocator with u32 codec, linked list, failed-allocation atomicity (48–50); CM-A04 structure primitives and a table filter (51–54, ADR-0023); a first-fit free-list allocator with block reuse, splitting, address-adjacent coalescing and `Result` maps (55, ADR-0024), a `Memory`-backed binary tree with recursive insert/in-order traversal (56), a `.mq.md` CSV row splitter (57), an open-addressing hash table with linear probing, update and `hash.full` (58), a `.mq.md` UTF-8 encoder over `Memory` (59), a validating UTF-8 decoder rejecting truncated, bad-continuation and surrogate/overlong input (60), a `Memory`-backed graph adjacency list (61), a recursive JSON parser for nested arrays/objects, strings with escapes, integers, booleans, null and error Results (62), a `Memory`-backed stack bytecode VM with PUSH/ADD/MUL/JMP/JZ/HALT (63), big-endian 16/32/64-bit plus LEB128 integer codecs (64), a `.mq.md` table sort rebuilding a new table from `table.row/columns/cell` (65), a table join (67), a quoted/escaped CSV row parser (68), table group (69), and an Int matrix multiply (70); the first-fit allocator also detects double free (`alloc.double_free`). Evidence: [`memory-p2-closure`](evidence/2026-11-20-memory-p2-closure.md), [`structure-api-p2`](evidence/2026-11-20-structure-api-p2.md), [`result-and-free-list-p2`](evidence/2026-11-20-result-and-free-list-p2.md). Local gate PASS: `crates/cli/tests/p2_closure.rs` runs 20 C01–C06/C11/C12 fixtures plus the stdlib table self-test in `--mode pure` (no foreign/plugin/import grants), scans sources for foreign/plugin/import shortcuts and compares value/stdout to goldens; evidence [`p2-closure-gate`](evidence/2026-11-20-p2-closure-gate.md). The bundled `stdlib/` tree, `std:` imports, digest verification, Analysis identity and frozen-CLI closure test are implemented (ADR-0028). Remaining outside C01–C12: publication as a separate external stdlib repository, and no remote CI URL. |
| P3 Resource/Stream ABI | **PARTIAL** | ADR-0025/0026 CM-A06 slices: opaque `Resource`, `resource.open/read/write/close`, stdout write in pure/project, granted project-file read and buffered project-file write in project, EOF/closed/handle errors, wire/host rejection; strict permits only stdio/stdout and refuses file/network resources. Fixture 66 + CLI/host tests. CM-A07 **Compat-C** is implemented: when a program calls `打印/print`, the loader injects the bundled `stdlib/io.mq.md` and the runtime routes to `io.写值` (all 15 value types, UTF-8 via `Memory`, `resource.write(stdout)`); `HostOp::Print` and the legacy `Value::display()` print path are removed, and a missing bundle fails with `kernel.unavailable`. Strict permits only the existing stdio console channel. Still missing: directories, network, generic provider registry, Table storage, strict file/network resources. |
| P4 Table logical/physical migration | **PARTIAL** | ADR-0032/CM-A08: `Value::Table` logical semantics unchanged (T0 `Vec<Vec<Value>>`); `stdlib/data/table.mq.md` provides select/filter/sort/append/set/join/group/`转GFM` as value-returning `.mq.md` functions with input immutability. GFM rendering is covered; no T1/T2/T3 physical storage, column store, cross-storage implementation or Memory-backed table. |
| P5 third-party Provider / TCP / HTTP | **PARTIAL** | semantic fixture 71 implements HTTP/1.1 response parsing (status/headers/chunked) and request construction in `.mq.md`; no host HTTP/TLS. ADR-0034 blocking TCP resource endpoint (`resource.open("tcp", "<ip>:<port>", ["read","write"])`, exact IP grant, project-only, 5s timeouts; loopback host+CLI tests). ADR-0033 in-process `ResourceProvider` v1: explicitly trusted providers register by kind, project-mode only, gated by `Capabilities.allow_resource_provider`, using the existing `resource.*`/`Result` ABI; a mock read/write provider is tested. No C/Worker provider transport, host DNS/TLS/HTTP implementation, UDP, clock/random/process/device providers, or provider package installation. |
| P5 third-party Provider / TCP / HTTP | **PARTIAL** | `stdlib/net/http.mq.md` + semantic fixture 71 implement HTTP/1.1 status/header/chunked parsing and request construction in `.mq.md`; `http_over_tcp.rs` runs a local HTTP exchange over `resource.open("tcp",...)`; no host HTTP/TLS and no external network test. ADR-0034 blocking TCP resource endpoint (`resource.open("tcp", "<ip>:<port>", ["read","write"])`, exact IP grant, project-only, 5s timeouts; loopback host+CLI tests). ADR-0033 in-process `ResourceProvider` v1: explicitly trusted providers register by kind, project-mode only, gated by `Capabilities.allow_resource_provider`, using the existing `resource.*`/`Result` ABI; a mock read/write provider is tested. No C/Worker provider transport, host DNS/TLS/HTTP implementation, UDP, clock/random/process/device providers, or provider package installation. |
| P6 performance / native backends | **NOT IMPLEMENTED** | no bytecode/JIT/GPU/QPU work |
The P1 memory domain is pure computation: it needs no grant and is available in
@@ -244,6 +248,9 @@ user-written allocator is explicitly **not** claimed.
- [`evidence/2026-11-20-tcp-endpoint.md`](evidence/2026-11-20-tcp-endpoint.md)
— ADR-0034 blocking TCP endpoint, IP grants, DNS refusal, loopback host/CLI
echo tests.
- [`evidence/2026-11-20-http-over-tcp.md`](evidence/2026-11-20-http-over-tcp.md)
— P5/C10 `.mq.md` HTTP framing over a loopback TCP stream, stdlib module and
end-to-end client test.
- [`evidence/2026-11-20-p2-closure-gate.md`](evidence/2026-11-20-p2-closure-gate.md)
— P2 C01–C06/C11/C12 pure no-Foreign/no-Plugin closure lane and golden
comparison.
+4 -1
View File
@@ -68,7 +68,10 @@ an external effect and is not replayed as pure computation.
## Consequences
* `.mq.md` can implement a line protocol/HTTP client parser on top of the TCP
byte stream using the existing Memory/Text/Result primitives.
byte stream using the existing Memory/Text/Result primitives. The bundled
`stdlib/net/http.mq.md` provides HTTP/1.1 response parsing (status, headers,
chunked transfer) and request construction; `http_over_tcp.rs` runs a local
HTTP exchange through `resource.open("tcp", ...)` and the module.
* The runtime still has no `net.request` builtin or new `HostOp`; a CLI test
opens a local echo server, writes/reads `ping` through `resource.*`, and
closes.
+52
View File
@@ -0,0 +1,52 @@
# RFC-CM P5/C10 evidence: HTTP/1.1 over the TCP resource endpoint
Date: 2026-11-20 (Asia/Shanghai)
Repository: `marqdo-cli`
Baseline: `0d4dc1d` plus this step's changes.
Related: [ADR-0034](../adr/0034-tcp-resource-endpoint.md),
[HTTP parser fixture](2026-11-20-http-parser.md), [STATUS §5](../STATUS.md).
Scope: `.mq.md` HTTP framing over a loopback TCP stream; no host HTTP/TLS.
## Module
`stdlib/net/http.mq.md` (import `std:net/http`) provides:
```text
解析响应(文本) -> {状态, 原因, 头, 体}
解码分块(体) -> Text
构建请求(方法, 路径, 头列表, 体) -> Text
切片/找子串/找字符/十六进制值
```
It uses only `text.codepoints`/`text.from_codepoint` and List/Map/Text values;
there is no `net.request` or host HTTP parser.
## End-to-end test
`crates/cli/tests/http_over_tcp.rs`:
1. starts a loopback `TcpListener` that reads the request and sends
`HTTP/1.1 200 OK ... Content-Length: 5 ... hello`;
2. runs a generated `.mq.md` program with `--allow-net 127.0.0.1`;
3. the program builds a GET request, UTF-8-encodes it through `std:text` into
`Memory`, writes it to `resource.open("tcp", addr, ["read","write"])`,
reads the response bytes, decodes them to Text with
`text.from_codepoint`, parses with `stdlib/net/http`, and returns
`[write.ok, read.ok, status, content-type, body, close.ok]`;
4. asserts `[true, true, 200, "text/plain", "hello", true]`.
`stdlib/tests/http.mq.md` independently pins the parser/builder without a
socket. Semantic fixture 71 pins the same logic in the conformance corpus.
## Gate
Local container: `cargo test -p marqdo-cli --test http_over_tcp` PASS and
`cargo test -p marqdo-cli --test stdlib_http` PASS; full workspace gate PASS.
No external network access is required.
## Not done
* HTTPS/TLS; no TLS security claim.
* External DNS, redirects, connection reuse, compression, cookies, HTTP/2.
* A host HTTP client/server; this is `.mq.md` framing over the byte stream.
* Strict-mode TCP (strict refuses TCP; project mode only).