Files
marqdo/tests/ext/llm-ask-offline.mq.md

636 B

markup, title, description, import
markup title description import
occlusion llm create + collect offline Factory create + collect alias; no network.
llm net
ext/ai/llm.mq.md lib/net.mq.md

main

model = > llm.create

print text=model) print text=backend)

fixture = "data: {"choices":[{"delta":{"content":"Hi"}}]}\n\ndata: {"choices":[{"delta":{"content":"!"}}]}\n\ndata: [DONE]\n" events = > net.openai_sse_parse text=fixture answer = > llm.collect events=events

print text=answer alias = > llm.stream_result events=events print text=alias