Stackbilt field guide · public review
The Edge That Thinks
Designing Reliable Generative AI Systems on Cloudflare
Read the free public-review edition Listen to the audio edition · 2 h 13 min
The argument
The model is not the application.
Most generative AI systems do not fail because the model was not intelligent enough. They fail because the surrounding system could not remember reliably, survive retries, enforce boundaries, control cost, or explain what happened.
The Edge That Thinks is the architecture field guide I wrote from building those surrounding systems across Stackbilt. Its central claim is practical: dependable AI comes from explicit routing and state, durable work, narrow capabilities, preserved provenance, enforceable budgets, and feedback loops that make autonomy earned rather than assumed.
What readers get
A production architecture, piece by piece.
- Routing
- Match model capability and cost to the actual task.
- State ownership
- Make memory, session, and workflow state explicit.
- Memory
- Separate retrieval, durable knowledge, and transient context.
- Durable jobs
- Design retries, idempotency, and recovery before production.
- Multi-model economics
- Treat inference quality, latency, and spend as a portfolio.
- Tool boundaries
- Give agents narrow capabilities with enforceable limits.
- Observability
- Preserve enough evidence to explain what happened.
- Identity & retention
- Define who can act, on whose behalf, and for how long.
- Earned autonomy
- Expand authority only as a system demonstrates reliability.
- Practice material
- Architecture diagrams, case files, and a production checklist.
Built from practice
The systems behind the observations.
The book draws from systems I have designed and operated, not an idealized reference architecture. Each exposed a different failure boundary in production.
- AEGIS. A persistent agent system that joins memory, scheduled work, model routing, governed tools, and operational feedback on the edge.
- img-forge. A production image-generation workload that made quotas, provenance, asynchronous work, and provider boundaries concrete.
- MindSpring. Semantic search over exported AI conversations, used to examine retrieval quality, ownership, and durable personal memory.
- edge-auth + llm-providers. Shared identity, entitlement, failover, circuit-breaking, and cost controls that keep model access from becoming application policy.
- Stackbilt platform. The broader operating surface where contracts, observability, deployment, and governance have to work across products rather than in isolation.
Audio edition
Hear it end to end.
The complete 0.2.1 text, read aloud: 2 h 13 min across 22 tracks, free to stream here.
Your place: . Resume
Track: Opening credits
- · Opening credits 0:50
- Front matter
- · How to Use This Book 3:33
- Chapters
- 1 The Edge That Thinks 9:59
- 2 The Request Is Not the Unit of Work 9:06
- 3 Service Composition Is a Security Decision 6:05
- 4 State, Locality, and the Honest Limits of D1 5:59
- 5 Route Before You Reason 4:54
- 6 Memory Is a Product Feature, Not a Prompt Field 5:04
- 7 Durable Objects, Queues, and Work That Outlives a Request 8:44
- 8 Tools, MCP, and Capability Boundaries 7:18
- 9 Multi-Model Economics and Quality Tiers 7:27
- 10 Observability: Trace Decisions, Not Just Errors 6:54
- 11 Identity, Tenancy, Retention, and Consent 8:03
- 12 From Workflow to Agent: Earned Autonomy 8:47
- Case files
- 13 Case File: A Cognitive Kernel With a Circuit Breaker 7:18
- 14 Case File: Multi-Tenant Generation Without a Fragile Request Path 7:21
- 15 Case File: Ingestion, Retrieval, and the Cost of Memory 5:55
- Chapters
- 16 The Production Checklist 4:48
- 17 Cloudflare OS: Context, Gatekeepers, and the Deterministic Turn 6:48
- Appendices
- A A Reference Architecture for Generative Work 5:27
- B Design Review Questions 2:23
- · Closing credits 0:36
Release posture
Substantive now. Still under review.
Version 0.2.1 is a substantive early edition shared for practitioner review. Corrections and review findings will inform version 1.0.
Final accessibility and publication gates remain open. Stackbilt maintains the complete free text edition, downloads, version history, corrections, and update ledger. This page documents my authorship, argument, and production experience, and hosts the audio edition, which follows the text release by release.
Read, inspect, or start a conversation.
Read/download the free edition
Copyright © 2026 Kurt Overmier. All rights reserved.