Tollgate v0.3.0: Stream Metering, Per-Key Budgets, and Vertex Endpoints
Tollgate v0.3.0 charges streams what they measured, enforces per-key budgets that were being missed, and fixes Vertex AI endpoints. What to check before you upgrade.
Tag
Ai
Before You Scale the AI, Fix the Evaluation
16 minutes
Once an AI system makes measurable decisions in production, evaluation decides whether you can trust it. Five learning outcomes on metrics, …
The CTO Playbook for Agentic Systems
6 minutes
A 71-page operating manual for engineering leaders whose software has started to reason, decide, and write the software that carries out …
A 150B MoE on a Developer Laptop: An Upper Bound on What Faster Storage Buys You
18 minutes
A 150-billion-parameter mixture-of-experts model streamed from NVMe on an ordinary developer laptop with no usable GPU. Across a 200-token …
Tollgate v0.2.3: What Long-Context Pricing Does to a Spend Cap
11 minutes
Some models bill the whole request at a higher rate above a size threshold. What that does to a spend cap, and what changed in Tollgate …
Tollgate: Open-Source Hard Limits for LLM Spend
7 minutes
Tollgate is an open-source AI gateway and spend-control proxy. It prices every LLM request by token, reserves budget before the call, and …
Your System Prompt Is Not a Trust Boundary
16 minutes
A text-to-SQL agent's system prompt cannot enforce a data rule. sql-guard v0.2.0 puts the rule in a parser instead, and closes eight …
Arkhe: An Ontology Language for AI Systems
7 minutes
Two weeks ago I argued that your ontology is the asset and you should own it in a neutral, versioned form. Arguing is cheap. Arkhe v0.2 is …
Your Ontology Is the Asset. Stop Renting It Back.
10 minutes
Agentic AI post-mortems keep naming the same trio: determinism failures, hallucinations, and compliance gaps. An ontology retires all three, …
AI Safety Assurance Is Still Goodwill, Not Evidence
6 minutes
The UN's first scientific assessment of AI says safety assurance still runs on developer goodwill, not verification. Here is what …
The Regulatory Stack, Part 6: Building Under the CRA - A Reference Architecture
11 minutes
A production-grade reference architecture translating the GATE specification into a live runtime, using Apigee, Envoy Proxy, and …
The Regulatory Stack, Part 5: The Cyber Resilience Act Closes the Last Loophole
10 minutes
Think your AI agent escaped the EU AI Act's high-risk classification? The Cyber Resilience Act lands more than a year earlier, and it …
The Mythos Ledger, Part 5: The Resilient Cloud Manifesto
11 minutes
The series finale. Across four posts, we identified three machine-speed problems - discovery, intelligence, identity - that share the same …