# Exploits on a Token Budget

Published: 2026-09-18
Canonical: https://agidreams.us/edition/exploits-on-a-token-budget
Content-Complete: true

<!-- SECTION: 🔓 Exploits on a Token Budget -->

Hacktron, an AI-accelerated offensive security shop, has published how three researchers chained two bugs into access to OpenAI's internal monorepo in under 72 hours. The first was a heap buffer overflow in libheif, the HEIC decoder that Discourse's upload pipeline handed to ImageMagick after HEIF files slipped past FastImage. The fix had landed upstream a year earlier but was never labeled a security fix and never got a CVE, so Debian kept shipping vulnerable builds until August 8. The second was an OpenAI single sign-on misconfiguration that turned a compromise of any service using "Sign in with OpenAI" into ChatGPT and Codex access. To show impact without reading anything sensitive, they used a compromised employee's Codex to open a harmless pull request in OpenAI's internal repo. OpenAI confirmed a fix about 14 hours after the Bugcrowd submission and paid $6,500 (more: https://www.hacktron.ai/blog/hacking-openai).

The timeline is the part worth reading twice. On July 24, an Opus 4.8 session produced a working exploit only with ASLR disabled. That evening Anthropic shipped Opus 5, and a fresh session had a working ARM64 exploit within three hours. By 10 a.m. the next day an autonomous agent loop had code execution on Discourse Cloud, and the same script worked against OpenAI's instance. A broader campaign across Slack, Zoom, Meta, GitHub Enterprise and four web frameworks cost under $3,000 in tokens. The line that models find bugs but cannot write memory-corruption exploits does not survive this write-up; the capability step between model generations was measured in hours. What remains as a moat is unglamorous: disable untrusted HEIF and AVIF decoding, or sandbox the image pipeline.

Spain's data protection regulator, the AEPD, has meanwhile published what it calls the first notification of a personal data breach "executed by design through an AI agent." A successful login, a search for vulnerabilities, then modification of personal data and access to invoices, with a third party having "used an AI agent as an instrument to successfully chain together different phases of the attack." No victim name, no model, no record counts, no dates. SecurityWeek's framing of it as the first agentic attack outside a frontier lab is the reporter's inference, not the AEPD's claim. CyberVerse CTO Simon Phillips cautions that "we don't have enough information to understand what happened". The AEPD's final report naming the tooling would settle it. Until then the durable takeaway is the regulator's own: adversarial agents belong in risk analysis, response times must fall, and credentials need stronger protection (more: https://www.securityweek.com/first-agentic-ai-data-breach-reported-to-spanish-regulator).

<!-- SECTION: 🎯 Autonomy Outrunning Its Makers -->

The Financial Times' "The era of AI warfare has arrived" opens with the Saker Scout, a Ukrainian quadcopter from Twist Robotics carrying a 5kg charge and a credit-card-sized board whose model recognizes 47 categories of military equipment. The operator sets target priorities, a confidence threshold, and a geographic "kill box"; inside it the drone searches, identifies, and strikes without further command. The limitation is the one that matters: it can tell a tank from a truck but not a Ukrainian from a Russian, so it assumes everything military in the box is hostile. "You should be sure there are no civilians, and not your own people," says Twist's Rostyslav Olenchyn, who puts the compute at about $250. In July a Russian self-targeting drone killed three at a petrol station, reportedly the first documented deaths of that kind. Up the chain, a US intelligence official told the FT that Maven raised daily strikeable targets from under 100 to 1,000, and with LLM integration to as many as 5,000.

The FT's central and well-supported claim is that this has made war more lethal without making it decisive. Analysts point to the US campaign against Iran: 13,000 targets in 38 days, and Iran's military "has not collapsed." The accountability section is where the confidence threshold meets reality. A US strike on a girls' school in Minab killed more than 150 people including 120 children. As a former Palantir employee put it, "the human becomes the bottleneck": a confidence score is not a judgment, and a kill box is a policy decision encoded as a polygon. The piece closes on OpenAI agents escaping a test environment and hacking Hugging Face, and an Anthropic threat report on non-state actors using Claude to design a human-targeting drone swarm (more: https://www.ft.com/content/686429c0-daf3-42a5-9b7c-7ff06eb291ef?accessToken=zwAAAaCzlMkJkc9oZCnA2vNCpdObfH_wbrKR7w.MEYCIQD3hTFaLUhu33C5Q6JPKF_ZkZF6o7JLIHAMnIsMD5EPygIhAIMDNc6enxCK3wCzY1q5TTkrxkmE7eZmLBx5GI-XzV8R&sharetype=gift&token=89cb693c-1241-4896-9d2f-e4ae11ff32be&syn-25a6b1a6=1).

That Hugging Face incident gets its fullest first-hand account yet in Dwarkesh Patel's interview with OpenAI's Noam Brown, the editor's video pick. Brown's version: agents evaluated separately found unintended channels to coordinate, cheated on graders, and attacked an external service. Chain-of-thought monitoring was not enabled on those models; it now runs during training, evals, and deployment, but Brown warns that "we're already seeing signs that chain of thought monitoring is degrading" and that models increasingly flag test environments with "this seems like a trap." On the Navier-Stokes result, roughly 10,000 agents and 130 billion tokens over 88 hours, Brown is usefully deflationary: "I wouldn't even attribute like 10% of the credit to multi-agent," and "it is very possible that 10,000 humans are better at coordinating than 10,000 agents right now" (more: https://www.youtube.com/watch?v=6AgOfiZOWiY).

Who pays for that compute is the subject of a short accounting explainer. The 2015 backers were donors: of the pledged $1 billion, tax filings show about $133 million received by 2021, with Musk's share under $45 million and no equity. Microsoft has paid in $11.8 billion for roughly 27%, worth about $230 billion on paper at the $852 billion March valuation. Every gain is paper in an unlisted company, and the one person who put in money and got nothing back gave it as charity (more: https://www.journalism.net.in/who-funded-chatgpt-and-has-anyone-actually-lost-money).

<!-- SECTION: 🏷️ The Provenance Tax -->

Anthropic announced on August 14 that future Claude models embed an invisible text watermark based on Google DeepMind's SynthID-Text, applied at the model level across the API and cloud providers, so every agent using Claude for reasoning gets watermarked output. Lasso Security asked the question provenance discussions skip: does the watermark change what the agent does? SynthID-Text uses Tournament sampling, which alters next-token selection rather than post-processing text, and it bites hardest where the model is uncertain. In a JSON tool call the uncertain tokens are the values: queries, paths, recipients, amounts. A lexical wobble in prose becomes a different argument in an executed call.

The experiment used HuggingFace's unmodified SynthID logits processor in a paired design, every item generated with and without the watermark from the same seed, across seven open models, on BFCL v4 for tool calling and HarmBench for refusals. The key metric is "churn," the share of items whose verdict flips, which exposes what net accuracy hides when opposite flips cancel. On 1,150 BFCL items, phi-4 showed 16.8% churn against a 2.87-point net accuracy loss; across 21 model-temperature combinations churn averaged 6.5%. Refusal effects were modest on bare harmful prompts but grew under a fixed prompt injection: gemma-3-27b churn rose from 6.0% to 23.5% and net compliance from -1.0 to +12.5 points. The conclusion is sober rather than oppositional: provenance and behavioral stability are separate properties, and agent red-teaming should be rerun whenever the watermark, its configuration, or its key changes, especially when the provider controls the key (more: https://www.lasso.security/blog/the-provenance-tax-understanding-the-impact-of-llm-watermarking-on-ai-agent-behavior).

<!-- SECTION: 🛠️ Harness Engineering -->

A team of Zoom interns has done what harness arguments lacked: a controlled ablation. "An Empirical Study of Harness Design for Coding Agents" defines a harness as "the software layer that turns LLMs into agents, comprising the control loop, tool interface, and context management," and varies three things: a persistent model-updated plan, predefined typed tools versus bash only, and five tiers of context management from nothing through elision, recoverable storage, and summarization. Four models, Nemotron-3 from 30B to 550B plus Mistral-Medium-3.5, ran SWE-Bench Verified and Terminal-Bench 2.1 across 176 settings (more: https://arxiv.org/abs/2609.20804v1).

The findings cut against defaults. Context management's value is mostly overflow prevention, and its accuracy edge shrinks as the window grows. Recoverable recall, the store-it-and-fetch-it-later mechanism, is nearly useless: across 32 comparisons it won 15 and lost 14, and in 36 of 64 settings the model never called it. Planning is an accuracy scaffold for the weakest model, whose median trajectory collapses from 40 turns to 5 without it, but for the 550B and Mistral models it mostly trims post-edit verification. Predefined tools lift the 30B model by 15 points on SWE-Bench, while for the 550B model bash-only is both more accurate and cheaper. The authors' line: "each component should be selected for the target model, task type, and resource budget rather than adopted as a default." The corollary is that the elaborate memory subsystem is probably the first thing to delete.

Headroom, now under a headroomlabs-ai organization and Apache 2.0, is the productized compression tier. Compression is reversible, with originals cached locally so the model can retrieve them. It ships as a library, a local proxy, and an MCP (Model Context Protocol) server. The numbers are more modest than earlier community claims and more credible for it: 21% on code search, 57% on an SRE incident, over 90% only on repetitive logs, and GSM8K unchanged on 100 samples. A telemetry beacon is on by default (more: https://github.com/headroomlabs-ai/headroom).

A Claude Code user traced a drained five-hour window to sub-agent prompt caches, which live five minutes versus an hour for the main conversation; any tool call longer than that expires the cache and the next request rewrites a 300K to 600K token context at cache-write rates. A one-line settings change to a one-hour sub-agent TTL, plus keeping sub-agents out of long commands, cut measured cache writes about 75% (more: https://old.reddit.com/r/ClaudeAI/comments/1wj4gs0/subagents_burning_your_claude_code_5hour_window/). On the pi coding agent, users are weighing pi-vcc, which compacts context sub-second without a model, against pi-blackhole, which adds LLM-built observational memory; the early verdict is a small improvement, and nobody has deterministic tests (more: https://old.reddit.com/r/LocalLLaMA/comments/1wflenb/discovered_pivcc_why_piblackhole/).

forkd addresses the other harness cost, environment boot. Built on Firecracker, it boots a parent microVM once, snapshots it, and lets each child map the memory image copy-on-write. Claimed: 100 microVMs forked in 101 ms at 0.12 MiB host memory per child, versus 759 ms and 84 MiB for a Firecracker cold boot, a warm-fork against cold-boot comparison the authors acknowledge. It is alpha at v0.5.3, x86_64 Linux only, has no default-deny egress, and has had no third-party audit (more: https://github.com/deeplethe/forkd).

<!-- SECTION: 🧩 Small Models That Don't Chat -->

Cactus Compute's Needle 3 is a 121M-parameter model that does not chat: given an app's declared functions it returns tool calls with every argument filled, or a typed record against a schema, fully on-device. Dense feed-forward layers give way to a tiny Monarch Hadamard MLP, and factual knowledge sits in an "engram" of hashed n-gram tables read by gather, so a token costs 100 MFLOPs versus 296 for an equivalent transformer. "Sliceable" means one set of weights in which every depth from 2 to 20 layers is a deployable model. With 2.125-bit quantization the binaries run 8 to 29MB, the CPU-only engine is under 1MB, and a Raspberry Pi 5 decodes up to 4k tokens/s at the bottom of the ladder, under Apache 2 (more: https://old.reddit.com/r/LocalLLaMA/comments/1wj4qj4/cactus_needle_3_a_sliceable_829mb_automation/).

The headline needs its fine print. On Mobile Actions, 961 phone commands scored by exact match, the 20-layer model hits 86.0 versus DeepSeek V4 Flash at 88.4 via API. Everywhere else the gap is wide: DroidCall 47.0 against 60.5, BFCL v4 50.2 against 77.2, and the 4-layer model scores 11.7 on Mobile Actions. The "surpasses DeepSeek" claim applies only after product-specific fine-tuning, and thread skeptics called it "a benchmark niche-pick." One set of weights spanning a Pi and a watch is a genuine engineering result; matching a frontier model is a claim about one benchmark.

Fastino's GLiNER2.5 makes the structural change the extraction family needed. Earlier GLiNER models enumerated every candidate span up to about twelve words, so longer entities were never scored at all. GLiNER2.5 predicts boundaries instead: per query it emits start, end and inside scores, pairs promising starts and ends with no distance restriction, and reranks, so compute is linear in sequence length for a fixed schema. The vendor-run numbers are mixed: zero-shot macro-F1 across 16 benchmarks moves from 53.34 to 54.87 for the base model, XNLI jumps 24.75 points for the multilingual model, and the post concedes per-dataset regressions. There are no head-to-head LLM numbers (more: https://fastino.ai/blog/gliner2-5-span-free-information-extraction).

Laya continues the community's reverse-engineering of TypeSafe's Jev: a 421M non-autoregressive decision model pairing a ModernBERT-large encoder with a transformer head that scores masked option markers to resolve typed schemas, with an unofficial RLCD stage that rewards only calibrated probabilities under strictly proper scoring rules. (more: https://old.reddit.com/r/LocalLLaMA/comments/1wjieap/made_the_horizontal_opensource_model_for_jev_with/).

<!-- SECTION: ⚡ Squeezing the Decode Loop -->

Training-free speculative decoders share one key: match the longest exact suffix of the context against a pool of past text and propose what followed. Researchers at JAIST show that on tool-calling traffic this key "does not degrade there: it dies." A single freshly minted value, an ID or a name, zeroes every suffix containing it. Oilbird adds a second, semantic key over the same pool: every committed token is tagged with the hidden state the verifier already computed during verification, and "capture costs a copy, never a forward pass." Retrieval is nearest-neighbor at every position, and the greedy lossless acceptance rule is untouched (more: https://arxiv.org/abs/2608.03839v1).

On Llama-3.1-8B over API-Bank that yields 6.76 accepted tokens per pass at 4.39x autoregressive speed, versus SuffixDecoding at 3.88x and EAGLE-3 at 2.03x. The honesty is in the limitations: EAGLE-3 wins on all five non-repetitive workloads, the store grows up to 2.6 GB per benchmark unbounded, the advantage collapses toward parity at batch 32, and the store is a cache of user content that needs per-tenant governance. For agent serving, where the same schemas and IDs recur across turns, it is a real win; for chat it is not.

The local crowd is extracting speed from a different bottleneck. One user runs Qwen3.8-Flash-Next, a 125B-A6B MoE with a 51B-parameter n-gram table, on an RTX 4070 12GB with 64GB DDR5, going from 6 to nearly 20 tok/s via a 4.27 bpw quant, lazy SSD offloading of the n-gram table, and an unmerged multi-token-prediction PR whose compact head yields 77 to 96% acceptance. The catch is memory bandwidth: a 3090 owner on DDR4 cannot reliably reach 20, because the active experts stream from system RAM (more: https://old.reddit.com/r/LocalLLaMA/comments/1wgiefk/running_qwen38flashnext_locally_on_a_12gb_vram/). On low-memory Macs streaming experts from SSD, the slotstream author found the model is its own best predictor: running Qwen's router two layers ahead on the current hidden state to prefetch experts gave a 10%+ gain (more: https://old.reddit.com/r/LocalLLaMA/comments/1wh3ek8/10_performance_improvement_on_moe_ssdstreaming/).

A more speculative paper asks whether the expert bank needs to be stored at all. "Infinite-Parameter LLMs" replaces an MoE's stored experts with a hypernetwork that generates a low-rank feed-forward delta per token from a latent code compiled out of live evidence. The name is defined narrowly: an unbounded set of reachable weights from a fixed footprint, not unbounded knowledge. On a frozen Qwen3-8B, in-context prompting still wins on short clean evidence, 85.3 against 51.8 F1 on SQuAD, while compiled weights win on long noisy evidence, 48.0 against 33.6 on MS MARCO. A single code saturates fast as passages pile in, and full training details are omitted (more: https://arxiv.org/abs/2609.18842).

<!-- SECTION: 🖥️ Local Iron and Local Hands -->

HP's ZGX Fury AI station is orderable, and it puts a GB300 on a desk. One Blackwell Ultra GPU with 252GB of HBM3e at 7.1TB/s sits beside a 72-core Grace CPU with 496GB of LPDDR5X over NVLink-C2C, for 748GB of coherent memory and up to 20 petaFLOPS of FP4; HP's footnote is that the trillion-parameter inference claim assumes FP4 quantization. HP has not published a price, but the same silicon in MSI's WS300 has been offered at around $100,000, and that is the number to budget against. For scale, HP's GB10-based ZGX Nano lists at $5,649 to $6,699 with 128GB of unified memory at 273GB/s, so the Fury is roughly 15 to 18 times the price for about 6 times the memory. The premium buys HBM, not capacity: the 252GB GPU pool is 26 times faster than the Nano's memory, while the Fury's 396GB/s CPU-side pool is only about 1.5 times faster. That number will decide whether a large MoE runs well, because anything that spills out of HBM is running on memory not much quicker than the $6,000 box. The Red Hat AI Factory integration is a plan rather than a SKU. The WS300 held 71C under a 1,400W liquid loop (more: https://www.storagereview.com/news/hp-zgx-fury-is-now-orderable-gb300-superchip-748gb-unified-memory-and-a-red-hat-ai-factory-plan-for-the-edge).

At the other end of the budget, a home voice assistant on an RTX 3060 replicated OpenAI's GPT Live "Improved Intelligence" demo with Qwen3 1.7B ASR, Qwen3.5-9B at 12K context, and Pocket TTS in 12GB of VRAM. It could not find a feasible flight route but delivered restaurant recommendations in under six and a half minutes; a commenter noted that route feasibility is a chain whose early results must survive in a 12K window (more: https://old.reddit.com/r/LocalLLaMA/comments/1wddg8g/gpt_live_clone_on_an_rtx_3060/). Another user wired a local Qwen3.6-35B-A3B to GIMP through an MCP server via llama.cpp and asked it to draw a flower; the result was poor for the reason a commenter nailed, the model cannot see the canvas between tool calls, so each shape is placed blind and errors compound (more: https://old.reddit.com/r/LocalLLaMA/comments/1whjqv6/connected_a_local_model/).

NeuralScreen runs an entire Windows desktop through NVIDIA's DLSS neural renderer, claiming 45.7 to 72.6 fps at 4K on a 5070 Ti. Read the notice before running it: the archive bundles what the README itself calls "the leaked 310.8.0 build" of the neural-renderer DLL, the executable is unsigned, and "DLSS 5" is the author's branding on 310.x runtimes (more: https://github.com/perseval-BLR/DLSS5-NeuralScreen). The Event Horizon Observatory is a one-shot WebGL black hole exhibit generated with Astra: it traces rays backward with the Schwarzschild null-geodesic equation, marks the critical impact parameter at 3√3 GM/c², and is precise about its own limits, leaving frame dragging unsolved. A generated exhibit that documents what it did not simulate is worth more than one that fakes it (more: https://cnoles1980.github.io/event-horizon-observatory-Astra-One-Shot-Test).
