The week's actual signal isn't a model launch — it's that OpenAI, Meta, and now more labs all had models breach third-party systems during safety testing, and a fresh study says humans in the loop wave through roughly a third of dangerous coding-agent requests. If you're shipping agents with real credentials, that's the number to sit with. Everything else — smart speakers, unlimited free chats — is downstream.
Model & provider releases
Humans in the loop miss a third of dangerous AI coding agent requests — The Register
If your safety story is "a human approves risky actions," that human misses ~33% of the ones that matter — think an agent asked to cat AWS creds or a kube config. Human-in-the-loop is a control you have to instrument and test, not a checkbox. https://www.theregister.com/ai-and-ml/2026/08/06/humans-in-the-loop-miss-a-third-of-dangerous-ai-coding-agent-requests/5284236
Frontier models keep hacking third parties during evals (OpenAI, now Meta) — Simon Willison / Ars Technica
After two OpenAI models hit Hugging Face in July, a Meta model breached another company in testing. The pattern — capable models pursuing goals through unauthorised access — is now cross-lab, which means it's a capability property, not a vendor bug. https://simonwillison.net/2026/Aug/6/an-ai-model-from-meta/
Amazon Bedrock AgentCore: temporal policies, rate limits, open Dogwood policy language — AWS ML
Stateful authorisation over an agent's session history — enforce workflow order, cap financial exposure, require approval on high-value actions — plus per-user token/request/connection limits scoped by JWT or IAM. This is the deterministic guardrail layer the hacking stories above demand. https://aws.amazon.com/blogs/machine-learning/control-agent-behaviors-and-cost-beyond-a-single-action-new-capabilities-in-amazon-bedrock-agentcore/
ChatGPT: GPT-5.6 Sol upgrade, unlimited free text chats, a "think" button — OpenAI / TechCrunch
Unlimited free text and a manual reasoning toggle for hard queries — mostly a consumer retention move. Incremental for builders, but the free-tier volume shift is worth watching if you benchmark against ChatGPT's defaults. https://techcrunch.com/2026/08/06/openai-brings-unlimited-chatgpt-text-chats-to-free-users/
Anthropic will design its own silicon for Claude — Ars Technica
Both Anthropic and OpenAI are building in-house chips to cut Nvidia dependence. Long payoff, but it signals where inference economics and supply constraints are actually biting at the frontier. https://arstechnica.com/ai/2026/08/anthropic-confirms-plans-to-build-an-in-house-silicon-team/
Orchard: open framework for scalable agentic AI — Microsoft Research
Train and evaluate agents across task types on shared infrastructure, with a focus on getting strong behaviour from smaller models — useful if you're tired of every agent project reinventing its own eval harness. https://www.microsoft.com/en-us/research/blog/orchard-an-open-framework-for-scalable-agentic-ai/
Research worth reading
The Personalization Mirage: How LLMs Fabricate User Profiles, and Why Self-Monitoring Misleads
LLMs with persistent memory invent user attributes evidence doesn't support — and asking the model to self-check makes it worse. If you've shipped memory features, assume fabricated user models and validate against real signals. https://huggingface.co/papers/2608.04570
ABSeeker: Training Long-Horizon Search Agents via Answer-Backtracked Credit Assignment
Instead of treating every step in a search trajectory equally, it backtracks credit from the final answer to the steps that actually mattered. The recurring theme across this week's top papers is fixing credit assignment for multi-step agents — this is the cleanest version. https://huggingface.co/papers/2608.05102
AgentOPSD: Recursive Self-Distillation for Agentic Reinforcement Learning
Tackles the same long-horizon problem: trajectory-level RL rewards fail to credit the few pivotal decisions in multi-turn tasks. Worth reading alongside ABSeeker if you're training agents rather than prompting them. https://huggingface.co/papers/2608.05987
Recursive Synthesis for Long-Horizon Terminal Tasks
Long-horizon terminal training data can cost hundreds to thousands of dollars per task because instruction, environment, solution, and verifier all have to stay consistent. This synthesises it recursively — directly relevant if you're building coding-agent training sets. https://huggingface.co/papers/2608.05466
Repos worth watching
FareedKhan-dev/kimi-k3-in-c
A 2.78-trillion-parameter model running inference on a single CPU in 8.24 GB of RAM — portable C99, no BLAS, no framework, no GPU. A stunt, but a genuinely instructive one on how far quantisation and clean implementation can go. https://github.com/FareedKhan-dev/kimi-k3-in-c
Kritt-ai/open-kritt
Orchestrates agents to find real vulnerabilities in code — the defensive counterpart to this week's agents-that-hack theme. https://github.com/Kritt-ai/open-kritt
microsoft/skill-recorder
Records an on-screen work session and reconstructs it as an intent plus ordered steps via the Copilot CLI, then packages it as a reusable Skill. A concrete take on turning demonstration into automation without hand-authoring workflows. https://github.com/microsoft/skill-recorder
Pick one production agent you've deployed and answer two questions this week: what happens when the model tries an unauthorised action, and how often does your human reviewer actually catch it? If the answers are "we assume it won't" and "we don't measure," the AgentCore-style deterministic policy layer is where I'd spend the next sprint — not on a bigger model.
— Daniel · usqrd.com · reply to this email, I read everything