The Harness

Industry beats regulators to a jailbreak severity scale

Show Notes

Anthropic filed the industry's first cross-vendor jailbreak severity framework with Amazon, Microsoft, and Google, formalizing AI self-governance ahead of regulatory mandates. A grassroots Right to Local Intelligence campaign launched with strong community support, pushing for legal safe-harbor protections for open model ownership before state AI bills can restrict it. Apple shipped a Safari MCP server enabling AI agents to drive the browser natively, while practitioners codified a short leash oversight method as the emerging baseline for responsible agentic coding.

What is The Harness ?

A daily summary of what is interesting and happening in the AI industry, with a focus on what this means for people building harness experiences that are used.

Good morning, it's Friday, July third.

In today's briefing we see Anthropic publishing a cross-vendor jailbreak severity framework, Cognition's Devin Security Swarm demonstrating how agents can automate security at scale, and a grassroots movement called Right to Local Intelligence organizing consumer protection for open model ownership.

First up, in lab news today;

Anthropic
Anthropic published a cross-vendor jailbreak severity framework on July second, co-developed with Amazon, Microsoft, and Google. The framework scores jailbreaks along a severity gradient from minor behavioral unlocks to wide-spectrum harmful output and pairs with a new HackerOne program for researchers to submit Fable 5 cybersecurity jailbreaks directly for review. The same announcement confirmed that Anthropic's updated classifier blocks the specific technique that triggered the eighteen-day export control suspension in over ninety-nine percent of cases. For AI PMs governing AI safety posture, this means access control governance can now shift from binary blocks to proportionate response, because a cross-vendor severity scale is the precondition for responsible disclosure norms rather than regulatory crises.

In the harness, tools and orchestration world;

Cognition's Devin Security Swarm, highlighted in smol.ai's July first issue, uses an Agentic MapReduce pattern: bounded agents fan out across a codebase, aggregate vulnerability findings in parallel, then validate exploitability before surfacing results. A Fortune five hundred pilot identified and fixed over a thousand production vulnerabilities. The architecture is enduring because the fan-out, aggregation, and validation stages are separable engineering decisions. You don't have to buy Cognition's product; you can compose a security swarm from off-the-shelf orchestration primitives. For AI PMs building agentic security pipelines, the question is no longer whether you can automate vulnerability discovery but whether you own the harness or are renting it, because the separable architecture means you can mix and match components.

Alongside this, LangChain's OpenWiki generates wiki-formatted, agent-consumable codebase documentation with a single init command. Weaviate Engram does the same at the session layer: reconciling new memories against existing knowledge before writing, not querying at every inference step. The design philosophy underlying both is the same: agents maintaining structured, updateable knowledge layers rather than relying on retrieval or raw log lookups. For teams building multi-step agent workflows, this means memory architecture is now a first-class primitive distinct from both the context window and vector retrieval, because structured, updateable knowledge layers give agents a durable way to build on their own prior work.

SkillComposer treats skill selection as a joint autoregressive problem rather than a lookup or template-match step. Reported gains of plus twenty-three point one percentage points and plus eighteen point two percentage points over no-skill baselines on SkillsBench reinforce what the Semgrep harness result from June twenty-ninth showed: production performance lives in the composition layer, not in the capability of any single skill. For product teams shipping coding agents, expect to spend as much engineering effort on skill sequencing as on model selection, because how you select and sequence tools at runtime is at least as important as what those tools can do.

Apple shipped a Safari MCP server in Safari Technology Preview two forty-seven, giving AI agents fifteen native browser tools: tab navigation, DOM inspection, JavaScript evaluation, network request capture with full headers and timing, accessibility checking, and form interaction. It runs entirely locally with no external network calls. This matters because Apple has historically been the last major platform to expose browser internals to third-party tooling; shipping MCP-native browser automation signals that agentic browser control is now table-stakes infrastructure. For product teams shipping agents that interact with web interfaces, the product question shifts from whether your agent can drive a browser to whether the data your agent generates in the browser feeds a proprietary loop, because browser automation has become a commodity capability.

A blog post on the short leash AI coding method hit one hundred eighteen HN points: active diff review before each change, frequent commits after each subtask, explicit permission denial when the agent proposes unwanted scope, and mandatory line-by-line review of any AI-assisted PR. The author frames it as achieving better outcomes than letting frontier-model autonomy run unchecked. The AI coding workflow is bifurcating: mass-market tools push toward velocity; high-stakes engineering contexts are formalizing oversight patterns before regulators define them. For engineering teams using AI agents for code changes, knowing whether your context is speed-first or comprehension-first is now a first-order product and hiring decision, because the two regimes require fundamentally different oversight patterns.

In World Model developments;

AdaJEPA is LeCun's world model with test-time adaptation via latent-state prediction error. The training-in-imagination framing that runs through this and related work, such as NEO's causal program learning and the WebGPU Gemma four push, sketches a paradigm where the model updates its internal world model during inference, not just during training. It's early-stage, but the implication for agent design is significant: substrates that self-correct over the course of a task, rather than locking in their priors at training time. For teams building agents that refine their approach as they accumulate evidence, this means world model self-correction is becoming a measurable capability, because the shift from training-only adaptation to inference-time adaptation expands what's possible in bounded reasoning loops.

On the regulatory and advocacy front;

A grassroots advocacy campaign, Right to Local Intelligence, surfaced on Hacker News calling for federal safe-harbor language protecting consumers' right to download, own, run, modify, and share open AI models. The campaign doesn't target a specific bill; it's pre-positioning before anticipated state-level legislation that could inadvertently criminalize local model use through licensing requirements, energy mandates, or child safety mechanisms applied to open weights. The Hacker News thread drew comparisons to Microsoft's historical attempts to restrict Linux and flagged California's AI Transparency Act as a potential flashpoint. Sixty percent of OpenRouter traffic is already open-source software. For any player in the open-weight infrastructure space, if state legislation restricts local inference, hosted open-weight APIs become the compliant alternative and you have a regulatory moat, because the demand signal for local model access has reached consumers and they are now organizing to protect it.

That's the briefing. Have a great day.