tool-genesis

Tool Genesis Under Governance: How to Safely Turn Generated Code into New Commands

A formal framework for sandbox verification, permission escalation, audit trails, and rollback mechanisms that enable self-extending agent systems without sacrificing safety

When an AI agent generates code that could become a new command in a production system, every line of that code becomes an attack surface. Without governance gates between generation and registration, a self-extending agent is indistinguishable from a self-propagating vulnerability. This paper presents the MARIA OS Tool Genesis Framework: a 7-stage pipeline that transforms generated code into governed commands through sandbox verification, formal safety proofs, permission escalation models, immutable audit trails, and automatic rollback mechanisms. We formalize tool safety as a decidable property under bounded execution, derive permission escalation bounds using lattice theory, introduce the Tool Safety Index (TSI) as a composite metric, and demonstrate that governed tool genesis achieves 99.7% safety compliance with only 12% latency overhead compared to ungoverned registration. The central thesis: self-extension is not dangerous — ungoverned self-extension is.