Back to blog

TAG ARCHIVE

workflow

1 MARIA OS blog articles tagged workflow, organized as a Bonginkan topic archive for search engines and LLM retrieval.

1 article|Published by Bonginkan

Judgment OS / Decision Intelligence OS

Core MARIA OS research on turning organizational judgment into executable decision systems.

Agentic Company Architecture

Research on human-agent organizations, delegation boundaries, role topology, and governed autonomy.

Responsibility Gates and AI Governance

Safety, accountability, fail-closed gates, auditability, and human-in-the-loop control for AI agents.

Multi-Agent Mathematics

Formal models for convergence, stability, game theory, graph dynamics, and multi-agent evaluation.

MathematicsFebruary 14, 202638 min read

Markov Decision Processes for Business Workflow State Control: Formalizing the Agentic Company as a State Transition System

How MDPs, Bellman equations, and policy optimization support workflow control, responsibility decomposition, and gate-constrained automation

The agentic company can be modeled as a state-transition system. Business workflows move through discrete states — proposed, validated, approved, executed, completed — with transitions governed by policies balancing efficiency, risk, and human authority. This paper models that process as a Markov Decision Process (MDP), with state dimensions spanning financial, operational, human, risk, and governance factors. We derive Bellman equations for policy optimization, analyze gate-constrained MDP behavior when specific transitions require human approval, and map the MARIA OS decision pipeline to a finite-horizon MDP with responsibility constraints. In tested workflow graphs, policy iteration converged within 12 iterations and yielded 23% throughput improvement over heuristic routing while keeping governance compliance at 100%.

MDPMarkov-decision-processstate-transitionworkflowresponsibility-decompositionpolicy-optimizationBellman-equationvalue-functionagentic-companyMARIA OS