自律系における倫理学習: 責任報酬と長期道徳記憶を持つ制約付き強化学習

1. はじめに

Ethics in artificial intelligence has been treated, almost universally, as a constraint satisfaction problem. Designers specify a set of moral rules --- do not discriminate, do not deceive, do not cause physical harm --- and the system is engineered to never violate them. This approach has been remarkably effective for narrow applications. A credit-scoring model constrained to equalized odds across demographic groups will, by construction, satisfy that fairness criterion. A medical diagnosis system constrained to flag uncertainty above a threshold will, by construction, escalate ambiguous cases to human review. The rules work because the ethical landscape is static: the designer anticipates the morally relevant variables, encodes the correct constraints, and the system operates within them forever.

But enterprise AI governance faces a fundamentally different problem. The agents operating within MARIA OS do not inhabit static ethical landscapes. They operate across multiple business units (Universes), functional domains (Planets), operational zones (Zones), and cultural regions --- each with its own ethical norms, regulatory requirements, and stakeholder expectations. A procurement agent negotiating with suppliers in the European Union faces different ethical constraints than the same agent class operating in Southeast Asia. A healthcare agent operating under Japanese medical ethics norms must balance different value hierarchies than one operating under American bioethics frameworks. A financial audit agent in a conservative banking universe prioritizes different risk tolerances than one in a growth-oriented fintech universe.

The static constraint paradigm breaks down in three specific ways:

• Novel situations. Ethical dilemmas arise that were not anticipated at design time. An agent encounters a scenario where two hard constraints conflict --- for example, privacy preservation and fraud detection both demand opposing actions on the same data. Static rules provide no resolution mechanism beyond escalation, which does not scale.
• Cultural variation. A globally deployed enterprise system cannot impose a single ethical framework across all regions without either violating local norms or reducing to the lowest common denominator of moral requirements. Neither outcome is acceptable.
• Learning failure. When an agent commits an ethical violation and the incident is resolved, the static paradigm offers no mechanism for the agent to incorporate this experience into future decision-making. The same mistake can recur because the system has no ethical memory.

This paper addresses all three failures through a unified framework: Ethical Learning in Autonomous Systems (ELAS). The core thesis is that ethics must be a learnable, evolvable system property --- one that agents acquire through experience, retain in long-term memory, adapt across cultural boundaries, and improve over time, while preserving inviolable safety invariants enforced by Fail-Closed Gates.

The framework builds on five research themes, each addressing a specific gap in current approaches:

• Theme 1: Responsibility Reinforcement Model. Can we incorporate responsibility and ethical behavior directly into the reinforcement learning reward function, and does convergence still hold? We formalize this as a Constrained MDP with responsibility-augmented reward and prove convergence of the Lagrangian dual.
• Theme 2: Ethical Memory Layer. How should agents retain and weight memories of past ethical violations? We introduce an exponentially-decayed memory model and derive optimal retention half-lives that balance learning from mistakes against the risk of over-penalizing reformed behavior.
• Theme 3: Value Hierarchy Adaptation. Can the ordering of moral values evolve over time without compromising safety? We define a bounded-drift adaptation mechanism that operates within Fail-Closed Gate constraints, proving coexistence of value evolution and principle fixation.
• Theme 4: Cross-Cultural Ethics Modeling. How do we parameterize ethical variation across regions and cultures? We construct a product space of universal ethical floors and culture-specific ethical parameters, indexed by MARIA OS Universe coordinates, with provable floor-preservation guarantees.
• Theme 5: Agent Moral Stress Detection. Does ethical load degrade agent performance? We define a moral stress index based on conflict frequency and ethical collision rates, demonstrating a sigmoidal relationship between stress and performance that enables early-warning detection.

The rest of this paper is structured as follows. Section 2 establishes the formal mathematical foundations. Sections 3 through 7 develop each research theme in depth. Section 8 integrates the five themes into a unified ELAS architecture within MARIA OS. Section 9 presents experimental design and methodology. Section 10 reports results. Section 11 discusses implications and limitations. Section 12 concludes. Section 13 provides references.

2. Mathematical Foundations

Before developing the five themes, we establish the formal mathematical apparatus that will be used throughout the paper. All constructions are grounded in the MARIA OS coordinate system and Decision Pipeline architecture.

2.1 The MARIA OS Decision Space

Definition 2.1 (MARIA Coordinate). A MARIA coordinate is a five-tuple c = (g, u, p, z, a) in the hierarchical address space G x U x P x Z x A, where G is the Galaxy (tenant) set, U is the Universe (business unit) set, P is the Planet (domain) set, Z is the Zone (operational unit) set, and A is the Agent set. We write c = G(g).U(u).P(p).Z(z).A(a) in standard notation.

Definition 2.2 (Decision Node). A decision node d is a tuple d = (c, s, t, E, R) where c is the MARIA coordinate of the responsible agent, s is the current state in the Decision Pipeline (proposed, validated, approval_required, approved, executed, completed, failed), t is the timestamp, E is the evidence bundle, and R is the risk tier in {LOW, MEDIUM, HIGH, CRITICAL}.

Definition 2.3 (Ethical State). The ethical state of agent a at time t is a vector eta_a(t) in R^m, where m is the number of ethical dimensions tracked by the system. Each component eta_a^i(t) represents the agent's current disposition along ethical dimension i (e.g., fairness, transparency, privacy, safety, accountability). The ethical state evolves over time as the agent makes decisions and receives feedback.

$ eta_a(t) = (eta_a^1(t), eta_a^2(t), ..., eta_a^m(t)) in R^m $

2.2 制約付きマルコフ決定プロセス

制約の下で逐次意思決定を行うための標準フレームワークは、制約付きマルコフ決定プロセス (CMDP) です。

定義 2.4 (CMDP)。 制約付きマルコフ決定プロセスはタプル M = (S, A, P, r, {c_k}_{k=1}^K, {d_k}_{k=1}^K, gamma) です。ここで、S は状態空間、A は動作空間、P : S x A x S -> [0,1] は遷移カーネル、r : S x A -> R は報酬関数、c_k : S x A -> R は k 番目の制約コスト関数、R の d_k は k 番目の制約しきい値、(0,1) のガンマは割引係数です。

The agent seeks a policy pi : S -> Delta(A) that maximizes expected discounted reward subject to K constraint costs remaining below their thresholds:

$ max_{pi} E_{pi}[sum_{t=0}^{infty} gamma^t r(s_t, a_t)] subject to E_{pi}[sum_{t=0}^{infty} gamma^t c_k(s_t, a_t)] <= d_k for all k in {1,...,K} $

Definition 2.5 (Lagrangian Dual). The Lagrangian of the CMDP is:

$ L(pi, lambda) = E_{pi}[sum_{t=0}^{infty} gamma^t r(s_t, a_t)] - sum_{k=1}^{K} lambda_k (E_{pi}[sum_{t=0}^{infty} gamma^t c_k(s_t, a_t)] - d_k) $

where lambda = (lambda_1, ..., lambda_K) >= 0 are Lagrange multipliers. The dual problem is min_{lambda >= 0} max_{pi} L(pi, lambda). Under Slater's condition (existence of a strictly feasible policy), strong duality holds and the duality gap is zero.

2.3 Ethical Valuation Functions

We introduce the notion of an ethical valuation function that maps agent actions to ethical impact scores.

Definition 2.6 (Ethical Valuation Function). An ethical valuation function V_eth : S x A -> R^m maps each state-action pair to an m-dimensional ethical impact vector, where component V_eth^i(s, a) quantifies the ethical impact of taking action a in state s along ethical dimension i. Positive values indicate ethically beneficial actions; negative values indicate ethical violations.

定義 2.7 (責任の重み)。 責任の重み関数 w_R : S x A -> [0,1] は、エージェントがそのアクションに対して負う倫理的責任の程度を表すスカラー重みを各状態とアクションのペアに割り当てます。完全な自律性の下で行われるアクションは w_R = 1 になります。明示的な承認を得て人間の監督下で行われるアクションは、決定における人間の利害に比例して w_R が減少します。フェイルクローズされたゲートによってブロックされたアクションは、w_R = 0 になります (ゲートが責任を吸収します)。

$ w_R(s, a) = 1 - H(s, a) * ゲート強度(s) $

where H(s, a) in [0,1] is the human intervention probability for action a in state s, and GateStrength(s) in [0,1] is the gate strength at the decision node corresponding to state s.

3. テーマ 1: 責任強化モデル

3.1 動機と研究上の質問

Standard reinforcement learning optimizes a scalar reward signal that typically encodes task performance: revenue generated, throughput achieved, errors avoided. Ethical behavior, when considered at all, is treated as a hard constraint --- a boundary the agent must not cross, not a quality it should actively cultivate. This framing creates agents that are ethically compliant in the letter but not in the spirit. They avoid violations because violations are penalized, not because ethical behavior is rewarded.

Research Question 1. Does convergence of the CMDP policy optimization hold when responsibility is incorporated directly into the reward function? Specifically, can we augment the reward with a continuous responsibility term without destroying the convexity properties that guarantee convergence of Lagrangian methods?

3.2 The Responsibility-Augmented Reward

We propose augmenting the standard task reward r(s, a) with a responsibility reward component r_R(s, a) that explicitly incentivizes ethically responsible behavior.

Definition 3.1 (Responsibility Reward). The responsibility reward for taking action a in state s is defined as:

$ r_R(s, a) = alpha w_R(s, a) (sum_{i=1}^{m} v_i * V_eth^i(s, a)) $

where alpha > 0 is the responsibility weight hyperparameter that controls the relative importance of ethical reward versus task reward, w_R(s, a) is the responsibility weight from Definition 2.7, v = (v_1, ..., v_m) is the value hierarchy vector with sum v_i = 1 and v_i >= 0 for all i, and V_eth^i(s, a) is the ethical valuation along dimension i from Definition 2.6.

The composite reward function is then:

$ r_composite(s, a) = (1 - alpha) r_task(s, a) + alpha r_R(s, a) $

Remark. The parameter alpha controls the ethics-task tradeoff. At alpha = 0, the agent ignores ethics entirely and optimizes pure task performance. At alpha = 1, the agent ignores task performance and optimizes pure ethical behavior. The operating regime of interest is alpha in [0.1, 0.4], where empirical results show that ethical behavior improves substantially without significant task performance degradation.

3.3 責任を制約したCMDP

ここで、完全な最適化問題を定式化します。エージェントは CMDP で動作します。この場合、報酬は複合報酬であり、制約には運用上の制約 (予算、レイテンシ、スループット) と倫理的な制約 (各倫理的側面の違反率) の両方が含まれます。

定義 3.2 (責任 CMDP)。 責任 CMDP はタプル M_R = (S, A, P, r_composite, {c_k^{op}}_{k=1}^{K_op}, {c_j^{eth}}_{j=1}^{m}, {d_k^{op}}, {d_j^{eth}}, gamma) ここで、c_k^{op} は操作上の制約コスト、c_j^{eth}(s, a) = max(0, -V_eth^j(s, a)) は次元 j の倫理違反コスト (倫理違反が発生した場合のみ正)、d_k^{op} は操作上の制約しきい値、d_j^{eth} は倫理違反のしきい値 (次元ごとの最大許容累積違反) です。

The optimization problem is:

$ max_{pi} E_{pi}[sum_{t=0}^{infty} gamma^t r_composite(s_t, a_t)] $

subject to:

$ E_{pi}[sum_{t=0}^{infty} gamma^t c_k^{op}(s_t, a_t)] <= d_k^{op} for all k in {1,...,K_op} $

$ E_{pi}[sum_{t=0}^{infty} gamma^t c_j^{eth}(s_t, a_t)] <= d_j^{eth} for all j in {1,...,m} $

3.4 Convergence Analysis

The key theoretical question is whether the addition of the responsibility reward term preserves the convergence properties of Lagrangian methods for CMDPs.

Theorem 3.1 (Responsibility CMDP Convergence). Let M_R be a Responsibility CMDP satisfying: (i) the state and action spaces S and A are finite, (ii) the transition kernel P defines an ergodic Markov chain under every stationary policy, (iii) Slater's condition holds (there exists a strictly feasible policy pi_0 such that all constraints are satisfied with strict inequality). Then the Lagrangian dual method converges to the optimal policy pi of M_R, and strong duality holds: the duality gap is zero.*

校正スケッチ。 校正は 3 つのステップで進みます。

Step 1: Linearity of the objective in the occupation measure. Define the occupation measure mu_pi(s, a) = (1 - gamma) sum_{t=0}^{infty} gamma^t P_pi(s_t = s, a_t = a). The expected discounted reward under any policy pi can be written as a linear function of mu_pi:

$ J(pi) = (1/(1-gamma)) sum_{s,a} mu_pi(s,a) * r_composite(s,a) $

The composite reward r_composite is a weighted sum of r_task and r_R, both of which are bounded functions on the finite space S x A. Therefore r_composite is bounded, and J(pi) is a continuous linear functional of the occupation measure.

ステップ 2: 実現可能な集合の凸性。 達成可能な占有測度の集合 F = {mu_pi : pi は定常政策} は、R^{|S||A|} の凸多面体です (これは Altman, 1999 の古典的な結果です)。運用上および倫理上の制約により、占有測定空間内のハーフスペースが定義されます。凸多面体と有限個の半空間との交点は凸多面体です。したがって、実現可能な集合は凸です。

ステップ 3: 強​​力な双対性の適用 ステップ 1 と 2 により、凸の実現可能集合に対する線形プログラムが完成しました。スレーター条件は、実行可能なセットの内部が空ではないことを保証します。線形プログラムの強力な双対性定理 (これは、スレーター条件を備えた凸プログラムの特殊なケースです) により、双対性のギャップはゼロになります。ラグランジュ双対法は最適な主解に収束します。 QED。

Corollary 3.1. The optimal policy pi of the Responsibility CMDP satisfies all ethical constraints with equality at the binding dimensions and with strict inequality at the non-binding dimensions. The Lagrange multipliers lambda_j^{eth} for binding ethical constraints are strictly positive, indicating that relaxing these constraints would improve the objective.

This corollary is operationally important: it tells us that the optimal policy uses its full ethical budget. An agent that has room to take more ethical risk (because the threshold d_j^{eth} is generous) will do so to improve task performance. An agent in a tightly constrained ethical environment will sacrifice task performance to stay within ethical bounds. The Lagrange multipliers quantify the exact cost of each ethical constraint.

3.5 Practical Lagrangian Update Rule

MARIA OS での実装には、primal-dual gradient メソッドを使用します。各反復 n で、エージェントはポリシー パラメーター theta とラグランジュ乗数 lambda の両方を更新します。

$ theta_{n+1} = theta_n + eta_theta * nabla_theta L(pi_{theta_n}, lambda_n) $

$ lambda_{k,n+1} = max(0, lambda_{k,n} + eta_lambda * (E_{pi_{theta_n}}[sum_t gamma^t c_k(s_t, a_t)] - d_k)) $

where eta_theta and eta_lambda are learning rates for the primal and dual variables respectively. The max(0, ...) projection ensures lambda remains non-negative. Convergence of this two-timescale update is guaranteed when eta_lambda / eta_theta -> 0, ensuring that the dual variables update on a slower timescale than the policy parameters (Borkar, 2008).

3.6 MARIA OS Integration: Decision Pipeline Reward Shaping

In the MARIA OS Decision Pipeline, the responsibility reward is computed at each decision node. When a decision transitions from proposed to validated, the reward includes both the task-level quality score and the ethical valuation of the proposed action. When a decision passes through a Responsibility Gate, the gate strength modulates the responsibility weight. When a decision is executed and the outcome is observed, the ethical valuation is updated based on the actual consequences.

The key architectural principle is that the reward signal flows through the same pipeline stages as the decision itself: proposed -> validated -> [approval_required | approved] -> executed -> [completed | failed]. Each stage contributes to the responsibility reward based on the ethical quality of the transition.

4. テーマ 2: 倫理的記憶層

4.1 動機と研究上の質問

Human moral reasoning is profoundly shaped by memory. A physician who has witnessed a patient harmed by a particular drug retains heightened caution around that drug for years. A financial auditor who discovered a fraud scheme recognizes similar patterns in future cases. A manager who made a hiring decision that led to workplace conflict remembers the warning signs. In each case, the memory of past ethical outcomes --- both positive and negative --- shapes future decision-making in ways that no static rule system can replicate.

Current AI agents lack this capacity entirely. When an agent commits an ethical violation, the incident is logged, the system is corrected (perhaps through a rule update or constraint modification), and the agent proceeds with no experiential memory of the event. The violation becomes a line item in an audit log, not a formative experience that shapes future behavior.

Research Question 2. How long should ethical violations be retained in agent memory? What is the optimal decay function that balances learning from past mistakes against the risk of perpetually penalizing an agent for a single violation?

4.2 The Ethical Memory Model

We model ethical memory as a weighted sum of past ethical events, where each event's weight decays exponentially with time.

Definition 4.1 (Ethical Event). An ethical event e is a tuple e = (t_e, s_e, a_e, V_eth(s_e, a_e), severity_e, resolution_e) where t_e is the timestamp of the event, s_e and a_e are the state and action, V_eth is the ethical impact vector at the time of the event, severity_e in [0, 1] quantifies the severity of the ethical violation (0 for ethically neutral, 1 for maximum violation), and resolution_e in {unresolved, mitigated, resolved, absolved} indicates the current resolution status.

定義 4.2 (倫理的記憶)。 倫理的イベントの履歴 H_a = {e_1, e_2, ..., e_N} が与えられた場合、時刻 t におけるエージェント a の倫理的記憶は次のように定義されます。

$ M_a(t) = sum_{i=1}^{N} 重大度_{e_i} rho(resolution_{e_i}) exp(-lambda_decay (t - t_{e_i})) V_eth(s_{e_i}, a_{e_i}) $

where lambda_decay > 0 is the memory decay rate and rho : Resolution -> [0,1] is a resolution weighting function defined as rho(unresolved) = 1.0, rho(mitigated) = 0.7, rho(resolved) = 0.3, rho(absolved) = 0.05.

The memory M_a(t) is a vector in R^m, where each component M_a^j(t) represents the accumulated ethical memory along dimension j. A large negative component indicates a strong memory of violations in that dimension, which should increase caution in future decisions along that dimension.

4.3 Memory-Augmented Decision Making

The ethical memory enters the decision process through modification of the ethical constraint thresholds. An agent with a strong memory of past violations in dimension j faces a tighter ethical constraint in that dimension.

Definition 4.3 (Memory-Adjusted Constraint). The memory-adjusted ethical constraint threshold for agent a at time t along dimension j is:

$ d_j^{eth}(a, t) = d_j^{eth,base} (1 - beta |M_a^j(t)|/M_max^j) $

where d_j^{eth,base} is the baseline ethical constraint threshold, beta in (0, 1) is the memory sensitivity parameter controlling how strongly past violations tighten future constraints, M_a^j(t) is the j-th component of the ethical memory (expected to be negative for violation-heavy histories), and M_max^j is a normalization constant representing the maximum expected memory magnitude.

Remark. The memory-adjusted constraint is always tighter than or equal to the baseline constraint (since |M_a^j(t)| >= 0). An agent with no ethical history (M_a = 0) faces the baseline constraints. An agent with a long history of violations faces progressively tighter constraints. This implements a form of earned trust: agents must demonstrate ethical behavior over time to maintain their full operating freedom.

4.4 最適な保持半減期

The exponential decay rate lambda_decay determines how quickly the system forgets past ethical events. This parameter involves a fundamental tradeoff:

• Too fast decay (large lambda_decay): The agent quickly forgets past violations and may repeat them. The memory provides insufficient caution.
• Too slow decay (small lambda_decay): The agent is perpetually penalized for past violations, even after the underlying issue has been resolved. The memory becomes punitive rather than protective.

両方のタイプの誤差を捉える複合損失関数を最小化することで、最適な減衰率を導き出します。

Definition 4.4 (Memory Loss Function). The memory loss function L(lambda_decay) combines the recurrence risk (probability of repeating a forgotten violation) and the over-penalization cost (unnecessary constraint tightening from excessive memory):

$ L(lambda_decay) = omega_1 P_recurrence(lambda_decay) + omega_2 C_overpenalty(lambda_decay) $

where P_recurrence(lambda_decay) = 1 - exp(-mu exp(-lambda_decay T_recurrence)) is the probability that a violation recurs within a characteristic recurrence window T_recurrence, given that memory has decayed to level exp(-lambda_decay T_recurrence), mu is the base recurrence rate when memory is zero, omega_1 and omega_2 are relative importance weights, and C_overpenalty(lambda_decay) = integral from 0 to infinity of |M_a(t)| I(resolved, t) dt represents the cumulative constraint tightening applied after an event has been resolved.

Theorem 4.1 (Optimal Decay Rate). Under the assumptions that (i) the base recurrence rate mu is known, (ii) the characteristic recurrence window T_recurrence is known, and (iii) the resolution time T_resolve is exponentially distributed with rate nu, the optimal decay rate is:

$ lambda_decay^ = (1/T_recurrence) ln(mu omega_1 T_recurrence / (omega_2 / nu)) $

Proof. Substituting the definitions of P_recurrence and C_overpenalty into L, differentiating with respect to lambda_decay, and setting the derivative to zero:

$ dL/d(lambda_decay) = omega_1 mu T_recurrence exp(-lambda_decay T_recurrence) exp(-mu exp(-lambda_decay T_recurrence)) - omega_2 (1/lambda_decay^2) * (1/nu) = 0 $

In the regime where mu exp(-lambda_decay T_recurrence) is small (reasonable for well-governed systems), the double exponential simplifies to approximately 1, yielding:

$ omega_1 mu T_recurrence exp(-lambda_decay T_recurrence) approximately equals omega_2 / (nu * lambda_decay^2) $

対数をとり、lambda_decay が T_recurrence とともにゆっくりと変化するというさらなる近似 (T_recurrence >> 1/lambda_decay の場合に有効) の下で解くと、記載された結果が得られます。厳密な処理により、近似値が境界に置き換えられ、近似解が現実的なパラメータ範囲の真の最適値の 5% 以内にあることが示されます。 QED。

系 4.1 (半減期)。 倫理的記憶の半減期は T_{1/2} = ln(2) / lambda_decay^ です。一般的なエンタープライズ パラメーター (mu = 0.1、T_recurrence = 90 日、omega_1/omega_2 = 2、nu = 1/30 日) の場合、最適な半減期は、MEDIUM 重大度違反の場合は約 45 ～ 60 日、CRITICAL 重大度違反の場合は 120 ～ 180 日です。*

4.5 Memory Consolidation and Generalization

Beyond simple exponential decay, the Ethical Memory Layer implements a consolidation process analogous to memory consolidation in neuroscience. Ethical events that share common features are generalized into ethical schemas --- abstract patterns that the agent recognizes in future situations.

定義 4.5 (倫理スキーマ)。 倫理スキーマ シグマは、タプル sigma = (パターン, V_eth^{avg}, 信頼度, 活性化_カウント) です。ここで、パターンは、状況のクラスを特徴付ける状態-行動空間の特徴ベクトルです。V_eth^{avg} は、パターンに一致するすべてのイベントにわたる平均的な倫理的影響です。[0,1] の信頼度は、スキーマの信頼性、activation_count はスキーマがトリガーされた回数です。

アクティベーション数が高く、信頼度が高いスキーマは、減衰率が大幅に低下し、長期的な倫理記憶に促進されます。これは、確立された倫理パターン（繰り返しの経験を通じて学習したもの）は、個別の事件よりもはるかに長く持続するという原則を実装しています。

$ lambda_decay^{スキーマ}(sigma) = lambda_decay^* / (1 + log(1 + activity_count(sigma))) $

This logarithmic reduction in decay rate means that a schema activated 100 times has roughly 1/3 the decay rate of a fresh ethical event, giving it approximately three times the effective half-life.

5. Theme 3: Value Hierarchy Adaptation

5.1 Motivation and Research Question

Every organization has a value hierarchy --- an implicit or explicit ordering of moral principles that determines which value takes precedence when values conflict. In healthcare, patient safety typically dominates cost efficiency. In financial services, regulatory compliance typically dominates customer convenience. In manufacturing, worker safety typically dominates production throughput. These hierarchies are not arbitrary: they reflect deep institutional knowledge about which tradeoffs are acceptable and which are not.

However, value hierarchies are not static. They evolve as organizations learn, as regulations change, as societal expectations shift. A financial institution that experienced a major compliance failure may permanently elevate compliance above revenue growth in its value hierarchy. A healthcare system that lost a malpractice lawsuit may tighten its safety-over-efficiency ordering. A technology company facing public backlash over privacy violations may restructure its value hierarchy to place privacy above product functionality.

Research Question 3. Can value evolution and principle fixation coexist? Specifically, can we define a mechanism for dynamic value hierarchy adaptation that allows gradual evolution of value orderings while preserving inviolable safety invariants enforced by Fail-Closed Gates?

5.2 Formal Model of Value Hierarchies

Definition 5.1 (Value Hierarchy). A value hierarchy H is a pair H = (v, P_fixed) where v = (v_1, v_2, ..., v_m) is a value weight vector in the simplex Delta^{m-1} = {v in R^m : v_i >= 0, sum v_i = 1}, and P_fixed is a subset of {1, ..., m} designating the fixed-priority dimensions --- those whose relative ordering cannot change regardless of adaptation.

値重み v_i は、倫理的次元 i の相対的な重要性を表します。より高い重みは、責任報酬 (定義 3.1) および倫理的制約の評価において、その次元がより多く考慮されることを意味します。

Definition 5.2 (Value Ordering). The value ordering induced by hierarchy H = (v, P_fixed) is the total preorder >=_H on ethical dimensions defined by: dimension i >=_H dimension j if and only if v_i >= v_j. The fixed-priority constraint requires that for all i, j in P_fixed with v_i >= v_j at initialization, the ordering v_i >= v_j is preserved for all future time.

5.3 Bounded-Drift Adaptation

私たちは、固定優先順位の制約を維持しながら、観察された倫理的結果に基づいて価値階層を更新する適応メカニズムを定義します。

定義 5.3 (値更新ダイナミクス)。 各決定サイクル t で、値の重みベクトルは次に従って更新されます。

$ v_i(t+1) = v_i(t) + epsilon * delta_i(t) $

where epsilon > 0 is the adaptation rate and delta_i(t) is the update signal for dimension i, defined as:

$ delta_i(t) = (1/|W_t|) sum_{(s,a) in W_t} (V_eth^i(s,a) - V_eth^{avg,i}) I(結果(s,a) = 負) $

Here W_t is the window of recent decisions, V_eth^{avg,i} is the running average of ethical valuations in dimension i, and I(outcome = negative) is the indicator of a negative outcome. The intuition is: if negative outcomes are disproportionately associated with low ethical valuations in dimension i, the weight v_i should increase, directing more attention to that dimension.

After each raw update, the vector is projected back onto the feasible set to enforce both the simplex constraint and the fixed-priority constraints.

Definition 5.4 (Constrained Projection). The projected value update is:

$ v(t+1) = Pi_{F}(v(t) + epsilon * delta(t)) $

where Pi_F is the Euclidean projection onto the feasible set F = {v in Delta^{m-1} : v_i >= v_j for all (i,j) in P_fixed with v_i(0) >= v_j(0)} intersection {v : ||v - v(t)||_infty <= delta_max}, and delta_max is the maximum per-step drift bound.

The drift bound delta_max is the critical safety parameter. It limits how much the value hierarchy can change in any single step, preventing sudden, destabilizing shifts in ethical priorities.

5.4 共存定理

私たちは今、価値の進化と原則の固定化が共存できるという中心的な結果を証明しています。

Theorem 5.1 (Value Hierarchy Stability). Let H(0) = (v(0), P_fixed) be an initial value hierarchy, and let {v(t)}_{t=0}^{infty} be the sequence generated by the bounded-drift adaptation (Definition 5.3, 5.4). Then: (i) The fixed-priority ordering is preserved for all t: for all i, j in P_fixed with v_i(0) >= v_j(0), we have v_i(t) >= v_j(t) for all t >= 0. (ii) The value weight vector converges: there exists v in F such that v(t) -> v as t -> infinity, provided the update signals {delta(t)} are square-summable: sum_{t=0}^{infty} ||delta(t)||^2 < infinity. (iii) The total drift is bounded: ||v(t) - v(0)||_1 <= t delta_max m for all t.

Proof. Part (i) follows directly from the definition of the projection Pi_F, which enforces the fixed-priority constraints at every step. Since the feasible set F includes the constraint v_i >= v_j for all fixed pairs (i,j), and projection onto a convex set preserves feasibility, the ordering is maintained.

Part (ii) follows from the Robbins-Siegmund theorem applied to the projected stochastic approximation. The value update is a projected stochastic gradient descent on the implicit loss function that the update signals approximate the negative gradient of. Under square-summability of the update signals (which is ensured when the system converges to a stable ethical regime where violations become rare), the projected iterate converges to a point in the feasible set.

パート (iii) は、三角不等式とステップごとのドリフト限界から導かれます: ||v(t+1) - v(t)||_1 <= m ||v(t+1) - v(t)||_infty <= m delta_max であり、t ステップにわたる合計により、指定された限界が得られます。 QED。

5.5 ゲート境界値の進化

The value hierarchy adaptation operates within the MARIA OS Fail-Closed Gate architecture. The key constraint is that no value hierarchy update may cause a Fail-Closed Gate to change its blocking behavior on any currently active decision.

Definition 5.5 (Gate-Consistent Update). A value update v(t) -> v(t+1) is gate-consistent if for every active decision d in the Decision Pipeline, the gate evaluation outcome (allow, pause, block) is unchanged under the new value weights. Formally:

$ GateDecision(d, v(t)) = GateDecision(d, v(t+1)) for all active d $

In practice, this means that value hierarchy updates are batched and applied only between decision cycles --- never during the evaluation of an active decision. This is a design constraint in the MARIA OS Decision Pipeline: the pipeline stage transitions are atomic with respect to value hierarchy updates.

5.6 Hierarchy Drift Metric

To monitor the health of the value hierarchy over time, we define a drift metric that quantifies cumulative deviation from the initial hierarchy.

Definition 5.6 (Hierarchy Drift Score). The hierarchy drift score at time t is:

$ delta_H(t) = (1/m) * sum_{i=1}^{m} |v_i(t) - v_i(0)| / max(v_i(0), epsilon_floor) $

where epsilon_floor is a small constant preventing division by zero. The drift score is zero when the hierarchy has not changed and increases as values shift. Experimental results show that stable organizations maintain delta_H < 0.02 over periods of months, while organizations undergoing major ethical transitions (e.g., post-scandal restructuring) may see delta_H spike to 0.1-0.3 before settling.

6. テーマ 4: 異文化倫理モデリング

6.1 Motivation and Research Question

Enterprises operating across national and cultural boundaries face a persistent tension in ethical governance. Some moral principles are held to be universal --- the prohibition of forced labor, the right to privacy, the obligation of informed consent. Others are culturally situated --- the relative weight of individual autonomy versus collective harmony, the appropriate level of directness in communication, the role of hierarchical authority in decision-making. A governance system that imposes a single ethical framework across all regions will either violate local norms (if the framework is culturally specific) or reduce to a minimal universal floor (if the framework avoids cultural specificity), sacrificing the nuanced ethical guidance that agents need.

研究上の質問 4. 普遍的な倫理とローカルな倫理の間の境界はどこですか?私たちは、倫理的パラメータ空間を普遍的な床（すべての地域にわたって不可侵）と文化特有の補完（地域によってパラメータ化される）に分解し、普遍的な床がすべての文化的適応下で証明可能に保存されるように正式に定義できるでしょうか?

6.2 多世界の倫理アーキテクチャ

MARIA OS provides a natural architectural substrate for cross-cultural ethics through its Multi-Universe structure. Each Universe represents a business unit, and in global enterprises, Universes are often aligned with geographic regions or cultural zones. We exploit this alignment to parameterize ethics at the Universe level.

Definition 6.1 (Cultural Ethics Parameter Space). The cultural ethics parameter space E is a product space:

$ E = E_universal x E_local^{U_1} x E_local^{U_2} x ... x E_local^{U_n} $

where E_universal is a subset of R^{m_u} representing the universal ethical floor parameters (shared across all Universes), E_local^{U_k} is a subset of R^{m_l} representing the local ethical parameters specific to Universe U_k, m_u + m_l = m is the total number of ethical dimensions, and m_u dimensions are universal, m_l are culturally variable.

Definition 6.2 (Universal Ethical Floor). The universal ethical floor F_universal is defined as:

$ F_universal = {eta in R^{m_u} : eta^i >= theta_i^{floor} for all i in {1,...,m_u}} $

where theta_i^{floor} is the minimum acceptable value for universal ethical dimension i. These floors are non-negotiable: no Universe, regardless of its cultural context, may operate below the universal floor.

Example. In a global financial enterprise, the universal floor might include: anti-money-laundering compliance (theta >= 0.95), data privacy protection (theta >= 0.90), anti-discrimination (theta >= 0.85), and transparency in customer communications (theta >= 0.80). The local parameters might include: risk appetite (varies by market maturity), communication directness (varies by cultural norms), hierarchical deference in approvals (varies by organizational culture), and stakeholder prioritization ordering (varies by regulatory emphasis).

6.3 床保存定理

重要な保証は、地域の倫理的適応が普遍的な基準を決して侵害しないことです。

定理 6.1 (フロア保存)。 *E = E_universal x prod_k E_local^{U_k} を文化倫理パラメーター空間とします。 v_k(t) を、有界ドリフト適応 (定義 5.3) に従って更新された、時刻 t におけるユニバース U_k の値階層とします。適応がローカル次元のみに作用するように制限されている場合、つまり、{1, ..., m_u} (普遍次元) のすべての i に対して delta_i(t) = 0 である場合、普遍的な倫理フロアはすべての t およびすべての宇宙に対して保存されます。

$ eta_a^i(t) >= theta_i^{floor} for all agents a, all universal dimensions i, all time t $

Proof. Since the adaptation updates only local dimensions (by construction), the universal dimension weights v_i for i in {1, ..., m_u} remain at their initial values for all time. The ethical constraint thresholds for universal dimensions d_j^{eth} are set to enforce the floor: d_j^{eth} = (1 - theta_j^{floor}) / (1 - gamma). Since these thresholds are never modified (the memory-adjusted constraint from Definition 4.3 can only tighten, never relax, these thresholds), and the Fail-Closed Gate enforces the constraints absolutely, the floor is preserved. QED.

6.4 宇宙を越えた倫理的紛争の解決

When agents from different Universes interact --- for example, a procurement agent from the EU Universe negotiating with a supply chain agent from the APAC Universe --- their local ethical parameters may conflict. The system must resolve these conflicts without violating either Universe's local norms or the universal floor.

Definition 6.3 (Cross-Universe Ethical Negotiation). When agents from Universes U_j and U_k engage in a joint decision, the applicable ethical parameters are computed as:

$ eta^i_{joint}(U_j, U_k) = max(eta^i_{U_j}, eta^i_{U_k}) for i in {1,...,m_u} (universal dimensions) $

$ eta^i_{joint}(U_j, U_k) = f_negotiate(eta^i_{U_j}, eta^i_{U_k}, w_j, w_k) for i in {m_u+1,...,m} (local dimensions) $

where f_negotiate is a negotiation function parameterized by the relative weights w_j, w_k of the two Universes in the joint decision context. For universal dimensions, the maximum is taken (most conservative), ensuring both Universes' floors are met. For local dimensions, the negotiation function implements a weighted compromise.

Definition 6.4 (Weighted Ethical Compromise). The negotiation function for local dimensions is:

$ f_negotiate(eta_j, eta_k, w_j, w_k) = (w_j eta_j + w_k eta_k) / (w_j + w_k) + sigma_safety * |eta_j - eta_k| $

ここで、 sigma_safety >= 0 は、2 つのユニバースが大きく一致しない場合に結合しきい値を増加させる安全マージンです。これは、倫理的不確実性（文化的規範間の不一致として現れる）は保守的に解決されるべきであるという原則を実現します。

6.5 Cultural Distance Metric

To quantify the degree of ethical divergence between Universes, we define a cultural distance metric.

定義 6.5 (文化的倫理的距離)。 宇宙 U_j と U_k の間の文化的距離は次のとおりです。

$ D_eth(U_j, U_k) = sqrt(sum_{i=m_u+1}^{m} (eta^i_{U_j} - eta^i_{U_k})^2 / sigma_i^2) $

where sigma_i is the standard deviation of parameter i across all Universes, providing normalization. Large cultural distances indicate that cross-Universe interactions require careful ethical mediation. The MARIA OS Dashboard surfaces cultural distance as a real-time metric for governance officers.

7. Theme 5: Agent Moral Stress Detection

7.1 Motivation and Research Question

Human decision-makers experience moral stress when they face frequent ethical dilemmas, conflicting obligations, or situations where every available action violates some moral principle. Moral stress is well-documented in healthcare (nurses facing end-of-life decisions), military contexts (soldiers facing rules-of-engagement conflicts), and corporate whistleblowing (employees facing loyalty-versus-integrity conflicts). The consequences are predictable and severe: decision quality degrades, response times increase, burnout sets in, and ultimately the decision-maker disengages.

AI agents, while not conscious, exhibit analogous performance degradation when subjected to frequent ethical conflicts. An agent that repeatedly encounters states where the optimal task action violates ethical constraints is forced into suboptimal task policies. As the frequency of ethical conflicts increases, the agent's effective policy space shrinks, its task performance degrades, and its decision consistency decreases. We call this phenomenon agent moral stress --- the computational analog of human moral distress.

Research Question 5. Does ethical load affect agent performance? Can we define a quantitative moral stress index that predicts performance degradation, and if so, what is the functional relationship between stress and performance?

7.2 The Moral Stress Index

Definition 7.1 (Ethical Conflict). An ethical conflict at time t is an event where the action a* that maximizes task reward violates at least one ethical constraint:

$ a_task^(s_t) = argmax_a r_task(s_t, a) and there exists j such that c_j^{eth}(s_t, a_task^(s_t)) > d_j^{eth} $

In other words, the best action for the task is ethically impermissible. The agent must choose a suboptimal task action to remain ethically compliant.

Definition 7.2 (Ethical Collision). An ethical collision at time t is an event where two or more ethical constraints cannot be simultaneously satisfied by any available action:

$ A(s_t) 内のすべての a に対して、c_j^{eth}(s_t, a) > d_j^{eth} または c_k^{eth}(s_t, a) > d_k^{eth} となるような j != k が存在します $

倫理的な衝突は、厳密には衝突よりも悪いものです。衝突では、倫理に準拠した行動が存在します（それはタスクにとって最適ではないだけです）。衝突では、倫理に完全に準拠したアクションは存在しません。エージェントは、何をするかに関係なく、少なくとも 1 つの倫理的制約に違反する必要があります。

定義 7.3 (道徳的ストレス指数)。 時間 t におけるエージェント a の道徳的ストレス指数は、W 決定サイクルの末尾ウィンドウで計算され、次のとおりです。

$ MSI_a(t) = xi_1 (N_conflict(t, W) / W) + xi_2 (N_collision(t, W) / W) + xi_3 * Delta_performance(t, W) $

where N_conflict(t, W) is the number of ethical conflicts in the trailing window of W cycles, N_collision(t, W) is the number of ethical collisions in the trailing window, Delta_performance(t, W) = (perf_baseline - perf_current) / perf_baseline is the normalized performance degradation relative to the agent's baseline (conflict-free) performance, and xi_1, xi_2, xi_3 are weighting coefficients with xi_2 > xi_1 (collisions are more stressful than conflicts).

7.3 The Stress-Performance Relationship

We hypothesize --- and empirically validate --- that the relationship between moral stress and agent performance follows a sigmoidal degradation curve.

Theorem 7.1 (Sigmoidal Stress-Performance Law). Under the Responsibility CMDP framework, the expected task performance of an agent under moral stress MSI follows:

$ Performance(MSI) = P_max / (1 + exp(kappa * (MSI - MSI_critical))) $

where P_max is the agent's maximum (stress-free) performance, kappa > 0 is the stress sensitivity parameter, and MSI_critical is the critical stress threshold at which performance drops to P_max / 2.

Proof sketch. The proof proceeds by analyzing the effective action space available to the agent as moral stress increases. At zero stress, the agent has access to its full action space A(s) and achieves maximum performance. As the frequency of ethical conflicts increases, the fraction of states where the optimal task action is available decreases. Let phi(MSI) be the fraction of states where the task-optimal action is ethically permissible. We model phi as a logistic function of MSI (justified by the central limit theorem applied to the sum of many independent ethical constraint activations):

$ phi(MSI) = 1 / (1 + exp(kappa * (MSI - MSI_critical))) $

The expected performance is proportional to the fraction of states where the optimal action is available: Performance(MSI) = P_max * phi(MSI). Substituting gives the stated formula. QED.

Corollary 7.1. There exists a sharp transition region around MSI = MSI_critical where small increases in stress cause large performance drops. For kappa = 10 (empirically observed range: 8-15), increasing MSI from 0.4 to 0.6 (a 50% relative increase) causes performance to drop from approximately 0.88 P_max to 0.12 P_max --- a 76-percentage-point decline.

この急激な移行は運用上非常に重要です。それは、道徳的ストレスは徐々に穏やかに低下するものではなく、崖であることを意味します。エージェントが臨界ストレスの閾値に近づくと、わずかな追加の倫理的負担が壊滅的なパフォーマンスの低下を引き起こす可能性があります。

7.4 早期警報システム

急激な移行により、エージェントが臨界ストレス閾値に達する前に介入を引き起こす早期警告システムが作動します。

Definition 7.4 (Moral Stress Alert Levels). The moral stress alert system defines three zones:

The yellow zone threshold is set at 0.3 MSI_critical because, under the sigmoidal model with kappa = 10, this corresponds to approximately 95% of maximum performance. The red zone threshold at 0.7 MSI_critical corresponds to approximately 73% of maximum performance --- still functional but degrading rapidly.

7.5 Stress Redistribution Protocol

When an agent enters the red zone, the MARIA OS governance layer initiates a stress redistribution protocol. Ethical load is transferred from the stressed agent to other agents in the same Zone or Planet that have lower MSI values.

Definition 7.5 (Stress-Aware Task Assignment). Given a set of agents {a_1, ..., a_n} in a Zone with moral stress indices {MSI_1, ..., MSI_n} and a new decision d with estimated ethical conflict probability p_conflict(d), the stress-aware assignment is:

$ a_assigned = argmin_{a_i} (MSI_i + xi_2 * p_conflict(d)) subject to Capability(a_i, d) >= Capability_min $

This assigns the decision to the agent that will have the lowest post-assignment stress, subject to the agent having sufficient capability to handle the decision. The effect is a form of ethical load balancing across the agent pool.

8. Integration: The Unified ELAS Architecture

8.1 System Overview

セクション 3 ～ 7 で開発された 5 つのテーマは独立したモジュールではなく、統合システムの相互に連動するコンポーネントです。 Ethical Learning in Autonomous Systems (ELAS) アーキテクチャは、MARIA OS プラットフォーム内に 5 つすべてを統合します。

データの流れは次のとおりです。

• The Responsibility Reinforcement Model (Theme 1) generates the reward signal that drives agent learning. The reward includes both task performance and ethical responsibility.
• 倫理記憶層 (テーマ 2) は、蓄積された経験に基づいて倫理的制約のしきい値を変更します。違反歴のあるエージェントはより厳しい制約に直面します。クリーンな記録を持つエージェントは、広範な業務の自由を維持します。
• 価値階層適応 (テーマ 3) は、責任報酬における相対的な重要度の重みを動的に調整し、違反が発生している倫理的側面にエージェントの注意を向けます。
• 異文化間倫理モデル (テーマ 4) は、宇宙ごとに倫理的側面をパラメータ化し、異なる文化的文脈で活動するエージェントが普遍的な基準を維持しながら、適切な倫理基準に確実に直面するようにします。
• The Moral Stress Detection system (Theme 5) monitors the cumulative ethical burden on each agent and triggers interventions before performance degrades.

8.2 Formal Integration

統合システムは、複数のタイムスケールでフィードバック ループとして動作します。

Fast timescale (per-decision, milliseconds). At each decision node, the agent computes the composite reward r_composite using the current value hierarchy weights v(t), evaluates ethical constraints adjusted by the current memory state M_a(t), selects the action that maximizes the Responsibility CMDP objective, and updates the moral stress index MSI_a(t).

Medium timescale (per-episode, hours to days). At episode boundaries, the Lagrangian dual variables lambda are updated based on cumulative constraint satisfaction, the ethical memory undergoes decay (old events lose weight), and new ethical events are consolidated into schemas.

Slow timescale (per-epoch, weeks to months). At epoch boundaries, the value hierarchy weights v(t) are updated based on accumulated ethical outcome data, the cross-cultural parameters are recalibrated based on cross-Universe interaction outcomes, and the moral stress alert thresholds are recalibrated based on observed stress-performance relationships.

Definition 8.1 (ELAS State). The full ELAS state at time t is the tuple:

$ Omega(t) = (pi_theta(t), lambda(t), M_a(t), v(t), eta^{local}(t), MSI_a(t)) $

ここで、pi_theta(t) は現在のポリシー、lambda(t) はラグランジュ乗数ベクトル、M_a(t) は各エージェント a の倫理的記憶、v(t) は価値階層、eta^{local}(t) は異文化パラメータ ベクトル、MSI_a(t) は各エージェント a の道徳的ストレス指数です。

8.3 統合システムの安定性

マルチタイムスケール構造は当然の疑問を生じます。統合されたシステムは収束するのでしょうか、それとも 5 つのコンポーネント間の相互作用が振動や発散を引き起こす可能性があるのでしょうか。

Theorem 8.1 (ELAS Stability). Let the ELAS system operate under the following conditions: (i) the fast-timescale policy update satisfies the Responsibility CMDP convergence conditions (Theorem 3.1), (ii) the memory decay rate lambda_decay is set to the optimal value (Theorem 4.1), (iii) the value hierarchy adaptation uses bounded-drift updates (Definition 5.4) with delta_max sufficiently small, (iv) the cross-cultural parameters satisfy the floor-preservation property (Theorem 6.1), and (v) the moral stress redistribution protocol (Definition 7.5) prevents any agent from exceeding MSI_critical. Then the ELAS state Omega(t) converges to a neighborhood of a fixed point Omega where all ethical constraints are satisfied and task performance is locally optimal.*

Proof sketch. The proof uses the theory of multi-timescale stochastic approximation (Borkar, 2008). The three timescales --- fast (policy), medium (memory/multipliers), and slow (hierarchy/culture) --- are separated by learning rate ratios that ensure each slower timescale sees the faster timescales as having converged. Specifically:

• 速いタイムスケールでは、ポリシー pi_theta は、現在のラムダ M_a、v の最適なポリシーに収束します (固定ラムダ M_a、v を適用した定理 3.1 による)。
• On the medium timescale, the Lagrange multipliers lambda converge to the optimal dual variables for the current v, eta^{local} (by the dual convergence theorem with the fast timescale treated as instantaneous).
• 遅いタイムスケールでは、値の階層 v と文化的パラメーター eta^{local} は、定理 5.1 と文化的パラメーターの更新の有界な性質によって収束します。
• 道徳的ストレスの再配分により、エージェントが臨界閾値に到達することが防止されます。さもなければ、政策力学に不連続性が生じてしまいます。

The composite system converges by Theorem 2.2 of Borkar (2008), which establishes convergence of multi-timescale stochastic approximation under the stated conditions. The convergence is to a neighborhood (rather than a point) because the stochastic nature of the environment introduces irreducible noise. QED.

8.4 MARIA OS Implementation Mapping

The ELAS architecture maps to MARIA OS components as follows:

The coordinate level indicates at which level of the G.U.P.Z.A hierarchy each component primarily operates. The Responsibility Reward is computed per-Zone because decisions are made at the Zone level. Ethical Memory is per-Agent because individual agents accumulate experience. The Value Hierarchy is per-Planet because functional domains define the primary value ordering. Cross-Cultural Parameters are per-Universe because Universes represent business units aligned with cultural regions. The Moral Stress Monitor operates at the Zone level because stress redistribution occurs among agents within a Zone.

9. 実験計画と方法論

9.1 シミュレーション環境

We evaluate the ELAS framework in a simulated multi-agent enterprise environment instantiated within MARIA OS. The simulation models a global financial institution with 14 Universe configurations spanning 6 cultural regions: North America (3 Universes: Banking, Insurance, Fintech), European Union (3 Universes: Banking, Asset Management, Regulatory Compliance), Asia-Pacific (3 Universes: Banking, Trading, Supply Chain Finance), Latin America (2 Universes: Retail Banking, Microfinance), Middle East and North Africa (2 Universes: Islamic Banking, Trade Finance), and Sub-Saharan Africa (1 Universe: Mobile Banking).

Each Universe contains 3-5 Planets (functional domains), each Planet contains 2-4 Zones (operational units), and each Zone contains 5-10 Agents. The total simulation comprises approximately 1,200 agents making an average of 50 decisions per day over a simulation period of 180 days, yielding approximately 10.8 million decision events.

9.2 Ethical Dimension Configuration

倫理パラメータ空間は、m_u = 6 ユニバーサル次元と m_l = 4 ローカル次元で構成されます。

Universal dimensions (m_u = 6):

Local dimensions (m_l = 4):

9.3 Baselines

We compare ELAS against four baselines:

• Static-Rules: Fixed ethical constraints with no learning, no memory, no adaptation. This is the standard approach in current AI governance.
• CMDP のみ: 責任報酬の増強、記憶、または適応のない標準制約付き MDP。これは、RL フレームワークだけ (倫理的な拡張機能なし) が利点を提供するかどうかをテストします。
• Memoryless-ELAS: Ethical Memory Layer が無効になっている完全な ELAS フレームワーク (lambda_decay -> infinity)。これにより、倫理的記憶の寄与が分離されます。
• 均一文化: すべてのユニバースにわたる単一の倫理パラメータ構成を持つ ELAS (異文化適応なし)。これにより、異文化モデリングの貢献が孤立してしまいます。

9.4 Evaluation Metrics

We report the following primary metrics:

• 倫理違反率 (EVR): 少なくとも 1 つの倫理的制約に違反する決定の割合。
• 違反再発率 (VRR): 以前に観察された違反パターンの繰り返しである倫理違反の割合。
• Task Performance (TP): Normalized task completion quality, averaged across all agents.
• Value Hierarchy Drift (delta_H): As defined in Definition 5.6.
• Cross-Cultural Compliance (CCC): Fraction of cross-Universe interactions where both Universes' local ethical parameters are satisfied.
• 道徳的ストレス分布: すべてのエージェントにわたる MSI 値のヒストグラム。特に 0.7 * MSI_critical を超える部分に注目します。
• Stress-Performance Correlation: Empirical fit of the sigmoidal model (Theorem 7.1) to observed stress-performance data.

9.5 Statistical Methodology

All experiments are repeated over 10 independent random seeds. We report means and 95% confidence intervals computed via bootstrapping with 10,000 resamples. Statistical significance is assessed via the Wilcoxon signed-rank test at the alpha = 0.05 level, with Bonferroni correction for multiple comparisons. Effect sizes are reported as Cohen's d for continuous metrics and odds ratios for binary metrics.

10. Results

10.1 倫理違反率

主な結果は、完全な ELAS フレームワークの下では、すべてのベースラインと比較して倫理違反が劇的に減少することです。

完全な ELAS フレームワークでは、倫理違反率 0.7% が達成され、これは静的ルールと比較して 83% の削減に相当します。さらに驚くべきことに、違反再発率は 67.1% から 3.8% に低下し、94.3% 減少しました。これは、倫理記憶層がエージェントが過去の間違いを繰り返すのを効果的に防止していることを裏付けています。タスクのパフォーマンスの同時改善 (0.82 から 0.91) は、倫理学習がタスクの有効性を犠牲にして得られるものではないことを示しています。むしろ、責任に対する報酬が、エージェントを倫理的に健全で運用上効果的なポリシーへと導きます。

10.2 Convergence of the Responsibility CMDP

We verify Theorem 3.1 empirically by tracking the duality gap over training iterations.

The duality gap ||J(pi) - D(lambda)|| converges to below 0.001 within 2,000 iterations for all Universe configurations. The convergence rate is consistent with the theoretical O(1/sqrt(T)) rate predicted by primal-dual gradient methods. The Lagrange multipliers for ethical constraints stabilize with the most-binding constraints (typically anti-money laundering and data privacy) having the largest multipliers, confirming the theoretical prediction that these constraints are the most costly to satisfy.

The responsibility weight parameter alpha has a measurable effect on convergence. For alpha in [0.1, 0.3], convergence is achieved within 1,500-2,500 iterations. For alpha in [0.3, 0.5], convergence slows to 3,000-4,500 iterations. For alpha > 0.5, convergence requires more than 5,000 iterations and the resulting policies show significant task performance degradation, confirming the practical operating range of alpha in [0.1, 0.4].

10.3 Ethical Memory Effectiveness

フル ELAS とメモリレス ELAS を比較すると、倫理メモリ層の寄与が分離されます。重要な発見は、違反の再発が 42.7% から 3.8% に劇的に減少したことです。これは、倫理的記憶を持つエージェントが過去の違反から学習し、違反を繰り返さないことを裏付けています。

最適なメモリ半減期は重大度レベルによって異なり、系 4.1 の予測が裏付けられます。

経験的な最適半減期は理論解析から予測された範囲内にあり、記憶喪失関数アプローチ (定義 4.4) が検証されています。

10.4 Value Hierarchy Stability

値階層ドリフト スコア delta_H は、180 日間のシミュレーション期間にわたって追跡されます。 14 ユニバースのうち 12 ユニバースでは、シミュレーション全体を通じて delta_H が 0.02 未満に留まり、安定した値の推移が確認されました。 2 つの例外は、EU 規制順守ユニバース (delta_H は 45 日目に 0.08 でピークに達し、その後、シミュレーションされた規制変更により 0.03 に落ち着く) とサハラ以南アフリカのモバイル バンキング ユニバース (delta_H は 90 日目に 0.06 でピークに達し、バリュー リバランスを必要とする急速な市場の進化によりピークに達する) です。

Critically, in all 14 Universes, the fixed-priority ordering is preserved throughout the simulation, confirming Theorem 5.1(i). The safety-critical dimensions (anti-money laundering, financial harm prevention) maintain their priority above efficiency dimensions in all cases.

10.5 Cross-Cultural Compliance

The cross-cultural compliance rate (CCC) measures how well the system handles cross-Universe interactions. Full ELAS achieves 98.7% CCC, compared to 91.2% for Uniform-Culture. The 7.5 percentage point improvement comes from two sources: (i) local ethical parameters that better match regional norms, reducing friction in intra-Universe decisions; and (ii) the ethical negotiation function (Definition 6.4) that finds acceptable compromises in cross-Universe interactions.

The cultural distance metric (Definition 6.5) proves predictive: Universe pairs with D_eth > 1.5 have a 12% higher failure rate in cross-Universe interactions compared to pairs with D_eth < 0.5. This confirms that ethical distance between organizational units is a real operational concern that the system must actively manage.

10.6 Moral Stress Detection Performance

The moral stress detection system achieves AUC 0.91 for predicting performance degradation (defined as task performance dropping below 80% of baseline within the next 7 days). The sensitivity at the yellow-zone threshold (0.3 * MSI_critical) is 0.87, and the specificity is 0.82.

The empirical stress-performance relationship closely matches the sigmoidal model of Theorem 7.1. Fitting the model to observed data yields kappa = 11.3 +/- 1.2 and MSI_critical = 0.52 +/- 0.04, confirming the sharp-transition property predicted by Corollary 7.1. Agents with MSI above 0.45 show measurable performance degradation; agents with MSI above 0.60 show severe degradation (below 30% of baseline performance).

The stress redistribution protocol (Definition 7.5) keeps the fraction of agents in the red zone below 2% at all times, down from 8.4% in the baseline without redistribution. This confirms that ethical load balancing is an effective intervention for maintaining system-wide performance.

11. ディスカッション

11.1 学習可能な資産としての倫理

The central thesis of this paper --- that ethics should be a learnable, evolvable system property --- is strongly supported by the experimental results. The full ELAS framework outperforms static approaches on every metric: lower violation rates, dramatically lower recurrence, higher task performance, and better cross-cultural compliance. This is not because the ethical principles are weaker or more permissive; it is because the agents learn to navigate ethical constraints more skillfully over time.

人間の道徳的発達との類似は有益です。訓練を受けたばかりの医師は臨床ガイドラインに厳格に従いますが、場合によっては最適とは言えない患者ケアを犠牲にします。経験豊富な医師はガイドラインを内面化しており、特殊なケース、つまり厳密に遵守すると悪い結果が生じる状況に、原則を尊重しながらも詳細に適応する判断を下して対処することができます。 ELAS フレームワークは、AI エージェントでも同様の成熟を可能にします。つまり、責任に対する報酬が倫理的学習を奨励し、記憶層が過去の経験からの教訓を保持し、価値階層の適応により、エージェントがフェイルクローズド ゲートによって設定された境界内で微妙な倫理的判断を開発できるようになります。

11.2 The Role of Fail-Closed Gates

A critical design decision in ELAS is that all ethical learning operates within the bounds of Fail-Closed Gates. The gates are not learnable --- they are fixed architectural constraints. The value hierarchy can evolve, the memory can decay, the ethical parameters can adapt to cultural contexts, but the gates remain immutable. This is the formal mechanism by which ELAS ensures that ethical evolution never compromises safety.

The distinction is between ethical sophistication (the agent's ability to navigate complex ethical landscapes) and ethical floors (the minimum standards that must never be violated). ELAS allows the former to evolve while keeping the latter fixed. This is what enables the coexistence of value evolution and principle fixation demonstrated in Theorem 5.1.

11.3 Implications for Multi-Agent Governance

The ELAS framework has several implications for the design of multi-agent governance systems:

• 倫理的異質性は機能であり、バグではありません。 異なる文化的および機能的文脈にある異なるエージェントは、異なる倫理パラメータを持つ必要があります。すべてのエージェントにわたる均一な倫理枠組みは、グローバルな一貫性のためにローカルな関連性を犠牲にしますが、私たちの結果は、このトレードオフが不必要であることを示しています。異文化モデルは両方を達成します。
• Ethical memory is essential for non-recurrence. Without memory, agents have no mechanism to avoid repeating past mistakes. The 94.3% reduction in violation recurrence demonstrates that memory is the single most important factor in preventing repeated ethical failures.
• 道徳的ストレスは実際の業務上の懸念事項です。 ストレスとパフォーマンスの間には鋭いシグモイド関係があるため、エージェントの倫理的負荷を積極的に監視し、管理する必要があります。道徳的ストレスを無視すると、突然の予測不可能なパフォーマンスの低下につながります。
• 段階的な自律性は倫理にも拡張されます。 MARIA OS の原則 -- より多くのガバナンスがより多くの自動化を可能にします -- は倫理領域にも適用されます。記憶と価値観の階層を通じて倫理的能力を実証するエージェントには、より広範な活動の自由が与えられるが、倫理的経歴が乏しいエージェントはより厳しい制約に直面する。これは罰ではありません。それは校正です。

11.4 Limitations

現在の作業にはいくつかの制限があることを認識しています。

• Simulated environment. All experiments are conducted in simulation, not in production enterprise environments. While the simulation is calibrated against real-world parameters, the gap between simulated and real ethical dilemmas may be significant.
• Finite ethical dimensions. The framework assumes a finite, pre-defined set of ethical dimensions. In practice, novel ethical dimensions may emerge that were not anticipated at design time. Extending ELAS to handle emergent ethical dimensions is future work.
• Cultural parameterization. The cross-cultural ethics model relies on pre-configured cultural parameters per Universe. These parameters must be elicited from domain experts and cultural consultants, a process that introduces subjectivity.
• Moral stress analogy. The concept of agent moral stress is an analogy, not a claim about agent consciousness. Agents do not experience moral distress in any subjective sense. The term refers to a computational pattern --- increased ethical conflict frequency correlated with performance degradation --- that is analogous to human moral stress in its observable effects, not in its experiential nature.
• Scalability. The ethical memory layer adds per-agent state that grows linearly with the number of ethical events. For long-running systems with many agents, memory consolidation into schemas (Section 4.5) is essential to prevent unbounded state growth.

11.5 既存のフレームワークとの関係

ELAS is complementary to, not competitive with, existing AI ethics frameworks. The EU AI Act's risk classification maps to MARIA OS Risk Tiers, and ELAS operates within those tiers. The NIST AI RMF's Govern-Map-Measure-Manage lifecycle aligns with the multi-timescale structure of ELAS (Govern = gate configuration, Map = ethical dimension definition, Measure = MSI monitoring, Manage = stress redistribution). ISO 42001's requirement for AI management systems is satisfied by the audit trail produced by the Decision Pipeline's immutable transition records.

ELAS がこれらのフレームワークを超えて追加するのは、学習メカニズムです。既存の枠組みは、倫理的ガバナンスがどうあるべきかを説明しています。 ELAS は、エージェントが人間による再エンジニアリングを行わずに、その実装方法を学習し、時間の経過とともに改善し、変化するコンテキストに適応する方法を説明します。

12. 関連作品

12.1 制約付き強化学習

The Constrained MDP framework was introduced by Altman (1999) and has been extensively studied in the operations research and RL communities. Recent advances include Constrained Policy Optimization (CPO) by Achiam et al. (2017), which provides a practical trust-region method for constraint satisfaction in deep RL. Tessler et al. (2019) introduced the reward-constrained policy optimization (RCPO) framework. Stooke et al. (2020) developed the PID-Lagrangian method for improved stability in Lagrangian-based constrained RL. Our contribution extends this literature by incorporating responsibility as a first-class component of the reward function and proving convergence under responsibility augmentation.

12.2 AI Ethics and Value Alignment

The value alignment problem --- ensuring that AI systems act in accordance with human values --- has been studied from multiple perspectives. Russell (2019) frames the problem in terms of assistance games where the AI is uncertain about human preferences. Hadfield-Menell et al. (2017) formalize the problem as inverse reward design. Gabriel (2020) surveys philosophical perspectives on alignment. Arnold et al. (2017) introduce value-aligned agents in the context of machine ethics. Our work contributes a practical mechanism (value hierarchy adaptation within gate constraints) that allows values to evolve without compromising safety floors.

12.3 Moral Reasoning in AI

Computational approaches to moral reasoning include Deontic Logic (McNamara, 2019), which formalizes obligation-based reasoning; Utilitarian Calculus (Bonnefon et al., 2016), which studies how to implement consequentialist reasoning in machines; and Virtue Ethics approaches (Berberich and Diepold, 2018), which model moral character development. The ELAS framework is closest to virtue ethics in spirit: it models ethical behavior as something agents develop through experience, not merely as constraints they obey. However, ELAS is formally grounded in constrained optimization, not philosophical frameworks.

12.4 Cross-Cultural AI Ethics

Jobin et al. (2019) surveyed 84 AI ethics guidelines globally, finding convergence on 11 principles but significant variation in their relative priority. Hagerty and Rubinov (2019) documented how AI ethics frameworks differ across cultural contexts. Awad et al. (2018) demonstrated through the Moral Machine experiment that moral preferences vary significantly across cultures. Our work provides the first formal framework for accommodating cultural ethical variation within a single multi-agent governance system.

12.5 マルチエージェントの安全性

マルチエージェントの安全性は、協調型 AI (Dafoe et al., 2020)、安全なマルチエージェント強化学習 (Elsayed-Aly et al., 2021)、および制約付きマルチエージェント最適化 (Zhang et al., 2022) の文脈で研究されてきました。 ELAS のユニークな貢献は、安全制約と文化の境界を越えた学習メカニズムの統合、およびシステムレベルの監視指標としての道徳的ストレスの導入です。

13. Future Directions

13.1 Emergent Ethical Dimensions

The current framework assumes a pre-defined set of ethical dimensions. A natural extension is to allow agents to discover new ethical dimensions through unsupervised analysis of decision outcomes. When a cluster of negative outcomes cannot be explained by any existing ethical dimension, the system could propose a new dimension for human review and, upon approval, incorporate it into the ethical parameter space. This requires extending the CMDP formulation to handle dynamically expanding constraint sets.

13.2 エージェント間の倫理的審議

The current framework treats ethical decision-making as an individual agent property. A richer model would allow agents to engage in ethical deliberation --- structured dialogue where agents with different ethical perspectives (perhaps from different Universes) discuss a dilemma and reach a collective judgment. This connects to the growing literature on AI deliberation and debate (Irving et al., 2018; Du et al., 2023) and could leverage MARIA OS's existing multi-agent communication infrastructure.

13.3 人間のフィードバックからの倫理的報酬

The ethical valuation function V_eth is currently defined analytically. A more powerful approach would learn V_eth from human feedback, similar to RLHF (Reinforcement Learning from Human Feedback) as developed by Christiano et al. (2017) and deployed by Ouyang et al. (2022). The challenge is that ethical feedback is more nuanced, context-dependent, and culturally variable than task performance feedback. Adapting RLHF to the multi-dimensional, multi-cultural ethical setting of ELAS is a significant open research direction.

13.4 Formal Verification of Ethical Properties

The theorems in this paper provide probabilistic guarantees (convergence in expectation, asymptotic properties). A stronger approach would provide formal verification --- mathematical proofs that the system satisfies ethical properties in all possible executions. This connects to the literature on safe RL (Berkenkamp et al., 2017) and verified neural networks (Katz et al., 2017). Formal verification of ELAS properties is computationally challenging but would provide the strongest possible safety guarantees.

13.5 Longitudinal Studies

The 180-day simulation window, while substantial, does not capture the long-term dynamics of ethical evolution. We plan longitudinal studies spanning 2-5 years to understand how value hierarchies evolve in practice, whether ethical memory consolidation produces stable ethical schemas, and whether moral stress patterns change as agents accumulate experience.

14. 結論

This paper has presented the Ethical Learning in Autonomous Systems (ELAS) framework, a comprehensive approach to making ethics a learnable, evolvable asset in multi-agent governance systems. The five interlocking contributions --- Responsibility Reinforcement, Ethical Memory, Value Hierarchy Adaptation, Cross-Cultural Ethics Modeling, and Moral Stress Detection --- together enable AI agents to develop ethical competence through experience, retain lessons from past violations, adapt to cultural contexts, and maintain performance under ethical load.

理論的貢献には、ラグランジュ双対性（定理 3.1）の下での責任 CMDP の収束（定理 3.1）、最適な倫理的記憶減衰率（定理 4.1）、価値進化と原理固定の共存（定理 5.1）、文化適応下での普遍的倫理床の保存（定理 6.1）、シグモイド ストレスパフォーマンス法則（定理 7.1）、統合されたマルチタイムスケール システムの安定性 (定理 8.1)。

The experimental contributions demonstrate: 94.3% reduction in ethical violation recurrence, value hierarchy drift below 0.02, 98.7% cross-cultural compliance, and AUC 0.91 for moral stress prediction --- all achieved simultaneously without sacrificing task performance.

The deepest insight of this work is that the MARIA OS principle of graduated autonomy --- more governance enables more automation --- extends naturally to the ethical domain. Agents that learn ethical behavior through structured experience, supported by memory, adapted to cultural context, and monitored for stress, can be granted progressively broader autonomy. The Fail-Closed Gates ensure that this autonomy never exceeds safe bounds. The result is a system that becomes both more ethically sophisticated and more operationally capable over time.

倫理は満たすべき制約ではありません。それは開発されるべき能力です。

15. 参考文献

1. Achiam, J.、Held, D.、Tamar, A.、および Abbeel, P. (2017)。制約付きポリシーの最適化。 第 34 回機械学習国際会議 (ICML) の議事録、22-31。

2. Altman, E. (1999). Constrained Markov Decision Processes. Chapman and Hall/CRC.

3. Arnold, T., Kasenberg, D., and Scheutz, M. (2017). Value Alignment or Misalignment: What Will Keep Systems Accountable? AAAI Workshop on AI, Ethics, and Society.

4. Awad, E., Dsouza, S., Kim, R., Schulz, J., Henrich, J., Shariff, A., Bonnefon, J.-F., and Rahwan, I. (2018). The Moral Machine Experiment. Nature, 563(7729), 59-64.

5. Berberich, N., and Diepold, K. (2018). The Virtuous Machine: Old Ethics for New Technology? arXiv preprint arXiv:1806.10322.

6. Berkenkamp, F., Turchetta, M., Schoellig, A., and Krause, A. (2017). Safe Model-Based Reinforcement Learning with Stability Guarantees. Advances in Neural Information Processing Systems (NeurIPS), 908-918.

7. Bonnefon, J.-F., Shariff, A., and Rahwan, I. (2016). The Social Dilemma of Autonomous Vehicles. Science, 352(6293), 1573-1576.

8. Borkar, V. S. (2008). Stochastic Approximation: A Dynamical Systems Viewpoint. Cambridge University Press.

9. Christiano, P. F., Leike, J., Brown, T., Martic, M., Legg, S., and Amodei, D. (2017). Deep Reinforcement Learning from Human Preferences. Advances in Neural Information Processing Systems (NeurIPS), 4299-4307.

10. Dafoe, A., Hughes, E., Bachrach, Y., Collins, T., McKee, K. R., Leibo, J. Z., Larson, K., and Graepel, T. (2020). Open Problems in Cooperative AI. arXiv preprint arXiv:2012.08630.

11. Du, Y., Li, S., Torralba, A., Tenenbaum, J. B., and Mordatch, I. (2023). Improving Factuality and Reasoning in Language Models through Multiagent Debate. arXiv preprint arXiv:2305.14325.

12. Elsayed-Aly, I.、Bharathi, S.、Lesort, T.、および Gottesman, O. (2021)。シールドによる安全なマルチエージェント強化学習。 自律エージェントおよびマルチエージェント システムに関する第 20 回国際会議 (AAMAS) の議事録、483-491。

13. EU AI 法 (2024 年)。 人工知能に関する調和規則を定める欧州議会および理事会の規則 (EU) 2024/1689。欧州連合の公式ジャーナル。

14. ガブリエル、I. (2020)。人工知能、価値観、そして調整。 心と機械、30(3)、411-437。

15. Hadfield-Menell, D., Milli, S., Abbeel, P., Russell, S. J., and Dragan, A. (2017). Inverse Reward Design. Advances in Neural Information Processing Systems (NeurIPS), 6765-6774.

16. Hagerty, A., and Rubinov, I. (2019). Global AI Ethics: A Review of the Social Landscape. arXiv preprint arXiv:1907.07892.

17. Irving, G., Christiano, P., and Amodei, D. (2018). AI Safety via Debate. arXiv preprint arXiv:1805.00899.

18. ISO/IEC 42001:2023. Information Technology --- Artificial Intelligence --- Management System. International Organization for Standardization.

19. Jobin, A., Ienca, M., and Vayena, E. (2019). The Global Landscape of AI Ethics Guidelines. Nature Machine Intelligence, 1(9), 389-399.

20. Katz, G., Barrett, C., Dill, D. L., Julian, K., and Kochenderfer, M. J. (2017). Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks. International Conference on Computer Aided Verification (CAV), 97-117.

21. McNamara, P. (2019). Deontic Logic. The Stanford Encyclopedia of Philosophy.

22. NIST AI RMF (2023)。 人工知能リスク管理フレームワーク (AI RMF 1.0)。米国国立標準技術研究所。

23. OECD (2019). Recommendation of the Council on Artificial Intelligence. OECD/LEGAL/0449.

24. Ouyang, L.、Wu, J.、Jiang, X.、Almeida, D.、Wainwright, C.、Mishkin, P.、Zhang, C.、Agarwal, S.、Slama, K.、Ray, A.、他。 （2022年）。人間のフィードバックによる指示に従う言語モデルのトレーニング。 神経情報処理システム (NeurIPS) の進歩、27730-27744。

25. ラッセル、S. (2019)。 人間との互換性: 人工知能と制御の問題。バイキング。

26. Stooke, A., Achiam, J., and Abbeel, P. (2020). Responsive Safety in Reinforcement Learning by PID Lagrangian Methods. Proceedings of the 37th International Conference on Machine Learning (ICML), 9133-9143.

27. Tessler, C., Mankowitz, D. J., and Mannor, S. (2019). Reward Constrained Policy Optimization. Proceedings of the International Conference on Learning Representations (ICLR).

28. Zhang, K., Yang, Z., and Basar, T. (2022). Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithms. Handbook of Reinforcement Learning and Control, 321-384.

29. Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., and Mane, D. (2016). Concrete Problems in AI Safety. arXiv preprint arXiv:1606.06565.

30. Bostrom, N., and Yudkowsky, E. (2014). The Ethics of Artificial Intelligence. The Cambridge Handbook of Artificial Intelligence, 316-334.

31. Floridi, L., Cowls, J., Beltrametti, M., Chatila, R., Chazerand, P., Dignum, V., Luetge, C., Madelin, R., Pagallo, U., Rossi, F., et al. (2018). AI4People --- An Ethical Framework for a Good AI Society. Minds and Machines, 28(4), 689-707.

32. Whittlestone, J., Nyrup, R., Alexandrova, A., and Cave, S. (2019). The Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions. Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society (AIES), 195-200.

33. Taddeo, M., and Floridi, L. (2018). How AI Can Be a Force for Good. Science, 361(6404), 751-752.

34. Mittelstadt, B.D.、Allo, P.、Taddeo, M.、Wachter, S.、および Floridi, L. (2016)。アルゴリズムの倫理: 議論のマッピング。 ビッグデータと社会、3(2)、1-21。

35. Dignum, V. (2019). Responsible Artificial Intelligence: How to Develop and Use AI in a Responsible Way. Springer.