自己維持システムとしての寿命 — 第 2 条/5
Introduction: The Organ That Rewrites Itself
No engineered system on Earth rewrites its own source code as aggressively, as continuously, and as successfully as the human brain. Every second of waking life — and a good deal of sleep — the brain generates predictions about what will happen next, compares those predictions against incoming sensory data, computes the mismatch, and uses that mismatch to update its own wiring. This is not merely a loose metaphor. Modern machine learning and control theory reuse several of these ideas, even if the mapping is not one-to-one.
The brain is, in the most literal sense, a recursive self-improving system (再帰的自己改善システム). It improves its own capacity to improve. Understanding how it accomplishes this feat — and where it fails — offers a concrete design specification for building artificial agents that can evolve safely under governance constraints.
Predictive Coding: The Brain's Core Algorithm
The predictive coding framework, developed by Rajesh Rao and Dana Ballard in 1999 and extended into a grand unified theory by Karl Friston, proposes that the cortex is organized as a hierarchical generative model. Each level of the cortical hierarchy maintains a model of the level below it and sends top-down predictions. The lower level compares these predictions against its own activity and sends back only the prediction error — the residual that the higher level failed to anticipate.
このアーキテクチャには深い意味があります。脳は感覚データを受動的に受信しないということです。それは世界を積極的に「幻覚」させ、その幻覚を現実と照合します。知覚は制御された幻覚 (制御された幻覚) であり、神経科学者のアニル・セスによって造られた言葉です。あなたが「見る」と経験しているものは、実際には、網膜に当たる光子パターンの原因についての脳の最善の推測であり、視覚階層を通って上方に伝播するエラー信号によって継続的に修正されます。
この方式の計算効率は驚くべきものです。高帯域幅の感覚ストリーム全体を階層上に送信する代わりに、各レベルは「驚き」、つまり上位レベルがまだ予測していなかった情報のみを送信します。これは、データ圧縮におけるデルタ エンコーディングに似ています。脳は、神経伝達の代謝コストを最小限に抑えながら、並外れた豊かな知覚を実現します。
階層型予測エラー
予測誤差は上方向と横方向の両方に伝播します。 V1 (一次視覚野) における低レベルの予測誤差は、予期しないエッジ方向を示す可能性があります。このエラーは V2 に伝播し、テクスチャとサーフェスのモデル内で説明しようとします。 V2 がエラーを説明できない場合、残差はさらに V4 および下側頭皮質に伝播し、そこで新しい物体の認識を引き起こす可能性があります。
各レベルで、システムは同じ決断に直面します。この誤差は現在のモデルのパラメーターを更新することで吸収できるでしょうか、それともモデルの 構造 を変更する必要があるのでしょうか?この区別 (パラメーターの更新とアーキテクチャの更新) は、機械学習における微調整と再トレーニングの違い、および MARIA VITAL フレームワークにおける自己修復と進化の違いに直接対応します。
ドーパミンと報酬の予測エラー
予測コーディングが脳がどのように 感覚 世界をモデル化するかを説明するものであれば、ドーパミン システムは脳がどのように 価値 をモデル化するかを説明します。 1990年代に始まった画期的な一連の研究で、ウルフラム・シュルツは、中脳のドーパミンニューロンが報酬そのものではなく、報酬予測誤差（期待される報酬と受け取った報酬の差）をエンコードしていることを実証しました。
When a monkey receives an unexpected juice reward, dopamine neurons fire a burst of activity. When the monkey learns to predict the reward from a preceding cue, the dopamine burst shifts from the reward to the cue. When an expected reward is omitted, dopamine activity dips below baseline — a negative prediction error. This is mathematically identical to the temporal difference (TD) learning signal used in reinforcement learning, a correspondence first noted by Read Montague, Peter Dayan, and Terrence Sejnowski in 1996.
The dopamine system thus implements a continuous A/B test on the brain's own value model. Every outcome is compared against expectation. Positive prediction errors (better than expected) strengthen the associations that led to the action. Negative prediction errors (worse than expected) weaken them. The system does not need an external supervisor; the error signal is generated internally, from the discrepancy between the brain's own predictions and the world's response.
The Exploration-Exploitation Tradeoff
Dopamine also modulates the balance between exploitation (using the current best policy) and exploration (trying new actions to discover potentially better policies). Tonic dopamine levels — the background firing rate — appear to encode a kind of average reward rate. When tonic dopamine is high, the organism exploits; when it is low, the organism explores. This is a biological implementation of the epsilon-greedy or softmax exploration strategies used in reinforcement learning.
エージェントのガバナンスとの関連性は即時です。悪用するだけのエージェントは脆弱になり、環境の変化に適応できなくなります。探索するだけのエージェントは、信頼できる動作に収束することはありません。脳のドーパミン システムは、最近の予測エラーの履歴に基づいて探索速度を動的に調整することで、この問題を解決します。 MARIA VITAL の Evolution Lab も同じトレードオフに直面しています。エージェントは自身の構成をどの程度積極的に変更すべきでしょうか?生物学的な答えは「最近の驚きに比例する」です。
Synaptic Plasticity: Weight Updates in Biological Hardware
皮質回路およびドーパミン作動性回路によって計算された予測誤差は、シナプス可塑性 (シナプス可塑性) を通じて脳の物理的変化に変換されます。 1949 年にドナルド・ヘッブによって初めて明確にされた基本原理は、多くの場合、「互いに発火するニューロンが互いに配線する」と要約されます。現代の神経科学は、これを一連の可塑性ルールに洗練しました。
長期増強（LTP） は、シナプス前とシナプス後の活動が時間的に相関している場合にシナプス接続を強化します。これは、連想学習の基礎となる生物学的メカニズム、つまり正確な予測に貢献するつながりの強化です。
長期うつ病 (LTD) は、活動が無相関または逆相関している場合、シナプスの接続を弱めます。これにより、予測誤差の原因となる接続が取り除かれ、入力統計のより正確なモデルに向けてネットワークが徐々に整形されます。
Spike-timing-dependent plasticity (STDP) adds temporal precision: if a presynaptic neuron fires just before a postsynaptic neuron, the synapse is strengthened; if the order is reversed, the synapse is weakened. This implements a causal inference rule — the brain preferentially strengthens connections that reflect cause-and-effect relationships in the world.
Metaplasticity — plasticity of plasticity — adjusts the threshold for LTP and LTD based on the neuron's recent activity history. A neuron that has been highly active becomes harder to potentiate further, preventing runaway excitation. This is the biological equivalent of adaptive learning rate schedules in gradient descent.
Together, these mechanisms mean that the brain is updating its own weights continuously, driven by internally generated error signals, with built-in safeguards against instability. It is a self-improving system with governance constraints baked into the biophysics.
The Cerebellum as Forward Model
While the cerebral cortex handles high-level prediction and the dopamine system handles value estimation, the cerebellum (小脳) implements rapid, precise forward models for motor control. When you reach for a coffee cup, the cerebellum predicts the sensory consequences of the motor command — what your arm will feel like in 200 milliseconds — and compares this prediction against actual proprioceptive feedback.
If the prediction is accurate, the movement proceeds smoothly. If there is a mismatch — the cup is heavier than expected, or the table has shifted — the cerebellum computes a correction signal and sends it to the motor cortex within tens of milliseconds. This is a closed-loop controller with an internally generated reference signal, operating at a timescale too fast for conscious awareness.
The cerebellum's climbing fiber inputs, originating from the inferior olive, are widely believed to carry the error signal that drives cerebellar learning. Each climbing fiber fires at most once or twice per second, delivering a powerful, all-or-nothing teaching signal that updates the weights of the parallel fiber synapses onto Purkinje cells. This architecture — a slow, high-magnitude error signal updating a fast, high-throughput forward model — is strikingly similar to the relationship between offline evaluation (slow, expensive, thorough) and online inference (fast, cheap, approximate) in production ML systems.
Sleep as Batch Processing
The brain does not only learn online. Sleep provides a critical offline processing window during which the day's experiences are replayed, consolidated, and integrated into long-term memory. During slow-wave sleep (深い睡眠), hippocampal place cells replay sequences of activity corresponding to recent experiences, but at compressed timescales — up to 20 times faster than the original experience.
This replay is not a passive recording. The hippocampus selectively replays experiences associated with high prediction error or high reward, prioritizing the consolidation of surprising or valuable information. Meanwhile, synaptic homeostasis theory, proposed by Giulio Tononi and Chiara Cirelli, suggests that sleep globally downscales synaptic weights, counteracting the net potentiation that accumulates during waking learning. This renormalization prevents saturation and restores the signal-to-noise ratio.
During REM sleep, the brain appears to engage in a different kind of processing — testing the generalization of learned models by generating novel combinations of stored experiences. Dreams, in this framework, are the brain's unit tests: synthetic scenarios that probe the robustness of recently updated models.
The engineering parallel is clear. Production systems need both online learning (processing data as it arrives) and offline batch processing (retraining on curated datasets, running regression tests, pruning stale parameters). The brain implements both, with sleep serving as the scheduled maintenance window.
What Transfers Cleanly to Tier-2 Agent Design
Not every biological detail should be copied into software. What transfers cleanly is the control structure. The brain suggests four design rules for recursive self-improvement in agents.
First, split fast correction from slow improvement. Online loops should correct local errors quickly, but larger model or prompt changes should be evaluated offline through replay, regression tests, and rollbackable promotion gates. This is the software analogue of cerebellar correction plus sleep-based consolidation.
第 2 に、突然変異率を支配変数として扱います。 メタ可塑性の教訓は、システムは学習するだけではなく、学習する必要があるということです。どれだけ積極的に学習を許可するかを規制する必要がある。最近大幅に変更したエージェントは、さらに自己変更する前に冷静になる必要があります。
Third, keep value signals separate from world-model signals. Predictive coding and dopamine solve different problems in the brain. Agent architectures should likewise distinguish 'did I predict correctly?' from 'did this outcome advance the objective?', rather than collapsing both into a single reward proxy that invites reward hacking.
Fourth, require external reality checks. The most dangerous failure mode in recursive systems is mistaking self-generated signals for external validation. Tier-2 improvement therefore needs benchmark replay, counterfactual tests, and evidence from actual task outcomes — not just self-scored confidence.
Failure Modes: When Self-Improvement Goes Wrong
The brain's recursive self-improvement architecture is powerful but not infallible. Several pathologies illustrate what happens when the loop breaks down:
Addiction hijacks the dopamine prediction error signal. Drugs of abuse produce artificially large dopamine bursts that override the brain's natural value estimation, driving compulsive behavior that the cortical monitoring systems cannot override. This is the biological equivalent of reward hacking in reinforcement learning — the agent optimizes a proxy metric that diverges from the true objective.
Rumination and anxiety represent failure modes of the predictive coding loop. The brain generates catastrophic predictions, cannot resolve the prediction error through action or evidence, and enters a self-reinforcing cycle of negative prediction and escalating arousal. The monitoring system detects a problem but the repair mechanism is unable to address it, leading to a stuck state.
統合失調症には、自己生成の予測と外部から引き起こされる感覚信号を区別する脳の能力の不全が関与している可能性があります。当然の放電メカニズム (予測を内部で生成されたものとしてタグ付けするシステム) が機能不全に陥ると、脳自身の予測が外部の出来事として経験され、幻覚や妄想が生じます。
These failure modes are not merely clinical curiosities. They are design constraints. Any recursive self-improving system must guard against reward hacking, stuck states, and confusion between internal models and external reality.
Connection to Agent Systems: MARIA VITAL Evolution Lab
The brain's architecture provides a detailed blueprint for the MARIA VITAL Evolution Lab:
Prediction → Error → Update maps to the Evolution Lab's Hypothesis → Test → Promote pipeline. An agent proposes a configuration change (prediction), tests it against a benchmark suite (error measurement), and promotes or reverts based on results (weight update). The key insight from neuroscience is that the error signal cannot be purely rhetorical — it must be grounded in measurable outcomes, replay traces, or controlled evaluation rather than self-description alone.
Hierarchical error processing maps to the Evolution Lab's multi-level evaluation. A minor configuration change (parameter update) is evaluated at the unit test level. A major architectural change (structural update) requires integration tests, load tests, and human review — analogous to the cortical hierarchy escalating errors that cannot be absorbed at lower levels.
Sleep-as-batch-processing maps to the Evolution Lab's offline evaluation mode. Candidate mutations are tested in a sandboxed environment before deployment, replaying historical workloads at compressed timescales. This is the agent equivalent of hippocampal replay, and in the current MARIA VITAL vocabulary it corresponds more closely to shadow-agent validation and gated promotion than to unconstrained live rewriting.
Metaplasticity maps to adaptive mutation rates. An agent that has recently undergone significant changes should have a reduced mutation rate, allowing the effects of previous changes to be properly evaluated before introducing new ones. An agent in a stable, well-understood environment should also have a low mutation rate — do not fix what is not broken.
The brain teaches us that recursive self-improvement is not just possible but inevitable for any sufficiently complex adaptive system. The practical question is not whether agents will adapt, but where adaptation is allowed to occur, what evidence is allowed to count as improvement, and which gates prevent drift from turning into reward hacking, instability, or opacity.