TAG ARCHIVE

multimodal-interaction

1 MARIA OS blog articles tagged multimodal-interaction, organized as a Bonginkan topic archive for search engines and LLM retrieval.

1 article|Published by Bonginkan

Responsibility Gates and AI Governance

Safety, accountability, fail-closed gates, auditability, and human-in-the-loop control for AI agents.

Multi-Agent Mathematics

Formal models for convergence, stability, game theory, graph dynamics, and multi-agent evaluation.

Evidence, RAG, and Knowledge Governance

Evidence bundles, retrieval architecture, Graph RAG, knowledge trust, and auditable reasoning pipelines.

IntelligenceFebruary 15, 202635 min read

Cognitive Science Foundations of Voice User Interface Design: An Attention Resource Allocation Model for Multimodal Dialogue

Integrating Wickens' multiple resource theory, Baddeley's working memory model, and information theory to formalize VUI design principles and validate them in the MARIA VOICE implementation

Voice user interface (VUI) design tends to rely on heuristics that do not adequately address the characteristics of auditory cognitive processing. This paper integrates Wickens' multiple resource theory, Baddeley's working memory model, and Shannon information theory to present a mathematical model of attention resource allocation in multimodal dialogue. We demonstrate the cognitive optimality of sentence-level streaming TTS, the theoretical basis for the 1.2-second debounce threshold, and the conditions under which barge-in suppression avoids resource conflict, providing a theoretical account of MARIA VOICE's design decisions.

voice-uicognitive-scienceinformation-theoryworking-memoryattention-resourcesmultimodal-interactionspeech-processingmaria-voiceformal-methodshuman-computer-interaction