情报科学 ›› 2024, Vol. 42 ›› Issue (7): 146-157.

• 业务研究 • 上一篇    下一篇

基于脑电频谱的公共数字文化多模态资源认知负荷研究 ——以国家公共文化云为例

  

  • 出版日期:2024-07-01 发布日期:2024-11-05

  • Online:2024-07-01 Published:2024-11-05

摘要: 【目的/意义】基于公共数字文化服务多模态资源融合现状,本文以认知负荷为切入点,分析国家公共文化 云平台中用户阅读多模态内容时的认知资源投入情况,据此优化公共数字文化服务的多模态资源建设。【方法/过 程】采用脑电受控实验法,收集用户阅读多模态资源时的脑电数据,进行频谱分析与统计检验,揭示用户阅读过程 中的认知负荷、工作记忆负载与注意力投入的差异。【结果/结论】视觉激活复合型多模态资源,即文字图片组合引 发更高认知负荷、工作记忆负载与注意力投入;视听激活复合型多模态资源,即文字图片视频组合引发更低认知负 荷、工作记忆负载与注意力投入。公共数字文化服务多模态资源建设时,应根据服务目标与用户认知特征,丰富听 觉激活、多元视听融合与视觉激活的多模态资源,实现资源精细化建设。【创新/局限】本研究探讨神经生理数据直 接应用于信息行为研究的可行性,通过细分多模态资源类型,为公共数字文化服务多模态资源建设提供可行建议。 研究局限在于采用了小规模受控实验,仅以国家公共文化云平台为例分析,结论可能具有局限性。

Abstract: 【Purpose/significance】This study focuses on the current situation of multi-modal resource integration in digital public cul⁃ tural service platforms. Taking cognitive load as the starting point, this paper analyzes the cognitive characteristics of users' digital reading in the context of digital public cultural services, and puts forward suggestions to optimize the construction of multi-modal re⁃ sources for digital public cultural services.【Method/process】This paper uses the EEG controlled experimental method to obtain EEG data when users read multi-modal resources of digital public cultural services. Conduct spectrum analysis and statistics on EEG data to clarify the cognitive differences of users reading multi-modal resources.【Result/conclusion】Visual activation of composite multi⁃ modal resources (text-pictures) induces higher cognitive load, working memory load and attention investment; audiovisual activation of composite multimodal resources (text-pictures-video) induces lower Cognitive load, working memory load, and attentional engage⁃ ment. When building multi-modal resources for digital public cultural services, when building multi-modal resources for digital pub⁃ lic cultural services, auditory activation, multivariate audiovisual integration and visually activated multimodal resources should be en⁃ riched to achieve refined construction of resources.【Innovation/limitation】This study explores the feasibility of directly applying neu⁃ rophysiological data to information behavior research, subdivides multi-modal resource types, and puts forward feasible suggestions for the construction of multi-modal resources for digital public cultural services. The research deficiency lies in the use of small-scale controlled experiments for research. Taking the National Public Culture Cloud Platform as an example, the conclusions may have limi⁃ tations.