情报科学 ›› 2024, Vol. 42 ›› Issue (11): 92-100.

• 理论研究 • 上一篇    下一篇

生成式人工智能诈骗情境中信息迷雾形成机理和受众反应研究

  

  • 出版日期:2024-11-01 发布日期:2025-04-08

  • Online:2024-11-01 Published:2025-04-08

摘要: 【目的/意义】GAI的技术红利让不法分子洞察到利用GAI产制信息迷雾进而升级诈骗手法的可行性和广 泛“钱景”,理清该诈骗情境中信息迷雾发生的整体过程对有效阻断GAI诈骗犯罪尤为关键。【方法/过程】本文旨在 对GAI诈骗情境中信息迷雾的形成机理和受众反应展开探索性研究,通过选取GAI诈骗事件报道和访谈文本作为 数据来源,利用系统性主题分析方法进行数据分析。【结果/结论】对于信息迷雾形成机理,得到信息环境、信息技 术、信息和信息主体四个影响因子,其中信息环境具有信息过载、社交网络特征,信息技术表现深度伪造、计算宣传 和类人化,信息呈现“可信”虚假信息,信息主体具备认知偏差、数字素养和防范意识;接着结合信息生态理论,进一 步阐释了信息迷雾形成的机理路径。对于信息迷雾的受众反应,获取认知、行为和情感三个维度,其中认知上会导 致歧视和偏见,情感上出现社会信任缺失和焦虑,行为上引发隐私泄露和被诈骗;且结合认知行为理论,解释了受 众反应的内在过程。【创新/局限】本研究在一定程度上丰富了信息迷雾理论研究,并为 GAI 诈骗系统治理提供参 考。然而,GAI诈骗样本的丰富度和理论模型的适用性还需进一步拓展和验证。

Abstract: 【Purpose/significance】The technical dividend of generative artificial intelligence gives criminals insight into the feasibility and wide ′money prospect′ of fraudulent means using GAI to produce information fog, and it is particularly critical to clarify the overall process of information fog occurrence in the fraud situation to effectively block GAI fraud crimes【. Method/process】This paper aims to conduct an exploratory research on the formation mechanism and audience response of information fog in GAI fraud scenario. We se⁃ lected GAI fraud reports and interview texts as data sources, and used systematic thematic analysis method to data analyze.【Result/ conclusion】(1)for the formation mechanism of information fog, four influencing factors are information environment, information tech⁃ nology, information and information subject. Among them, information environment presents the characteristics of information overload and social network, information technology presents deepfakes, computational propaganda and anthropomorphic, information presents ′credible′ disinformation, and information subject has cognitive bias, digital literacy and awareness of prevention. Guided by informa⁃ tion ecology theory, we further explains the mechanism of information fog formation. (2)for the audience response of information fog, we obtain three dimensions of cognition, behavior and emotion. Among them, cognition leads to discrimination and prejudice, emotion ap⁃ pears social trust loss and anxiety, and behavior has privacy disclosure and be deceived. Guided by cognitive behavior theory, we ex⁃ plains the intrinsic process of audience response【. Innovation/limitation】This study enriches the research of information fog to a certain extent, and provides reference for GAI fraud management. However, the richness of GAI fraud samples and the applicability of theo⁃ retical models need to be further developed and verified.