人工智能伴侣：机器情感的关系建构及其伦理限度The Relational Construction of Machine Emotion in Artificial intelligence Companions and Its Ethical Limits
程鹏
摘要(Abstract)：
人工智能伴侣通过共情话语、长期记忆、拟人化呈现和持续互动介入人的情感生活，使机器情感问题由情感真假判断转向关系伦理评价。机器虽缺乏人的主观情感，却能够形成被理解、被记住和持续在场的关系体验，并进一步影响用户的期待、选择和现实社会联结。机器情感可以理解为一种建构性真实，其关系影响可区分为关系体验、关系效应和伦理显著的关系效应。共情话语、长期记忆和拟人化界面分别从回应内容、时间连续和对象呈现三个维度推动关系建构，同时可能引发模拟性共情的责任缺位、低成本亲密的关系替代和平台化陪伴的情感操控。人工智能伴侣的伦理治理需要围绕情感透明、非排他性关系边界、情感记忆节制、非操控原则和情感对齐展开，并将共情回应、关系记忆、拟人化呈现、退出设计和平台商业目标纳入评价，以维护用户的情感自主、主体尊严和现实社会联结。
关键词(KeyWords)： 人工智能伴侣;机器情感;关系真实;关系伦理;情感对齐
基金项目(Foundation):
作者(Author): 程鹏
参考文献(References)：
- (1)参见Laura Bayor, et al.，“Social-Oriented Communication with AI Companions:Benefits, Costs, and Contextual Patterns，” Business&Information Systems Engineering,Vol.67, No.5(2025),pp.637-655.
- (1)参见Bickmore Timothy W. and Rosalind W. Picard，“Establishing and Maintaining Long-Term HumanComputer Relationships，”ACM Transactions on Computer-Human Interaction,Vol.12,No.2(2005),pp.293-327.
- (2)参见Nass, Clifford, and Youngme Moon，“Machines and Mindlessness:Social Responses to Computers，”Journal of Social Issues,Vol.56,No.1(2000),pp.81-103.
- (3)参见Picard Rosalind W.，“Affective Computing:Challenges，” International Journal of Human-Computer Studies, Vol. 59, Nos. 1-2(2003), pp. 55-64.
- (4)参见Hannah Rashkin, et al.，“Towards Empathetic Open-Domain Conversation Models:A New Benchmark and Dataset，”Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics,Florence:Association for Computational Linguistics,2019,pp.5370-5381.
- (5)参见Skjuve, et al.，“My Chatbot Companion:A Study of Human-Chatbot Relationships，”International Journal of Human-Computer Studies,Vol.149(2021),Article 102601.
- (6)参见Xie Tianling,Iryna Pentina, and Tyler Hancock，“Friend,Mentor,Lover:Does Chatbot Engagement Lead to Psychological Dependence？”Journal of Service Management,Vol.34,No.4(2023),pp.806-828.
- (7)参见Ryan Calo，“Digital Market Manipulation，”George Washington Law Review,Vol.82,No. 4(2014),pp.995-1051.
- (8)参见Linnea I. Laestadius, et al.，“Too Human and Not Human Enough:A Grounded Theory Analysis of Mental Health Harms from Emotional Dependence on the Social Chatbot Replika，”New Media&Society,Vol.26,No.10(2024),pp.5923-5941.
- (1)参见宋保林、陈丽云：《人工情感与人工智能应用》，《科技管理研究》2022年第10期。
- (1)参见Decety Jean and Philip L. Jackson，“The Functional Architecture of Human Empathy，”Behavioral and Cognitive Neuroscience Reviews,Vol.3,No.2(2004),pp.71-100.
- (2)参见Hannah Rashkin, et al.，“Towards Empathetic Open-Domain Conversation Models:A New Benchmark and Dataset，”in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics,2019,pp.5370-5381,https：//aclanthology.org/P19-1534/，访问时间：2026年7月16日。
- (1)参见Li Zhou, et al.，“The Design and Implementation of Xiao Ice,an Empathetic Social Chatbot，”Computational Linguistics,Vol.46,No.1(2020),pp.53-93.
- (2)参见张妍、赵宇翔、吴大伟等：《人智交互情境中用户对生成式人工智能的心智感知及反应研究》，《情报理论与实践》2024年第8期。
- (1)参见Malfacini Kim，“The Impacts of Companion AI on Human Relationships:Risks,Benefits,and Design Considerations，”AI&Society,Vol.40(2025),pp.5527-5540.
- (1)参见徐向东：《道德能力、人工智能与人类智能》，《新文科教育研究》2025年第4期。
- (2)参见Simon Coghlan, et al.，“To Chat or Bot to Chat:Ethical Issues with Using Chatbots in Mental Health，”Digital Health,Vol.9(2023),Article 20552076231183542.
- (1)参见Jie Wu，“Social and Ethical Impact of Emotional AI Advancement:The Rise of Pseudo-Intimacy Relationships and Challenges in Human Interactions，”Frontiers in Psychology,Vol.15(2024),Article 1410462.
- (1)参见Colin M. Gray, et al.，“The Dark(Patterns)Side of UX Design，” in Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems,2018,pp.1-14.
- (2)参见Ryan Calo，“Digital Market Manipulation，”George Washington Law Review,Vol.82(2014),pp.995-1051.
- (3)参见Julian De Freitas,Zeliha Oguz-Uguralp, and Ahmet Kaan-Uguralp，“Emotional Manipulation by AI Companions，”https：//doi.org/10.48550/ar Xiv.2508.19258，访问时间：2026年7月12日。
- (1)参见UNESCO，“Recommendation on the Ethics of Artificial Intelligence，”https：//www.unesco.org/en/artificial-intelligence/recommendation-ethics，访问时间：2026年7月16日。
- (1)参见Andrew McStay，“Emotional AI,Soft Biometrics and the Surveillance of Emotional Life:An Unusual Consensus on Privacy，”Big Data&Society,Vol.7,No.1(2020),Article 2053951720904386.
- (1)参见Ryan Calo，“Digital Market Manipulation，”George Washington Law Review,Vol.82(2014),pp.995-1051.
- (1)参见Brent Daniel Mittelstadt，“The Ethics of Algorithms:Mapping the Debate，”Big Data&Society,Vol.3,No.2(2016),Article 2053951716679679.
- (2)参见Hannah Rose Kirk, et al.，“Why Human-AI Relationships Need Socioaffective Alignment，”Humanities and Social Sciences Communications,Vol.12(2025),Article 728.