Files and links (1)
Published, Version of Record (VoR)Open Access via Drexel Libraries Read and Publish Program 2025CC BY V4.0, Open
Conference proceeding
Master of Deceit: Comparative Analysis of Human and Machine-Generated Deceptive Text
Proceedings of the 17th ACM Web Science Conference 2025, pp 189-198
20 May 2025
Featured in Collection : Research Supported by Drexel Libraries' OA Programs
Abstract
Deception, the intentional act of creating false impressions, has long been studied in human interactions. With the emergence of AI and large language models (LLMs), deception now extends to machine-generated content, raising concerns about distinguishing between human and AI-created content. In this study, we compare deceptive and truthful texts produced by humans and LLMs (GPT-3.5 and GPT-4o) using two datasets; a crowdsourced online Review Dataset and a transcribed interview dataset (MU3D). We replicate the data generation process with LLMs, introducing personas into prompts to examine linguistic differences and potential biases. Using LIWC, we analyze word choice, complexity, and cognitive patterns across human- and LLM-generated deception and truthful texts. Our findings show that LLM-generated deception differs significantly from human deception, exhibiting greater verbosity, formality, and lexical sophistication, while human deception is more socially driven, relying more on social references, interpersonal cues, and natural conversational patterns. Despite improvements in LLMs, context-dependent biases remain embedded in LLM-generated texts, emphasizing the need for stronger bias mitigation strategies and responsible AI deployment. Our study identifies key linguistic markers that differentiate LLM-generated from human deception and highlights the importance of assessing hidden biases and potential risks in AI-generated deceptive text and misinformation.
Metrics
25 Record Views
Details
- Title
- Master of Deceit: Comparative Analysis of Human and Machine-Generated Deceptive Text
- Creators
- Quang Minh Trinh - Drexel UniversitySamiha Zarin - Drexel UniversityRezvaneh Rezapour (Corresponding Author) - Drexel University
- Publication Details
- Proceedings of the 17th ACM Web Science Conference 2025, pp 189-198
- Conference
- Websci '25: 17th ACM Web Science Conference 2025
- Series
- ACM Conferences
- Publisher
- Association for Computing Machinery
- Number of pages
- 10
- Resource Type
- Conference proceeding
- Language
- English
- Academic Unit
- Information Science
- Web of Science ID
- WOS:001528454600019
- Other Identifier
- 991022053728304721
UN Sustainable Development Goals (SDGs)
This publication has contributed to the advancement of the following goals:
InCites Highlights
Data related to this publication, from InCites Benchmarking & Analytics tool:
- Web of Science research areas
- Computer Science, Information Systems
- Computer Science, Interdisciplinary Applications