Journal article
Sliding into My DMs: Detecting Uncomfortable or Unsafe Sexual Risk Experiences within Instagram Direct Messages Grounded in the Perspective of Youth
Proceedings of the ACM on human-computer interaction, v 7(CSCW1), pp 1-29
16 Apr 2023
Abstract
We collected Instagram data from 150 adolescents (ages 13-21) that included 15,547 private message conversations of which 326 conversations were flagged as sexually risky by participants. Based on this data, we leveraged a human-centered machine learning approach to create sexual risk detection classifiers for youth social media conversations. Our Convolutional Neural Network (CNN) and Random Forest models outperformed in identifying sexual risks at the conversation-level (AUC=0.88), and CNN outperformed at the message-level (AUC=0.85). We also trained classifiers to detect the severity risk level (i.e., safe, low, medium-high) of a given message with CNN outperforming other models (AUC=0.88). A feature analysis yielded deeper insights into patterns found within sexually safe versus unsafe conversations. We found that contextual features (e.g., age, gender, and relationship type) and Linguistic Inquiry and Word Count (LIWC) contributed the most for accurately detecting sexual conversations that made youth feel uncomfortable or unsafe. Our analysis provides insights into the important factors and contextual features that enhance automated detection of sexual risks within youths' private conversations. As such, we make valuable contributions to the computational risk detection and adolescent online safety literature through our human-centered approach of collecting and ground truth coding private social media conversations of youth for the purpose of risk classification.
Metrics
7 Record Views
37 citations in Scopus
Details
- Title
- Sliding into My DMs: Detecting Uncomfortable or Unsafe Sexual Risk Experiences within Instagram Direct Messages Grounded in the Perspective of Youth
- Creators
- Afsaneh Razi - Drexel University, Philadelphia, PA, USAAshwaq Alsoubai - Vanderbilt UniversitySeunghyun Kim - Georgia Institute of TechnologyShiza Ali - Boston UniversityGianluca Stringhini - Boston UniversityMunmun De Choudhury - Drexel UniversityPamela J. Wisniewski - Vanderbilt University
- Publication Details
- Proceedings of the ACM on human-computer interaction, v 7(CSCW1), pp 1-29
- Publisher
- ACM
- Grant note
- #187941 / William T. Grant Foundation (http://dx.doi.org/10.13039/100001143) IIP-1827700 and IIS-1844881 / National Science Foundation (http://dx.doi.org/10.13039/100000001)
- Resource Type
- Journal article
- Language
- English
- Academic Unit
- Information Science (Informatics)
- Scopus ID
- 2-s2.0-85153950132
- Other Identifier
- 991021861871404721