Consumer AI Safety and Digital Mental Health
The use of generative AI chatbots (such as ChatGPT, Character.AI, Replika, and similar consumer products) for companionship and mental wellness is rapidly growing, with a high proportion of adolescents and young adults reporting use. However, these products are not designed as mental health interventions, and minimal clinical evidence exists regarding how patients with diagnosed mental illness may interact with them. Numerous media reports have raised concerns about potential harms, yet the actual prevalence of use among psychiatric patients and associated benefits and risks remain poorly characterized. Our group is investigating the prevalence and patterns of AI chatbot use in patients with mental illness, including those requiring acute hospitalization, exploring psychometric associations with use, and measuring exposure to potentially helpful and harmful content. Through surveys, chat logs, EHR data, and direct measurement of use patterns, we hope to create understanding of how patients with mental illness interact with these consumer AI products, and how those interactions may influence their mental health.