AI chatbots may be generating buzz in health communication, but a randomized trial of nearly 1,300 parents found that traditional public health messaging from agencies like the CDC outlasted AI in sustaining parents' intent to vaccinate their kids against HPV. While both approaches boosted immediate intent, only government materials kept the effect going at 45 days. The takeaway: AI isn't ready to replace well-designed public health campaigns just yet.
AI chatbots are getting a lot of attention in healthcare, but when it comes to convincing parents to vaccinate their kids against HPV, tried-and-true public health messaging still holds the edge. A randomized trial published in JAMA Network Open tested nearly 1,300 parents across the U.S., Canada, and the UK, comparing the effects of CDC-style government materials versus large language model (LLM) chatbots — one with a default style, one conversational — on parental intent to vaccinate.
All three interventions boosted intent immediately after exposure. But at the 45-day mark, only government public health materials maintained a statistically significant effect. The chatbots' impact faded faster, suggesting that a single AI conversation may not be enough to drive lasting behavior change.
By the Numbers:
Why it matters: With HPV vaccination rates still well below where they need to be, this study is a reality check on AI hype. Researchers suggest future efforts should integrate AI as part of a broader support system — paired with reminders, scheduling, and clinician follow-up — rather than relying on a one-time chatbot conversation to drive lasting behavior change.
