COVID-19 Messaging for Vaccination

• ClinicalTrials.gov Identifier: NCT05182554
• Recruitment Status: Completed
• First Posted: January 10, 2022
• Last Update Posted: August 5, 2022
• Sponsor: Massachusetts Institute of Technology
• Collaborators: Facebook, Inc.; Code3; Stanford University; Harvard University; Yale University; Johns Hopkins University; Massachusetts General Hospital; Ludwig-Maximilians - University of Munich; National Institutes of Health (NIH)
• Information provided by (Responsible Party): Massachusetts Institute of Technology

Study Description

Brief Summary:

This study will distribute videos of health professionals encouraging Covid-19 vaccination to a large sample of Facebook users, and will test the most effective ways to maximize diffusion of this vaccine-related content to increase vaccination rates. The study sample will be U.S. states where vaccination rates remained low in fall 2021. The experimental design is an RCT with 4 groups, randomized at the county level: 1) a control group which receives no intervention, 2) a treatment group in which Facebook users receive ads which include videos of health professionals telling them to get vaccinated, 3) a treatment group in which Facebook users receive ads which include videos of health professionals encouraging them to help their friends to get vaccinated, and 4) a treatment group in which Facebook users receive ads which include videos of health professionals encouraging them to get their most influential friends to help their friends get vaccinated. In treatments 3 and 4, participants will have the option to sign up to be a "vaccine ambassador," in which case they will get notifications when the study team posts new vaccine-related content, and will receive reminders about encouraging their friends to be vaccinated. The vaccine ambassadors will also be entered into a lottery to win prizes. The study team is building a website to host the videos of health professionals which answer common questions about Covid-19 vaccination. The investigators will measure engagement with the vaccine-related content as well as assess effects on vaccination rates at the county level.

Condition or disease	Intervention/treatment	Phase
Vaccination Refusal; COVID-19 Pandemic	Behavioral: Doctor Videos; Behavioral: Sharing Videos; Behavioral: Sharing Videos (Influencers); Behavioral: Vaccine Ambassador; Behavioral: Video framing; Behavioral: Video order	Not Applicable

Detailed Description:

The study will have three treatment arms and a control group. Each of the treatments will be randomized at the county level and will be initiated through a Facebook ad campaign.

Experimental Sample: The experimental sample includes all states where less than 60% of the total population had received a first dose of Covid-19 vaccine by October 21, 2021. There are 1402 counties in the 19 states satisfying those criteria (Alabama, Alaska, Arkansas, Georgia, Idaho, Iowa, Indiana, Louisiana, Michigan, Mississippi, Missouri, Montana, North Dakota, Ohio, Oklahoma, South Carolina, Tennessee, West Virginia, Wyoming). Excluding the five counties with missing data, there are 1,397 counties in the experiment, of which there are 468 counties in the control group, 310 counties in T1 ("direct" messaging) treatment, 309 counties in T2 ("friends" messaging), and 310 counties in T3 ("gossips" messaging).

The following procedures will be used:

• Treatment Group 1 ("Direct" messaging): The investigators will conduct a Facebook ad campaign to show content about COVID-19 vaccination to a large number of Facebook users. Facebook will allocate ad credits across users in treatment areas. The ads will be displayed twice per week for 3-4 weeks. Like for any Facebook ad, individuals can choose to whether or not to watch the video and can close the ad at any time. If individuals wish, they can also share any of the content with others. The videos shown in the ads will be hosted on our project Facebook page "Doctors for Coronavirus Prevention." As in previous projects by the investigators, a health professional (normally wearing a white coat or scrubs) will read very short scripts directly onto the camera (see eg. https://www.facebook.com/doctors4covidprevention/posts/104965558099200 for an example).
• Treatment Group 2 ("Friends" messaging): For this group, the Facebook ad campaign will recruit individuals to become "vaccine ambassadors" to help spread the word about vaccination to their friends, families and communities. Recruitment ads will be disseminated in a similar manner to the content in T1. Individuals will be able to share the ad with others. Individuals interested in learning more can click through a link in the ad to the vaccine ambassador webpage. Participants can consume or share any of the information on the webpage. Interested individuals can also enroll formally as vaccine ambassadors. They can share their contact information with the study to a) be entered into prize lotteries, b) receive reminders to share content with others, c) be contacted in the future for possible follow-up surveys. They will be asked to give their informed consent at this time and will be screened based on whether they live in a treated county and whether they are 18 years or older.
• Treatment Group 3 ("Gossips" messaging): This treatment looks the same as Treatment Group 2, except the recruitment ads will differ slightly. If the individual clicks through to learn more about vaccine ambassadors, they will also be reminded to share the invitation with people they know who are often the source of important news or information.
• Control: individuals in these counties will receive no intervention and will never be contacted by members of the study team.

Treatment and control status at the county level will be merged with aggregated and de-identified datasets to measure COVID vaccinations, COVID symptoms, and cases, and engagement with the vaccine ambassador content.

The study team will create a series of websites with materials that the vaccine ambassadors can share with friends, family and others in their communities. This same content will be disseminated through sponsored Facebook ads in T1. On the website, the framing of the vaccine-related videos with either a "fact" or "myth" frame will be randomized. The purpose is to study which framing is more effective at engaging users.

Study Design

• Study Type: Interventional (Clinical Trial)
• Actual Enrollment: 17828769 participants
• Allocation: Randomized
• Intervention Model: Parallel Assignment
• Intervention Model Description: There are four arms in the study which geographic areas are assigned to in parallel. The geographic areas in the three treatment arms will receive a Facebook ad campaign over the same time period to one another.
• Masking: None (Open Label)
• Primary Purpose: Treatment
• Official Title: Increasing the Effectiveness and Diffusion of COVID-19 Messaging for Vaccination
• Actual Study Start Date: December 22, 2021
• Actual Primary Completion Date: January 27, 2022
• Actual Study Completion Date: January 27, 2022

Arms and Interventions

Arm	Intervention/treatment
No Intervention: Control; No intervention in this arm; the study team will examine publicly available county- and zip code-level outcomes in this group.
Experimental: Treatment 1: Direct; Facebook users in the area receive ads which include videos of health professionals telling them to get vaccinated. The health professionals answer common questions about Covid-19 vaccines (e.g. are they safe / are they free).	Behavioral: Doctor Videos; Receive ads on Facebook or through our website with videos in which health professionals tell people to get the Covid-19 vaccine. The health professionals answer common questions about the Covid-19 vaccine, such as how mRNA vaccines work, and what types of side effects to expect.
Experimental: Treatment 2: Friends; Facebook users in the area receive ads which include videos of health professionals encouraging them to help their friends to get vaccinated. There is also a link in the ad to a website build by the study team. This website hosts videos which answer common questions about vaccination (the same videos which are directly served to Facebook users in Treatment 1).	Behavioral: Doctor Videos; Receive ads on Facebook or through our website with videos in which health professionals tell people to get the Covid-19 vaccine. The health professionals answer common questions about the Covid-19 vaccine, such as how mRNA vaccines work, and what types of side effects to expect.; Behavioral: Sharing Videos; Receive ads on Facebook with videos in which health professionals tell people to encourage their unvaccinated friends to get the Covid-19 vaccine.; Behavioral: Vaccine Ambassador; Adults in participating geographic areas can sign up to be a "vaccine ambassador" on a website that the study team has built. The study team will send updates to vaccine ambassadors when new content has been posted to the website (e.g. a new video) and/or to remind the vaccine ambassadors to encourage their friends to get vaccinated. The study team will incentivize vaccine ambassadors by entering participating ambassadors into a lottery for a prize.; Behavioral: Video framing; The same videos will be displayed using two different frames: a "myth" frame and a "fact" frame. Visitors to the vaccine content website will randomly receive one framing of each video.; Behavioral: Video order; The order in which videos appear on the vaccine content website will be randomized.
Experimental: Treatment 3: Gossips; Facebook users in the area receive ads which include videos of health professionals encouraging them to nominate their most influential friends to help their friends get vaccinated. The difference from Treatment 2 is that the health professionals call on Facebook users to get their most influential friends to do the convincing about the vaccine. There is also a link in the ad to a website built by the study team. This website hosts videos which answer common questions about vaccination (the same videos that are directly served to Facebook users in Treatment 1).	Behavioral: Doctor Videos; Receive ads on Facebook or through our website with videos in which health professionals tell people to get the Covid-19 vaccine. The health professionals answer common questions about the Covid-19 vaccine, such as how mRNA vaccines work, and what types of side effects to expect.; Behavioral: Sharing Videos (Influencers); Receive ads on Facebook with videos in which health professionals tell people to get their most influential friends to encourage their unvaccinated friends to get the Covid-19 vaccine.; Behavioral: Vaccine Ambassador; Adults in participating geographic areas can sign up to be a "vaccine ambassador" on a website that the study team has built. The study team will send updates to vaccine ambassadors when new content has been posted to the website (e.g. a new video) and/or to remind the vaccine ambassadors to encourage their friends to get vaccinated. The study team will incentivize vaccine ambassadors by entering participating ambassadors into a lottery for a prize.; Behavioral: Video framing; The same videos will be displayed using two different frames: a "myth" frame and a "fact" frame. Visitors to the vaccine content website will randomly receive one framing of each video.; Behavioral: Video order; The order in which videos appear on the vaccine content website will be randomized.

Outcome Measures

Primary Outcome Measures :

1. Changes in county-level Covid-19 vaccination [ Time Frame: During intervention and up to 6 months after intervention ]
   Measured by publicly available county- or zip code-level vaccination data. The study will examine total vaccinations as well as vaccinations by age group. The study will also examine people 1) getting their first dose of vaccine, 2) completing their vaccine series, and 3) getting booster shots.
2. Social shares of vaccine-related content [ Time Frame: During intervention and up to 6 months after intervention ]
   Number of social media shares of vaccine-related videos and messaging that the study team has created, disaggregated at the county or zip code level.
3. Number of views of vaccine-related content [ Time Frame: During intervention and up to 6 months after intervention ]
   Number of views of the website and vaccine-related videos, disaggregated at the county or zip code level.

Secondary Outcome Measures :

1. COVID-19 cases [ Time Frame: During intervention and up to 6 months after intervention ]
   Measured by publicly available county- or zip code-level Covid-19 cases, in some areas also split by vaccinated vs unvaccinated status.
2. COVID-19 symptoms prevalence [ Time Frame: During intervention and up to 6 months after intervention ]
   Measured by publicly available county- or zip code-level Covid-19 symptoms, in some areas also split by vaccinated vs unvaccinated status.
3. COVID-19 hospitalization and mortality [ Time Frame: During intervention and up to 6 months after intervention ]
   Measured by data on patients admitted to hospitals or who have been recorded to have died from Covid-19, , in some areas also split by vaccinated vs unvaccinated status.
4. Vaccine hesitancy [ Time Frame: During intervention and up to 6 months after intervention ]
   Measured by publicly available county- or zip code-level surveys
5. Movement and Travel [ Time Frame: During intervention and up to 6 months after intervention ]
   Measured using mobile phone location data of Facebook users. Vaccinated people may be more likely to take risks, including travel.
6. School closures [ Time Frame: During intervention and up to 6 months after intervention ]
   Increased cases could lead to more school closures. The investigators do not expect the study to be well-powered on this outcome.
7. Number of vaccine ambassador volunteers [ Time Frame: During intervention ]
   This will be compared between the "friends" and "gossips" treatment groups. This will include people who start to sign up to be vaccine ambassadors as well people who complete the vaccine ambassador consent process.

Eligibility Criteria

• Ages Eligible for Study: 18 Years and older (Adult, Older Adult)
• Sexes Eligible for Study: All
• Accepts Healthy Volunteers: Yes

Criteria

Inclusion Criteria:

• Facebook user
• Over 18 years old
• In a geographic area targeted by the study

Exclusion Criteria:

-

Contacts and Locations

Locations

United States, Massachusetts

Massachusetts Institute of Technology

Cambridge, Massachusetts, United States, 02139

Sponsors and Collaborators

Massachusetts Institute of Technology

Facebook, Inc.

Code3

Stanford University

Harvard University

Yale University

Johns Hopkins University

Massachusetts General Hospital

Ludwig-Maximilians - University of Munich

National Institutes of Health (NIH)

Investigators

• Principal Investigator: Esther Duflo, PhD; Massachusetts Institute of Technology
• Principal Investigator: Ben Olken, PhD; Massachusetts Institute of Technology
• Principal Investigator: Abhijit Banerjee, PhD; Massachusetts Institute of Technology
• Principal Investigator: Marcella Alsan, MD, PhD; Harvard Kennedy School
• Principal Investigator: Arun Chandrasekhar, PhD; Stanford University
• Principal Investigator: Emily Breza, PhD; Harvard University
• Principal Investigator: Paul Goldsmith-Pinkham, PhD; Yale University
• Principal Investigator: Emily Hoppe, PhD Student; Johns Hopkins School of Nursing
• Principal Investigator: Pierre-Luc Vautrey, PhD Student; Massachusetts Institute of Technology
• Principal Investigator: Lisa Ho, PhD Student; Massachusetts Institute of Technology
• Principal Investigator: Lucy Ogbu-Nwobodo, MD; MGH/McLean Harvard Psychiatry Program
• Principal Investigator: Erica Warner, ScD, MPH; Harvard Medical School & Massachusetts General Hospital
• Principal Investigator: Carlos Torres, MD; Massachusetts General Hospital
• Principal Investigator: Fatima Stanford, MD, MPH, MPA; Harvard Medical School & Massachusetts General Hospital
• Principal Investigator: Sarah Eichmeyer, PhD; Ludwig-Maximilians - University of Munich

More Information

• Responsible Party: Massachusetts Institute of Technology
• ClinicalTrials.gov Identifier: NCT05182554
• Other Study ID Numbers: 2106000397
• First Posted: January 10, 2022
• Last Update Posted: August 5, 2022
• Last Verified: January 2022

Individual Participant Data (IPD) Sharing Statement:

• Plan to Share IPD: No
• Plan Description: The investigators do not plan to share any individual participant data. The only individual participant data that the study will collect will be contact information through the "vaccine ambassador" program. "Vaccine ambassadors" are adults living in geographic areas assigned to Treatment 2 or Treatment 3 who have signed up on the study website to receive updates and reminders about vaccination-related content. However, the study team does not plan on collecting any information about the behavior of vaccine ambassadors, and so do not plan to share any of their data (which will just consisting of contact information) with other researchers.

• Studies a U.S. FDA-regulated Drug Product: No
• Studies a U.S. FDA-regulated Device Product: No

Keywords provided by Massachusetts Institute of Technology:

Covid-19 Vaccine; Social Media

Additional relevant MeSH terms:

COVID-19; Pneumonia, Viral; Pneumonia; Respiratory Tract Infections; Infections; Virus Diseases; Coronavirus Infections; Coronaviridae Infections; Nidovirales Infections; RNA Virus Infections; Lung Diseases; Respiratory Tract Diseases