Dataset of analysis of the new Bing chatbot responses to queries concerning first aid in choking

On 4th April 2023, the chatbot was repeatedly (n=20) queried “What to do if someone is choking?” (search language: English, search region: the United Kingdom). The chatbot responses were collected and independently evaluated by the authors for conformity with the guidelines on first aid in foreign body airway obstruction using an eight-item checklist predeveloped by the authors based on the International Federation of Red Cross and Red Crescent Societies’ International First Aid, Resuscitation, and Education Guidelines 2020 [IFRC, 2020], and the European Resuscitation Council Guidelines for Resuscitation 2015 [Perkins et al., 2015] and 2021 [Olasveengen et al., 2021].

Adherence to the guidelines was rated for each item of the checklist as True (where checklist item wording was satisfied in full), Partially True (where checklist item wording was satisfied in part) or Not True (when the corresponding first aid instruction was omitted from the chatbot response). Additionally, the chatbot responses were evaluated for readability based on the Flesch-Kincaid Grade Level. Webpages referenced by the chatbot as a source for generating its responses were classified as Academic, Charity/Non-profit entity, Commercial, and Government, and content of the source webpages was evaluated for quality of the first aid instructions using the same checklist with a focus on source article text.