AI talking science: Experimental studies on the perception of AI-based chatbots as sources of science-based information

AI-based chatbots offer new opportunities for communicating science-based information, but often fall short of established standards. We conducted two pre-registered experiments examining user perceptions of an AI-based chatbot providing information on nanoparticles in sunscreen. Study one (N = 508) tested whether a disclaimer about the chatbot's uncertain training data affected perceived source trustworthiness and information credibility. The results showed no significant effect of the disclaimer; perceptions were primarily influenced by users' prior attitudes. Study two (N = 1059) tested the evaluation of information on nanoparticles in sunscreen in an experiment with a 2 (source: scientist vs. AI-based chatbot) ×2 (presentation: static vs. dynamic) between-subjects design. The study showed that the scientist was evaluated as more trustworthy and the provided information seen as more credible compared to the AI-based chatbot. The two studies highlight the relevance of perceived objectivity in science and health communication, whether executed by humans or machines.