The California state fire prevention agency has launched an AI chatbot to improve efficiency. The outcome is troubling, reports Markup Marena Carolo. “Chatbots generate answers using the CAL Fire website and agency ReadyForwildFire.org. They can communicate to users about topics such as active wildfires, agents, Fire Prepartness tips, and Cal Fire programs.”
Calmatters has discovered that “chatbots aimed at providing important fire prevention resources and near-real-time emergency information “cannot accurately explain the containment of a particular wildfire, but do not reliably provide information such as a list of evacuation items,” and cannot inform users about evacuation orders. ”
The chatbot struggled to answer questions about preparing the fire, depending on how the questions were expressed. “And while the chatbots didn’t generate incorrect answers to any of the queries created by Calmatters, they don’t always get the latest information.” The chatbot is also unable to provide information about evacuation orders.
Experts say bot testing should have been done long before it was launched for public use. “Agencies interested in using chatbots should identify questions that the public is likely to ask AI tools in advance. These ensure that agents provide and refine their chatbots by ensuring that public pilot members have the information they ask for their systems.”
Source link
