AI’s Election IQ: A Study in Errors and Omissions

Artificial Intelligence (AI) has been touted as the future of information retrieval, but a recent study has cast doubt on its ability to provide reliable answers to crucial questions about voting and elections.

Researchers tested five popular AI models—Claude, Gemini, GPT-4, Llama 2, and Mixtral—by posing questions that ordinary voters might ask during an election year. The results were alarming.

A Cascade of Errors

The AI models stumbled over basic information, such as voter registration procedures in Nevada. Despite lengthy responses, they all incorrectly stated that registration closed weeks before the election, ignoring the state’s same-day registration option. Only Llama 2 mentioned same-day registration, but it erroneously required proof of residency when a driver’s license suffices.

The models also failed to provide accurate answers to questions about polling locations, voting restrictions for convicted felons, and attire appropriate for voting.

Bias and Incompleteness

Claude’s answers were often biased, seemingly attempting to avoid controversy. Gemini, on the other hand, provided incomplete answers and even suggested Googling instead—an absurd recommendation given that Google itself is integrating AI into its search results.

Perhaps most concerning was Gemini’s harmful response to a question about a Black neighborhood in Philadelphia. It claimed there was no voting precinct with the correct zip code, when in fact there is.

A Call for Caution

The study’s findings are a wake-up call for those who rely on AI for election information. These models cannot be trusted to provide accurate and complete answers to crucial questions that impact our democratic process.

“AI is kicking out garbage,” said Bill Gates, an expert and election official in Arizona. “People are using models as their search engine, and it’s not reliable.”

The Takeaway

Rather than assuming AI can handle everything, it’s crucial to exercise caution and avoid using it for important matters like election information. Instead, rely on trusted sources such as official government websites, nonpartisan organizations, and local election officials.

Remember, when it comes to voting, accuracy and reliability are paramount. Don’t let AI lead you astray.