To assess whether AI assistants could identify dental offices open for emergency care late at night.
Approach:
Assistants and locations: Dental.me tested ChatGPT, Google Gemini, and Anthropic Claude across the 50 largest U.S. cities on November 14. The supplied context does not specify the year.
Testing and verification: Researchers asked each assistant to name three specific dental offices, with phone numbers, open at the time to treat a patient with a toothache. They compared recommendations with Google Maps listings and posted operating hours.
Key Findings:
Across 150 responses, assistants recommended 600 locations or services, including hospital emergency departments and hotlines or referral services. Of 248 recommended locations with verifiable posted hours, 170 (69%) were listed as closed at the time.
Closed-location recommendation rates were 43% for ChatGPT, 54% for Claude, and 97% for Gemini.
In 93 responses, researchers could not confirm that any recommended dental office was open, excluding hospital emergency departments.
Of 201 dental offices identified by assistants as open 24 hours, 65 were confirmed open, 46 were listed as closed, and 45 could not be found on Google Maps.
Sixty-one recommendations had no matching Google Maps listing. Five named dentists could not be verified in the federal provider registry for the stated state; Dental.me reported that four had no corresponding dentist registered anywhere in the United States.
Interpretation:
Dental.me reported that AI recommendations for late-night emergency dental care often did not match posted office hours or verifiable listings. The study assessed recommendation accuracy, not the clinical quality of the practices.
Limitations:
Availability was assessed using posted Google hours applicable at the time of inquiry, rather than subsequently displayed business-status information; some practices may provide after-hours telephone services while their offices are closed.
The study did not assess the clinical quality of recommended practices.
The findings were reported by Dental.me, which operates a dental directory.
Conclusion:
Dental.me advised users to call before traveling to a recommended office.
New package provides startup dental practices with access to clinical, billing, and revenue cycle management tools, along with consulting and performance benchmarking.