Study Shows Radiologists Overconfident in Difficult Cases

A recent Radiology study examined how confidence levels among radiologists and nonradiologists change with diagnostic difficulty, revealing a cognitive bias known as the 'hard-easy effect.'

The study involved 28 radiologists in their second year of residency or later and 50 nonradiology medical professionals who reviewed bone radiographs to determine if bone lesions were present or absent.

Participants rated their confidence and recommended next steps, such as ordering additional imaging or consulting a senior colleague. Their responses were compared to a reference standard based on CT or MRI findings validated by two board-certified musculoskeletal radiologists.

The study found that overconfidence rates among participants reached 14.73%, with radiologists showing higher success and confidence rates than nonradiologists. However, a consistent hard-easy effect was observed, where confidence did not decline as sharply as accuracy in difficult cases.

In the easiest cases, accuracy was about 98% and confidence around 93%, indicating good calibration. In the most difficult cases, accuracy dropped to about 37%, while confidence remained around 80%.

The findings suggest that expertise improves diagnostic performance but does not eliminate the hard-easy effect, highlighting the need for awareness of cognitive biases in medical decision-making.