SDBench
AI overview
Sign in and the AI will write an overview from our coverage.
Headlines · 1
- Microsoft’s MAI-DxO outperforms generalists in simulated diagnosis
Microsoft’s multi-agent MAI-DxO asks sequential questions, selects tests and debates diagnoses, according to a peer-reviewed Science study reported by The Next Web. It achieved 83.2% accuracy on 304 complex cases derived from New England Journal of Medicine reports, compared with 36.1% for generalist physicians with reference materials and about 22% without them. On 325 emergency-department cases, it scored 80.3%, versus 46.8% for generalist physicians. Microsoft acknowledged that the evaluations used retrospective text cases and had no physical examinations or medical imaging. Specialists and multidisciplinary teams were not included, and the system has not been validated in live clinical care. Microsoft researchers plan to work with Beth Israel Deaconess Medical Center on testing.
cnBeta · 🔥 0
Experience and discussion from the community
Share my SDBench experienceAsk about SDBench
Nobody has shared their experience with SDBench yet.