机构:[1]Department of Radiology, Jinling Hospital, Affiliated Hospital of Medical School, Nanjing University, Nanjing 210002, China.[2]Health Science Center, Ningbo University, Zhejiang, China.[3]Department of Biostatistics, School of Public Health, Nanjing Medical University, Nanjing, China.[4]Department of Radiology, University Second Hospital, Lanzhou, China.[5]Department of Medical Imaging, The First Affiliated Hospital of Kunming Medical University, Kunming, China.医技科室医学影像中心昆明医科大学附属第一医院[6]Department of Radiology, the Affiliated Hospital of Xuzhou Medical University, Xuzhou, Jiangsu, China.[7]The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China.[8]Image Center, The First People's Hospital of Kashi Prefecture, Kashi, China.[9]Deepwise Artificial Intelligence (AI) Laboratory, Deepwise Inc, Beijing, China.[10]Institute of Artificial Intelligence, Beihang University, Beijing, China.[11]Department of Computer Science, The University of Hong Kong, Hong Kong, China.[12]Center for Public Health and Epidemic Preparedness & Response, Peking University, Beijing, China.
"Just Accepted" papers have undergone full peer review and have been accepted for publication in Radiology: Artificial Intelligence. This article will undergo copyediting, layout, and proof review before it is published in its final version. Please note that during production of the final copyedited article, errors may be discovered which could affect the content. Purpose To evaluate a Sham-AI model acting as a placebo control for a Standard-AI model for intracranial aneurysm diagnosis. Materials and Methods This retrospective crossover, blinded, multireader multicase study was conducted from November 2022 to March 2023. A Sham-AI model with near-zero sensitivity and similar specificity to a Standard-AI model was developed using 16,422 CT angiography (CTA) examinations. Digital subtraction angiography-verified CTA examinations from four hospitals were collected, half of which were processed by Standard-AI and the others by Sham-AI to generate Sequence A; Sequence B was generated reversely. Twenty-eight radiologists from seven hospitals were randomly assigned with either sequence, and then assigned with the other sequence after a washout period. The diagnostic performances of radiologists alone, radiologists with Standard-AI-assisted, and radiologists with Sham-AI-assisted were compared using sensitivity and specificity, and radiologists' susceptibility to Sham-AI suggestions was assessed. Results The testing dataset included 300 patients (median age, 61 (IQR, 52.0-67.0) years; 199 male), 50 of which had aneurysms. Standard-AI and Sham-AI performed as expected (sensitivity: 96.0% versus 0.0%, specificity: 82.0% versus 76.0%). The differences in sensitivity and specificity between Standard-AI-assisted and Sham-AIassisted readings were +20.7% (95%CI: 15.8%-25.5%, superiority) and 0.0% (95%CI: -2.0%-2.0%, noninferiority), respectively. The difference between Sham-AI-assisted readings and radiologists alone was-2.6% (95%CI: -3.8%--1.4%, noninferiority) for both sensitivity and specificity. 5.3% (44/823) of true-positive and 1.2% (7/577) of false-negative results of radiologists alone were changed following Sham-AI suggestions. Conclusion Radiologists' diagnostic performance was not compromised when aided by the proposed Sham-AI model compared with their unassisted performance. Published under a CC BY 4.0 license.
基金:
This study was funded by the Youth Fund of the National Natural Science
Foundation of China (82102155 for Z.S.) and the Key Projects of the National Natural
Science Foundation of China (81830057 and 82230068 for L.J.Z.).
语种:
外文
被引次数:
WOS:
PubmedID:
中科院(CAS)分区:
出版当年[2026]版:
无
最新[2025]版:
大类|1 区医学
小类|1 区计算机:人工智能2 区核医学
JCR分区:
出版当年[2025]版:
无
最新[2024]版:
Q1COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCEQ1RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING
第一作者机构:[1]Department of Radiology, Jinling Hospital, Affiliated Hospital of Medical School, Nanjing University, Nanjing 210002, China.
共同第一作者:
通讯作者:
推荐引用方式(GB/T 7714):
Shi Zhao,Hu Bin,Lu Mengjie,et al.Development and Validation of a Sham-AI Model for Intracranial Aneurysm Detection at CT Angiography[J].Radiology. Artificial Intelligence.2025,7(3):e240140.doi:10.1148/ryai.240140.
APA:
Shi Zhao,Hu Bin,Lu Mengjie,Zhang Manting,Yang Haiting...&Zhang Long Jiang.(2025).Development and Validation of a Sham-AI Model for Intracranial Aneurysm Detection at CT Angiography.Radiology. Artificial Intelligence,7,(3)
MLA:
Shi Zhao,et al."Development and Validation of a Sham-AI Model for Intracranial Aneurysm Detection at CT Angiography".Radiology. Artificial Intelligence 7..3(2025):e240140