Explore multimodal AI research for medical imaging.
The Imaging Informatics research area focuses on extracting knowledge from medical imaging data. Medical imaging data contains vast amounts of anatomical and physiological information to diagnose and classify and understand the progression of disease. Our group specializes in combining the deep insights gleaned from medical imaging data with the medical record through standards-based data models to enable multimodal research.
Our team includes imaging scientists who focus on deep learning methods for medical image segmentation, clinical imaging specialists in Radiology and Ophthalmology, and informaticists. Our group includes Paul Nagy, PhD, a Fellow of the Society of Imaging Informatics in Medicine (SIIM), past society Chair, and past Chair of the College of SIIM Fellows; and Teri Sippel Schmidt, MS, a Fellow of SIIM and a recipient of the SIIM Gold Medal. Our projects focus on integrating the DICOM imaging data with EHR data using the OHDSI Common Data Model (CDM) to generate reproducible computational evidence.
Project Highlight:
Medical research should be transparent and reproducible. Our lab is focusing on replicating published Alzheimer’s research papers, at scale, using AI for image segmentation, and combining this information with clinical information from the EHR using the OHDSI OMOP Imaging Extensions. Recently, we implemented the OHDSI Imaging Extensions to include DICOM image attributes. Combining EHR and DICOM criteria, we were able to computationally identify a cohort with inclusion and exclusion criteria. We used the OpenMapT1 segmentation algorithm to quantify hippocampus volumes and stored that quantified imaging data into the OMOP CDM, comparing the hippocampus volumes to the clinical cognitive scores from the EHR. This is novel because cohort, segmentation, correlations to clinical data, and analysis were automated, significantly reducing time and effort, replicating papers on public data sets, and creating transparent research.
Recent Grants
Recent Publications
- Breaking data silos: incorporating the DICOM imaging standard into the OMOP CDM to enable multimodal research: JAMIA (2025)
- Development of Medical Imaging Data Standardization for Imaging-Based Observational Research: OMOP Common Data Model Extension. J Digit Imaging. Inform. med. 37, 899–908 (2024).
- Advancing Medical Imaging Research Through Standardization: The Path to Rapid Development, Rigorous Validation, and Robust Reproducibility. Investigative Radiology (2024):10.1097