Multimodal Presentation of Biomedical Data Željko Obrenovic, Dušan Starcevic, Emil Jovanov 1. INTRODUCTION ...............................................................................................................................................2 2. DEFINING TERMS ............................................................................................................................................2 3. PRESENTATION OF BIOMEDICAL DATA..................................................................................................3 3.1. EARLY BIOMEDICAL SIGNAL DETECTION AND PRESENTATION ..................................................................3 3.2. COMPUTER-BASED SIGNAL DETECTION AND PRESENTATION ....................................................................3 3.3. TYPES OF BIOMEDICAL DATA .......................................................................................................................4 4. MULTIMODAL PRESENTATION ..................................................................................................................6 4.1. COMPUTING PRESENTATION MODALITIES ...................................................................................................6 4.1.1. Visualization ..........................................................................................................................................7 4.1.2. Audio Presentation ................................................................................................................................9 4.1.3. Haptic Rendering ................................................................................................................................ 11 4.1.4. Olfactory Presentation ....................................................................................................................... 12 4.2. MULTIMODAL INTEGRATION...................................................................................................................... 12 4.2.1. Integration Mechanisms ..................................................................................................................... 12 4.2.2. Common Multimodal Combinations.................................................................................................. 13 4.3. HUMAN INFORMATION PROCESSING.......................................................................................................... 14 5. TOOLS AND PLATFORMS ........................................................................................................................... 16 5.1. PRESENTATION HARDWARE ....................................................................................................................... 16 5.1.1. Visualization Devices ......................................................................................................................... 16 5.1.2. Sound Presentation Devices............................................................................................................... 16 5.1.3. Haptic Feedback Devices ................................................................................................................... 16 5.1.4. Olfactory Presentation Devices......................................................................................................... 17 5.2. SOFTWARE SUPPORT .................................................................................................................................. 17 6. MULTIMODAL PRESENTATION IN BIOMEDICAL APPLICATIONS ................................................ 19 6.1. MEDICAL DIAGNOSTICS ............................................................................................................................. 19 6.2. MEDICAL EDUCATION AND TRAINING....................................................................................................... 20 6.3. SURGICAL PROCEDURES ............................................................................................................................. 21 6.4. REHABILITATION AND MEDICAL TREATMENT .......................................................................................... 21 7. CONCLUSION ................................................................................................................................................. 22 8. BIBLIOGRAPHY............................................................................................................................................. 23