Shohei Mori
Junior Research Group Leader
About me
Researcher in human-centered 3D vision for XR.
I am a Junior Research Group Leader at the Visualization Research Center (VISUS) and the Cluster of Excellence IntCDC at the University of Stuttgart, Germany. I additionally serve as a Guest Associate Professor (Global) at Keio University, Japan, and contribute to the Stuttgart Research Focus Re/producing Realities (Re2). I lead the Mediated Reality Group.
My research focuses on 3D vision for XR with an emphasis on human-centered computing approaches to vision and graphics challenges. I investigate how computational methods can mediate and augment human perception of the physical world.
My work has been published in premier venues including IEEE VR, IEEE ISMAR, ACM SIGGRAPH Asia, ECCV, IEEE/CVF WACV, ACM CHI, ACM UIST, ACM VRST, and IEEE TVCG. Multiple works have received awards, including the IEEE VR Best Paper Award (2022), IEEE ISMAR Best Paper Award (2021, 2023), IEEE ISMAR Best Demo Award (2015), and the SIG-MR Award (2025).
I serve as Paper Co-Chair for IEEE VR 2027 and previously served as Program Co-Chair for IEEE VR 2026 and Associate Paper Co-Chair for IEEE ISMAR 2025.
Workshop Calls
Recent Topics
View all →
Intelligent Volume Capture
Human-centered 3D vision and AR for consistent and comprehensive scene capture.
Intelligent Volume Capture
IntelliCap: Intelligent Guidance for Consistent View Sampling
IEEE ISMAR 2025
Scene Understanding with Scene Graphs
Vision-language agents reason about 3D scene semantics.
Scene Understanding with Scene Graphs
Think While You Map: Asynchronous Vision-Language Agents for Incremental 3D Scene Graphs
ECCV 2026
Diminished Reality
Removing 3D objects from a live scene for computationally mediated reality.
Diminished Reality
InpaintFusion: Incremental RGB-D Inpainting for 3D Scenes
IEEE TVCG (2020) · IEEE ISMAR 2020
Perceptual Modulation in XR
Illusory effects arise from visual augmentation operating through mediated reality
Perceptual Modulation in XR
Perceived Weight of Mediated Reality Sticks
IEEE TVCG (2025) · IEEE VR 2026
Professional Activity, Awards, and Teaching
Honors
Awards
IEEE VR 2026, Best Research Demo Award Nominee for
Experiencing Weight Illusion in AR Extended Displays: A Portable Community Demo
Experiencing Weight Illusion in AR Extended Displays: A Portable Community Demo
Design Association of Augmented Experience (DAAX) 2026, Good Experience Design Student Award for
Not All WIP Are Perceived Equally: Different Speed Expectations in Seated Walk-in-Place Locomotion
Not All WIP Are Perceived Equally: Different Speed Expectations in Seated Walk-in-Place Locomotion
SIG-MR 2025, SIG-MR Award for
Toward Multi-Plane Image Reconstruction from a Casually Captured Focal Stack (in Japanese)
Toward Multi-Plane Image Reconstruction from a Casually Captured Focal Stack (in Japanese)
MIRU 2024, Interactive Presentation Award for
Multi-layer Image Generation from Synthetic Defocus Image Evaluation (in Japanese)
Multi-layer Image Generation from Synthetic Defocus Image Evaluation (in Japanese)
MIRU 2024, Student Encouragement Award for
Depth Estimation Using Event Focal Stack (in Japanese)
Depth Estimation Using Event Focal Stack (in Japanese)
IEEE ISMAR 2023, Best Journal Paper Award for
Multi-layer Scene Representation from Composed Focal Stacks
Multi-layer Scene Representation from Composed Focal Stacks
IEEE ISMAR 2023, Best Journal Paper Award Nominee for
Exemplar-Based Inpainting for 6DOF Virtual Reality Photos
Exemplar-Based Inpainting for 6DOF Virtual Reality Photos
IEEE VR 2022, Best Journal Paper Award for
Video See-Through Mixed Reality with Focus Cues
Video See-Through Mixed Reality with Focus Cues
IIEEJ 2022, Best Journal Paper Award for
Visual Odometry Adjusted to the Scale of a Global Map (in Japanese)
Visual Odometry Adjusted to the Scale of a Global Map (in Japanese)
JSCAS 2022, Best Paper Award for
3D Structure Estimation of the Surgical Field from Multi-view Video ―Towards the Free-viewpoint Visualization of Open Surgery― (in Japanese)
3D Structure Estimation of the Surgical Field from Multi-view Video ―Towards the Free-viewpoint Visualization of Open Surgery― (in Japanese)
IEEE ISMAR 2021, Best Conference Paper Award for
Neural Cameras: Learning Camera Characteristics for Coherent Mixed Reality Rendering
Neural Cameras: Learning Camera Characteristics for Coherent Mixed Reality Rendering
KELVAR @ IEEE VR 2020, Best Paper Award for
Tools for Teaching Mining Students in Virtual Reality based on 360° Video Experiences
Tools for Teaching Mining Students in Virtual Reality based on 360° Video Experiences
ICVSS 2016, Best Reading Group
IEEE ISMAR 2015, Best Demo Award for
DOMINO (Do Mixed-reality Non-stop) Toppling
DOMINO (Do Mixed-reality Non-stop) Toppling
KJMR 2015, Best Presentation Award for
An AR/MR Camera Tracker Using View Dependent Texture Mapping
An AR/MR Camera Tracker Using View Dependent Texture Mapping
KJMR 2014, Best Presentation Award for
Building a Data Acquisition Studio for Diminished Reality Research
Building a Data Acquisition Studio for Diminished Reality Research
Ritsumeikan University PASEAR 2009, Dean Education Award
Ritsumeikan University PASEAR 2008, Education Award
Ritsumeikan University PASEAR 2007, Award for Excellence
Grants
Exzellenzclusters 2120 IntCDC, Participating Researcher (€284,790, Apr. 2026–Jun. 2029)
AI and Imaging Methods to Characterise the Performance of Biofibre Systems
AI and Imaging Methods to Characterise the Performance of Biofibre Systems
Ritsumeikan International Collaborative Research Promotion Program (Startup), Counterpart Principal Investigator (¥1M, Apr. 2024–Mar. 2025)
Immersive 3D Spatial Editing for Large Workspace with a Stretchable Stylus and a Hand-held Canvas
Immersive 3D Spatial Editing for Large Workspace with a Stretchable Stylus and a Hand-held Canvas
FWF P33634, Co-Investigator (€407,116, Jan. 2021–Dec. 2024)
3DDR – Real-time Three-Dimensional Diminished Reality
3DDR – Real-time Three-Dimensional Diminished Reality
AVL List GmbH, Expert Researcher (Apr. 2023–Oct. 2023)
Proof-of-Concept zur Modifikation von Sensordaten
Proof-of-Concept zur Modifikation von Sensordaten
R-GIRO, Project Member (Apr. 2021–Mar. 2026)
An Interdisciplinary Research Center on Supporting Cognitive and Communication for Elderly
An Interdisciplinary Research Center on Supporting Cognitive and Communication for Elderly
Grant-in-Aid for Young Scientists (B), 17K12729, Principal Investigator (¥4.03M, Apr. 2017–Sep. 2018)
Perceptually High Contrast Optical See-Through HMD based on Adaptation
Perceptually High Contrast Optical See-Through HMD based on Adaptation
Grant-in-Aid for JSPS Fellows (PD), 16J05114, Research Fellow (¥4.42M, Apr. 2016–Sep. 2018)
Research on Mixed and Augmented Reality Using Light Field Cameras
Research on Mixed and Augmented Reality Using Light Field Cameras
Grant-in-Aid for JSPS Fellows (DC-1), 13J09193, Research Fellow (¥3.0M, Apr. 2013–Mar. 2016)
Two Approaches for Improving the Expressiveness of Mixed Reality Space
Two Approaches for Improving the Expressiveness of Mixed Reality Space
Grant-in-Aid for Scientific Research (S), 24220004, Research Collaborator (May 2012–Mar. 2017)
Systematizing and Consolidating a Technological Basis of Mixed and Diminished Reality Space
Systematizing and Consolidating a Technological Basis of Mixed and Diminished Reality Space
Scholarships
Ritsumeikan University (2013–2016), KENKYU-SHOREI Scholarship S
Prize Fellowship for Doctoral Degree Students, for JSPS DC1/DC2 achievers
Prize Fellowship for Doctoral Degree Students, for JSPS DC1/DC2 achievers
Ritsumeikan University (2011), Saionji Graduate School Encouragement Scholarship
For the top graduate
For the top graduate
Ritsumeikan University (2010), Saionji Ikuei Scholarship
For the top three high achievers
For the top three high achievers
Ritsumeikan University (2009), Saionji Ikuei Scholarship
For the top three high achievers
For the top three high achievers
Ritsumeikan University (2008), Saionji Ikuei Scholarship
For the top three high achievers
For the top three high achievers
Teaching
Lecturer
"Image-Based and Neural Rendering" (Advanced Seminar) at University of Stuttgart (WS2024)
Lectures, scientific writing, and presentation organization
Lectures, scientific writing, and presentation organization
"Virtual Reality" (Research Seminar) at TU Graz (2022–2024)
Organization of weekly students' research presentations
Organization of weekly students' research presentations
Guest Lecturer
"Real-Time Graphics" at University of Stuttgart (with Dieter Schmalstieg, SS2025)
Lectures on image-based and neural rendering
Lectures on image-based and neural rendering
"Cognitive Science Research Center Study Group" at Ritsumeikan University (organized by Asako Kimura, 21.11.2024)
Invited lecture on "Augmented Reality Research in Austria and Germany"
Invited lecture on "Augmented Reality Research in Austria and Germany"
"Mixed Reality Technologies" at FH Salzburg (with Markus Tatzgern, SS2025, SS2026)
Lectures on diminished reality
Lectures on diminished reality
"Realtime Visualisation" at FH Salzburg (with Markus Tatzgern, WS2020–WS2023)
Lectures on image-based rendering; assignment design on light field reparameterization and AR-based capturing
Lectures on image-based rendering; assignment design on light field reparameterization and AR-based capturing
"Augmented Reality" at TU Graz (with Denis Kalkofen et al., WS2018–WS2023)
Lectures on visual tracking, camera calibration, image-based rendering, and diminished reality
Lectures on visual tracking, camera calibration, image-based rendering, and diminished reality
"Virtual Reality" at TU Graz (with Dieter Schmalstieg / Clemens Arth, SS2022–SS2024)
Lecture on image-based rendering, plenoptic cameras, light field displays, and neural rendering
Lecture on image-based rendering, plenoptic cameras, light field displays, and neural rendering
"Biomedical Visualization / AK Computergraphics" at TU Graz (with Denis Kalkofen, WS2022, WS2023)
Lecture on light field theory, imaging, and microscopy
Lecture on light field theory, imaging, and microscopy
"Information Engineering Special Lecture Series" at Keio University (organized by Maki Sugimoto, 25.11.2022)
Invited lecture on "What we can/cannot see through today's mixed reality"
Invited lecture on "What we can/cannot see through today's mixed reality"
"Visual Informatics Lecture Series" at Osaka Electro-Communication University (organized by
Akira Kimachi, 6.3.2023)
Invited lecture on "Why is 'place CG there' in AR still challenging"
Invited lecture on "Why is 'place CG there' in AR still challenging"
Teaching Assistant
"Scientific Writing" at TU Graz (with Peter Mohr, WS2022)
Provided topics for student research and description
Provided topics for student research and description
"Computer Vision and Graphics" at TU Graz (with Markus Steinberger, Peter Mohr, Ana Stanescu, and Lukas Radl, SS2024)
Managed CG assignment and conducted plagiarism interviews
Managed CG assignment and conducted plagiarism interviews
"Experiments in Media Technology – Virtual/Mixed Reality" at Ritsumeikan University (2011, 2012)
Group work support and assignment evaluations
Group work support and assignment evaluations
Invited Lab Talks
Keio University (with Peter Mohr-Ziak and Ana Stanescu, organized by Hideo Saito, 27.11.2024)
Augmented Reality Research in Austria and Germany
Augmented Reality Research in Austria and Germany
Ritsumeikan University (with Peter Mohr-Ziak and Ana Stanescu, organized by Asako Kimura, 20.11.2024)
Augmented Reality Research in Austria and Germany
Augmented Reality Research in Austria and Germany
FH Salzburg (organized by Markus Tatzgern, 30.11.2023)
Mediated Reality: 3D Real-World Augmentation and Beyond
Mediated Reality: 3D Real-World Augmentation and Beyond
NAIST (organized by Hideaki Uchiyama, 22.11.2023)
Through the Looking Glass of Mediated Reality
Through the Looking Glass of Mediated Reality
University of Stuttgart (organized by Dieter Schmalstieg, 28.10.2023)
Lenses to See the World and Us in Mediated Reality
Lenses to See the World and Us in Mediated Reality
Osaka University (organized by Daisuke Iwai, 8.03.2023)
Towards Editable World and Understanding It
Towards Editable World and Understanding It
Student Supervision
Bachelor Thesis Supervisor — Christopher Gaug (University of Stuttgart), "Generating 3D Hedge Mazes from Base 2D Maps" (01.08.2025)
Master Thesis Supervisor — Jonas Geiselhart (University of Stuttgart), "Investigating Challenges in Generalizing Neural Radiance Fields with Learned Scene Priors" (27.06.2025)
Bachelor Thesis Supervisor — Tobias Kemmler (University of Stuttgart), "Generating 3D Topiaries from Base Geometric Shapes" (13.06.2025)
Ph.D. Thesis Examiner — Mana Masuda (Keio University), "Tracking and Scene Representation for Fast-moving Cameras by Event Data Synthesis" (07.11.2024)
Professional service
Organizing Committee
Paper Co-Chair for IEEE VR 2027
Co-Organizer for Hype-XR 2026
Co-Organizer for IWDR 2026
Program Co-Chair for IEEE VR 2026
Associate Paper Co-Chair for IEEE ISMAR 2025
Student Volunteer Co-Chair for ACM CHI 2025
Award Co-Chair for APMAR 2024
General Co-Chair for IW-P3HSE 2024
Co-Organizer for DREAMING Challenge 2024
Web Co-Chair for IEEE VR 2019
Demo Co-Chair for IEEE ISMAR 2018
General Co-Chair for HDCD4MAR 2017
Local Chair for PoTS Symposium 2017
Publication Co-Chair for VRSJ Annual Conf. 2017
Workshop Organizing Chair for IWDR 2016
Program Committee
Evaluator for IMPRS-IS (2025, 2026)
Review Committee & Technical Administration for Cluster of Excellence IntCDC (2025–2026)
International Program Committee for IEEE ISMAR 2026
International Program Committee for ACM VRST 2026
Super-Committee Member for IEEE VR 2025
International Program Committee for IEEE VR 2025
International Program Committee for ACM VRST 2025
International Program Committee for VMV 2025
Super-Committee Member for IEEE VR 2024
International Program Committee for IEEE VR 2024
International Program Committee for IEEE ISMAR 2024
International Program Committee for IEEE VR 2023
International Program Committee for IEEE ISMAR 2023
International Program Committee for IEEE VR 2022
International Program Committee for IEEE ISMAR 2022
International Program Committee for IEEE VR 2021
International Program Committee for IEEE ISMAR 2021
International Program Committee for IEEE VR 2020
International Program Committee for IEEE ISMAR 2020
International Program Committee for Web3D 2020
International Program Committee for IEEE VR 2019
International Program Committee for ICAT-EGVE 2017
Session Chairs
Session Chair for IEEE VR 2026
Session Chair for IEEE VR 2025
Session Chair for IEEE ISMAR 2024
Session Chair for IEEE VR 2024
Session Chair for IEEE ISMAR 2021
Session Chair for IEEE ISMAR 2020
Mentorship
Doctoral Consortium Mentor for IEEE ISMAR 2026
Speed Mentorship Mentor for IEEE VR 2026
Doctoral Consortium Mentor for IEEE VR 2026
Doctoral Consortium Mentor for IEEE VR 2025
Doctoral Consortium Mentor for IEEE VR 2024
Conference Reviewer
ACM SIGGRAPH Asia 2026
ACM UIST 2026
ACM SIGGRAPH Asia 2023
ACM SIGGRAPH Asia 2025 (Emerging Technology)
ACM CHI 2025 (Late-Breaking Work)
MICCAI 2025
ACM SIGGRAPH 2025
ACM SIGGRAPH 2024
IEEE ISBI DREAMING Challenge 2024
ACM CHI 2023
IEEE/RSJ IROS 2023
ICAT-EGVE 2022 (Posters/Demos)
ACM CHI 2020
IEEE InfoVis 2020
ACM VRST 2019
IEEE ISMAR 2019
Augmented Human (AH) 2019
APMAR 2019
ICAT-EGVE 2019
IEEE ISMAR 2018
APMAR 2018
IEEE ISMAR 2017
ICAT-EGVE 2017
IEEE VR 2018
IWDR 2016
Journal Reviewer
IEEE Trans. on Visualization and Computer Graphics (TVCG) (2018, 2020–2025)
IEEE Trans. on Multimedia (2016, 2021, 2022)
IEEE Computer Graphics and Applications (CG&A) (2020)
IEEE Trans. on Image Processing (TIP) (2023, 2024)
IEEE Trans. on Instrumentation and Measurement (TIM) (2020)
Springer Virtual Reality (VR) (2023, 2024)
International Journal of Human-Computer Interaction (2025)
Frontiers in Virtual Reality (2021, 2024)
Frontiers in Signal Processing (2024)
IPSJ Trans. on Computer Vision and Applications (CVA) (2017, 2019)
IEICE Trans. on Information and Systems (2017, 2018)
ITE Trans. on Media Technology and Applications (MTA) (2015)
Technologies – Information and Communication Technologies (2017)
Virtual Worlds (2023, 2024)
Concurrency and Computation: Practice and Experience (CCPE) (2021)
Trans. of the Virtual Reality Society of Japan (VRSJ) (2016, 2017, 2021, 2022)
Multimedia Tools and Applications (MTA) (2023)
Indonesian Journal of Electrical Engineering and Computer Science (IJEECS) (2023)
Working Member
Participating Researcher for EXC IntCDC RP43-1 (2025–present)
Member for Stuttgart Research Focus Re/producing Realities (Re2) (2025–present)
Specially Appointed Member for IPSJ Info-WorkPlace (2023–2025)
Academic Journal Committee for Virtual Reality Society of Japan (2020–2024)
Newsletter Committee for Virtual Reality Society of Japan (2016–2020)
Secretary for Technical Committee on Plenoptic Time-Space Technology (2016–2019)
Support Member for ISO/IEC JTC 1/SC 24/WG 9 (2016–2019)
Support Member for TrakMark (2015, 2016)