skip to main content
research-article
Open access

Split-Lohmann Multifocal Displays

Published: 26 July 2023 Publication History

Abstract

This work provides the design of a multifocal display that can create a dense stack of focal planes in a single shot. We achieve this using a novel computational lens that provides spatial selectivity in its focal length, i.e, the lens appears to have different focal lengths across points on a display behind it. This enables a multifocal display via an appropriate selection of the spatially-varying focal length, thereby avoiding time multiplexing techniques that are associated with traditional focus tunable lenses. The idea central to this design is a modification of a Lohmann lens, a focus tunable lens created with two cubic phase plates that translate relative to each other. Using optical relays and a phase spatial light modulator, we replace the physical translation of the cubic plates with an optical one, while simultaneously allowing for different pixels on the display to undergo different amounts of translations and, consequently, different focal lengths. We refer to this design as a Split-Lohmann multifocal display. Split-Lohmann displays provide a large étendue as well as high spatial and depth resolutions; the absence of time multiplexing and the extremely light computational footprint for content processing makes it suitable for video and interactive experiences. Using a lab prototype, we show results over a wide range of static, dynamic, and interactive 3D scenes, showcasing high visual quality over a large working range.

Supplementary Material

ZIP File (papers_220-supplemental.zip)
supplemental material.
MP4 File (papers_220_VOD.mp4)
presentation

References

[1]
Kaan Akşit, Ward Lopes, Jonghyun Kim, Peter Shirley, and David Luebke. 2017. Near-eye Varifocal Augmented Reality Display Using See-through Screens. ACM Transactions on Graphics 36, 6 (Nov. 2017), 189:1--189:13.
[2]
Kurt Akeley. 2004. Achieving Near-correct Focus Cues Using Multiple Image Planes. Ph. D. Dissertation. Stanford University.
[3]
Kurt Akeley, Simon J. Watt, Ahna Reza Girshick, and Martin S. Banks. 2004. A Stereo Display Prototype with Multiple Focal Distances. ACM Transactions on Graphics 23, 3 (Aug. 2004), 804--813.
[4]
Luis W Alvarez. 1978. Development of variable-focus lenses and a new refractor. Journal of the American Optometric Association 49, 1 (1978), 24--29.
[5]
Luis W Alvarez and William E Humphrey. 1970. Variable-power lens and system. US Patent 3,507,565.
[6]
Sergio Barbero. 2009. The Alvarez and Lohmann refractive lenses revisited. Optics Express 17, 11 (2009), 9376--9390.
[7]
Praneeth Chakravarthula, Ethan Tseng, Tarun Srivastava, Henry Fuchs, and Felix Heide. 2020. Learned hardware-in-the-loop phase retrieval for holographic near-eye displays. ACM Transactions on Graphics 39, 6 (2020), 1--18.
[8]
Jen-Hao Rick Chang, B. V. K. Vijaya Kumar, and Aswin C. Sankaranarayanan. 2018. Towards Multifocal Displays with Dense Focal Stacks. ACM Transactions on Graphics 37, 6 (Dec. 2018), 198:1--198:13.
[9]
Jen-Hao Rick Chang, Anat Levin, B. V. K. Vijaya Kumar, and Aswin C. Sankaranarayanan. 2020. Towards Occlusion-aware Multifocal Displays. ACM Transactions on Graphics 39, 4 (2020), 68:1--15.
[10]
Ai Hong Chen, Daniel J. O'Leary, and Edwin R. Howell. 2000. Near visual function in young children. Part I: near point of convergence. Part II: amplitude of accommodation. Part III: near heterophoria. Ophthalmic and Physiological Optics 20, 3 (2000), 185--198.
[11]
Suyeon Choi, Seungjae Lee, Youngjin Jo, Dongheon Yoo, Dongyeon Kim, and Byoungho Lee. 2019. Optimal Binary Representation via Non-convex Optimization on Tomographic Displays. Optics Express 27, 17 (2019), 24362--24381.
[12]
Wei Cui and Liang Gao. 2017. Optical mapping near-eye three-dimensional display with correct focus cues. Optics Letters 42, 13 (2017), 2475--2478.
[13]
Joseph W Goodman. 2005. Introduction to Fourier optics. 3rd. Roberts and Company Publishers.
[14]
Felix Heide, Qiang Fu, Yifan Peng, and Wolfgang Heidrich. 2016. Encoded diffractive optics for full-spectrum computational imaging. Scientific reports 6, 1 (2016), 1--10.
[15]
David M Hoffman, Ahna R Girshick, Kurt Akeley, and Martin S Banks. 2008. Vergence-accommodation Conflicts Hinder Visual Performance And Cause Visual Fatigue. Journal of Vision 8, 3 (2008), 33--33.
[16]
Xinda Hu and Hong Hua. 2014. High-resolution Optical See-through Multi-focal-plane Head-mounted Display Using Freeform Optics. Optics Express 22, 11 (2014), 13896--13903.
[17]
Hong Hua. 2017. Enabling Focus Cues in Head-mounted Displays. Proc. IEEE 105, 5 (2017), 805--824.
[18]
Youngjin Jo, Seungjae Lee, Dongheon Yoo, Suyeon Choi, Dongyeon Kim, and Byoungho Lee. 2019. Tomographic Projector: Large Scale Volumetric Display with Uniform Viewing Experiences. ACM Transactions on Graphics 38, 6 (Nov. 2019), 215:1--215:13.
[19]
Paul V Johnson, Jared AQ Parnell, Joohwan Kim, Christopher D Saunter, Gordon D Love, and Martin S Banks. 2016. Dynamic Lens and Monovision 3D Displays to Improve Viewer Comfort. Optics Express 24, 11 (2016), 11808--11827.
[20]
Robert Konrad, Nitish Padmanaban, Keenan Molner, Emily A. Cooper, and Gordon Wetzstein. 2017. Accommodation-invariant Computational Near-eye Displays. ACM Transactions on Graphics 36, 4 (July 2017), 88:1--88:12.
[21]
George Alex Koulieris, Kaan Akşit, Michael Stengel, Rafał K Mantiuk, Katerina Mania, and Christian Richardt. 2019. Near-eye display and tracking technologies for virtual and augmented reality. In Computer Graphics Forum, Vol. 38. 493--519.
[22]
Sheng Liu, Dewen Cheng, and Hong Hua. 2008. An Optical See-through Head Mounted Display with Addressable Focal Planes. In IEEE/ACM International Symposium on Mixed and Augmented Reality. 33--42.
[23]
Adolf W Lohmann. 1970. A new class of varifocal lenses. Applied Optics 9, 7 (1970), 1669--1671.
[24]
Gordon D Love, David M Hoffman, Philip JW Hands, James Gao, Andrew K Kirby, and Martin S Banks. 2009. High-speed Switchable Lens Enables the Development of a Volumetric Stereoscopic Display. Optics Express 17, 18 (2009), 15716--15725.
[25]
Andrew Maimone, Andreas Georgiou, and Joel S. Kollin. 2017. Holographic Near-eye Displays for Virtual and Augmented Reality. ACM Transactions on Graphics 36, 4 (July 2017), 85:1--85:16.
[26]
Andrew Maimone and Junren Wang. 2020. Holographic optics for thin and lightweight virtual reality. ACM Transactions on Graphics 39, 4 (2020), 67--1.
[27]
Nathan Matsuda, Alexander Fix, and Douglas Lanman. 2017. Focal Surface Displays. ACM Transactions on Graphics 36, 4 (July 2017), 86:1--86:14.
[28]
Olivier Mercier, Yusufu Sulai, Kevin Mackenzie, Marina Zannoli, James Hillis, Derek Nowrouzezahrai, and Douglas Lanman. 2017. Fast Gaze-contingent Optimal Decompositions for Multifocal Displays. ACM Transactions on Graphics 36, 6 (Nov. 2017), 237:1--237:15.
[29]
Rahul Narain, Rachel A. Albert, Abdullah Bulbul, Gregory J. Ward, Martin S. Banks, and James F. O'Brien. 2015. Optimal Presentation of Imagery with Focus Cues on Multi-plane Displays. ACM Transactions on Graphics 34, 4 (July 2015), 59:1--59:12.
[30]
Nitish Padmanaban, Robert Konrad, Tal Stramer, Emily A Cooper, and Gordon Wetzstein. 2017. Optimizing Virtual Reality for All Users Through Gaze-contingent and Adaptive Focus Displays. Proceedings of the National Academy of Sciences 114 (2017), 9.
[31]
Yifan Peng, Suyeon Choi, Nitish Padmanaban, and Gordon Wetzstein. 2020. Neural holography with camera-in-the-loop training. ACM Transactions on Graphics (TOG) 39, 6 (2020), 1--14.
[32]
Yingsi Qin, Wei-Yu Chen, Matthew O'Toole, and Aswin C. Sankaranarayanan. 2023. Project Page: Split-Lohmann Multifocal Displays. https://imaging.cs.cmu.edu/split_lohmann.
[33]
Kishore Rathinavel, Hanpeng Wang, Alex Blate, and Henry Fuchs. 2018. An Extended Depth-at-field Volumetric Near-eye Augmented Reality Display. IEEE Transactions on Visualization and Computer Graphics 24, 11 (2018), 2857--2866.
[34]
Jannick P Rolland, Myron W Krueger, and Alexei Goon. 2000. Multifocal Planes Head-mounted Displays. Applied Optics 39, 19 (2000), 3209--3215.
[35]
Daniel Scharstein, Heiko Hirschmüller, York Kitajima, Greg Krathwohl, Nera Nešić, Xi Wang, and Porter Westling. 2014. High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth. In Pattern Recognition.
[36]
Liang Shi, Beichen Li, and Wojciech Matusik. 2022. End-to-end learning of 3d phase-only holograms for holographic display. Light: Science & Applications 11, 1 (2022), 247.
[37]
Guanjun Tan, Tao Zhan, Yun-Han Lee, Jianghao Xiong, and Shin-Tson Wu. 2018. Polarization-multiplexed multiplane display. Optics Letters 43, 22 (Nov 2018), 5651--5654.
[38]
David George Voelz. 2011. Computational fourier optics: a MATLAB tutorial. Vol. 534. SPIE press Bellingham, Washington.
[39]
Austin Wilson and Hong Hua. 2019. Design and demonstration of a vari-focal optical see-through head-mounted display using freeform Alvarez lenses. Optics Express 27, 11 (2019), 15627--15637.
[40]
Lei Xiao, Anton Kaplanyan, Alexander Fix, Matthew Chapman, and Douglas Lanman. 2018a. DeepFocus: Learned Image Synthesis for Computational Displays. ACM Transactions on Graphics 37, 6 (Dec. 2018), 200:1--200:13.
[41]
Lei Xiao, Anton Kaplanyan, Alexander Fix, Matthew Chapman, and Douglas Lanman. 2018b. DeepFocus: Learned Image Synthesis for Computational Displays. ACM Transactions on Graphics 37, 6 (dec 2018).
[42]
Tao Zhan, Jianghao Xiong, Junyu Zou, and Shin-Tson Wu. 2020. Multifocal displays: review and prospect. PhotoniX 1, 1 (2020), 1--31.

Cited By

View all
  • (2024)Impact of focus cue presentation on perceived realism of 3-D scene structure: Implications for scene perception and for display technologyJournal of Vision10.1167/jov.24.2.1324:2(13)Online publication date: 27-Feb-2024
  • (2024)A Novel Framework for Joint Learning of City Region Partition and RepresentationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365285720:7(1-23)Online publication date: 16-May-2024
  • (2024)Aperture-Aware Lens DesignACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657398(1-10)Online publication date: 13-Jul-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 42, Issue 4
August 2023
1912 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/3609020
Issue’s Table of Contents
This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2023
Published in TOG Volume 42, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. multifocal displays
  2. computational displays
  3. vergence-accomodation conflict
  4. lohmann lenses

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1,009
  • Downloads (Last 6 weeks)71
Reflects downloads up to 21 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Impact of focus cue presentation on perceived realism of 3-D scene structure: Implications for scene perception and for display technologyJournal of Vision10.1167/jov.24.2.1324:2(13)Online publication date: 27-Feb-2024
  • (2024)A Novel Framework for Joint Learning of City Region Partition and RepresentationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365285720:7(1-23)Online publication date: 16-May-2024
  • (2024)Aperture-Aware Lens DesignACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657398(1-10)Online publication date: 13-Jul-2024
  • (2024)RIGL: A Unified Reciprocal Approach for Tracing the Independent and Group Learning ProcessesProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671711(4047-4058)Online publication date: 25-Aug-2024
  • (2024)The 5th International Workshop on Talent and Management Computing (TMC'2024)Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671479(6759-6760)Online publication date: 25-Aug-2024
  • (2024)AFDGCF: Adaptive Feature De-correlation Graph Collaborative Filtering for RecommendationsProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657724(1242-1252)Online publication date: 10-Jul-2024
  • (2024)Split Lohmann computer holography: fast generation of 3D hologram in single-step diffraction calculationAdvanced Photonics Nexus10.1117/1.APN.3.3.0360013:03Online publication date: 1-May-2024
  • (2024)StageAR: Markerless Mobile Phone Localization for AR in Live Events2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00119(1000-1010)Online publication date: 16-Mar-2024
  • (2024)MeshReduce: Scalable and Bandwidth Efficient 3D Scene Capture2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00026(20-30)Online publication date: 16-Mar-2024
  • (2024)Highly immersive imaging: Depth of field effect implemented through ray tracing with multiple samplesJournal of Physics: Conference Series10.1088/1742-6596/2711/1/0120172711:1(012017)Online publication date: 1-Feb-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media