TDT16 - Extended Reality - Kunnskapsbasen
TDT16 - Extended Reality
Teacher: Gabriel Hanssen Kiss (gabriel.kiss@ntnu.no), together with Frank Lindseth and Theoharis Theoharis
The course is given in English.
The format of the course is a series of sessions for each of the topics
Contact the teacher if you want additional information
Workload: 3,75 SP
Start-up: first week of September (exact dates to be defined)
Learning outcomes:
The main learning outcomes of the module:
1) Introduction to extended reality (XR): main building blocks and possible approaches
2) In depth look at VR/AR/MR related methods (XR space, position orientation and tracking, augmentation) and hardware (visualization devices, navigation and interaction devices)
3) Tools for creating XR content (Hardware and Software / Frameworks)
4) Applications of XR: medical, architecture, gaming, education, simulation tools, data augmentation for AI, Digital Twins and Smart Cities
Syllabus
The literature consists of several articles from books, journals, conference proceedings and tutorials / Videos.
Teaching approach
The course is given through workshops where the students present the content followed by discussions. Regular meetings every second week are planned.
Exam
Oral examination
Reading list:
Publications (work in progress):
Dieter Schmalstieg, Tobias Höllerer (2016): Augmented Reality: Principles and Practice, Addison-Wesley ISBN: 9780133153217
Terry Peters, Ziv Yaniv, Christian Linte and Jackie Williams (2018): Mixed and Augmented Reality in Medicine, CRC Press, 2018. ISBN 9780367570767
Xiao Lia, Wen Yib, Hung-Lin Chia, Xiangyu Wang, Albert P.C. Chana (2018): A critical review of virtual and augmented reality (VR/AR) applications in construction safety, Automation in Construction, Volume 86, February 2018, pp. 150-162
María-BlancaIbáñez, CarlosDelgado-Kloos (2018): Augmented reality for STEM learning: A systematic review, Computers & Education, Volume 123, August 2018, pp. 109-123, https://doi.org/10.1016/j.compedu.2018.05.002
Mani Golparvar-Fard, Feniosky Peña-Mora, Silvio Savarese (2009): Application of D4AR, 4-Dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication ITcon Vol. 14, Special issue Next Generation Construction IT: Technology Foresight, Future Studies, Roadmapping, and Scenario Planning, pg. 129-153, https://www.itcon.org/2009/13
Leonardo A. Espinosa Leal, Anthony Chapman, Magnus Westerlund (2019) Reinforcement learning for extended reality: designing self-play scenarios, Proceedings of the 52nd Hawaii International Conference on System Sciences, https://hdl.handle.net/10125/59456
Tutorials (work in progress):
Unity, Unreal Ungine and WebXR:
https://docs.unity3d.com/Manual/XR.html
https://www.youtube.com/channel/UCLelC0ma8d6XU8rFy41Z5rw/featured
Mixed and augmented reality studio MARS: https://www.youtube.com/watch?v=kJtUwrUh4xs&feature=youtu.be
https://www.unrealengine.com/en-US/learn
https://www.unrealengine.com/en-US/features/vr-ar-and-mr-xr-support