Issues, Challenges, and Solutions in Data Acquisition in Virtual and Augmented Reality Environments
DOI:
https://doi.org/10.21015/vtse.v12i2.1849Abstract
This paper looks at some of the challenges associated with data acquisition in VR and AR environments, principally by incorporating the privacy of digital forensic and sensor technology. While VR and AR technologies are mainly seen as providing an immersive experience, they also pose significant challenges in collecting data and protecting data collected in environments for privacy. It will look into advanced sensor technologies of high-resolution cameras, inertial measurement units, and biosensors for data accuracy and efficiency. This further researches the methods of data fusion, in particular, Kalman filtering and machine learning-based fusion. Lastly, the role of edge computing in local data processing to reduce the demands for latency and bandwidth is analyzed to allow for real-time processing. It also discusses privacy-enhancing technologies, such as differential privacy and homomorphic encryption, to ensure the protection of user data while maintaining ethical standards. The present article is aimed at implementing a comprehensive framework integrating these technologies to address both technical and moral problems associated with data acquisition through VR and AR for secure and efficient application in these fields.
References
Sadeghi-Niaraki and S. M. Choi, "A survey of marker-less tracking and registration techniques for health & environmental applications to augmented reality and ubiquitous geospatial information systems," Sensors, vol. 20, no. 10, p. 2997, 2020.
Alex, M. E., and Kishore, R., "Forensics framework for cloud computing," Comput. Electr. Eng., vol. 60, pp. 193-205, 2017.
Bertino, E., and Ferrari, E., "Big data security and privacy," in A Comprehensive Guide Through the Italian Database Research Over the Last 25 Years, Cham: Springer International Publishing, 2017, pp. 425-439.
Bamji, J. Godbaz, M. Oh, S. Mehta, A. Payne, S. Ortiz, S. Nagaraja, T. Perry, and B. Thompson, "A review of indirect time-of-flight technologies," IEEE Trans. Electron Devices, vol. 69, no. 6, pp. 2779-2793, 2022.
Diaz, M. Walker, D. A. Szafir, and D. Szafir, "Designing for depth perceptions in augmented reality," in 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2017, pp. 111-122.
Kyrlitsias and D. Michael-Grigoriou, "Social interaction with agents and avatars in immersive virtual environments: A survey," Front. Virtual Reality, vol. 2, p. 786665, 2022.
C. Tikkinen-Piri, A. Rohunen, and J. Markkula, "EU General Data Protection Regulation: Changes and implications for personal data collecting companies," Comput. Law Security Rev., vol. 34, no. 1, pp. 134-153, 2018.
Calloway, T., "Adaptive Three-Tier Sensor Fusion Model with Application to See-Through Augmented Reality in Urban Environments," Ph.D. dissertation, Univ. Massachusetts Lowell, 2021.
Cha, S.C., Hsu, T.Y., Xiang, Y. and Yeh, K.H., “Privacy enhancing technologies in the Internet of Things: Perspectives and challenges”, IEEE Internet of Things Journal, 6(2), pp.2159-2187
Kilsdonk, L. W. Peute, and M. W. Jaspers, "Factors influencing implementation success of guideline-based clinical decision support systems: a systematic review and gaps analysis," Int. J. Med. Inform., vol. 98, pp. 56-64, 2017.
Salvetti and B. Bertagni, "Virtual worlds and augmented reality: The enhanced reality lab as a best practice for advanced simulation and immersive learning," Form@re-Open J. Formazione Rete, vol. 19, no. 1, pp. 242-255, 2019.
Fan, C. L., Lee, J., Lo, W. C., Huang, C. Y., Chen, K. T., and Hsu, C. H., "Fixation prediction for 360 video streaming in head-mounted virtual reality," in Proc. 27th Workshop Netw. Oper. Syst. Support Digit. Audio Video, 2017, pp. 67-72.
Jesus, A. Casimiro, and A. Oliveira, "A survey on data quality for dependable monitoring in wireless sensor networks," Sensors, vol. 17, no. 9, p. 2010, 2017.
Wu, B. Masia, A. Jarabo, Y. Zhang, L. Wang, Q. Dai, T. Chai, and Y. Liu, "Light field image processing: An overview," IEEE J. Sel. Top. Signal Process., vol. 11, no. 7, pp. 926-954, 2017.
Ardiny and E. Khanmirza, "The role of AR and VR technologies in education developments: opportunities and challenges," in Proc. 2018 6th RSI Int. Conf. Robot. Mechatronics (ICRoM), 2018, pp. 482-487.
H. Lee and K. Leonas, "Consumer experiences, the key to survive in an omni-channel environment: Use of virtual technology," J. Textile Apparel, Technol. Manage., vol. 10, no. 3, 2018.
B. Adhanom, N. N. Griffin, P. MacNeilage, and E. Folmer, "The effect of a foveated field-of-view restrictor on VR sickness," in Proc. 2020 IEEE Conf. Virtual Reality 3D User Interfaces (VR), 2020, pp. 645-652.
Aliprantis, M. Konstantakis, R. Nikopoulou, P. Mylonas, and G. Caridakis, "Natural Interaction in Augmented Reality Context," in Proc. VIPERC@ IRCDL, 2019, pp. 50-61.
J. Cao, K. Y. Lam, L. H. Lee, X. Liu, P. Hui, and X. Su, "Mobile augmented reality: User interfaces, frameworks, and intelligence," ACM Comput. Surv., vol. 55, no. 9, pp. 1-36, 2023.
Khoshelham, H. Tran, and D. Acharya, "Indoor mapping eyewear: geometric evaluation of spatial mapping capability of HoloLens," Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci., vol. 42, pp. 805-810, 2019.
K. Lebeck, K. Ruth, T. Kohno, and F. Roesner, "Towards security and privacy for multi-user augmented reality: Foundations with end users," in Proc. 2018 IEEE Symp. Security Privacy (SP), 2018, pp. 392-408.
K. M. Mithil, K. B. M. Kumar, L. Sharma, M. Z. S. Pasha, and H. D. Kallinath, "An interactive voice controlled humanoid smart home prototype using concepts of natural language processing and machine learning," in 2018 3rd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT), 2018, pp. 1537-1546.
Kong, X. Peng, Y. Chen, P. Wang, and M. Xu, "Multi-sensor measurement and data fusion technology for manufacturing process monitoring: a literature review," Int. J. Extreme Manuf., vol. 2, no. 2, p. 022001, 2020.
L. Lobschat, B. Mueller, F. Eggers, L. Brandimarte, S. Diefenbach, M. Kroschke, and J. Wirtz, "Corporate digital responsibility," J. Bus. Res., vol. 122, pp. 875-888, 2021.
Liang, Y., Zhao, C. Z., Yuan, H., Chen, Y., Zhang, W., Huang, J. Q., Yu, D., Liu, Y., Titirici, M. M., Chueh, Y. L., and Yu, H., "A review of rechargeable batteries for portable electronic devices," InfoMat, vol. 1, no. 1, pp. 6-32, 2019.
Eswaran and M. R. Bahubalendruni, "Challenges and opportunities on AR/VR technologies for manufacturing systems in the context of industry 4.0: A state of the art review," J. Manuf. Syst. vol. 65, pp. 260-278, 2022.
M. Eswaran and M. R. Bahubalendruni, "Challenges and opportunities on AR/VR technologies for manufacturing systems in the context of industry 4.0: A state of the art review," J. Manuf. Syst., vol. 65, pp. 260-278, 2022.
M. F. Pereira, C. Prahm, J. Kolbenschlag, E. Oliveira, and N. F. Rodrigues, "Application of AR and VR in hand rehabilitation: A systematic review," J. Biomed. Inform., vol. 111, p. 103584, 2020.
M. Madary and T. K. Metzinger, "Real virtuality: A code of ethical conduct. Recommendations for good scientific practice and the consumers of VR-technology," Front. Robot. AI, vol. 3, p. 180932, 2016.
Morgan, R. M., "Conceptualising forensic science and forensic reconstruction. Part I: a conceptual model," Sci. Justice, vol. 57, no. 6, pp. 455-459, 2017.
Moussaïd, M., Schinazi, V. R., Kapadia, M., and Thrash, T., "Virtual sensing and virtual reality: how new technologies can boost research on crowd dynamics," Front. Robot. AI, vol. 5, p. 82, 2018.
C. Martins, B. Marques, J. Alves, T. Araújo, P. Dias, and B. S. Santos, "Augmented reality situated visualization in decision-making," Multimedia Tools Appl., vol. 81, no. 11, pp. 14749-14772, 2022.
N. C. Thompson, K. Greenewald, K. Lee, and G. F. Manso, "The computational limits of deep learning," arXiv preprint arXiv:2007.05558, 2020.
N. Ranasinghe, P. Jain, S. Karwita, D. Tolley, and E. Y. L. Do, "Ambiotherm: enhancing sense of presence in virtual reality by simulating real-world environmental conditions," in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017, pp. 1731-1742.
Nykänen, T., and Leukkunen, J., "The usability of an augmented reality map application on the Microsoft Hololens 2," Bachelor's thesis, T. Nykänen; J. Leukkunen, 2022.
Oriti, D., Manuri, F., Pace, F. D., and Sanna, A., "Harmonize: A shared environment for extended immersive entertainment," Virtual Reality, vol. 27, no. 4, pp. 3259-3272, 2023.
Cipresso, I. A. C. Giglioli, M. A. Raya, and G. Riva, "The past, present, and future of virtual and augmented reality research: a network and cluster analysis of the literature," Frontiers in Psychology, vol. 9, p. 309500, 2018.
Mealy, Virtual & Augmented Reality for Dummies. Hoboken, NJ: John Wiley & Sons, 2018.
P. Ren, X. Qiao, Y. Huang, L. Liu, C. Pu, S. Dustdar, and J. Chen, "Edge ar x5: An edge-assisted multi-user collaborative framework for mobile web augmented reality in 5g and beyond," IEEE Trans. Cloud Comput., vol. 10, no. 4, pp. 2521-2537, 2020.
Porciuncula, F., Roto, A. V., Kumar, D., Davis, I., Roy, S., Walsh, C. J., and Awad, L. N., "Wearable movement sensors for rehabilitation: a focused review of technological and clinical advances," PM&R, vol. 10, no. 9, pp. S220-S232, 2018.
D. La, M. V. Ngo, T. Q. Dinh, T. Q. Quek, and H. Shin, "Enabling intelligence in fog computing to achieve energy and latency reduction," Digital Commun. Netw., vol. 5, no. 1, pp. 3-9, 2019.
Qiao, X., Ren, P., Dustdar, S., Liu, L., Ma, H., and Chen, J., "Web AR: A promising future for mobile augmented reality—State of the art, challenges, and insights," Proc. IEEE, vol. 107, no. 4, pp. 651-666, 2019.
Wei, K. Ouyang, X. Bao, X. Gao, and C. Chen, "High-precision smart calibration system for temperature sensors," Sens. Actuators A: Phys., vol. 297, p. 111561, 2019.
Gupta, "Ethical issues in designing internet-based research: recommendations for good practice," J. Res. Pract., vol. 13, no. 2, p. D1, 2017.
S. Salcedo-Sanz, P. Ghamisi, M. Piles, M. Werner, L. Cuadra, A. Moreno-Martínez, E. Izquierdo-Verdiguier, J. Muñoz-Marí, A. Mosavi, and G. Camps-Valls, "Machine learning information fusion in Earth observation: A comprehensive review of methods, applications and data sources," *Information Fusion*, vol. 63, pp. 256-272, 2020.
S. Vlahovic, M. Suznjevic, and L. Skorin-Kapov, "A survey of challenges and methods for Quality of Experience assessment of interactive VR applications," J. Multimodal User Interfaces, vol. 16, no. 3, pp. 257-291, 2022.
A. Syed, M. S. Siddiqui, H. B. Abdullah, S. Jan, A. Namoun, A. Alzahrani, A. Nadeem, and A. B. Alkhodre, "In-depth review of augmented reality: Tracking technologies, development tools, AR displays, collaborative AR, and security concerns," Sensors, vol. 23, no. 1, p. 146, 2022.
T. K. Huang, C. H. Yang, Y. H. Hsieh, J. C. Wang, and C. C. Hung, "Augmented reality (AR) and virtual reality (VR) applied in dentistry," Kaohsiung J. Med. Sci., vol. 34, no. 4, pp. 243-248, 2018.
T. Masood and J. Egger, "Augmented reality: focusing on photonics in industry 4.0," IEEE J. Sel. Top. Quantum Electron., vol. 27, no. 6, pp. 1-11, 2021.
Camomilla, E. Bergamini, S. Fantozzi, and G. Vannozzi, "Trends supporting the in-field use of wearable inertial sensors for sport performance evaluation: A systematic review," Sensors, vol. 18, no. 3, p. 873, 2018.
Verhulst, A. Woods, L. Whittaker, J. Bennett, and P. Dalton, "Do VR and AR versions of an immersive cultural experience engender different user experiences?," Comput. Hum. Behav., vol. 125, p. 106951, 2021.
Brunotte, J. Droste, and K. Schneider, "Context content consent–how to design user-centered privacy explanations," in The 35th International Conference on Software Engineering & Knowledge Engineering, 2023.
Wei, "Research progress on virtual reality (VR) and augmented reality (AR) in tourism and hospitality: A critical review of publications from 2000 to 2018," *J. Hospitality Tourism Technol.*, vol. 10, no. 4, pp. 539-570, 2019.
Li, W. Yi, H. L. Chi, X. Wang, and A. P. Chan, "A critical review of virtual and augmented reality (VR/AR) applications in construction safety,"Automat. Constr., vol. 86, pp. 150-162, 2018.
Tan, W. Xu, S. Li, and K. Chen, "Augmented and virtual reality (AR/VR) for education and training in the AEC industry: a systematic review of research and applications," Buildings, vol. 12, no. 10, p. 1529, 2022.
Downloads
Published
How to Cite
Issue
Section
License
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC-By) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
This work is licensed under a Creative Commons Attribution License CC BY
