Hostname: page-component-7b7567c8c-wxvwp Total loading time: 0 Render date: 2026-11-15T14:34:24.513Z Has data issue: false hasContentIssue false
  • English
  • Français

CHALLENGES OF USING AUGMENTED REALITY TO SUPPORT AN EFFICIENT AND ERROR-FREE ASSEMBLY IN COMPLEX VARIANT ENVIRONMENTS

Published online by Cambridge University Press:  19 June 2023

Valesko Cedrik Dausch,
Daniel Roth,
Matthias Kreimeyer and
Sebastian Bohr
Valesko Cedrik Dausch*
Affiliation:
University of Stuttgart;
Daniel Roth
Affiliation:
University of Stuttgart;
Matthias Kreimeyer
Affiliation:
University of Stuttgart;
Sebastian Bohr
Affiliation:
MAN Truck & Bus SE
*
Dausch, Valesko, Cedrik University of Stuttgart, Germany, valesko.dausch@iktd.uni-stuttgart.de

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the 'Save PDF' action button.

As part of the digital transformation towards Industry 4.0, the tasks of staff on the shop floor are changing. Despite increasing automation, complex assembly steps still have to be carried out by humans, especially when it comes to complex products rich in variants, whose assembly cannpt be fully automated for various reasons. Due to increasing individualization and the steadily growing complexity of products, providing the right information at the right time and in the right place is becoming more important. In this context, the visualization of information via novel technologies such as augmented reality plays a crucial role towards an efficient and error-free production process. This paper compiles existing challenges when using augmented reality as a visualization form for an assistance system. On the one hand, the challenges found originate from a systematic literature review and are organized according to predefined categories. On the other hand, these challenges are complemented and compared through findings gained from expert interviews, which are conducted with employees of two European commercial vehicle manufacturers in the field of production. The analysis of the two methods highlights the need for further research.

Keywords

VisualisationIndustry 4.0Augmented RealityAssemblyInformation management

Information

Type
Article
Information
Proceedings of the Design Society , Volume 3: ICED23 , July 2023, pp. 857 - 866
Creative Commons
Creative Common License - CCCreative Common License - BYCreative Common License - NCCreative Common License - ND
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Copyright
The Author(s), 2023. Published by Cambridge University Press

References

Alarcon, R., Wild, F., Perey, C., Genescà, M. M., Ruiz, M., Olmos, M., and Dubert, D. (2020), “Augmented Reality for the enhancement of space product assurance and safety”, Acta Astronautica, vol. 168, pp. 191–199, [online] https://doi.org/10.1016/j.actaastro.2019.10.020.CrossRefGoogle Scholar
Alves, J. B., Marques, B., Dias, P. and Santos, B. S. (2021) “Using augmented reality for industrial quality assurance: a shop floor user study”, The International Journal of Advanced Manufacturing Technology, vol. 115, 1-2, pp. 105–116, [online] https://link.springer.com/article/10.1007/s00170-021-07049-8.CrossRefGoogle Scholar
Alves, J. B., Marques, B., Oliveira, M., Tiago Araujo, T., Dias, P. and Sousa Santos, B. (2019) “Comparing Spatial and Mobile Augmented Reality for Guiding Assembling Procedures with Task Validation”, 19th IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC 2019), Porto, Portugal, pp. 1–6, [online] https://doi.org/10.1109/ICARSC.2019.8733642.CrossRefGoogle Scholar
Azuma, R. (1997) “A Survey of Augmented Reality”, Presence: Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355–385, [online] https://doi.org/10.1162/pres.1997.6.4.355.CrossRefGoogle Scholar
Azuma, R. (2016) “The Most Important Challenge Facing Augmented Reality”, Presence: Teleoperators and Virtual Environments, vol. 25, no. 3, pp. 234–238, [online] https://doi.org/10.1162/PRES_a_00264CrossRefGoogle Scholar
Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S. and MacIntyre, B. (2001) “Recent advances in augmented reality”, IEEE Computer Graphics and Applications, vol. 21, no. 6, pp. 34–47.CrossRefGoogle Scholar
Bellalouna, F. (2022) “Use Case of the Application of the Optical-See-Through Augmented Reality Technology in the Engineering Context”, Procedia CIRP, vol. 106, pp. 3–8, [online] https://doi.org/10.1109/38.963459.CrossRefGoogle Scholar
Billinghurst, M., Kato, H. and Myojin, S. (2009) “Advanced Interaction Techniques for Augmented Reality Applications”, Shumaker, R. (eds) Virtual and Mixed Reality. VMR 2009. Lecture Notes in Computer Science, vol. 5622, pp. 13–22, [online] https://doi.org/10.1007/978-3-642-02771-0_2.Google Scholar
Bitnamic (2022) Microsoft HoloLens 2: Funktionen und Verbesserungen, bitnamic, [online] https://bitnamic.net/microsoft-hololens-2-funktionen-und-verbesserungen/ [accessed 29 October 2022].Google Scholar
Bottani, E. and Vignali, G. (2019) “Augmented reality technology in the manufacturing industry: A review of the last decade”, IISE Transactions, vol. 51, no. 3, pp. 284–310, [online] https://doi.org/10.1080/24725854.2018.1493244CrossRefGoogle Scholar
Chatzopoulos, D., Bermejo, C., Huang, Z. and Hui, P. (2017) “Mobile Augmented Reality Survey: From Where We Are to Where We Go”, IEEE Access, vol. 5, pp. 6917–6950, [online] https://doi.org/10.1109/ACCESS.2017.2698164CrossRefGoogle Scholar
Danielsson, O., Holm, M. and Syberfeldt, A. (2020) “Augmented reality smart glasses for operators in production: Survey of relevant categories for supporting operators”, Procedia CIRP, vol. 93, pp. 1298–1303, [online] https://doi.org/10.1016/j.procir.2020.04.099.CrossRefGoogle Scholar
Danielsson, O., Syberfeldt, A., Holm, M. and Wang, L. (2018) “Operators perspective on augmented reality as a support tool in engine assembly”, Procedia CIRP, vol. 72, pp. 45–50, [online] https://doi.org/10.1016/j.procir.2018.03.153.CrossRefGoogle Scholar
Erboz, G. (2017) “How to Define Industry 4.0: Main Pillars of Industry 4.0”, 7th International Conference on Management, Nitra, Slovakia.Google Scholar
Fast-Berglund, Å., Gong, L. and Li, D. (2018) “Testing and validating Extended Reality (xR) technologies in manufacturing”, Procedia Manufacturing, vol. 25, pp. 31–38, [online] https://doi.org/10.1016/j.promfg.2018.06.054.CrossRefGoogle Scholar
Gattullo, M., Evangelista, A., Uva, A. E., Fiorentino, M. and Gabbard, J. L. (2022) “What, How, and Why are Visual Assets Used in Industrial Augmented Reality? A Systematic Review and Classification in Maintenance, Assembly, and Training (From 1997 to 2019)”, IEEE transactions on visualization and computer graphics, vol. 28, no. 2, pp. 1443–1456, [online] https://doi.org/10.1109/TVCG.2020.3014614.CrossRefGoogle ScholarPubMed
Ghazwani, Y. and Smith, S. (2020) “Interaction in Augmented Reality: Challenges to Enhance User Experience”, Proceedings of the 2020 4th International Conference on Virtual and Augmented Reality Simulations. New York, NY, USA, Association for Computing Machinery, pp. 39–44, [online] https://doi.org/10.1145/3385378.3385384.CrossRefGoogle Scholar
Gong, L., Fast-Berglund, A. and Johansson, B. (2021) “A Framework for Extended Reality System Development in Manufacturing”, IEEE Access, vol. 9, pp. 24796–24813, [online] https://doi.org/10.1109/ACCESS.2021.3056752CrossRefGoogle Scholar
Gorecky, D., Worgar, S. and Meixner, G. (2011) “COGNITO: a cognitive assistance and training system for manual tasks in industry”, ECCE 2011 - European Conference on Cognitive Ergonomics. Rostock, Germany, 24.08.2011, pp. 53–56, [online] https://doi.org/10.1145/2074712.2074723.CrossRefGoogle Scholar
Holm, M., Adamson, G., Moore, P. and Wang, L. (2016) “Why I want to be a Future Swedish Shop-floor Operator”, Procedia CIRP, vol. 41, pp. 1101–1106, [online] https://doi.org/10.1016/j.procir.2015.12.057.CrossRefGoogle Scholar
Jetter, J., Eimecke, J. and Rese, A. (2018) “Augmented reality tools for industrial applications: What are potential key performance indicators and who benefits?”, Computers in Human Behavior, vol. 87, pp. 18–33, [online] https://doi.org/10.1016/j.chb.2018.04.054.CrossRefGoogle Scholar
Khuong, B. M., Kiyokawa, K., Miller, A., La Viola, J. J., Mashita, T. and Takemura, H. (2014) “The effectiveness of an AR-based context-aware assembly support system in object assembly”, 2014 IEEE Virtual Reality (VR). Minneapolis, USA, 29.03.2014 - 02.04.2014, pp. 57–62, [online] https://doi.org/10.1109/VR.2014.6802051.CrossRefGoogle Scholar
Lv, Z., Lloret, J. and Song, H. (2022) “5G for mobile augmented reality”, International Journal of Communication Systems, vol. 35, no. 5, [online] https://doi.org/10.1002/dac.5107.CrossRefGoogle Scholar
Mattsson, S., Li, D. and Fasth, Fast-Berglund, Åsa (2018) “Application of design principles for assembly instructions – evaluation of practitioner use”, Procedia CIRP, vol. 76, pp. 42–47, [online] https://doi.org/10.1016/j.procir.2018.02.011.CrossRefGoogle Scholar
Milgram, P. and Kishino, F. (1994) “A Taxonomy of Mixed Reality Visual Displays”, IEICE Trans. Information Systems, vol. E77-D, no. 12, pp. 1321–1329.Google Scholar
Neumann, U. and Majoros, A. (1998) “Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance”, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180), pp. 4–11, [online] https://doi.org/10.1109/VRAIS.1998.658416.CrossRefGoogle Scholar
Orlosky, J., Kiyokawa, K. and Takemura, H. (2017) “Virtual and Augmented Reality on the 5G Highway”, Journal of Information Processing, vol. 25, pp. 133–141, [online] https://doi.org/10.2197/ipsjjip.25.133.CrossRefGoogle Scholar
Porcelli, I., Rapaccini, M., Espíndola, D. and Pereira, C. (2013) “Technical and Organizational Issues about the Introduction of Augmented Reality in Maintenance and Technical Assistance Services”, IFAC Proceedings Volumes, vol. 46, no. 7, pp. 257–262, [online] https://doi.org/10.3182/20130522-3-BR-4036.00024.CrossRefGoogle Scholar
Quint, F. and Loch, F. (2015) “Using Smart Glasses to Document Maintenance Processes”, Mensch und Computer 2015, Stuttgart, Germany, vol. 95, pp. 203–208, [online] https://doi.org/10.1515/9783110443905-030.Google Scholar
Radkowski, R. (2015) “Investigation of Visual Features for Augmented Reality Assembly Assistance”, International Conference on Virtual, Augmented and Mixed Reality, vol. 9179, pp. 488–498.CrossRefGoogle Scholar
Rokhsaritalemi, S., Sadeghi-Niaraki, A. and Choi, S.-M. (2020) “A Review on Mixed Reality: Current Trends, Challenges and Prospects”, Applied Sciences, vol. 10, p. 636, [online] https://doi.org/10.3390/app10020636.CrossRefGoogle Scholar
Romero, D., T., Noran, O., Bernus, P., Berglund, Å. F. and Gorecky, D. (2016) “Towards an Operator 4.0 Typology: A Human-Centric Perspective on the Fourth Industrial Revolution Technologies”, International Conference on Computers & Industrial Engineering (CIE46), Tianjin, China, pp.1–11.Google Scholar
Rosales, J., Deshpande, S. and Anand, S. (2021) “IIoT based Augmented Reality for Factory Data Collection and Visualization”, Procedia Manufacturing, vol. 53, pp. 618–627, [online] https://doi.org/10.1016/j.promfg.2021.06.062.CrossRefGoogle Scholar
Sarhan, Q. (2018) “Internet of Things: A Survey of Challenges and Issues”, International Journal of Internet of Things and Cyber-Assurance, vol. 1, [online] https://doi.org/10.1504/IJITCA.2018.10011246.CrossRefGoogle Scholar
Shiratuddin, M. F., Jamali, S. and Wong, K. (2014) “An Overview of mobile-Augmented Reality in Higher Education”, International Journal on Recent Trends In Engineering & Technology, vol. 11, pp. 229–238.Google Scholar
Souza Cardoso, L. F. de, Queiroz Mariano, F. C. M. Q. and Zorzal, E. R. (2020) “A survey of industrial augmented reality”, Computers & Industrial Engineering, vol. 139, p. 106159, [online] https://doi.org/10.1016/j.cie.2019.106159.CrossRefGoogle Scholar
Szajna, A., Stryjski, R., Woźniak, W., Chamier-Gliszczyński, N. and Kostrzewski, M. (2020) “Assessment of Augmented Reality in Manual Wiring Production Process with Use of Mobile AR Glasses”, Sensors, Basel, Switzerland, vol. 20, no. 17, [online] https://doi.org/10.3390/s20174755.Google ScholarPubMed
Um, J., Popper, J.; Ruskowski, M. (2018) “Modular augmented reality platform for smart operator in production environment”, 2018 IEEE Industrial Cyber-Physical Systems (ICPS), St. Petersburg.CrossRefGoogle Scholar
Uva, A., Gattullo, M., Manghisi, V., Spagnulo, D., Cascella, G. L. and Fiorentino, M. (2018) “Evaluating the effectiveness of spatial augmented reality in smart manufacturing: a solution for manual working stations”, The International Journal of Advanced Manufacturing Technology, vol. 94, [online] https://doi.org/10.1007/s00170-017-0846-4.CrossRefGoogle Scholar
van Krevelen, R. and Poelman, R. (2010) “A Survey of Augmented Reality Technologies, Applications and Limitations”, International Journal of Virtual Reality, vol. 9, p. 1, [online] https://doi.org/10.20870/IJVR.2010.9.2.2767.CrossRefGoogle Scholar
Wang, X., Ong, S. K. and Nee, A. Y. C. (2016) “A comprehensive survey of augmented reality assembly research”, Advances in Manufacturing, vol. 4, no. 1, pp. 1–22, [online] https://doi.org/10.1007/s40436-015-0131-4.CrossRefGoogle Scholar
Werrlich, S., Eichstetter, E., Nitsche, K. and Notni, G. (2017) “An Overview of Evaluations Using Augmented Reality for Assembly Training Tasks”, International Journal of Computer and Information Engineering, vol. 11, no. 10, pp. 1129–1135, [online] https://doi.org/10.5281/zenodo.1132315.Google Scholar
Wilson, D.-M., Martin-Hammond, A. and Gilbert, J. (2012) “iTech: An Interactive Virtual Assistant for Technical Communication”, InTech, [online] https://doi.org/10.5772/37455.CrossRefGoogle Scholar
Xiao, L., Nouri, S., Hegland, J., Garcia, A. G. and Lanman, D. (2022) “NeuralPassthrough: Learned Real-Time View Synthesis for VR”, ACM SIGGRAPH Conference, pp. 1–9, [online] https://doi.org/10.48550/arXiv.2207.02186.Google Scholar
Ziaee, O. and Hamedi, M. (2021) “Augmented reality applications in manufacturing and its future scope in Industry 4.0”, ArXiv, vol. abs/2112.11190, [online] https://doi.org/10.48550/arxiv.2112.1119.CrossRefGoogle Scholar
Zubizarreta, J., Aguinaga, I. and Amundarain, A. (2019) “A framework for augmented reality guidance in industry”, The International Journal of Advanced Manufacturing Technology, vol. 102, no. 9, pp. 4095–4108, [online] https://doi.org/10.1007/s00170-019-03527-2.CrossRefGoogle Scholar