A PhD candidate working on engineering optimisation in augmented reality
Discover how AR technology that seamlessly blends virtual with real world can transform the industry
With necessary information and instructions displayed directly in front of you, you can do any task confidently. You know the warning sound will beep if there is any error or danger. You can collaborate with the computer as if it is part of you. That’s what AR is trying to achieve - to transform you into an Iron Man.
Tired of hardcopy manuals and lengthy training process, researchers have been working hard to apply augmented reality technology in improving the work efficiency and quality of human in the industry. With lively visual information such as 3D text and graphics animation that guides human in completing a complex task onsite, it is found that work quality is improved with less errors and reduced time (Read more…).
A fully functional AR application involves multidisciplinary modules including computer vision for accurate tracking and positioning, computer graphics for information rendering and intelligent system for relevant content creation (Read more…). In particular, tracking allows the computer to know where the user is located and looking at in the real world so that virtual information can be rendered on intended position in real time. Currently, most of the virtual content is manually created for specific context. Hence, research challenges in accurate tracking and automatic content creation etc. have to be solved before you can finally wear the Iron Man suit.
Please be excited. Despite these research challenges, AR applications have attracted great interest from both academia and industry. In recent years, companies such as Google, Facebook and Microsoft have invested billions of dollars in AR technologies like Google Glass, Magic Leap, Hololens and more (Read more…). Driven by advancements in computer vision and artificial intelligence due to deep learning techniques, AR applications combining with AI methods are being developed so that in near future, you can be an Iron Man at work.
Abstract: This paper presents the design and implementation of an augmented reality (AR) tool in aid of operators being in a hybrid, human and robot collaborative industrial environment. The system aims to provide production and process related information as well as to enhance the operators’ immersion in the safety mechanisms, dictated by the collaborative workspace. The developed system has been integrated with a service based station controller, which is responsible for orchestrating the flow of information to the operator, according to the task execution status. The tool has been applied to a case study from the automotive sector, resulting in an enhanced operator's integration with the assembly process.
Pub.: 06 Jan '16, Pinned: 13 Apr '17
Abstract: Early hands-on experiences with the Microsoft Hololens augmented/mixed reality device are reported and discussed, with a general aim of exploring basic 3D visualization. A range of usage cases are tested, including data visualization and immersive data spaces, in-situ visualization of 3D models and full scale architectural form visualization. Ultimately, the Hololens is found to provide a remarkable tool for moving from traditional visualization of 3D objects on a 2D screen, to fully experiential 3D visualizations embedded in the real world.
Pub.: 13 Oct '16, Pinned: 13 Apr '17
Abstract: This paper proposes a mobile augmented reality (MAR) system aimed to support students in the use of a milling and lathe machines at a university manufacturing laboratory. The system incorporates 3D models of machinery and tools, text instructions, animations and videos with real processes to enrich the information obtained from the real world. The elements are shown when the user points the camera of a mobile device to specific parts of the machinery, where augmented reality (AR) markers are placed. The main goals of the project were (1) create an AR system that guides inexperienced users in machinery handling and (2) measure the acceptance rate and performance of the system in the school manufacturing laboratory. The guidance is provided by means of virtual information about how to operate the machinery when the trainer is not present. The system was implemented as a mobile app for Android devices and it was tested by 16 students and teachers at the university manufacturing laboratory through a survey. The results of this study revealed that students, laboratory technicians, and teachers had positive opinions and good acceptance about the use of the MAR system in the manufacturing laboratory. © 2016 Wiley Periodicals, Inc. Comput Appl Eng Educ; View this article online at wileyonlinelibrary.com/journal/cae; DOI 10.1002/cae.21772
Pub.: 20 Oct '16, Pinned: 13 Apr '17
Abstract: In this paper, augmented reality (AR) is used to enhance the visualization and interaction of finite element analysis (FEA) of structures. An integrated simulation system is proposed which acquires input data using sensors and uses AR technology to visualize FEA results in the real world. A number of intuitive interaction methods have been devised and implemented in this system. The user can perform real-time FEA simulation to investigate structural behavior under different loading conditions either through manipulating virtual loads or creating different loading conditions. Exploration of FEA results is enhanced through natural interfaces for manipulating, slicing and clipping the result data. Moreover, the user can modify the FE models of the structures through simplified operations for different purposes, e.g.,~adding structural members for stiffening and performing local mesh refinement. The modified model can be re-analyzed automatically. A prototype system has been built and a case study has been implemented to demonstrate the innovative interaction methods and evaluate the system performance.
Pub.: 04 Nov '16, Pinned: 13 Apr '17
Abstract: In many branches of industry, occupational safety experts identified two main causes of worker injuries related to the usage of modern electro-mechanical machines and systems: inadequate training and insufficient work experience, and monotonicity of the tasks often performed repeatedly. In this paper, we present a system based on augmented reality (AR) technologies that can be useful in reducing these factors of risk at work and decreasing the error rate and preventing injuries. The system that is implemented on mobile devices is intended to project augmented reality instructions directly at the work place. A worker is led by the AR-system step by step through various work and safety procedures that should be performed. Each procedure consists of steps specified by a series of instructions accessed through an interactive check list. To ensure the safeness, if a confirmation is missing because of a skipped, incompletely, or wrongly performed step of a procedure, the AR-system blocks further implementation of the procedure and returns the worker to the previous step until the correct actions are carried out. At the same time, interactive work with the checklist breaks the monotonicity of the job. The system is personalized according to skills of a worker by taking into account his professional training and work experience. Depending on that it is determined the amount of data to be displayed to a worker helping even less skilled workers to perform a task.
Pub.: 28 Nov '16, Pinned: 13 Apr '17
Abstract: We investigate the combination of Augmented Reality (AR) with Intelligent Tutoring Systems (ITS) to assist with training for manual assembly tasks. Our approach combines AR graphics with adaptive guidance from the ITS to provide a more effective learning experience. We have developed a modular software framework for intelligent AR training systems, and a prototype based on this framework that teaches novice users how to assemble a computer motherboard. An evaluation found that our intelligent AR system improved test scores by 25 % and that task performance was 30 % faster compared to the same AR training system without intelligent support. We conclude that using an intelligent AR tutor can significantly improve learning compared to more traditional AR training.
Pub.: 04 Nov '14, Pinned: 13 Apr '17
Abstract: This paper presents a complete natural feature based tracking system that supports the creation of augmented reality applications focused on the automotive sector. The proposed pipeline encompasses scene modeling, system calibration and tracking steps. An augmented reality application was built on top of the system for indicating the location of 3D coordinates in a given environment which can be applied to many different applications in cars, such as a maintenance assistant, an intelligent manual, and many others. An analysis of the system was performed during the Volkswagen/ISMAR Tracking Challenge 2014, which aimed to evaluate state-of-the-art tracking approaches on the basis of requirements encountered in automotive industrial settings. A similar competition environment was also created by the authors in order to allow further studies. Evaluation results showed that the system allowed users to correctly identify points in tasks that involved tracking a rotating vehicle, tracking data on a complete vehicle and tracking with high accuracy. This evaluation allowed also to understand the applicability limits of texture based approaches in the textureless automotive environment, a problem not addressed frequently in the literature. To the best of the authors’ knowledge, this is the first work addressing the analysis of a complete tracking system for augmented reality focused on the automotive sector which could be tested and validated in a major benchmark like the Volkswagen/ISMAR Tracking Challenge, providing useful insights on the development of such expert and intelligent systems.
Pub.: 29 Mar '17, Pinned: 13 Apr '17