A pinboard by
this curator

A PhD candidate working on engineering optimisation in augmented reality


Discover how AR technology that seamlessly blends virtual with real world can transform the industry

If you can be an Iron Man at work

In 10 seconds?

With necessary information and instructions displayed directly in front of you, you can do any task confidently. You know the warning sound will beep if there is any error or danger. You can collaborate with the computer as if it is part of you. That’s what AR is trying to achieve - to transform you into an Iron Man.

Don’t believe it?

Tired of hardcopy manuals and lengthy training process, researchers have been working hard to apply augmented reality technology in improving the work efficiency and quality of human in the industry. With lively visual information such as 3D text and graphics animation that guides human in completing a complex task onsite, it is found that work quality is improved with less errors and reduced time (Read more…).

But why isn’t this happening yet

A fully functional AR application involves multidisciplinary modules including computer vision for accurate tracking and positioning, computer graphics for information rendering and intelligent system for relevant content creation (Read more…). In particular, tracking allows the computer to know where the user is located and looking at in the real world so that virtual information can be rendered on intended position in real time. Currently, most of the virtual content is manually created for specific context. Hence, research challenges in accurate tracking and automatic content creation etc. have to be solved before you can finally wear the Iron Man suit.

It’s coming

Please be excited. Despite these research challenges, AR applications have attracted great interest from both academia and industry. In recent years, companies such as Google, Facebook and Microsoft have invested billions of dollars in AR technologies like Google Glass, Magic Leap, Hololens and more (Read more…). Driven by advancements in computer vision and artificial intelligence due to deep learning techniques, AR applications combining with AI methods are being developed so that in near future, you can be an Iron Man at work.


The application of augmented reality technologies for the improvement of occupational safety in an industrial environment

Abstract: In many branches of industry, occupational safety experts identified two main causes of worker injuries related to the usage of modern electro-mechanical machines and systems: inadequate training and insufficient work experience, and monotonicity of the tasks often performed repeatedly. In this paper, we present a system based on augmented reality (AR) technologies that can be useful in reducing these factors of risk at work and decreasing the error rate and preventing injuries. The system that is implemented on mobile devices is intended to project augmented reality instructions directly at the work place. A worker is led by the AR-system step by step through various work and safety procedures that should be performed. Each procedure consists of steps specified by a series of instructions accessed through an interactive check list. To ensure the safeness, if a confirmation is missing because of a skipped, incompletely, or wrongly performed step of a procedure, the AR-system blocks further implementation of the procedure and returns the worker to the previous step until the correct actions are carried out. At the same time, interactive work with the checklist breaks the monotonicity of the job. The system is personalized according to skills of a worker by taking into account his professional training and work experience. Depending on that it is determined the amount of data to be displayed to a worker helping even less skilled workers to perform a task.

Pub.: 28 Nov '16, Pinned: 13 Apr '17

Markerless Tracking System for Augmented Reality in the Automotive Industry

Abstract: This paper presents a complete natural feature based tracking system that supports the creation of augmented reality applications focused on the automotive sector. The proposed pipeline encompasses scene modeling, system calibration and tracking steps. An augmented reality application was built on top of the system for indicating the location of 3D coordinates in a given environment which can be applied to many different applications in cars, such as a maintenance assistant, an intelligent manual, and many others. An analysis of the system was performed during the Volkswagen/ISMAR Tracking Challenge 2014, which aimed to evaluate state-of-the-art tracking approaches on the basis of requirements encountered in automotive industrial settings. A similar competition environment was also created by the authors in order to allow further studies. Evaluation results showed that the system allowed users to correctly identify points in tasks that involved tracking a rotating vehicle, tracking data on a complete vehicle and tracking with high accuracy. This evaluation allowed also to understand the applicability limits of texture based approaches in the textureless automotive environment, a problem not addressed frequently in the literature. To the best of the authors’ knowledge, this is the first work addressing the analysis of a complete tracking system for augmented reality focused on the automotive sector which could be tested and validated in a major benchmark like the Volkswagen/ISMAR Tracking Challenge, providing useful insights on the development of such expert and intelligent systems.

Pub.: 29 Mar '17, Pinned: 13 Apr '17