Today one of the most important problems in modern Augmented and Mixed reality applications is the analysis of surrounding objects in order to trace variability of the observed environment, the behavior of which is usually unpredictable. The solution to this problem can be widely applied in many mobile applications as a tool to interact with surrounding objects in the environment. Augmented and Mixed realities are both extremely promising directions for further research of interaction with the real environment. In this paper, we suggest a method of creation of geometric data based on a series of points in order to reconstruct the surface of real objects. This allows us to ensure the interaction with virtual objects. The proposed method comprises three steps: point detection, points clusterization into multiple groups of points, depending on their location, and the creation of geometric data such as lines and surfaces.
This research focuses on the possibility of building an alternative mixed reality (MR) system, which will eliminate all its main causes of visual discomfort and form a model of the real world in the virtual space, as much as possible corresponding to it. The relationship between virtual reality (VR) systems, which are limited to models of their own virtual world, and MR systems, which add virtual objects to the real world, is examined. This paper presents an approach based on generating a point cloud of static objects using RGB-D sensors of the MR device, its further classification and segmentation, and then searching for a similar CAD object in the appropriate database. The found virtual analogue, after appropriate transformations, replaces the real object of the scene. To create more realism, RGB images of real objects can be superimposed as textures on the corresponding virtual scene objects. The paper proposes a multimodal approach, which consists in searching for objects with similar modalities in databases. A virtual scene created in a single space using this approach eliminates the possibility of forming unnatural lighting and observation conditions for all objects, including virtual copies of real objects and added virtual objects.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.