1. |
Balta H.♦, Będkowski J.♦, Govindaraj S.♦, Majek K.♦, Musialik P.♦, Serrano D.♦, Alexis K.♦, Siegwart R.♦, De Cubber G.♦, Integrated Data Management for a Fleet of Search-and-rescue Robots,
Journal of Field Robotics, ISSN: 1556-4959, DOI: 10.1002/rob.21651, Vol.34, No.3, pp.539-582, 2016Abstract: Search-and-rescue operations have recently been confronted with the introduction of robotic tools that assist the human search-and-rescue workers in their dangerous but life-saving job of searching for human survivors after major catastrophes. However, the world of search and rescue is highly reliant on strict procedures for the transfer of messages, alarms, data, and command and control over the deployed assets. The introduction of robotic tools into this world causes an important structural change in this procedural toolchain. Moreover, the introduction of search-and-rescue robots acting as data gatherers could potentially lead to an information overload toward the human search-and-rescue workers, if the data acquired by these robotic tools are not managed in an intelligent way. With that in mind, we present in this paper an integrated data combination and data management architecture that is able to accommodate real-time data gathered by a fleet of robotic vehicles on a crisis site, and we present and publish these data in a way that is easy to understand by end-users. In the scope of this paper, a fleet of unmanned ground and aerial search-and-rescue vehicles is considered, developed within the scope of the European ICARUS project. As a first step toward the integrated data-management methodology, the different robotic systems require an interoperable framework in order to pass data from one to another and toward the unified command and control station. As a second step, a data fusion methodology will be presented, combining the data acquired by the different heterogenic robotic systems. The computation needed for this process is done in a novel mobile data center and then (as a third step) published in a software as a service (SaaS) model. The SaaS model helps in providing access to robotic data over ubiquitous Ethernet connections. As a final step, we show how the presented data-management architecture allows for reusing recorded exercises with real robots and rescue teams for training purposes and teaching search-and-rescue personnel how to handle the different robotic tools. The system was validated in two experiments. First, in the controlled environment of a military testing base, a fleet of unmanned ground and aerial vehicles was deployed in an earthquake-response scenario. The data gathered by the different interoperable robotic systems were combined by a novel mobile data center and presented to the end-user public. Second, an unmanned aerial system was deployed on an actual mission with an international relief team to help with the relief operations after major flooding in Bosnia in the spring of 2014. Due to the nature of the event (floods), no ground vehicles were deployed here, but all data acquired by the aerial system (mainly three-dimensional maps) were stored in the ICARUS data center, where they were securely published for authorized personnel all over the world. This mission (which is, to our knowledge, the first recorded deployment of an unmanned aerial system by an official governmental international search-and-rescue team in another country) proved also the concept of the procedural integration of the ICARUS data management system into the existing procedural toolchain of the search and rescue workers, and this in an international context (deployment from Belgium to Bosnia). The feedback received from the search-and-rescue personnel on both validation exercises was highly positive, proving that the ICARUS data management system can efficiently increase the situational awareness of the search-and-rescue personnel. Affiliations:
Balta H. | - | Royal Military Academy of Belgium (BE) | Będkowski J. | - | other affiliation | Govindaraj S. | - | Space Applications Services NV/SA (BE) | Majek K. | - | Institute of Mathematical Machines (PL) | Musialik P. | - | Institute of Mathematical Machines (PL) | Serrano D. | - | Eurecat Technology Centre (ES) | Alexis K. | - | Eidgenössische Technische Hochschule Zürich (CH) | Siegwart R. | - | Eidgenössische Technische Hochschule Zürich (CH) | De Cubber G. | - | Royal Military Academy of Belgium (BE) |
| |
2. |
Będkowski J., Majek K.♦, Majek P.♦, Musialik P.♦, Pełka M.♦, Nüchter A.♦, Intelligent Mobile System for Improving Spatial Design Support and Security Inside Buildings,
Mobile Networks and Applications, ISSN: 1383-469X, DOI: 10.1007/s11036-015-0654-8, Vol.21, No.2, pp.313-326, 2016Abstract: This paper concerns the an intelligent mobile application for spatial design support and security domain. Mobility has two aspects in our research: The first one is the usage of mobile robots for 3D mapping of urban areas and for performing some specific tasks. The second mobility aspect is related with a novel Software as a Service system that allows access to robotic functionalities and data over the Ethernet, thus we demonstrate the use of the novel NVIDIA GRID technology allowing to virtualize the graphic processing unit. We introduce Complex Shape Histogram, a core component of our artificial intelligence engine, used for classifying 3D point clouds with a Support Vector Machine. We use Complex Shape Histograms also for loop closing detection in the simultaneous localization and mapping algorithm. Our intelligent mobile system is built on top of the Qualitative Spatio-Temporal Representation and Reasoning framework. This framework defines an ontology and a semantic model, which are used for building the intelligent mobile user interfaces. We show experiments demonstrating advantages of our approach. In addition, we test our prototypes in the field after the end-user case studies demonstrating a relevant contribution for future intelligent mobile systems that merge mobile robots with novel data centers. Keywords: Intelligent mobile system, 3D object recognition, Qualitative representation and reasoning, 3D mapping Affiliations:
Będkowski J. | - | IPPT PAN | Majek K. | - | Institute of Mathematical Machines (PL) | Majek P. | - | Institute of Mathematical Machines (PL) | Musialik P. | - | Institute of Mathematical Machines (PL) | Pełka M. | - | Institute of Mathematical Machines (PL) | Nüchter A. | - | Julius-Maximilians-University Würzburg (DE) |
| |
3. |
Będkowski J.♦, Majek K.♦, Musialik P.♦, Adamek A.♦, Andrzejewski D.♦, Czekaj D.♦, Towards terrestrial 3D data registration improved by parallel programming and evaluated with geodetic precision,
Automation in Construction, ISSN: 0926-5805, DOI: 10.1016/j.autcon.2014.07.013, Vol.47, pp.78-91, 2014Abstract: In this paper a quantitative and qualitative evaluation of proposed ICP-based data registration algorithm, improved by parallel programming in CUDA (compute unified device architecture), is shown. The algorithm was tested on data collected with a 3D terrestrial laser scanner Z + F Imager 5010 mounted on the mobile platform PIONNER 3AT. Parallel implementation enables data registration on-line, even using a laptop with a standard hardware configuration (graphic card NVIDIA GeForce 6XX/7XX series). Robustness is assured by the use of CUDA-enhanced fast NNS (nearest neighbor search) applied for ICP (iterative closest point) with SVD (singular value decomposition) solver. The evaluation is based on the reference ground truth data registered with geodetic precision. The geodetic approach extends our previous work and gives an accurate benchmark for the algorithm. The data were collected in an urban area under a demolition scenario in a real environment. We compared four registration strategies concerning data preprocessing, such as subsampling and vegetation removal. The result is the analysis of measured performance and the accuracy of the geometric maps. The system provides accurate metric maps on-line and can be used in several applications such as mobile robotics for construction area modelling or spatial design support. It is a core component for our future work on mobile mapping systems. Keywords: Iterative closest point, Data registration, Mobile mapping, CUDA parallel programming, Spatial design support Affiliations:
Będkowski J. | - | other affiliation | Majek K. | - | Institute of Mathematical Machines (PL) | Musialik P. | - | Institute of Mathematical Machines (PL) | Adamek A. | - | Warsaw University of Technology (PL) | Andrzejewski D. | - | Warsaw University of Technology (PL) | Czekaj D. | - | Warsaw University of Technology (PL) |
| |
4. |
Ostrowski I.♦, Majek K.♦, Adamek A.♦, Musialik P.♦, Będkowski J.♦, Masłowski A.♦, Mobilny system tworzenia przestrzennej dokumentacji semantycznej,
POMIARY AUTOMATYKA KONTROLA, ISSN: 0032-4140, Vol.58, No.12, pp.1117-1120, 2012Abstract: W artykule przedstawiono mobilny system tworzenia przestrzennej dokumentacji semantycznej. Zaproponowano nową metodę filtracji oraz rejestracji danych wykorzystującą obliczenia równoległe (NVIDIA FERMI). Opracowany system informatyczny umożliwia gromadzenie danych przestrzennych z wykorzystaniem geodezyjnego systemu pomiarowego 3D oraz pozwala na etykietowanie obiektów. Tworzona mapa semantyczna jest dostępna z poziomu dowolnego urządzenia mobilnego (laptop, smartphone, tablet). Keywords: mapa semantyczna, przestrzenna dokumentacja semantyczna, skanowanie laserowe, chmura punktów, obliczenia równoległe, wizualizacja Affiliations:
Ostrowski I. | - | other affiliation | Majek K. | - | Institute of Mathematical Machines (PL) | Adamek A. | - | Warsaw University of Technology (PL) | Musialik P. | - | Institute of Mathematical Machines (PL) | Będkowski J. | - | other affiliation | Masłowski A. | - | Warsaw University of Technology (PL) |
| |