Refine
Document Type
- Article (2) (remove)
Language
- English (2)
Has Fulltext
- yes (2)
Keywords
- sensor fusion (2) (remove)
Faculty / Organisational entity
We present a system concept allowing humans to work safely in the same environment as a robot manipulator. Several cameras survey the common workspace. A look-up-table-based fusion algorithm is used to back-project directly from the image spaces of the cameras to the manipulator?s con-figuration space. In the look-up-tables both, the camera calibration and the robot geometry are implicitly encoded. For experiments, a conven-tional 6 axis industrial manipulator is used. The work space is surveyed by four grayscale cameras. Due to the limits of present robot controllers, the computationally expensive parts of the system are executed on a server PC that communicates with the robot controller via Ethernet.
This paper presents a method for simultaneous classification and robust tracking of traffic participants based on the labeled random finite set (RFS) tracking framework. Specifically, a method to integrate the object class information into the tracking loop of the multiple model labeled multi-Bernoulli (MMLMB) filter, using Dempster-Shafer evidence theory is presented. The multi-object state is estimated using the detections from the sensors and by propagation of multi-object density in a Bayesian fashion. Parallelly, the object class information is also predicted and updated recursively. The underlying object class information required for this could typically be obtained from different types of sensor such as radar, lidar and camera, using classical perception or more recent deep learning methods. On one hand, this enables an unified classification and tracking of traffic participants. On the other hand, it also increases the robustness of multi-object tracking, as the parameters of the tracking algorithm could be adapted using the class information. Moreover, using the Dempster-Shafer method for fusing class information from different sensor sources improves the overall performance, especially when the sensors have contradicting classification.