Online CAD reconstruction with hand-held depth cameras (HandCAD-2)

• Applicant: Professor Dr. Dominik Henrich
• Subject Area: Automation, Mechatronics, Control Systems, Intelligent Technical Systems, Robotics ; Image and Language Processing, Computer Graphics and Visualisation, Human Computer Interaction, Ubiquitous and Wearable Computing
• Term: from 2015 to 2023
• Website: Homepage
• Project identifier: Deutsche Forschungsgemeinschaft (DFG) - Project number 270133832

Three-dimensional geometric computer models (CAD models) are used in many technical applications, such as in construction, manufacturing, simulation and in computer games. These models serve very different purposes, but have in common that they represent an imitation of rigid bodies in the real world. A CAD model is created either manually in several complex steps of a designer, or in a creative process on the computer. Alternatively, an existing object or an existing environment is captured by sensors and then a geometric model is automatically generated from the measurements (CAD reconstruction). Today, low-cost depth cameras are available for CAD reconstruction. In addition to the geometric data thus collected, additional abstract information of the detected objects, such as their properties, symmetries or features are desirable. Furthermore, the CAD reconstruction should be quick and easy to perform even without expert knowledge.In this research project methods for the automatic generation of CAD models from sensor data from hand-held cameras depth are developed and investigated. Here, the online computable reconstruction of individual objects and of complete interior or exterior scenes in the form of abstract models is considered with different resolution levels. The reconstruction should be generated with low performance computing hardware, such that the results can be displayed already during the acquisition. Specific challenges are non-planar, structure-less or symmetric surfaces and dynamic objects, such as people moving through the scene. In the long run, it would be desirable to draw additional conclusions on the reconstructed objects, such as: Which object is it? Is the object fixed or movable? What are the possible movements of the object (e.g. a door)?

• DFG Programme: Research Grants