Winners of Artec 3D and Luxembourg University SHARP challenge announced at CVPR in New Orleans
Photo: Jared Heinly
Luxembourg, 20 June 2022 | In the vibrant and iconic city of New Orleans on June 19, 2022, winners of the third Shape Recovery from Partial Textured 3D Scans (SHARP) Workshop and Challenge were announced. This annual challenge is co-founded and run by global leader in 3D scanning technology Artec 3D, and the University of Luxembourg’s Interdisciplinary Center for Security, Reliability and Trust (SnT) with the aim of advancing AI and machine learning with 3D data processing, and promoting 3D technology as an essential academic topic.
In January this year, the challenge was announced, the competition commenced, and the teams got started. In June and as part of the Computer Vision and Pattern Recognition Conference (CVPR) conference, three teams of finalists presented their work before the results were announced.
Representing Artec 3D and presenting the prizes – a total of €8,000 – were SnT co-chairs Djamila Aouada (SnT) and Kseniya Cherenkova (Artec 3D, SnT) who attended virtually.
Professor Djamila Aouada (SnT) delivers a keynote speech at CVPR 2022. Photo: Women in Computer Vision Workshop @WiCVworkshop
This annual challenge encourages the creation of breakthrough methods for recovering complete textured 3D scans from raw incomplete data through two challenges – Textured Partial Scan Completion and Sharp Edge Recovery.
The challenge: Accuracy through algorithms
Through their tasks, teams had to accurately reconstruct a full 3D textured mesh from a partial 3D scan in the first challenge, and in the second – using a 3D object scan with smooth edges – reconstruct corresponding CAD model as a triangular mesh with sharp edges approximating the ground-truth sharp edges.
For the first challenge, participants were tasked with creating an algorithm superior to Artec 3D’s reference algorithm for two tracks: the first track, which required recovering textured human body scans from partial acquisitions, was won by the team from Dalian University of Technology, China, and the second – recovering textured object scans from partial acquisitions, using a dataset which contained over 2,000 objects with different levels of complexity in texture and geometry – was won by ETH Zurich, Switzerland.
The second challenge was an out-of-competition category that allowed all teams to compete against each other and the hosts. Here, the Dalian University of Technology team came out tops once again in Track 2, while the Artec + SnT team maintained a lead and remained unbeaten in Track 1.
Breaking new ground in 3D data processing
Gleb Gusev, Chief Technology Officer of Artec 3D, said, “The AI/ML community have already made huge achievements in dealing with 1- and 2-dimensional data such as speech, text, and images using neural networks. But, working with 3D data is far more difficult – it’s a completely different beast and it’s still very new territory.”
Referring to the significance of this project and the possibilities AI can present, he continued, “By initiating and sponsoring these challenges, we are moving 3D data understanding to a new level, where we can accomplish far more, such as automatic data completion and automatic mesh-to-CAD conversion by using AI-based algorithms.”
For more than five years, Luxembourg-based industry leaders Artec 3D has worked in collaboration with SnT to conduct academic research projects and develop educational partnerships. Since its launch in 2009, SnT has continued to conduct internationally competitive research in information and communication technology with a goal of creating a significant socio-economic impact. Since its collaboration with Artec 3D in 2017, research projects have focused on body measurement research, educational collaborations, security (3D face recognition), and more.