We propose SHS-Net to estimate oriented normals directly from point clouds. In contrast, previous studies usually achieve this process through a two-stage paradigm using different algorithms, i.e., (1) unoriented normal estimation (e.g., PCA, AdaFit and HSurf-Net) and (2) normal orientation (e.g., MST, QPBO and ODP).
We propose a novel method called SHS-Net for oriented normal estimation of point clouds by learning signed hyper surfaces, which can accurately predict normals with global consistent orientation from various point clouds. Almost all existing methods estimate oriented normals through a two-stage pipeline, i.e., unoriented normal estimation and normal orientation, and each step is implemented by a separate algorithm. However, previous methods are sensitive to parameter settings, resulting in poor results from point clouds with noise, density variations and complex geometries. In this work, we introduce signed hyper surfaces (SHS), which are parameterized by multi-layer perceptron (MLP) layers, to learn to estimate oriented normals from point clouds in an end-to-end manner. The signed hyper surfaces are implicitly learned in a high-dimensional feature space where the local and global information is aggregated. Specifically, we introduce a patch encoding module and a shape encoding module to encode a 3D point cloud into a local latent code and a global latent code, respectively. Then, an attention-weighted normal prediction module is proposed as a decoder, which takes the local and global latent codes as input to predict oriented normals. Experimental results show that our SHS-Net outperforms the state-of-the-art methods in both unoriented and oriented normal estimation on the widely used benchmarks.
The learning pipeline of the signed hyper surfaces for oriented normal estimation. We propose to implicitly learn signed hyper surfaces in the feature space for estimating oriented normals. This new surface representation is learned from patch encoding and shape encoding using our designed loss functions.
This dataset can be download from here.
Scene 1 | Scene 2 |
---|---|
|
|
@inproceedings{li2023shsnet,
author = {Li, Qing and Feng, Huifang and Shi, Kanle and Gao, Yue and Fang, Yi and Liu, Yu-Shen and Han, Zhizhong},
title = {{SHS-Net}: Learning Signed Hyper Surfaces for Oriented Normal Estimation of Point Clouds},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
pages = {13591-13600},
month = {June},
year = {2023},
doi = {10.1109/CVPR52729.2023.01306},
url = {https://doi.ieeecomputersociety.org/10.1109/CVPR52729.2023.01306},
}
@article{li2024shsnet-pami,
author = {Li, Qing and Feng, Huifang and Shi, Kanle and Gao, Yue and Fang, Yi and Liu, Yu-Shen and Han, Zhizhong},
title = {Learning Signed Hyper Surfaces for Oriented Point Cloud Normal Estimation},
booktitle = {IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)},
year = {2024},
volume = {46},
number = {12},
pages = {9957-9974},
doi = {10.1109/TPAMI.2024.3431221},
}