SHS-Net: Learning Signed Hyper Surfaces for Oriented Normal Estimation of Point Clouds

TPAMI 2024 / CVPR 2023

Qing Li1     Huifang Feng2     Kanle Shi3     Yue Gao1     Yi Fang4     Yu-Shen Liu1     Zhizhong Han5
1Tsinghua University,   2Xiamen University,   3Kuaishou Technology,   4New York University Abu Dhabi,   5Wayne State University

We propose SHS-Net to estimate oriented normals directly from point clouds. In contrast, previous studies usually achieve this process through a two-stage paradigm using different algorithms, i.e., (1) unoriented normal estimation (e.g., PCA, AdaFit and HSurf-Net) and (2) normal orientation (e.g., MST, QPBO and ODP).

Abstract

We propose a novel method called SHS-Net for oriented normal estimation of point clouds by learning signed hyper surfaces, which can accurately predict normals with global consistent orientation from various point clouds. Almost all existing methods estimate oriented normals through a two-stage pipeline, i.e., unoriented normal estimation and normal orientation, and each step is implemented by a separate algorithm. However, previous methods are sensitive to parameter settings, resulting in poor results from point clouds with noise, density variations and complex geometries. In this work, we introduce signed hyper surfaces (SHS), which are parameterized by multi-layer perceptron (MLP) layers, to learn to estimate oriented normals from point clouds in an end-to-end manner. The signed hyper surfaces are implicitly learned in a high-dimensional feature space where the local and global information is aggregated. Specifically, we introduce a patch encoding module and a shape encoding module to encode a 3D point cloud into a local latent code and a global latent code, respectively. Then, an attention-weighted normal prediction module is proposed as a decoder, which takes the local and global latent codes as input to predict oriented normals. Experimental results show that our SHS-Net outperforms the state-of-the-art methods in both unoriented and oriented normal estimation on the widely used benchmarks.

Method

The learning pipeline of the signed hyper surfaces for oriented normal estimation. We propose to implicitly learn signed hyper surfaces in the feature space for estimating oriented normals. This new surface representation is learned from patch encoding and shape encoding using our designed loss functions.

FamousShape Dataset

This dataset can be download from here.

Results

Normal RMSE

Surface Reconstruction

Demo

Scene 1 Scene 2

BibTeX

      
        @inproceedings{li2023shsnet,
          author    = {Li, Qing and Feng, Huifang and Shi, Kanle and Gao, Yue and Fang, Yi and Liu, Yu-Shen and Han, Zhizhong},
          title     = {{SHS-Net}: Learning Signed Hyper Surfaces for Oriented Normal Estimation of Point Clouds},
          booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
          publisher = {IEEE Computer Society},
          address   = {Los Alamitos, CA, USA},
          pages     = {13591-13600},
          month     = {June},
          year      = {2023},
          doi       = {10.1109/CVPR52729.2023.01306},
          url       = {https://doi.ieeecomputersociety.org/10.1109/CVPR52729.2023.01306},
        }
      
    
      
        @article{li2024shsnet-pami,
          author    = {Li, Qing and Feng, Huifang and Shi, Kanle and Gao, Yue and Fang, Yi and Liu, Yu-Shen and Han, Zhizhong},
          title     = {Learning Signed Hyper Surfaces for Oriented Point Cloud Normal Estimation},
          booktitle = {IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)},
          year      = {2024},
          volume    = {46},
          number    = {12},
          pages     = {9957-9974},
          doi       = {10.1109/TPAMI.2024.3431221},
        }