Search Results

Neural Mesh Reconstruction

Download or Read eBook Neural Mesh Reconstruction PDF written by Zhiqin Chen and published by . This book was released on 2023 with total page 0 pages. Available in PDF, EPUB and Kindle.
Neural Mesh Reconstruction
Author :
Publisher :
Total Pages : 0
Release :
ISBN-10 : OCLC:1389625793
ISBN-13 :
Rating : 4/5 (93 Downloads)

Book Synopsis Neural Mesh Reconstruction by : Zhiqin Chen

Book excerpt: Deep learning has revolutionized the field of 3D shape reconstruction, unlocking new possibilities and achieving superior performance compared to traditional methods. However, despite being the dominant 3D shape representation in real-world applications, polygon meshes have been severely underutilized as a representation for output shapes in neural 3D reconstruction methods. One key reason is that triangle tessellations are irregular, which poses challenges for generating them using neural networks. Therefore, it is imperative to develop algorithms that leverage the power of deep learning while generating output shapes in polygon mesh formats for seamless integration into real-world applications. In this thesis, we propose several data-driven approaches to reconstruct explicit meshes from diverse types of input data, aiming to address this challenge. Drawing inspiration from classical data structures and algorithms in computer graphics, we develop representations to effectively represent meshes within neural networks. First, we introduce BSP-Net. Inspired by a classical data structure Binary Space Partitioning (BSP), we represent a 3D shape as a union of convex primitives, each obtained by intersecting half-spaces. This 3-layer BSP-tree representation allows a shape to be stored in a 3-layer multilayer perceptron (MLP) as a neural implicit, while an exact polygon mesh can be extracted from the MLP weights by parsing the underlying BSP-tree. BSP-Net is the first shape decoder neural network that can produce compact and watertight polygon meshes natively. Next, we present Neural Marching Cubes (NMC), a data-driven algorithm for reconstructing meshes from discretized implicit fields. NMC is built upon Marching Cubes (MC), but it learns the vertex positions and local mesh topologies from example training meshes, thereby avoiding topological errors and achieving better reconstruction of geometric features. In our subsequent work, Neural Dual Contouring (NDC), we replace the MC meshing algorithm with Dual Contouring (DC) with slight modifications, so that our algorithm that can reconstruct meshes from signed/unsigned distance fields, binary voxels, and point clouds, with high accuracy and fast inference speed. Furthermore, inspired by the volume rendering algorithm in Neural Radiance Fields (NeRF), we introduce differentiable rendering to NDC to arrive at MobileNeRF, a NeRF based on triangle meshes with view-dependent textures that can reconstruct scenes from multi-view images. MobileNeRF is the first NeRF-based method that can run on phones and other mobile devices, exhibiting its efficiency and compatibility.


Neural Mesh Reconstruction Related Books

Neural Mesh Reconstruction
Language: en
Pages: 0
Authors: Zhiqin Chen
Categories:
Type: BOOK - Published: 2023 - Publisher:

DOWNLOAD EBOOK

Deep learning has revolutionized the field of 3D shape reconstruction, unlocking new possibilities and achieving superior performance compared to traditional me
Neural Meshes: Surface Reconstruction with a Learning Algorithm
Language: en
Pages: 16
Authors: Ioannis P. Ivrissimtzis
Categories:
Type: BOOK - Published: 2004 - Publisher:

DOWNLOAD EBOOK

Neural Meshes
Language: en
Pages: 16
Authors:
Categories: Computer graphics
Type: BOOK - Published: 2004 - Publisher:

DOWNLOAD EBOOK

Abstract: "In this paper we propose a Learning algorithm for surface reconstruction. Our algorithm simulates an incrementally expanding neural network which lea
Neural Mesh Flow
Language: en
Pages: 59
Authors: Kunal Gupta
Categories:
Type: BOOK - Published: 2020 - Publisher:

DOWNLOAD EBOOK

Meshes are important representations of physical 3D entities in the virtual world. Applications like rendering, simulations and 3D printing require meshes to be
Computer Vision – ECCV 2022
Language: en
Pages: 806
Authors: Shai Avidan
Categories: Computers
Type: BOOK - Published: 2022-11-10 - Publisher: Springer Nature

DOWNLOAD EBOOK

The 39-volume set, comprising the LNCS books 13661 until 13699, constitutes the refereed proceedings of the 17th European Conference on Computer Vision, ECCV 20
Scroll to top