Recommand Reading:
- Implicit Neural Representations with Periodic Activation Functions (Sitzmann et al. 2020)
- Instant Neural Graphics Primitives with a Multiresolution Hash Encoding, Müller et al., SIGGRAPH 2022 | github | bibtex
- Neural Radiance Fields (NeRF)
- A Structured Dictionary Perspective on Implicit Neural Representations
- Geometry Processing with Neural Fields
Latest:
- Regularize implicit neural representation by itself
- Transformers as Meta-Learners for Implicit Neural Representations
- Versatile Neural Processes for Learning Implicit Neural Representations
- Efficient Meta-Learning via Error-based Context Pruning for Implicit Neural Representations
- Generalizable Implicit Neural Representations via Instance Pattern Composers
- Transformers as Meta-Learners for Implicit Neural Representations
- Deep Learning on Implicit Neural Representations of Shapes
- Neural Implicit Dictionary Learning via Mixture-of-Expert Training
- Implicit Neural Representations with Levels-of-Experts
- Neural Implicit Surface Evolution using Differential Equations
- A Level Set Theory for Neural Implicit Evolution under Explicit Flows
- Coordinates Are NOT Lonely -- Codebook Prior Helps Implicit Neural 3D Representations
- Neural Matching Fields: Implicit Representation of Matching Fields for Visual Correspondence
- Continuous PDE Dynamics Forecasting with Implicit Neural Representations
- Implicit Neural Spatial Representations for Time-dependent PDEs
- DiGS : Divergence guided shape implicit neural representation for unoriented point clouds
- Hindering Adversarial Attacks with Implicit Neural Representations
3D Representation History
- DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation (Park et al. 2019)
- Occupancy Networks: Learning 3D Reconstruction in Function Space (Mescheder et al. 2019)
- IM-Net: Learning Implicit Fields for Generative Shape Modeling (Chen et al. 2018)
- Sal: Sign agnostic learning of shapes from raw data (Atzmon et al. 2019)
- Implicit Geometric Regularization for Learning Shapes (Gropp et al. 2020)
- Implicit Neural Representations with Periodic Activation Functions (Sitzmann et al. 2020)
- Neural Unsigned Distance Fields for Implicit Function Learning (Chibane et al. 2020)
Implicit representations of Geometry and Appearance(NeRF Related)
- Neural Radiance Fields (NeRF) (For a curated list of NeRF follow-up work specifically, From awesome-NeRF
Faster Inference
- Learning Neural Transmittance for Efficient Rendering of Reflectance Fields, Mohammad Shafiei et al., BMVC 2021 | bibtex
- Neural Sparse Voxel Fields, Liu et al., NeurIPS 2020 | github | bibtex
- AutoInt: Automatic Integration for Fast Neural Volume Rendering, Lindell et al., CVPR 2021 | github | bibtex
- DeRF: Decomposed Radiance Fields, Rebain et al. Arxiv 2020 | bibtex
- DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks, Neff et al., CGF 2021 | github | bibtex
- FastNeRF: High-Fidelity Neural Rendering at 200FPS, Garbin et al., Arxiv 2021 | bibtex
- KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs , Reiser et al., ICCV 2021 | github | bibtex
- PlenOctrees for Real-time Rendering of Neural Radiance Fields, Yu et al., Arxiv 2021 | github | bibtex
- Mixture of Volumetric Primitives for Efficient Neural Rendering, Lombardi et al., SIGGRAPH 2021 | bibtex
- Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering, Sitzmann et al., Arxiv 2021 | github | bibtex
- RT-NeRF: Real-Time On-Device Neural Radiance Fields Towards Immersive AR/VR Rendering, Li et al., ICCAD 2022 | bibtex
- ENeRF: Efficient Neural Radiance Fields for Interactive Free-viewpoint Video, Lin et al., SIGGRAPH 2022 | github | bibtex
- R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis, Wang et al., ECCV 2022 | github | bibtex
- Real-Time Neural Light Field on Mobile Devices, Cao et al., Arxiv 2022 | github | bibtext
Faster Training
- Depth-supervised NeRF: Fewer Views and Faster Training for Free, Deng et al., Arxiv 2021 | github | bibtex
- Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction, Sun et al., CVPR 2022 | github | bibtex
- Instant Neural Graphics Primitives with a Multiresolution Hash Encoding, Müller et al., SIGGRAPH 2022 | github | bibtex
- Plenoxels Radiance Fields without Neural Networks, Yu et al., CVPR 2022 | github | bibtex
- TensoRF: Tensorial Radiance Fields, Chen et al., ECCV 2022 | github | bibtex
- BakedSDF: Meshing Neural SDFs for Real-Time View Synthesis, Yariv et al., Arxiv 2023 | bibtex
Unconstrained Images
- NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections, Martin-Brualla et al., CVPR 2021 | bibtex
- Ha-NeRF: Hallucinated Neural Radiance Fields in the Wild, Chen et al., CVPR 2022 | github | bibtex
Deformable
- Deformable Neural Radiance Fields, Park et al., Arxiv 2020 | github | bibtex
- D-NeRF: Neural Radiance Fields for Dynamic Scenes, Pumarola et al., CVPR 2021 | github | bibtex
- Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction, Gafni et al., CVPR 2021 | github | bibtex
- Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video, Tretschk et al., Arxiv 2020 | github | bibtex
- PVA: Pixel-aligned Volumetric Avatars, Raj et al., CVPR 2021 | bibtex
- Neural Articulated Radiance Field, Noguchi et al., Arxiv 2021 | github | bibtex
- CLA-NeRF: Category-Level Articulated Neural Radiance Field, Tseng et al., ICRA 2022 | bibtex
- Animatable Neural Radiance Fields for Modeling Dynamic Human Bodies, Peng et al., ICCV 2021 | github | bibtex
- A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields, Park et al., Arxiv 2021 | github | bibtex
- Animatable Neural Radiance Fields from Monocular RGB Videos, Chen et al., Arxiv 2021 | github | bibtex
- Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Control, Liu et al., SIGGRAPH Asia 2021 | bibtex
- HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video, Weng et al., CVPR 2022 | github | bibtex
- AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Training, Jiang et al., CVPR 2023 | bibtex
Video
- Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes, Li et al., CVPR 2021 | github | bibtex
- Space-time Neural Irradiance Fields for Free-Viewpoint Video, Xian et al., CVPR 2021 | bibtex
- Neural Radiance Flow for 4D View Synthesis and Video Processing, Du et al., Arxiv 2020 | bibtex
- Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans, Peng et al., CVPR 2021 | github | bibtex
- UV Volumes for Real-time Rendering of Editable Free-view Human Performance, Chen et al., CVPR 2023 | github | bibtex
- Neural 3D Video Synthesis from Multi-view Video, Li et al., CVPR 2022 | bibtex
- Dynamic View Synthesis from Dynamic Monocular Video, Gao et al., ICCV 2021 | bibtex
- Block-NeRF: Scalable Large Scene Neural View Synthesis, Tancik et al., Arxiv 2022 | bibtex
- Streaming Radiance Fields for 3D Video Synthesis Li et al. NeurIPS 2022 | github | bibtex
Generalization
- GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis, Schwarz et al., NeurIPS 2020 | github | bibtex
- GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering, Trevithick and Yang, Arxiv 2020 | github | bibtex
- pixelNeRF: Neural Radiance Fields from One or Few Images, Yu et al., CVPR 2021 | github | bibtex
- Learned Initializations for Optimizing Coordinate-Based Neural Representations, Tancik et al., CVPR 2021 | github | bibtex
- pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis, Chan et al., CVPR 2021 | bibtex
- Portrait Neural Radiance Fields from a Single Image, Gao et al., Arxiv 2020 | bibtex
- ShaRF: Shape-conditioned Radiance Fields from a Single View, Rematas et al., ICML 2021 | bibtex
- IBRNet: Learning Multi-View Image-Based Rendering, Wang et al., CVPR 2021 | github | bibtex
- CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields, Niemeyer & Geiger, Arxiv 2021 | bibtex
- NeRF-VAE: A Geometry Aware 3D Scene Generative Model, Kosiorek et al., Arxiv 2021 | bibtex
- Unconstrained Scene Generation with Locally Conditioned Radiance Fields, DeVries et al., Arxiv 2021 | bibtex
- MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo, Chen et al., ICCV 2021 | github | bibtex
- Stereo Radiance Fields (SRF): Learning View Synthesis from Sparse Views of Novel Scenes, Chibane et al., CVPR 2021 | bibtex
- Neural Rays for Occlusion-aware Image-based Rendering, Liu et al., Arxiv 2021 | bibtex
- Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis, Matthew Tancik et al., Arxiv 2021 | bibtex
- MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis, Jiaxin Li et al., ICCV 2021 | github | bibtex
- TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis, Benjamin Attal et al., NeurIPS 2021 | bibtex
- CodeNeRF: Disentangled Neural Radiance Fields for Object Categories, Jang et al., ICCV 2021 | bibtex
- StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis, Gu et al., Arxiv 2021 | bibtex
- Generative Occupancy Fields for 3D Surface-Aware Image Synthesis, Xu et al., NeurIPS 2021 | github | bibtex
- NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images, Ben Mildenhall et al, arXiv 2021 | bibtex
- Point-NeRF: Point-based Neural Radiance Fields, Xu et al., CVPR 2022 | github | bibtex
- SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image, Xu et al., ECCV 2022 | github | bibtex
- Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion, Wang et al., CVPR 2023 | github | bibtex
Pose Estimation
- iNeRF: Inverting Neural Radiance Fields for Pose Estimation, Yen-Chen et al. IROS 2021 | bibtex
- A-NeRF: Surface-free Human 3D Pose Refinement via Neural Rendering, Su et al. Arxiv 2021 | bibtex
- NeRF--: Neural Radiance Fields Without Known Camera Parameters, Wang et al., Arxiv 2021 | github | bibtex
- iMAP: Implicit Mapping and Positioning in Real-Time, Sucar et al., ICCV 2021 | bibtex
- NICE-SLAM: Neural Implicit Scalable Encoding for SLAM, Zhu et al., Arxiv 2021 | bibtex
- GNeRF: GAN-based Neural Radiance Field without Posed Camera, Meng et al., Arxiv 2021 | bibtex
- BARF: Bundle-Adjusting Neural Radiance Fields, Lin et al., ICCV 2021 | bibtex
- Self-Calibrating Neural Radiance Fields, Jeong et al., ICCV 2021 | github | bibtex
- L2G-NeRF: Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields, Chen et al., CVPR 2023 | github | bibtex
Lighting
- NeRD: Neural Reflectance Decomposition from Image Collections, Boss et al., Arxiv 2020 | github | bibtex
- NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis, Srinivasan et al. CVPR 2021 | bibtex
- NeX: Real-time View Synthesis with Neural Basis Expansion, Wizadwongsa et al. Arxiv 2021 | github | bibtex
- NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination, Zhang et al. Arxiv 2021 | github | bibtex
- A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis, Pan et al., NeurIPS 2021 | github | bibtex
- KiloNeuS: Implicit Neural Representations with Real-Time Global Illumination, Esposito et al., Arxiv 2022 | bibtex
Compositionality
- NeRF++: Analyzing and Improving Neural Radiance Fields, Zhang et al., Arxiv 2020 | github | bibtex
- GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields, Niemeyer et al., CVPR 2021, bibtex
- Object-Centric Neural Scene Rendering, Guo et al., Arxiv 2020 | bibtex
- Learning Compositional Radiance Fields of Dynamic Human Heads, Wang et al., Arxiv 2020 | bibtex
- Neural Scene Graphs for Dynamic Scenes, Ost et al., CVPR 2021 | bibtex
- Unsupervised Discovery of Object Radiance Fields, Yu et al., Arxiv 2021 | bibtex
- Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering, Yang et al., ICCV 2021 | github | bibtex
- MoFaNeRF: Morphable Facial Neural Radiance Field, Zhuang et al., Arxiv 2021 | github | bibtex
Scene Labelling and Understanding
- In-Place Scene Labelling and Understanding with Implicit Scene Representation, Zhi et al., Arxiv 2021 | bibtex
- NeRF-SOS: Any-view Self-supervised Object Segmentation on Complex Real-world Scenes, Fan et al., ICLR 2023 | bibtex
Editing
- Editing Conditional Radiance Fields, Liu et al., Arxiv 2021 | github | bibtex
- Editable Free-viewpoint Video Using a Layered Neural Representation, Zhang et al., SIGGRAPH 2021 | github | bibtex
- NeRF-In: Free-Form NeRF Inpainting with RGB-D Priors, Liu et al., Arxiv 2022 | bibtex
- Unified Implicit Neural Stylization, Fan et al., ECCV 2022| github | bibtex
Object Category Modeling
- FiG-NeRF: Figure Ground Neural Radiance Fields for 3D Object Category Modelling, Xie et al., Arxiv 2021 | bibtex
- NeRF-Tex: Neural Reflectance Field Textures, Baatz et al., EGSR 2021 | bibtex
Multi-scale
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields, Barron et al., Arxiv 2021 | github | bibtex
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields, Barron et al., Arxiv 2022 | bibtex
Model Reconstruction
- UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction, Oechsle et al., ICCV 2021 | bibtex
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction, Wang et al., NeurIPS 2021 | github | bibtex
- Volume Rendering of Neural Implicit Surfaces, Yariv et al., NeurIPS 2021 | github | bibtex
- NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Images, Meng et al., CVPR 2023 | github | bibtex
Depth Estimation
- NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo, Wei et al., ICCV 2021 | bibtex
Robotics
- 3D Neural Scene Representations for Visuomotor Control, Li et al., CoRL 2021 Oral | bibtex
- Vision-Only Robot Navigation in a Neural Radiance World, Adamkiewicz et al., RA-L 2022 Vol.7 No.2 | bibtex
Large-scale scene
Hybrid Representation (implicit / explicit)
- Implicit Functions in Feature Space for 3D ShapeReconstruction and Completion
- Local Implicit Grid Representations for 3D Scenes
- Convolutional Occupancy Networks
- Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstruction
- Neural Sparse Voxel Fields
- Pixel-NERF (Yu et al. 2020) :
- Local Deep Implicit Functions for 3D Shape
- PatchNets: Patch-Based Generalizable Deep Implicit 3D Shape Representations
- Instant Neural Graphics Primitives with a Multiresolution Hash Encoding, Müller et al., SIGGRAPH 2022 | github | bibtex
- Iso-Points: Optimizing Neural Implicit Surfaces with Hybrid Representations
Theory
Symmetries in Implicit Neural Representations
- Vector Neurons: A General Framework for SO(3)-Equivariant Networks (Deng et al. 2021)
Generalization & Meta-Learning with Neural Implicit Representations
- Pifu: Pixel-aligned implicit function for high-resolution clothed human digitization (Saito et al. 2019)
- Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representations (Sitzmann et al. 2019)
- MetaSDF: MetaSDF: Meta-Learning Signed Distance Functions (Sitzmann et al. 2020)
- SDF-SRN: Learning Signed Distance 3D Object Reconstruction from Static Images (Lin et al. 2020)
- Learned Initializations for Optimizing Coordinate-Based Neural Representations (Tancik et al. 2020)
Fitting high-frequency detail with positional encoding & periodic nonlinearities
- Implicit Neural Representations with Periodic Activation Functions (Sitzmann et al. 2020)
- Fourier features let networks learn high frequency functions in low dimensional domains (Tancik et al. 2020)
Applications
Robotics Applications
- 3D Neural Scene Representations for Visuomotor Control
- Full-Body Visual Self-Modeling of Robot Morphologies
- Neural Descriptor Fields: SE(3)-Equvariant Object Representations for Manipulation
Implicit Neural Representations of Images
- Implicit Neural Representations with Periodic Activation Functions (Sitzmann et al. 2020)
- X-Fields: Implicit Neural View-, Light- and Time-Image Interpolation (Bemana et al. 2020)
- Learning Continuous Image Representation with Local Implicit Image Function (Chen et al. 2020)
- Alias-Free Generative Adversarial Networks (StyleGAN3)
Implicit Representations for Partial Differential Equations & Boundary Value Problems
- Implicit Geometric Regularization for Learning Shapes (Gropp et al. 2020)
- Implicit Neural Representations with Periodic Activation Functions (Sitzmann et al. 2020)
- AutoInt: Automatic Integration for Fast Neural Volume Rendering (Lindell et al. 2020)
- MeshfreeFlowNet: Physics-Constrained Deep Continuous Space-Time Super-Resolution Framework (Jiang et al. 2020)
Generative Adverserial Networks with Implicit Representations
For 3D
- Generative Radiance Fields for 3D-Aware Image Synthesis (Schwarz et al. 2020)
- pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis (Chan et al. 2020)
- Unconstrained Scene Generation with Locally Conditioned Radiance Fields (DeVries et al. 2021)
- Alias-Free Generative Adversarial Networks (StyleGAN3)
For 2D
- Adversarial Generation of Continuous Images (Skorokhodov et al. 2020)
- Learning Continuous Image Representation with Local Implicit Image Function (Chen et al. 2020)
- Image Generators with Conditionally-Independent Pixel Synthesis (Anokhin et al. 2020)
- Alias-Free GAN (Karras et al. 2021)
Image-to-image translation
- Spatially-Adaptive Pixelwise Networks for Fast Image Translation (Shaham et al. 2020)
Articulated representations
- NASA: Neural Articulated Shape Approximation (Deng et al. 2020)