SlideShare a Scribd company logo
Light Field Networks:
Neural Scene Representations with
Single-Evaluation Rendering
Hyeongmin Lee
Yonsei University
2022.5.15
PR-386: Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering
Pinhole Camera Model
Pinhole Camera Model
 Pinhole Camera Model
Pinhole Camera Model
 Normalized Plane
Pinhole Camera Model
 Intrinsic Parameter
Pinhole Camera Model
 Intrinsic Parameter
Pinhole Camera Model
 Extrinsic Parameter
NeRF
NeRF
 Neural Radiance Field
NeRF
 Ray
NeRF
 Ray
Light Field Networks
Light Field Networks
 Light Field Networks
Light Field Networks
 Parametrization of Line
• Two 3D Points
𝑃𝑃1
𝑃𝑃2
• One 3D Point & Direction Vector
𝑃𝑃
𝑑𝑑
Light Field Networks
 Plucker Coordinate
• Direction Vector
• A plane containing both the origin and the line
𝑃𝑃
𝑂𝑂
𝑑𝑑
𝑚𝑚
Light Field Networks
 Light Field Network
𝑡𝑡
𝑟𝑟
Getting Depth from LFNs
Getting Depth from LFNs
 Epipolar Plane
Getting Depth from LFNs
 Epipolar Plane
Meta Learning Framework
Meta Learning Framework
 Lambertian Space
Meta Learning Framework
 Hypernetwork Framework
[Train Dataset]
[Functions]
[Training]
Meta Learning Framework
 Results
https://www.vincentsitzmann.com/lfns/
Thank You!

More Related Content

PDF
PR-302: NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
Hyeongmin Lee
 
PDF
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
taeseon ryu
 
PDF
Generative adversarial text to image synthesis
Universitat Politècnica de Catalunya
 
PDF
PR-409: Denoising Diffusion Probabilistic Models
Hyeongmin Lee
 
PDF
Generative adversarial networks
남주 김
 
PDF
Single Image Super Resolution Overview
LEE HOSEONG
 
PDF
Deformable DETR Review [CDM]
Dongmin Choi
 
PDF
Attention is All You Need (Transformer)
Jeong-Gwan Lee
 
PR-302: NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
Hyeongmin Lee
 
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
taeseon ryu
 
Generative adversarial text to image synthesis
Universitat Politècnica de Catalunya
 
PR-409: Denoising Diffusion Probabilistic Models
Hyeongmin Lee
 
Generative adversarial networks
남주 김
 
Single Image Super Resolution Overview
LEE HOSEONG
 
Deformable DETR Review [CDM]
Dongmin Choi
 
Attention is All You Need (Transformer)
Jeong-Gwan Lee
 

What's hot (20)

PDF
A brief introduction to recent segmentation methods
Shunta Saito
 
PDF
Deep Learning - Convolutional Neural Networks
Christian Perone
 
PDF
GANs and Applications
Hoang Nguyen
 
PPTX
Human Pose Estimation by Deep Learning
Wei Yang
 
PDF
Modern Convolutional Neural Network techniques for image segmentation
Gioele Ciaparrone
 
PPT
Action Recognition (Thesis presentation)
nikhilus85
 
PPTX
[Paper Reading] Attention is All You Need
Daiki Tanaka
 
PDF
[기초개념] Graph Convolutional Network (GCN)
Donghyeon Kim
 
PDF
1시간만에 GAN(Generative Adversarial Network) 완전 정복하기
NAVER Engineering
 
PPTX
Neural Scene Representation & Rendering: Introduction to Novel View Synthesis
Vincent Sitzmann
 
PDF
Video Classification: Human Action Recognition on HMDB-51 dataset
Giorgio Carbone
 
PPTX
Transformers in Vision: From Zero to Hero
Bill Liu
 
PPTX
A Deep Journey into Super-resolution
Ronak Mehta
 
PDF
Skin Lesion Detection from Dermoscopic Images using Convolutional Neural Netw...
Universitat Politècnica de Catalunya
 
PDF
Siamese networks
Nicholas McClure
 
PDF
Gaussian Mixture Model
KyeongUkJang
 
PPTX
ViT.pptx
Changjin Lee
 
PDF
Restricted Boltzmann Machine | Neural Network Tutorial | Deep Learning Tutori...
Edureka!
 
PDF
Score based generative model
sangyun lee
 
PPTX
Semantic segmentation with Convolutional Neural Network Approaches
UMBC
 
A brief introduction to recent segmentation methods
Shunta Saito
 
Deep Learning - Convolutional Neural Networks
Christian Perone
 
GANs and Applications
Hoang Nguyen
 
Human Pose Estimation by Deep Learning
Wei Yang
 
Modern Convolutional Neural Network techniques for image segmentation
Gioele Ciaparrone
 
Action Recognition (Thesis presentation)
nikhilus85
 
[Paper Reading] Attention is All You Need
Daiki Tanaka
 
[기초개념] Graph Convolutional Network (GCN)
Donghyeon Kim
 
1시간만에 GAN(Generative Adversarial Network) 완전 정복하기
NAVER Engineering
 
Neural Scene Representation & Rendering: Introduction to Novel View Synthesis
Vincent Sitzmann
 
Video Classification: Human Action Recognition on HMDB-51 dataset
Giorgio Carbone
 
Transformers in Vision: From Zero to Hero
Bill Liu
 
A Deep Journey into Super-resolution
Ronak Mehta
 
Skin Lesion Detection from Dermoscopic Images using Convolutional Neural Netw...
Universitat Politècnica de Catalunya
 
Siamese networks
Nicholas McClure
 
Gaussian Mixture Model
KyeongUkJang
 
ViT.pptx
Changjin Lee
 
Restricted Boltzmann Machine | Neural Network Tutorial | Deep Learning Tutori...
Edureka!
 
Score based generative model
sangyun lee
 
Semantic segmentation with Convolutional Neural Network Approaches
UMBC
 
Ad

Similar to PR-386: Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering (20)

PDF
Content-Based Image Retrieval (D2L6 Insight@DCU Machine Learning Workshop 2017)
Universitat Politècnica de Catalunya
 
PDF
CNN vs SIFT-based Visual Localization - Laura Leal-Taixé - UPC Barcelona 2018
Universitat Politècnica de Catalunya
 
PPTX
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
Matthew O'Toole
 
PDF
Content-based image retrieval using a mobile device as a novel interface
Jonathon Hare
 
PPTX
Computational Photography_TED.pptx
NandaKishoreMallapra1
 
PPTX
Optical Computing for Fast Light Transport Analysis
Matthew O'Toole
 
PDF
LiDAR-based Autonomous Driving III (by Deep Learning)
Yu Huang
 
PPTX
Image Segmentation Using Deep Learning : A survey
NUPUR YADAV
 
PPTX
sahuPPT.pptx
KartikDutta10
 
PDF
Deep VO and SLAM
Yu Huang
 
PDF
AR/SLAM for end-users
Rakuten Group, Inc.
 
PDF
fusion of Camera and lidar for autonomous driving I
Yu Huang
 
PDF
Online video object segmentation via convolutional trident network
NAVER Engineering
 
PPTX
Convolutional Patch Representations for Image Retrieval An unsupervised approach
Universitat de Barcelona
 
PDF
Calibration Issues in FRC: Camera, Projector, Kinematics based Hybrid Approac...
Joo-Haeng Lee
 
PPTX
TechnicalBackgroundOverview
Motaz El-Saban
 
PDF
Camera-Based Road Lane Detection by Deep Learning II
Yu Huang
 
PDF
PR-278: RAFT: Recurrent All-Pairs Field Transforms for Optical Flow
Hyeongmin Lee
 
PDF
Unsupervised/Self-supervvised visual object tracking
Yu Huang
 
PDF
Deep learning for 3-D Scene Reconstruction and Modeling
Yu Huang
 
Content-Based Image Retrieval (D2L6 Insight@DCU Machine Learning Workshop 2017)
Universitat Politècnica de Catalunya
 
CNN vs SIFT-based Visual Localization - Laura Leal-Taixé - UPC Barcelona 2018
Universitat Politècnica de Catalunya
 
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
Matthew O'Toole
 
Content-based image retrieval using a mobile device as a novel interface
Jonathon Hare
 
Computational Photography_TED.pptx
NandaKishoreMallapra1
 
Optical Computing for Fast Light Transport Analysis
Matthew O'Toole
 
LiDAR-based Autonomous Driving III (by Deep Learning)
Yu Huang
 
Image Segmentation Using Deep Learning : A survey
NUPUR YADAV
 
sahuPPT.pptx
KartikDutta10
 
Deep VO and SLAM
Yu Huang
 
AR/SLAM for end-users
Rakuten Group, Inc.
 
fusion of Camera and lidar for autonomous driving I
Yu Huang
 
Online video object segmentation via convolutional trident network
NAVER Engineering
 
Convolutional Patch Representations for Image Retrieval An unsupervised approach
Universitat de Barcelona
 
Calibration Issues in FRC: Camera, Projector, Kinematics based Hybrid Approac...
Joo-Haeng Lee
 
TechnicalBackgroundOverview
Motaz El-Saban
 
Camera-Based Road Lane Detection by Deep Learning II
Yu Huang
 
PR-278: RAFT: Recurrent All-Pairs Field Transforms for Optical Flow
Hyeongmin Lee
 
Unsupervised/Self-supervvised visual object tracking
Yu Huang
 
Deep learning for 3-D Scene Reconstruction and Modeling
Yu Huang
 
Ad

More from Hyeongmin Lee (20)

PDF
PR-455: CoTracker: It is Better to Track Together
Hyeongmin Lee
 
PDF
PR-430: CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retri...
Hyeongmin Lee
 
PDF
PR-420: Scalable Model Compression by Entropy Penalized Reparameterization
Hyeongmin Lee
 
PDF
PR-395: Variational Image Compression with a Scale Hyperprior
Hyeongmin Lee
 
PDF
PR-376: Softmax Splatting for Video Frame Interpolation
Hyeongmin Lee
 
PDF
PR-365: Fast object detection in compressed video
Hyeongmin Lee
 
PDF
PR-340: DVC: An End-to-end Deep Video Compression Framework
Hyeongmin Lee
 
PDF
PR-328: End-to-End Optimized Image Compression
Hyeongmin Lee
 
PDF
PR-315: Taming Transformers for High-Resolution Image Synthesis
Hyeongmin Lee
 
PDF
Pr266
Hyeongmin Lee
 
PDF
PR-252: Making Convolutional Networks Shift-Invariant Again
Hyeongmin Lee
 
PDF
PR-240: Modulating Image Restoration with Continual Levels via Adaptive Featu...
Hyeongmin Lee
 
PDF
PR-228: Geonet: Unsupervised learning of dense depth, optical flow and camera...
Hyeongmin Lee
 
PDF
PR-214: FlowNet: Learning Optical Flow with Convolutional Networks
Hyeongmin Lee
 
PDF
[PR12] Making Convolutional Networks Shift-Invariant Again
Hyeongmin Lee
 
PPTX
Latest Frame interpolation Algorithms
Hyeongmin Lee
 
PPTX
[Paper Review] Temporal Generative Adversarial Nets with Singular Value Clipping
Hyeongmin Lee
 
PPTX
[Paper Review] A Middlebury Benchmark & Context-Aware Synthesis for Video Fra...
Hyeongmin Lee
 
PPTX
[Paper Review] Video Frame Interpolation via Adaptive Convolution
Hyeongmin Lee
 
PDF
[Paper Review] A spatio -Temporal Descriptor Based on 3D -Gradients
Hyeongmin Lee
 
PR-455: CoTracker: It is Better to Track Together
Hyeongmin Lee
 
PR-430: CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retri...
Hyeongmin Lee
 
PR-420: Scalable Model Compression by Entropy Penalized Reparameterization
Hyeongmin Lee
 
PR-395: Variational Image Compression with a Scale Hyperprior
Hyeongmin Lee
 
PR-376: Softmax Splatting for Video Frame Interpolation
Hyeongmin Lee
 
PR-365: Fast object detection in compressed video
Hyeongmin Lee
 
PR-340: DVC: An End-to-end Deep Video Compression Framework
Hyeongmin Lee
 
PR-328: End-to-End Optimized Image Compression
Hyeongmin Lee
 
PR-315: Taming Transformers for High-Resolution Image Synthesis
Hyeongmin Lee
 
PR-252: Making Convolutional Networks Shift-Invariant Again
Hyeongmin Lee
 
PR-240: Modulating Image Restoration with Continual Levels via Adaptive Featu...
Hyeongmin Lee
 
PR-228: Geonet: Unsupervised learning of dense depth, optical flow and camera...
Hyeongmin Lee
 
PR-214: FlowNet: Learning Optical Flow with Convolutional Networks
Hyeongmin Lee
 
[PR12] Making Convolutional Networks Shift-Invariant Again
Hyeongmin Lee
 
Latest Frame interpolation Algorithms
Hyeongmin Lee
 
[Paper Review] Temporal Generative Adversarial Nets with Singular Value Clipping
Hyeongmin Lee
 
[Paper Review] A Middlebury Benchmark & Context-Aware Synthesis for Video Fra...
Hyeongmin Lee
 
[Paper Review] Video Frame Interpolation via Adaptive Convolution
Hyeongmin Lee
 
[Paper Review] A spatio -Temporal Descriptor Based on 3D -Gradients
Hyeongmin Lee
 

Recently uploaded (20)

PDF
Principles of Food Science and Nutritions
Dr. Yogesh Kumar Kosariya
 
PDF
67243-Cooling and Heating & Calculation.pdf
DHAKA POLYTECHNIC
 
PDF
The Effect of Artifact Removal from EEG Signals on the Detection of Epileptic...
Partho Prosad
 
PPTX
Module2 Data Base Design- ER and NF.pptx
gomathisankariv2
 
PDF
settlement FOR FOUNDATION ENGINEERS.pdf
Endalkazene
 
PDF
20ME702-Mechatronics-UNIT-1,UNIT-2,UNIT-3,UNIT-4,UNIT-5, 2025-2026
Mohanumar S
 
PDF
Chad Ayach - A Versatile Aerospace Professional
Chad Ayach
 
PPTX
Chapter_Seven_Construction_Reliability_Elective_III_Msc CM
SubashKumarBhattarai
 
PPTX
Inventory management chapter in automation and robotics.
atisht0104
 
PDF
Biodegradable Plastics: Innovations and Market Potential (www.kiu.ac.ug)
publication11
 
PPTX
MT Chapter 1.pptx- Magnetic particle testing
ABCAnyBodyCanRelax
 
PDF
2010_Book_EnvironmentalBioengineering (1).pdf
EmilianoRodriguezTll
 
PDF
Software Testing Tools - names and explanation
shruti533256
 
PPTX
22PCOAM21 Data Quality Session 3 Data Quality.pptx
Guru Nanak Technical Institutions
 
PDF
EVS+PRESENTATIONS EVS+PRESENTATIONS like
saiyedaqib429
 
PDF
Top 10 read articles In Managing Information Technology.pdf
IJMIT JOURNAL
 
PDF
flutter Launcher Icons, Splash Screens & Fonts
Ahmed Mohamed
 
PDF
Packaging Tips for Stainless Steel Tubes and Pipes
heavymetalsandtubes
 
PPTX
IoT_Smart_Agriculture_Presentations.pptx
poojakumari696707
 
PPTX
database slide on modern techniques for optimizing database queries.pptx
aky52024
 
Principles of Food Science and Nutritions
Dr. Yogesh Kumar Kosariya
 
67243-Cooling and Heating & Calculation.pdf
DHAKA POLYTECHNIC
 
The Effect of Artifact Removal from EEG Signals on the Detection of Epileptic...
Partho Prosad
 
Module2 Data Base Design- ER and NF.pptx
gomathisankariv2
 
settlement FOR FOUNDATION ENGINEERS.pdf
Endalkazene
 
20ME702-Mechatronics-UNIT-1,UNIT-2,UNIT-3,UNIT-4,UNIT-5, 2025-2026
Mohanumar S
 
Chad Ayach - A Versatile Aerospace Professional
Chad Ayach
 
Chapter_Seven_Construction_Reliability_Elective_III_Msc CM
SubashKumarBhattarai
 
Inventory management chapter in automation and robotics.
atisht0104
 
Biodegradable Plastics: Innovations and Market Potential (www.kiu.ac.ug)
publication11
 
MT Chapter 1.pptx- Magnetic particle testing
ABCAnyBodyCanRelax
 
2010_Book_EnvironmentalBioengineering (1).pdf
EmilianoRodriguezTll
 
Software Testing Tools - names and explanation
shruti533256
 
22PCOAM21 Data Quality Session 3 Data Quality.pptx
Guru Nanak Technical Institutions
 
EVS+PRESENTATIONS EVS+PRESENTATIONS like
saiyedaqib429
 
Top 10 read articles In Managing Information Technology.pdf
IJMIT JOURNAL
 
flutter Launcher Icons, Splash Screens & Fonts
Ahmed Mohamed
 
Packaging Tips for Stainless Steel Tubes and Pipes
heavymetalsandtubes
 
IoT_Smart_Agriculture_Presentations.pptx
poojakumari696707
 
database slide on modern techniques for optimizing database queries.pptx
aky52024
 

PR-386: Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering