๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

3D reconstruction10

[Paper Review] Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers https://arxiv.org/abs/2312.09147 Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with TransformersRecent advancements in 3D reconstruction from single images have been driven by the evolution of generative models. Prominent among these are methods based on Score Distillation Sampling (SDS) and the adaptation of diffusion models in the 3D domain. Despitarxi.. 2025. 2. 17.
[Paper Review][Workflow Review] DreamFusion: Text-to-3D Using 2D Diffusion DreamFusion ์€ Text input์— 3D output์„ ๊ฒฐ๊ณผ๋กœ ํ•˜๋Š” ๋…ผ๋ฌธ์ž…๋‹ˆ๋‹ค.https://dreamfusion3d.github.io/ DreamFusion: Text-to-3D using 2D DiffusionDreamFusion: Text-to-3D using 2D Diffusion, 2022.dreamfusion3d.github.io  ์ •๋ง ๊ฐ„๋‹จํ•˜๊ฒŒ ์ •๋ฆฌ๋ฅผ ํ•˜์ž๋ฉด,NeRF ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๋žœ๋คํ•œ 3D ๋ฌผ์ฒด๋ฅผ ๋ Œ๋”ํ•ฉ๋‹ˆ๋‹ค.๊ทธ๋ฆฌ๊ณ  text ๋ฐ์ดํ„ฐ๋ฅผ input์œผ๋กœ ๋„ฃ์œผ๋ฉด Stable Diffusion ์„ ์ด์šฉํ•˜์—ฌ 2D image ๋ฅผ generate ํ•ฉ๋‹ˆ๋‹ค.generated ๋œ ์ด๋ฏธ์ง€์™€ NeRF ์—์„œ ๋ Œ๋”๋œ 3D ์ด๋ฏธ์ง€์˜ 2D, ๊ทธ๋ฆฌ๊ณ  text prompt ๋ฅผ SDS (Score Distillati.. 2025. 1. 23.
[Code Build][Ubuntu] Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Rendering https://github.com/Anttwo/Frosting?tab=readme-ov-file GitHub - Anttwo/Frosting: [ECCV 2024 - ORAL] Official PyTorch implementation of Gaussian Frosting: Editable Complex Radiance Fie[ECCV 2024 - ORAL] Official PyTorch implementation of Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Rendering - Anttwo/Frostinggithub.comhttps://github.com/Anttwo/Frosting/blob/main/media/gifs/bu.. 2025. 1. 10.
[Code Build][Ubuntu] SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering https://github.com/Anttwo/SuGaR?tab=readme-ov-file GitHub - Anttwo/SuGaR: [CVPR 2024] Official PyTorch implementation of SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D[CVPR 2024] Official PyTorch implementation of SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering - Anttwo/SuGaRgithub.com  [ required ubuntu environment]ubunt.. 2025. 1. 10.
[Paper Review] 3D Gaussian Splatting for Real-Time Radiance Field Rendering ์ด ๋…ผ๋ฌธ ๋‚ด์šฉ์œผ๋กœ ๋“ค์–ด๊ฐ€๊ธฐ ์ „์— Pinhole Camera Model ์— ๋Œ€ํ•ด์„œ ์–ด๋Š ์ •๋„ ์ดํ•ด๋ฅผ ํ•˜๊ณ  ๊ฐ€๋ฉด ์ข‹๋‹ค.  Abstract1080p ํ•ด์ƒ๋„์˜ ๋ฌด์ œํ•œ ๋ฐ ์™„์ „ํ•œ ์žฅ๋ฉด์˜ ๋ Œ๋”๋ง์—์„œ๋Š” ์ด์ „๊นŒ์ง€๋Š” ์–ด๋–ค ๋ฐฉ๋ฒ•๋„ ์‹ค์‹œ๊ฐ„ ๋””์Šคํ”Œ๋ ˆ์ด ์†๋„(≥30 fps)๋ฅผ ๋‹ฌ์„ฑํ•˜์ง€ ๋ชปํ•˜๊ณ  ์žˆ๋‹ค.์ด ๋…ผ๋ฌธ์—์„œ๋Š” 1080p ํ•ด์ƒ๋„์—์„œ ๊ณ ํ’ˆ์งˆ ์‹ค์‹œ๊ฐ„(≥30 fps) ์ƒˆ๋กœ์šด ์‹œ์  ํ•ฉ์„ฑ์„ ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•˜๋Š” ์„ธ ๊ฐ€์ง€ ์ฃผ์š” ์š”์†Œ๋ฅผ ์†Œ๊ฐœํ•œ๋‹ค.1. 3D ๊ฐ€์šฐ์‹œ์•ˆ ํ™œ์šฉ: ์นด๋ฉ”๋ผ ์บ˜๋ฆฌ๋ธŒ๋ ˆ์ด์…˜ ๊ณผ์ •์—์„œ ์ƒ์„ฑ๋œ ํฌ์†Œ ํฌ์ธํŠธ๋ฅผ ์‹œ์ž‘์œผ๋กœ, ์žฅ๋ฉด์„ 3D ๊ฐ€์šฐ์‹œ์•ˆ์œผ๋กœ ํ‘œํ˜„ํ•˜์—ฌ ์—ฐ์†์ ์ธ ๋ณผ๋ฅจ๊ธฐ๋ฐ˜ Radiance Field ์˜ ์žฅ์ ์„ ์œ ์ง€ํ•˜๋ฉด์„œ ๋นˆ ๊ณต๊ฐ„์—์„œ์˜ ๋ถˆํ•„์š”ํ•œ ๊ณ„์‚ฐ์„ ํ”ผํ•œ๋‹ค.2. ์ตœ์ ํ™”์™€ ๋ฐ€๋„ ์ œ์–ด: 3D ๊ฐ€์šฐ์‹œ์•ˆ์˜ ๋น„๋“ฑ๋ฐฉ์„ฑ ๊ณต๋ถ„์‚ฐ์„ ์ตœ์ ํ™”ํ•˜์—ฌ ์žฅ๋ฉด์„ ์ •.. 2024. 12. 14.
[Paper Review] NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis Abstract์ด ๋…ผ๋ฌธ์—์„œ๋Š” ๋ณต์žกํ•œ ์žฅ๋ฉด์˜ ์ƒˆ๋กœ์šด ์‹œ์ ์„ ์ƒ์„ฑํ•˜๋ฉฐ, ๊ธฐ์กด ์—ฐ๊ตฌ๋ฅผ ๋›ฐ์–ด๋„˜๋Š” ์„ฑ๋Šฅ์„ ๋‹ฌ์„ฑํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์ œ์•ˆํ•œ๋‹ค.์ด ๋ฐฉ๋ฒ•์€ ์†Œ์ˆ˜์˜ ์ž…๋ ฅ ๋ทฐ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์—ฐ์†์ ์ธ volume scene ํ•จ์ˆ˜๋ฅผ ์ตœ์ ํ™”ํ•œ๋‹ค.์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ์žฅ๋ฉด์„ fully connected (not convolution) deep network ๋กœ ํ‘œํ˜„ํ•œ๋‹ค. - ์ž…๋ ฅ: ์—ฐ์†์ ์ธ 5D ์ขŒํ‘œ => ๊ณต๊ฐ„ ์œ„์น˜(x, y, z) ์™€ ์‹œ์  ๋ฐฉํ–ฅ(θ, φ) ์„ ์ž…๋ ฅ- ์ถœ๋ ฅ: ํ•ด๋‹น ์œ„์น˜์˜ ์ฒด์  ๋ฐ€๋„(volume density) ์™€ ์‹œ์  ์ข…์† ๋ฐฉ์ถœ ๋ณต์‚ฌ๊ด‘(view-dependent emitted radiance) ์ถœ๋ ฅ- ํ•ฉ์„ฑ ๊ณผ์ •: ์นด๋ฉ”๋ผ์—์„œ ์žฅ๋ฉด์œผ๋กœ ๋ป—์–ด๋‚˜๊ฐ€๋Š” ๊ด‘์„ (rays) ์„ ๋”ฐ๋ผ 5D ์ขŒํ‘œ(๊ณต๊ฐ„์œ„์น˜์™€ ์‹œ์ ๋ฐฉํ–ฅ)๋ฅผ ์„ ํƒํ•œ ๋’ค, ํ•ด๋‹น ์ขŒํ‘œ์—์„œ ์‹ ๊ฒฝ๋ง์„.. 2024. 12. 10.