๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

์ „์ฒด ๊ธ€143

[Notable] NeRF vs Voxel vs Mesh 1. NeRF (Neural Radiance Fields)์˜ ์žฅ์ :์„ธ๋ฐ€ํ•œ ๋””ํ…Œ์ผ: NeRF๋Š” ๋ณผ๋ฅจ ๋ Œ๋”๋ง์„ ์‚ฌ์šฉํ•˜์—ฌ ๋งค์šฐ ์„ธ๋ฐ€ํ•œ ์žฅ๋ฉด์„ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด ๋ณต์žกํ•œ ์กฐ๋ช… ํšจ๊ณผ, ๋””ํ…Œ์ผํ•œ ์งˆ๊ฐ, ๋ชจ๋“  ๋ฐฉํ–ฅ์—์„œ์˜ ๋ Œ๋”๋ง์—์„œ ๋›ฐ์–ด๋‚œ ํ’ˆ์งˆ์„ ์–ป์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ํŠนํžˆ, ๋น›์˜ ๋ฐ˜์‚ฌ์™€ ๊ตด์ ˆ ๋“ฑ ๋ฌผ๋ฆฌ์  ์ƒํ˜ธ์ž‘์šฉ์„ ์„ธ๋ฐ€ํ•˜๊ฒŒ ๋ชจ๋ธ๋งํ•  ์ˆ˜ ์žˆ๋‹ค๋Š” ์ ์—์„œ ๊ณ ํ•ด์ƒ๋„์˜ ์‚ฌ์‹ค์ ์ธ ๊ฒฐ๊ณผ๋ฅผ ์–ป์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.์—ฐ์†์ ์ธ ํ‘œํ˜„: NeRF๋Š” 3D ๊ณต๊ฐ„์„ ์—ฐ์†์ ์ธ ๋ฐ€๋„์™€ ์ƒ‰์ƒ ๊ฐ’์œผ๋กœ ๋ชจ๋ธ๋งํ•ฉ๋‹ˆ๋‹ค. ์ด ๋ฐฉ์‹์€ 3D ์žฅ๋ฉด์„ ๋””์ง€ํ„ธํ™”ํ•  ๋•Œ ๋ถ€๋“œ๋Ÿฝ๊ณ  ์ž์—ฐ์Šค๋Ÿฌ์šด ์ „ํ™˜์„ ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•˜์—ฌ ๋” ๊ณ ๊ธ‰์Šค๋Ÿฌ์šด ์‹œ๊ฐ์  ํšจ๊ณผ๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.๊ณ ํ’ˆ์งˆ ๋ Œ๋”๋ง: NeRF๋Š” ์ด๋ฏธ์ง€ ๊ธฐ๋ฐ˜์˜ 3D ํ•ฉ์„ฑ์—์„œ ๋งค์šฐ ์‚ฌ์‹ค์ ์ธ ๊ฒฐ๊ณผ๋ฅผ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค. ํŠนํžˆ ์‚ฌ์ง„์ฒ˜๋Ÿผ ์ž์—ฐ์Šค๋Ÿฌ์šด ์กฐ๋ช…๊ณผ.. 2025. 1. 21.
[Code Build][Ubuntu] Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Rendering https://github.com/Anttwo/Frosting?tab=readme-ov-file GitHub - Anttwo/Frosting: [ECCV 2024 - ORAL] Official PyTorch implementation of Gaussian Frosting: Editable Complex Radiance Fie[ECCV 2024 - ORAL] Official PyTorch implementation of Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Rendering - Anttwo/Frostinggithub.comhttps://github.com/Anttwo/Frosting/blob/main/media/gifs/bu.. 2025. 1. 10.
[Code Build][Ubuntu] SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering https://github.com/Anttwo/SuGaR?tab=readme-ov-file GitHub - Anttwo/SuGaR: [CVPR 2024] Official PyTorch implementation of SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D[CVPR 2024] Official PyTorch implementation of SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering - Anttwo/SuGaRgithub.com  [ required ubuntu environment]ubunt.. 2025. 1. 10.
[Code Build][Ubuntu] 3D Gaussian splatting ์ €๋Š” dataset ๊ตฌ์ถ•๊ณผ train ์€ vessl server (ubuntu) ํ™˜๊ฒฝ์—์„œ ์ง„ํ–‰ ํ–ˆ๊ณ ,viewer ๋Š” exe ๋กœ ์‹คํ–‰ํ•ด์•ผ๋˜๊ธฐ ๋•Œ๋ฌธ์— window ํ™˜๊ฒฝ์—์„œ ์ง„ํ–‰ ํ–ˆ์Šต๋‹ˆ๋‹ค.gaussian splatting ์˜ ํ™˜๊ฒฝ์‚ฌํ•ญ์€ ๋‹ค์Œ๊ณผ ๊ฐ™์Šต๋‹ˆ๋‹ค.name: gaussian_splatting channels:   - pytorch   - conda-forge   - defaults dependencies:   - cudatoolkit=11.6   - plyfile   - python=3.7.13   - pip=22.3.1   - pytorch=1.12.1   - torchaudio=0.12.1   - torchvision=0.13.1   - tqdm   - pip:     - submodules/diff-.. 2025. 1. 8.
[Paper Review] 3D Gaussian Splatting for Real-Time Radiance Field Rendering ์ด ๋…ผ๋ฌธ ๋‚ด์šฉ์œผ๋กœ ๋“ค์–ด๊ฐ€๊ธฐ ์ „์— Pinhole Camera Model ์— ๋Œ€ํ•ด์„œ ์–ด๋Š ์ •๋„ ์ดํ•ด๋ฅผ ํ•˜๊ณ  ๊ฐ€๋ฉด ์ข‹๋‹ค.  Abstract1080p ํ•ด์ƒ๋„์˜ ๋ฌด์ œํ•œ ๋ฐ ์™„์ „ํ•œ ์žฅ๋ฉด์˜ ๋ Œ๋”๋ง์—์„œ๋Š” ์ด์ „๊นŒ์ง€๋Š” ์–ด๋–ค ๋ฐฉ๋ฒ•๋„ ์‹ค์‹œ๊ฐ„ ๋””์Šคํ”Œ๋ ˆ์ด ์†๋„(โ‰ฅ30 fps)๋ฅผ ๋‹ฌ์„ฑํ•˜์ง€ ๋ชปํ•˜๊ณ  ์žˆ๋‹ค.์ด ๋…ผ๋ฌธ์—์„œ๋Š” 1080p ํ•ด์ƒ๋„์—์„œ ๊ณ ํ’ˆ์งˆ ์‹ค์‹œ๊ฐ„(โ‰ฅ30 fps) ์ƒˆ๋กœ์šด ์‹œ์  ํ•ฉ์„ฑ์„ ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•˜๋Š” ์„ธ ๊ฐ€์ง€ ์ฃผ์š” ์š”์†Œ๋ฅผ ์†Œ๊ฐœํ•œ๋‹ค.1. 3D ๊ฐ€์šฐ์‹œ์•ˆ ํ™œ์šฉ: ์นด๋ฉ”๋ผ ์บ˜๋ฆฌ๋ธŒ๋ ˆ์ด์…˜ ๊ณผ์ •์—์„œ ์ƒ์„ฑ๋œ ํฌ์†Œ ํฌ์ธํŠธ๋ฅผ ์‹œ์ž‘์œผ๋กœ, ์žฅ๋ฉด์„ 3D ๊ฐ€์šฐ์‹œ์•ˆ์œผ๋กœ ํ‘œํ˜„ํ•˜์—ฌ ์—ฐ์†์ ์ธ ๋ณผ๋ฅจ๊ธฐ๋ฐ˜ Radiance Field ์˜ ์žฅ์ ์„ ์œ ์ง€ํ•˜๋ฉด์„œ ๋นˆ ๊ณต๊ฐ„์—์„œ์˜ ๋ถˆํ•„์š”ํ•œ ๊ณ„์‚ฐ์„ ํ”ผํ•œ๋‹ค.2. ์ตœ์ ํ™”์™€ ๋ฐ€๋„ ์ œ์–ด: 3D ๊ฐ€์šฐ์‹œ์•ˆ์˜ ๋น„๋“ฑ๋ฐฉ์„ฑ ๊ณต๋ถ„์‚ฐ์„ ์ตœ์ ํ™”ํ•˜์—ฌ ์žฅ๋ฉด์„ ์ •.. 2024. 12. 14.
[Paper Review] NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis Abstract์ด ๋…ผ๋ฌธ์—์„œ๋Š” ๋ณต์žกํ•œ ์žฅ๋ฉด์˜ ์ƒˆ๋กœ์šด ์‹œ์ ์„ ์ƒ์„ฑํ•˜๋ฉฐ, ๊ธฐ์กด ์—ฐ๊ตฌ๋ฅผ ๋›ฐ์–ด๋„˜๋Š” ์„ฑ๋Šฅ์„ ๋‹ฌ์„ฑํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์ œ์•ˆํ•œ๋‹ค.์ด ๋ฐฉ๋ฒ•์€ ์†Œ์ˆ˜์˜ ์ž…๋ ฅ ๋ทฐ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์—ฐ์†์ ์ธ volume scene ํ•จ์ˆ˜๋ฅผ ์ตœ์ ํ™”ํ•œ๋‹ค.์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ์žฅ๋ฉด์„ fully connected (not convolution) deep network ๋กœ ํ‘œํ˜„ํ•œ๋‹ค. - ์ž…๋ ฅ: ์—ฐ์†์ ์ธ 5D ์ขŒํ‘œ => ๊ณต๊ฐ„ ์œ„์น˜(x, y, z) ์™€ ์‹œ์  ๋ฐฉํ–ฅ(ฮธ, ฯ†) ์„ ์ž…๋ ฅ- ์ถœ๋ ฅ: ํ•ด๋‹น ์œ„์น˜์˜ ์ฒด์  ๋ฐ€๋„(volume density) ์™€ ์‹œ์  ์ข…์† ๋ฐฉ์ถœ ๋ณต์‚ฌ๊ด‘(view-dependent emitted radiance) ์ถœ๋ ฅ- ํ•ฉ์„ฑ ๊ณผ์ •: ์นด๋ฉ”๋ผ์—์„œ ์žฅ๋ฉด์œผ๋กœ ๋ป—์–ด๋‚˜๊ฐ€๋Š” ๊ด‘์„ (rays) ์„ ๋”ฐ๋ผ 5D ์ขŒํ‘œ(๊ณต๊ฐ„์œ„์น˜์™€ ์‹œ์ ๋ฐฉํ–ฅ)๋ฅผ ์„ ํƒํ•œ ๋’ค, ํ•ด๋‹น ์ขŒํ‘œ์—์„œ ์‹ ๊ฒฝ๋ง์„.. 2024. 12. 10.