๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ
๐Ÿ˜ŽAI/3D Reconstruction

[Notable] 3DGS(3D gaussian splatting) ์€ Differentiable ํ•œ๊ฐ€?

by SolaKim 2025. 2. 17.

โ–ถ3DGS ๋Š” Explicit Representation (๋ช…์‹œ์  ํ‘œํ˜„) ๋ฐฉ์‹์ด์ง€๋งŒ, ๋ Œ๋”๋ง ๊ณผ์ •์ด ๋ฏธ๋ถ„ ๊ฐ€๋Šฅํ•˜๊ฒŒ ์„ค๊ณ„๋˜์–ด ์žˆ์–ด์„œ ํ•™์Šตํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

 

โœ… Explicit Representation์ธ๋ฐ ์™œ Differentiable ํ• ๊นŒ?

๋ณดํ†ต Explicit Representation(๋ช…์‹œ์  ํ‘œํ˜„)์€ 3D ๊ฐ์ฒด๋ฅผ ์ง์ ‘์ ์œผ๋กœ ๋‚˜ํƒ€๋‚ด๋Š” ๋ฐฉ์‹์ด๊ธฐ ๋•Œ๋ฌธ์—, ๋ฏธ๋ถ„์ด ์–ด๋ ต๋‹ค๊ณ  ์ƒ๊ฐํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
์˜ˆ๋ฅผ ๋“ค์–ด:

  • Point Cloud (์  ํด๋ผ์šฐ๋“œ) โ†’ ๋‹จ์ˆœํ•œ 3D ์ขŒํ‘œ ์ง‘ํ•ฉ์ด๋ฏ€๋กœ ๋ฏธ๋ถ„์ด ์–ด๋ ค์›€.
  • Mesh (๋ฉ”์‰ฌ, ์‚ผ๊ฐํ˜• ๊ธฐ๋ฐ˜ ๋ชจ๋ธ) โ†’ ๋ฒ„ํ…์Šค(Vertex)์™€ ํŽ˜์ด์Šค(Face)๋กœ ํ‘œํ˜„๋˜๋ฉฐ, ์ผ๋ฐ˜์ ์ธ ๊ฒฝ์šฐ ๋ฏธ๋ถ„์ด ์‰ฝ์ง€ ์•Š์Œ.

ํ•˜์ง€๋งŒ 3DGS๋Š” Gaussian Splatting์„ ์‚ฌ์šฉํ•˜์—ฌ ๋ฏธ๋ถ„ ๊ฐ€๋Šฅ(differentiable)ํ•œ ๋ฐฉ์‹์œผ๋กœ ๊ตฌํ˜„๋จ!

 

 

๐Ÿ”ฅ 3DGS๊ฐ€ ๋ฏธ๋ถ„ ๊ฐ€๋Šฅํ•œ ์ด์œ 

  1. ๋ Œ๋”๋ง ๊ณผ์ •์—์„œ Gaussian Splatting์„ ์‚ฌ์šฉ
    • Gaussian Splatting์€ 2D ์ด๋ฏธ์ง€ ํ‰๋ฉด์— 3D Gaussian์„ ํˆฌ์˜ํ•˜์—ฌ ํ•ฉ์„ฑ(splatting)ํ•˜๋Š” ๊ณผ์ •.
    • ์ด ๊ณผ์ •์—์„œ Soft Blending(๋ถ€๋“œ๋Ÿฌ์šด ํ•ฉ์„ฑ) ์„ ์‚ฌ์šฉํ•˜์—ฌ ์—ฐ์†์ ์ธ ๊ฐ’์„ ๋งŒ๋“ค๊ธฐ ๋•Œ๋ฌธ์— ๋ฏธ๋ถ„ ๊ฐ€๋Šฅํ•จ.
  2. Gradient(๊ธฐ์šธ๊ธฐ)๋ฅผ ํ†ตํ•ด ํ•™์Šตํ•  ์ˆ˜ ์žˆ์Œ
    • ๊ฐ Gaussian์˜ ์œ„์น˜, ํฌ๊ธฐ, ๋ฐฉํ–ฅ, ์ƒ‰์ƒ, ํˆฌ๋ช…๋„(Opacity), ์กฐ๋ช… ํŠน์„ฑ(Spherical Harmonics) ๋“ฑ์„ ๋ฏธ๋ถ„ ๊ฐ€๋Šฅํ•œ ๋ฐฉ์‹์œผ๋กœ ์ตœ์ ํ™”ํ•จ.
    • ๋”ฐ๋ผ์„œ Loss Function์„ ํ†ตํ•ด Gradient Descent(๊ฒฝ์‚ฌ ํ•˜๊ฐ•๋ฒ•)๋กœ ํ•™์Šต ๊ฐ€๋Šฅ.

๐Ÿ“Œ ๊ฒฐ๋ก : 3DGS๋Š” ๋ช…์‹œ์ (Explicit) ํ‘œํ˜„ ๋ฐฉ์‹์ด์ง€๋งŒ, Gaussian Splatting ๋ฐฉ์‹ ๋•๋ถ„์— ๋ฏธ๋ถ„์ด ๊ฐ€๋Šฅํ•˜์—ฌ ๋”ฅ๋Ÿฌ๋‹ ํ•™์Šต์ด ๊ฐ€๋Šฅํ•จ.

 

 

โœ… NeRF๋Š” ์™œ Differentiable ํ•œ๊ฐ€?

NeRF (Neural Radiance Fields)๋Š” ๋ณธ์งˆ์ ์œผ๋กœ Implicit Representation(์•”์‹œ์  ํ‘œํ˜„) ๋ฐฉ์‹์ž…๋‹ˆ๋‹ค.
์ฆ‰, 3D ๊ณต๊ฐ„ ์ „์ฒด๋ฅผ ๋‰ด๋Ÿด ๋„คํŠธ์›Œํฌ๋ฅผ ํ†ตํ•ด ์—ฐ์†์ ์ธ ํ•จ์ˆ˜๋กœ ํ‘œํ˜„ํ•˜๊ธฐ ๋•Œ๋ฌธ์— ๋ฏธ๋ถ„ ๊ฐ€๋Šฅํ•จ.

๐Ÿ”ฅ NeRF๊ฐ€ ๋ฏธ๋ถ„ ๊ฐ€๋Šฅํ•œ ์ด์œ 

  1. Volume Rendering์„ ์‚ฌ์šฉ
    • ๊ด‘์„ ์„ ์ด์„œ ๊ฐ ์œ„์น˜์—์„œ์˜ RGB์™€ ๋ฐ€๋„(Density)๋ฅผ ์ƒ˜ํ”Œ๋งํ•˜์—ฌ ์ด๋ฏธ์ง€๋ฅผ ํ•ฉ์„ฑ.
    • ์ด ๊ณผ์ •์ด ์—ฐ์†์ (Continuous)์ด๊ณ  ๋ฏธ๋ถ„ ๊ฐ€๋Šฅํ•จ.
  2. ๋”ฅ๋Ÿฌ๋‹ ํ•™์Šต์ด ๊ฐ€๋Šฅ
    • ๋„คํŠธ์›Œํฌ์˜ ๋งค๊ฐœ๋ณ€์ˆ˜(Weights)๊ฐ€ Loss Function์„ ํ†ตํ•ด ์ตœ์ ํ™”๋  ์ˆ˜ ์žˆ๋„๋ก ๋ฏธ๋ถ„ ๊ฐ€๋Šฅํ•˜๊ฒŒ ์„ค๊ณ„๋จ.

๐Ÿ“Œ ๊ฒฐ๋ก : NeRF๋Š” ๋‰ด๋Ÿด ๋„คํŠธ์›Œํฌ ๊ธฐ๋ฐ˜์˜ Implicit Representation์ด๋ฏ€๋กœ ์ž์—ฐ์Šค๋Ÿฝ๊ฒŒ ๋ฏธ๋ถ„ ๊ฐ€๋Šฅ.]

 

 

3DGS๋Š” Differentiableํ•˜๋‹ค!

Gaussian Splatting ๊ณผ์ •์ด ๋ฏธ๋ถ„ ๊ฐ€๋Šฅํ•˜์—ฌ ๋”ฅ๋Ÿฌ๋‹ ํ•™์Šต์ด ๊ฐ€๋Šฅ.
๋”ฐ๋ผ์„œ, ๊ธฐ์กด Explicit ๋ฐฉ์‹(์˜ˆ: Mesh, Point Cloud)๊ณผ๋Š” ๋‹ค๋ฅด๊ฒŒ End-to-End ํ•™์Šต ๊ฐ€๋Šฅ.