Currently, what's the best way to make gaussian splat scenes from video?

Thats quite a difficult question, given the large amount of methods (https://github.com/MrNeRF/awesome-3D-gaussian-splatting).

I think "3D Gaussian Splatting as Markov Chain Monte Carlo" looks very promising, as it redesigns the training so that it is no longer dependent on the desification algorithm: https://arxiv.org/abs/2404.09591v1

Ah, I'm rather looking for a ready-to-go repo for a layman like me to just have a quick go. The latest I used was nerfstudio a long time ago. Seems to be updated regularly still, I wonder if it supports training splat scenes now. I also wonder if there were any better similar projects since then.

If your video source is of a static scene that the camera is moving through. You could try poly.cam

Upload you video directly to the website for Gaussian splat processing

And based on their license acknowledgments poly.cam uses nerfstudio and gsplat, in case anyone else was wondering

https://learn.poly.cam/third-party-libraries

Nerfstudio dev here! We have a splatfacto method in nerfstudio that provides a similar interface to our nerf methods.

> This enables endless editing and visualization possibilities, given that python is turing complete.

This is a strange thing to write, given that the sky is blue.

Well I think there is a small connection between endless editing possibilities and a programming language that can express any kind of function, but I also get your point. I might remove it in the future.

So this is just an ImGui frontend for diff-gaussian-rasterization?

Humble suggestion: consider avoiding "just" as it can sound dismissive.

Consider "mostly" instead to indicate you realize there is more work involved than the word "just" would convey.

Yes basically. Also some other handy features like runtime editing or viewing multiple scenes at once

This video gives some good intuitive examples of Gaussian splatting: https://youtu.be/GInps7ViawA

Thanks for the recommendation! Here is another video that shows some features of the gaussian splatting viewer: https://www.youtube.com/watch?v=AJGSa_wnZS8&lc=Ugw6r2VCynG5W...