Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About the degenerate solution #178

Open
THHH0Sunshine opened this issue Nov 20, 2024 · 4 comments
Open

About the degenerate solution #178

THHH0Sunshine opened this issue Nov 20, 2024 · 4 comments

Comments

@THHH0Sunshine
Copy link

THHH0Sunshine commented Nov 20, 2024

In the paper, the 2D Gaussian is lower-bounded by a fixed-size Gaussian in screen space:

0

This results in very thin Gaussians having a dot at its center instead of being low-pass filtered like 3DGS:

Thin 2D Gaussian without the degenerate solution:
2

Thin 2D Gaussian with the degenerate solution:
1

Is this intended? I think that the solution may not solve the issue of gradient instability, because the needle shaped Gaussians still have large gradients, which causes over densification in certain areas:

3

The over densification issue is also mentioned in CityGaussianV2. The issue does not occur in 3DGS.

@hbb1
Copy link
Owner

hbb1 commented Nov 20, 2024

Hi, I didn't follow and I didn't encounter such issue before. The low pass filter mainly does magnification to the reconstruction filter. What do you mean gradient instability and how is it related to densification?

@THHH0Sunshine
Copy link
Author

The issue is that there are many degenerated Gaussians with large gradients, and Gaussians with large gradients are cloned or split during densification, leading to number explosion of Gaussians. This does not happen on 3DGS, so I think it may be related to the filtering strategy difference between 3DGS and 2DGS.

@hbb1
Copy link
Owner

hbb1 commented Nov 21, 2024

I guess this is more related to the densification strategy since we adopted a different method (but we intend to mimic that of 3DGS) for increasing points. The filtering strategy is also possible, but inspecting densification strategy is a good starting point for you. I believe that you would benefit from discussing with the authors of CityGaussianV2.

@THHH0Sunshine
Copy link
Author

Thank you for your answer.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants