Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support runtime loading of ply splat format? #157

Open
tufeixp opened this issue Jan 16, 2025 · 3 comments
Open

Support runtime loading of ply splat format? #157

tufeixp opened this issue Jan 16, 2025 · 3 comments

Comments

@tufeixp
Copy link

tufeixp commented Jan 16, 2025

It'd be nice if this repo can support runtime loading of ply splat format, like this repo have done:
https://github.com/clarte53/GaussianSplattingVRViewerUnity

Also, I find the ply models generated by using:
https://github.com/alvinliu0/HumanGaussian/tree/main?tab=readme-ov-file#pretrained-models
and
https://github.com/Microsoft/TRELLIS
will both report vertex size mismatch issue while importing in editor Gaussian splat creator.
Please look into it.

Here the header:
ply
format binary_little_endian 1.0
element vertex 675392
property float x
property float y
property float z
property float nx
property float ny
property float nz
property float f_dc_0
property float f_dc_1
property float f_dc_2
property float opacity
property float scale_0
property float scale_1
property float scale_2
property float rot_0
property float rot_1
property float rot_2
property float rot_3
end_header

and I tried to modify the InputSplatData to this:
public struct InputSplatDataS
{
public Vector3 pos;
public Vector3 nor;
public Vector3 dc0;
public float opacity;
public Vector3 scale;
public Quaternion rot;
}
However, the error 's gone and loaded without correct rendering, the points will show with the debug points option choosen in the render mode.

@Hiverlab-Ray
Copy link

Hiverlab-Ray commented Jan 18, 2025

I've tried reconfiguring the editor scripts into run-time (even for those downloaded via web URLs). With some code understanding and knowledge, it's definitely possible which I have successfully made it working.

See video: https://github.com/user-attachments/assets/3c03977d-c8c6-4731-86b8-91afee2fddf7

@aras-p
Copy link
Owner

aras-p commented Jan 19, 2025

Please look into it.
Here the header:

Yeah, so their PLY file format is different from the original 3DGS paper format. This repository right now only supports the file format as it was in the original gaussian splatting paper, and not any of the later modifications to the format done by others.

Someday I might implement support for other PLY format variations, but it is not very likely (I stopped working on gaussian splatting a year ago). If anyone wants to contribute support, I'll gladly look at it.

@akutterxressential
Copy link

@aras-p It is a pity that you stopped working on it. We want to use this project for our jobs but I don`t have good enough programmers so we could contribute. I hope this changes some day...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants