Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request for MLC on JP5.1 version upgrade for supporting llama3.1 #761

Open
phgcha opened this issue Dec 28, 2024 · 1 comment
Open

Request for MLC on JP5.1 version upgrade for supporting llama3.1 #761

phgcha opened this issue Dec 28, 2024 · 1 comment

Comments

@phgcha
Copy link

phgcha commented Dec 28, 2024

Hi,

I'm trying to run Llama3.1 on Jetson AGX orin device running on JP5.1. As I was trying with MLC, I figured that the MLC image built for JP5.1 is much behind and does not support Llama3.1. If this is actually the case, could you please release a new MLC image for JP5.1?

@dusty-nv
Copy link
Owner

@phgcha hey sorry, I messed with this a little while, long enough to know its not wanting to build on JP5 anymore. Actually it had previously stopped building some time ago, but I think you may be able to find one with llama 3.1. That's not to say its impossible to work through the complation issues one by one - if possible I would upgrade to jetpack 6 if you are doing genAI and need to keep updated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants