Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About video input #361

Closed
gemcollector opened this issue Apr 10, 2024 · 5 comments
Closed

About video input #361

gemcollector opened this issue Apr 10, 2024 · 5 comments
Labels
component:demos Update demos status:awaiting user response Awaiting a response from the author type:feature request New feature/request/enhancement

Comments

@gemcollector
Copy link

Description of the feature request:

Fantastic work! I wonder if is it possible to input a video (.mp4) while using gemini-1.5-pro api? The tutorial seems to only provide access to a single image.

What problem are you trying to solve with this feature?

I wanna input a video sequence, just like the web version.

Any other information you'd like to share?

No response

@gemcollector gemcollector added the type:feature request New feature/request/enhancement label Apr 10, 2024
@singhniraj08
Copy link
Contributor

@gemcollector, Video formats are supported for Gemini 1.5 pro api. For larger images, videos (sequences of image frames), and audio, upload the files with the File API before including them in prompts. Thank you!

@singhniraj08 singhniraj08 added status:awaiting user response Awaiting a response from the author component:demos Update demos labels Apr 18, 2024
@gemcollector
Copy link
Author

Thanks for your reply~! So Does it mean if we wanna upload the videos, we can only upload sequences of image frames instead of directly uploading the .mp4 file?

@gemcollector
Copy link
Author

Are there any examples I can refer to? Thank you!

@gemcollector
Copy link
Author

I think this repo can solve my question! Thanks! https://github.com/google-gemini/cookbook

@singhniraj08
Copy link
Contributor

@gemcollector, Sorry for delayed response. You can follow Gemini API: Prompting with Video tutorial. The Gemini API currently does not support video files directly. Instead, you can provide a series of timestamps and image files. Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component:demos Update demos status:awaiting user response Awaiting a response from the author type:feature request New feature/request/enhancement
Projects
None yet
Development

No branches or pull requests

2 participants