Enhancement: Support for the new Bing image recognition

[Mitman93]

Contact Details

No response

What features would you like to see added?

Pretty self-explanatory. Bing recently had an update where you can now upload images in your chats, and it does a decent job at understanding them. This functionality (image upload) on the frontend shouldn't be too difficult to implement into LibreChat, no? Just wondering. Thanks for all that you do on this great project!

More details

Which components are impacted by your request?

No response

Pictures

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

Hi @Mitman93 thanks for requesting this.

Unfortunately, it may not be so simple since Bing access is very hacky, using unofficial access to the backend api of bing.com, and something I haven't personally worked on as I use a dependency to use it with this project: https://github.com/waylaidwanderer/node-chatgpt-api

Even so, it's not yet implemented in one of the more popular projects: acheong08/EdgeGPT#573

I will have to defer this feature to a 3rd party.

I am working on file support, and we may get image interpretation by way of another means sooner.

[UnknownErrorCodes]

Hi @Mitman93 thanks for requesting this.

Unfortunately, it may not be so simple since Bing access is very hacky, using unofficial access to the backend api of bing.com, and something I haven't personally worked on as I use a dependency to use it with this project: https://github.com/waylaidwanderer/node-chatgpt-api

Even so, it's not yet implemented in one of the more popular projects: acheong08/EdgeGPT#573

I will have to defer this feature to a 3rd party.

I am working on file support, and we may get image interpretation by way of another means sooner.

Thank you for your hard work.
I noticed that someone has implemented the new Bing image recognition feature in the issue you mentioned at acheong08/EdgeGPT#573. Here's the project link: renqabs/ChatSydney-react-img. You may have noticed it already, but I hope it could be helpful to your work.

[Airkek]

@danny-avila what do you think about this PR?: waylaidwanderer/node-chatgpt-api#452
It would be nice if LibreChat supported this

[danny-avila]

@danny-avila what do you think about this PR?: waylaidwanderer/node-chatgpt-api#452 It would be nice if LibreChat supported this

I can look into it!