Repository navigation
Asynchronous file upload (google.generativeai.upload_file) and other blocking methods? #564
Description
Description of the feature request:
Currently google.generativeai.upload_file is a blocking function, it would be nice if there are async versions of these methods along with other I/O related methods like get_file and delete_file though upload_file can be made asynchronous if uploading lets say 100mb of file.
What problem are you trying to solve with this feature?
Adding asynchronous versions of upload file methods is good in applications where it is async-driven (e.g. Discord bots, web) which currently using this to utilize multimodal features can potentially block the entire script which is not good for such applications
Any other information you'd like to share?
Right now I'm using something like asyncio.to_thread to make it asynchronous, but offering a native async methods would be nice
Right now there are only two async methods with this SDK are generate_content and send_message
Although it would also be a good idea if adding async variant to SDK as well
Activity
MarkDaoust commentedon Oct 2, 2024
asyncio.to_thread, interesting. That's new to me.The implementation of that upload function is kind of messy (see #327). When I was writing it there just didn't seem to be a clear way to simply make an async implementation.
Am I reading this right? (Once 327 is fixed) we can make the implementation for
upload_file_asyncjust:wmcbtech30 commentedon Oct 3, 2024
MarkDaoust commentedon Oct 29, 2024
#586
gokturkDev commentedon Nov 6, 2024
I occasionally get the following error when using
asyncio.to_threadI tried hard to diagnose what exactly is triggering this but in vain, it sometimes works and sometimes breaks for the same image.
Eventually mitigated it with a retry mechanism.
Posting this because it might be related @MarkDaoust