Repository navigation
GCP Cloud Run Operator? #31447
Description
Description
There is a great Operator for Cloud Functions: https://airflow.apache.org/docs/apache-airflow-providers-google/stable/operators/cloud/functions.html
But, if needing a bit more compute/control than the functions runtime supports, utilizing Cloud Run could be ideal.
Use case/motivation
Looking to be able to trigger Cloud Run jobs from Airflow akin to Cloud Functions [ when needing to compute slightly larger things that don't work with Functions ].
Related issues
I did not see any related issues.
Hoping for some comment on whether this would be welcomed. If nobody else would address, but would be a welcomed contribution, then I am happy to dig into contributing.
Are you willing to submit a PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
Activity
boring-cyborg commentedon May 21, 2023
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
eladkal commentedon May 21, 2023
Duplicate of #24730
eladkal commentedon May 21, 2023
feel free to help with reviewing #28525 which aims to add the requested functionality
brucearctor commentedon May 21, 2023
Hi @eladkal -- are you sure that this is a duplicate, and that #28525 addresses this? It appears both are about CloudRunJobs [ https://cloud.google.com/run/docs/create-jobs ] which is related albeit different from Cloud Run [ https://cloud.google.com/run/docs/overview/what-is-cloud-run ]? From what I recall about CloudRunJobs [ has been awhile, but I opted to not bother using ], it can be used for jobs, but is more specialized in what it can do [ read: less flexible ] than Cloud Run.