Repository navigation
Support connection with Proxy in Databricks provider #32576
Description
Apache Airflow version
2.6.3
What happened
Databricks connection is unable to query login.microsoftonline.com if using a proxy as there is no provision in databricks.py file to include proxy as part of requests.post command to include proxy in it.
What you think should happen instead
there is no provision in databricks.py file to include proxy as part of requests.post command to include proxy in it.
How to reproduce
Try reaching login.microsoftonline.com endpoint via proxy.
Tried providing proxy as part of extra in databricks connection
{
"azure_tenant_id": "xxxx",
"proxies": {
"http": "http://xxxx:443",
"https": "http://xxxx:443"
}
}
Error:
{databricks_base.py:434} INFO - Using AAD Token for SPN.
{databricks_base.py:223} INFO - Existing AAD token is expired, or going to expire soon. Refreshing...
{connectionpool.py:1003} DEBUG - Starting new HTTPS connection (1): login.microsoftonline.com:443
{databricks_base.py:469} ERROR - Attempt 1 API Request to Databricks failed with reason: <Future at 0x7f1954c4e280 state=finished raised ConnectTimeout>
Noticed that line 251 where the requests.post happens doesn't have this enabled.
Operating System
Linux
Versions of Apache Airflow Providers
No response
Deployment
Other
Deployment details
No response
Anything else
No response
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct
Activity
boring-cyborg commentedon Jul 13, 2023
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
[-]Proxy support needed[/-][+]Support connection with Proxy in Databricks provider[/+]potiuk commentedon Jul 13, 2023
cc: @alexott ?
sravanscb commentedon Nov 29, 2023
Hi Team
Is anyone looking into this?
potiuk commentedon Nov 29, 2023
If no-one is assigned and actively doing here, there is no other source of information than this issue. It waits for someone to pick an interest - do I understand you want to get assigned and start working on it @sravanscb ? Shall I assign you?
adnanhb commentedon Aug 5, 2024
@potiuk can you assign this issue to me? We need this feature urgently.
potiuk commentedon Aug 5, 2024
Surely - go ahead.
potiuk commentedon Mar 2, 2026
@adnanhb We are unassigning you from this issue as part of our updated assignment policy.
This is not meant to discourage your contribution — quite the opposite! You are still very welcome to work on this issue and submit a PR for it. Simply comment that you are working on it and open a PR when ready.
We found that formal assignments were not working well, as they often prevented others from contributing when the assignee was not actively working on the issue.
eladkal commentedon May 26, 2026
cc @mwojtyczka will you have time to look into this report?