Skip to content

Airflow doesn't recognize rediss:... url to point to a Redis broker #31027

Description

@vlazuka

Apache Airflow version

Other Airflow 2 version (please specify below)

What happened

Airflow 2.5.3

Redis is attached using rediss:... url. While deploying the instance, it Airflow/Celery downgrades rediss to redis with the warning [2023-05-02 18:38:30,377: WARNING/MainProcess] Secure redis scheme specified (rediss) with no ssl options, defaulting to insecure SSL behaviour.

Adding AIRFLOW__CELERY__SSL_ACTIVE=True as an environmental variable (the same as ssl_active = true in airflow.cfg file [celery] section) fails with the error
airflow.exceptions.AirflowException: The broker you configured does not support SSL_ACTIVE to be True. Please use RabbitMQ or Redis if you would like to use SSL for broker.
Screenshot 2023-05-12 at 12 07 45 PM

What you think should happen instead

It seems that Airflow doesn't recognize rediss:... url to be related to Redis broker

How to reproduce

Airflow 2.5.3

Python 3.10.9
Redis 4.0.14 (url starts with rediss:...)
Screenshot 2023-05-12 at 12 07 29 PM

You need to add AIRFLOW__CELERY__SSL_ACTIVE=True as an environmental variable or ssl_active = true to airflow.cfg file [celery] section and deploy the instance
Screenshot 2023-05-12 at 12 07 15 PM

Operating System

Ubuntu 22.04.2 LTS

Versions of Apache Airflow Providers

No response

Deployment

Other

Deployment details

Heroku platform, heroku-22 stack, python 3.10.9

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

  1. boring-cyborg commented on May 2, 2023

    @boring-cyborg

    Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.

  2. vlazuka commented on May 2, 2023

    @vlazuka
    ContributorAuthor

    PR to fix the issue #31028

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions