Skip to content

External DAG processor not working #23447

Closed

Description

@allebacco

Apache Airflow version

2.3.0 (latest released)

What happened

Running a standalone Dag Processor instance with airflow dag-processor throws the following exception:

Standalone DagProcessor is not supported when using sqlite.

What you think should happen instead

The airflow dag-processor should start without an exception in case of Postgres database

How to reproduce

The error is in the following line:

sql_conn: str = conf.get('core', 'sql_alchemy_conn').lower()

It should be

sql_conn: str = conf.get('database', 'sql_alchemy_conn').lower() 

due to the change in the configuration file done in #22284

Operating System

Ubuntu 20.04

Versions of Apache Airflow Providers

No response

Deployment

Virtualenv installation

Deployment details

No response

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

  1. boring-cyborg commented on May 3, 2022

    @boring-cyborg

    Thanks for opening your first issue here! Be sure to follow the issue template!

  2. eladkal commented on May 3, 2022

    @eladkal
    Contributor

    Duplicate of #23408

  3. added
    duplicateIssue that is duplicated
    and removed
    kind:bugThis is a clearly a bug
    on May 3, 2022
  4. allebacco commented on May 3, 2022

    @allebacco
    Author

    @eladkal are you sure that thias issue is a duplicate? In this case I am not using AIRFLOW__CORE__SQL_ALCHEMY_CONN_CMD.

    The line mentioned in the description of the issue is reading the sql alchemy connection string from the core section instead of the database one. Maybe I am missing some detail of the configuration mechanism.

  5. reopened this on May 8, 2022
  6. potiuk commented on May 8, 2022

    @potiuk
    Member

    @mhenc - can you take a look please?

  7. tirkarthi commented on May 9, 2022

    @tirkarthi
    Contributor

    I guess this can be closed now with #23575 merged .

  8. potiuk commented on May 9, 2022

    @potiuk
    Member

    Indeed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    duplicateIssue that is duplicated

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions