DB migrate throws na error on encrypt_trigger_kwargs

[romanzdk]

Apache Airflow version

Other Airflow 2 version (please specify below)

If "Other Airflow 2 version" selected, which one?

2.9.0

What happened?

airflow db migrate throws an error:

[2024-04-08T13:41:38.179+0000] {migration.py:216} INFO - Context impl PostgresqlImpl.                                                                                   │
[2024-04-08T13:41:38.180+0000] {migration.py:219} INFO - Will assume transactional DDL.                                                                                 │
[2024-04-08T13:41:38.185+0000] {db.py:1650} INFO - Creating tables                                                                                                      │
INFO  [alembic.runtime.migration] Context impl PostgresqlImpl.                                                                                                          │
INFO  [alembic.runtime.migration] Will assume transactional DDL.                                                                                                        │
INFO  [alembic.runtime.migration] Context impl PostgresqlImpl.                                                                                                          │
INFO  [alembic.runtime.migration] Will assume transactional DDL.                                                                                                        │
Traceback (most recent call last):                                                                                                                                      │
  File "/usr/local/bin/airflow", line 8, in <module>                                                                                                                    │
    sys.exit(main())                                                                                                                                                    │
  File "/usr/local/lib/python3.10/site-packages/airflow/__main__.py", line 58, in main                                                                                  │
    args.func(args)                                                                                                                                                     │
  File "/usr/local/lib/python3.10/site-packages/airflow/cli/cli_config.py", line 49, in command                                                                         │
    return func(*args, **kwargs)                                                                                                                                        │
  File "/usr/local/lib/python3.10/site-packages/airflow/utils/cli.py", line 114, in wrapper                                                                             │
    return f(*args, **kwargs)                                                                                                                                           │
  File "/usr/local/lib/python3.10/site-packages/airflow/utils/providers_configuration_loader.py", line 55, in wrapped_function                                          │
    return func(*args, **kwargs)                                                                                                                                        │
  File "/usr/local/lib/python3.10/site-packages/airflow/cli/commands/db_command.py", line 130, in migratedb                                                             │
    db.upgradedb(                                                                                                                                                       │
  File "/usr/local/lib/python3.10/site-packages/airflow/utils/session.py", line 79, in wrapper                                                                          │
    return func(*args, session=session, **kwargs)                                                                                                                       │
  File "/usr/local/lib/python3.10/site-packages/airflow/utils/db.py", line 1674, in upgradedb                                                                           │
    encrypt_trigger_kwargs(session=session)                                                                                                                             │
  File "/usr/local/lib/python3.10/site-packages/airflow/utils/db.py", line 982, in encrypt_trigger_kwargs                                                               │
    trigger.kwargs = BaseSerialization.deserialize(json.loads(trigger.encrypted_kwargs))                                                                                │
  File "/usr/local/lib/python3.10/json/__init__.py", line 346, in loads                                                                                                 │
    return _default_decoder.decode(s)                                                                                                                                   │
  File "/usr/local/lib/python3.10/json/decoder.py", line 337, in decode                                                                                                 │
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())                                                                                                                   │
  File "/usr/local/lib/python3.10/json/decoder.py", line 355, in raw_decode                                                                                             │
    raise JSONDecodeError("Expecting value", s, err.value) from None                                                                                                    │
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

What you think should happen instead?

no error

How to reproduce

use python:3.10.12-slim-bookworm image with airflow 2.9.0. deploy into kubernetes cluster 1.26.5. Celery Executor. run airflow db migrate

Operating System

Debian GNU/Linux 12 (bookworm)

Versions of Apache Airflow Providers

apache-airflow-providers-amazon==8.19.0
apache-airflow-providers-celery==3.6.1
apache-airflow-providers-cncf-kubernetes==8.0.1
apache-airflow-providers-common-io==1.3.0
apache-airflow-providers-common-sql==1.11.1
apache-airflow-providers-fab==1.0.2
apache-airflow-providers-ftp==3.7.0
apache-airflow-providers-http==4.10.0
apache-airflow-providers-imap==3.5.0
apache-airflow-providers-postgres==5.10.2
apache-airflow-providers-smtp==1.6.1
apache-airflow-providers-sqlite==3.7.1

Deployment

Other Docker-based deployment

Deployment details

on-premise Kubernetes cluster 1.26.5, celery executor, PostgreSQL 13.13

Anything else?

Related: 6f0e5bc #38358

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[potiuk]

cc: @hussein-awala

[AronsonDan]

Hey,
We are experiencing the same issue.
environment details:
Python version: 3.11
docker image: apache/airflow:2.9.0-python3.11
executor: Kubernetes executor

traceback:

Traceback (most recent call last):
  File "/home/airflow/.local/bin/airflow", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/__main__.py", line 58, in main
    args.func(args)
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/cli/cli_config.py", line 49, in command
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/utils/cli.py", line 114, in wrapper
    return f(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/utils/providers_configuration_loader.py", line 55, in wrapped_function
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/cli/commands/db_command.py", line 130, in migratedb
    db.upgradedb(
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/utils/session.py", line 79, in wrapper
    return func(*args, session=session, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/utils/db.py", line 1674, in upgradedb
    encrypt_trigger_kwargs(session=session)
  File "/home/airflow/.local/lib/python3.11/site-packages/airflow/utils/db.py", line 982, in encrypt_trigger_kwargs
    trigger.kwargs = BaseSerialization.deserialize(json.loads(trigger.encrypted_kwargs))
                                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

[hussein-awala]

I will take a look.

Did you have this error the first time you ran airflow db migrate or did you run it multiple times?

[AronsonDan]

I will take a look.

Did you have this error the first time you ran airflow db migrate or did you run it multiple times?

Both on my end

[hussein-awala]

I found the root of the issue, I'm working on the fix