Template job specs created from DatabricksWorklfowTaskGroup to use Jinja rendering

[arollet22]

Description

Allow passing jinja syntax in task_config parameters of DatabricksTaskOperator that gets rendered at execution time.

Use case/motivation

I should be able to make full use of Airflow context variables in a Databricks Job Run to ensure idempotency of my DAG such as logical_date or other params in case of occasional manual runs.

Related issues

It is linked with #42438 but this issue was never finished as the changes were not merged #45066

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[eladkal]

@jroachgolf84 will you have time to take a look?

[jroachgolf84]

Yes, I can take a look at this one.

[jroachgolf84]

PR has been created for this issue: #65858