Status of testing Providers that were prepared on February 08, 2023 #29424

Activity

1. eladkal

   added

   kind:metaHigh-level information important to the communityHigh-level information important to the community

   testing statusStatus of testing releasesStatus of testing releases

   on Feb 8, 2023
2. pankajkoti commented on Feb 9, 2023

   

   pankajkoti

   on Feb 9, 2023

   Last edited by pankajkoti

   Member

   More actions

   Thanks @eladkal . I tested my PR #29349 which is part of Provider google: 8.9.0rc1 and it works fine.

   👍React with 👍1Reacted by Elad Kalif

   🚀React with 🚀1Reacted by Andrey Anshin
3. seunggabi commented on Feb 9, 2023

   

   seunggabi

   on Feb 9, 2023

   Contributor

   More actions

   Thanks @eladkal .
   I tested a minute ago.

   #29360: @seunggabi
   https://pypi.org/project/apache-airflow-providers-tableau/4.1.0rc1/

   It was works.

   from airflow.providers.tableau.operators.tableau import TableauOperator
   
   ...
   
   task_refresh_workbook_blocking = TableauOperator(
       resource="workbooks",
       method="refresh",
       match_with="{{ params.match_with }}",
       find="{{ params.find }}",
       blocking_refresh=True,
       task_id="refresh_tableau_workbook_blocking",
       dag=dag,
   )
   

   

   👍React with 👍1Reacted by Elad Kalif

   🚀React with 🚀1Reacted by Andrey Anshin
4. johannaojeling commented on Feb 9, 2023

   

   johannaojeling

   on Feb 9, 2023

   Contributor

   More actions

   #28764 is tested with the Beam RC and works as expected

   👍React with 👍1Reacted by Elad Kalif

   🎉React with 🎉1Reacted by Andrey Anshin
5. csm10495 commented on Feb 9, 2023

   

   csm10495

   on Feb 9, 2023

   Contributor

   More actions

   #28808 still seems legit

   👍React with 👍1Reacted by Elad Kalif
6. vchiapaikeo commented on Feb 9, 2023

   

   vchiapaikeo

   on Feb 9, 2023

   Contributor

   More actions

   #28959 looks good

   write_on_empty=False (default)
   

   write_on_empty=True
   

   👍React with 👍1Reacted by Elad Kalif
7. o-nikolas commented on Feb 9, 2023

   

   o-nikolas

   on Feb 9, 2023

   Last edited by o-nikolas

   Contributor

   More actions

   I added code to kill the process while running to test the emr on_kill changes, and the cleanup code ran successfully (and I confirmed the resource was deleted in my AWS account):

   INFO  [airflow.task.operators] Job flow with id j-1ADYKTIV4THO5 created
   INFO  [airflow.task.operators] SLEEPING NOW, KILL THE PROCESS TO TEST ON_KILL
   INFO  [airflow.task.operators] TRYING TO KILL MYSELF
   ERROR [airflow.task] Received SIGTERM. Terminating subprocesses.
   INFO  [airflow.task.operators] Terminating job flow j-1ADYKTIV4THO5
   

   While I was there, I tested the wait_for_completion changes on the same operator. It worked successfully:

   INFO  [airflow.task] Executing <Task(EmrCreateJobFlowOperator): create_job_flow> on 2021-01-01 00:00:00+00:00
   INFO  [airflow.task] Exporting env vars: AIRFLOW_CTX_DAG_OWNER='airflow' AIRFLOW_CTX_DAG_ID='example_emr' AIRFLOW_CTX_TASK_ID='create_job_flow' AIRFLOW_CTX_EXECUTION_DATE='2021-01-01T00:00:00+00:00' AIRFLOW_CTX_TRY_NUMBER='1' AIRFLOW_CTX_DAG_RUN_ID='backfill__2021-01-01T00:00:00+00:00'
   INFO  [airflow.task.operators] Creating job flow using aws_conn_id: aws_default, emr_conn_id: emr_default
   INFO  [airflow.hooks.base] Using connection ID 'emr_default' for task execution.
   INFO  [airflow.hooks.base] Using connection ID 'aws_default' for task execution.
   INFO  [botocore.credentials] Found credentials in environment variables.
   INFO  [airflow.task.operators] Job flow with id j-2VDGDHAR3ASCT created
   INFO  [airflow.providers.amazon.aws.utils.waiter] Waiting for job flow to be finished.
   INFO  [airflow.providers.amazon.aws.utils.waiter] Waiting for job flow to be finished.
   INFO  [airflow.providers.amazon.aws.utils.waiter] Waiting for job flow to be finished.
   INFO  [airflow.providers.amazon.aws.utils.waiter] Waiting for job flow to be finished.
   INFO  [airflow.providers.amazon.aws.utils.waiter] Waiting for job flow to be finished.
   

   I marked both changes as tested above in the task list.

   👍React with 👍1Reacted by Elad Kalif
8. josh-fell commented on Feb 10, 2023

   

   josh-fell

   on Feb 10, 2023

   Contributor

   More actions

   Thanks for organizing @eladkal!

   All of the dbt Cloud changes look good as well as the Python API docs change in #29041.

   👍React with 👍1Reacted by Elad Kalif
9. eladkal commented on Feb 11, 2023

   

   eladkal

   on Feb 11, 2023

   ContributorAuthor

   More actions

   Thank you everyone.
   Providers are released
   I invite everyone to help improve providers for the next release, a list of open issues can be found here.

   ❤️React with ❤️1Reacted by Seunggabi Kim
10. eladkal

    closed this as completedon Feb 11, 2023