Repository navigation

AWS Batch Executor - #37618

Merged

o-nikolas merged 19 commits into

apache:mainfrom

aws-mwaa:syedahsn/aws_executors_batch

Mar 5, 2024

Commits on Mar 1, 2024

Introduce AWS Executors to the Amazon provider package. The EcsFargateExecutor and BatchExecutor launches Airflow tasks on AWS ECS/Fargate service and the AWS Batch service, respectively.

aelzeiny
authored and
syedahsn
committed
453099f
Initial commit to break up code into different modules
syedahsn
committed
cb873d7
WIP: Changes to get executor working
syedahsn
committed
77f0ca9
Added option to allow users to pass in config options.
syedahsn
committed
34d3998
prevent any failures in the executor from killing the scheduler
syedahsn
committed
0bf0a51
WIP: Move add_job inside try block
syedahsn
committed
04909eb
Add documentation for Batch Executor
syedahsn
committed
7dd43ab
Health check and Token Expiration
syedahsn
committed
bcc5966
Retries on task failures
syedahsn
committed
4cf1dad
Remove old config files
syedahsn
committed
0e96b4a
Add missing doc string, and update outdated doc string
syedahsn
committed
160cfab
Add unit tests, and move Dockerfile to executor folder
syedahsn
committed
ff71352
Fix failing tests
syedahsn
committed
0081d17
Add doc string to base config key class
syedahsn
committed
c054b09
Remove assert statement from non testing code
syedahsn
committed
860f4eb
Make requested changes
syedahsn
committed
c81477f
Fix test name
syedahsn
committed
a2e5d0b
Fix failing test
syedahsn
committed
0129e75

Commits on Mar 4, 2024

Add comment about Batch Job failure
syedahsn
committed
e707935