Repository navigation

Add Apache Arrow provider - #52330

Merged

dabla merged 263 commits into

apache:mainfrom

dabla:feature/apache-arrow-provider

Aug 25, 2026

This pull request is big! We're only showing the most recent 250 commits

Commits on Aug 4, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  985163d
Commits on Aug 5, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  04163a8
Commits on Aug 6, 2025
- refactor: Implemented ADBC dialect
  davidblain-infrabel
  committed
  80208ab
Commits on Aug 7, 2025
- refactor: Implemented get_column_names in PostgresDialect so we don't depend on sqlalchemy anymore
  davidblain-infrabel
  committed
  b56cb0c
- refactor: Removed AdbcDialect and make sure AdbcHook can work with existing dialects as ADBC dialect doesn't make sense
  davidblain-infrabel
  committed
  d4edee5
Commits on Aug 12, 2025
Commits on Aug 13, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  b1bad8f
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  55ae8ae
- refactor: Replace native placeholders with ADBC placeholder to support prepared statements through ADBC
  
  davidblain-infrabel
  authored and
  dabla
  committed
  0b7993d
- refactor: Use prepared statements in PostgresDialect
  
  davidblain-infrabel
  authored and
  dabla
  committed
  f2c19eb
- refactor: Fixed placeholders in prepared statements in PostgresDialect
  
  davidblain-infrabel
  authored and
  dabla
  committed
  a741d46
- refactor: Refactored _run_command in AdbcHook
  
  davidblain-infrabel
  authored and
  dabla
  committed
  fcb1d20
- refactor: Updated adbc-driver-manager and pyarrow dependencies
  
  davidblain-infrabel
  authored and
  dabla
  committed
  6fded87
- refactor: Refactored insert_rows
  dabla
  committed
  11d21d6
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  8ea29bf
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  fc6068d
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  a44d975
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  67bc924
Commits on Aug 14, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  1124109
Commits on Aug 18, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  20f3e4e
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  ac59e63
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  fda7c41
Commits on Aug 19, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  fc18a8a
Commits on Aug 20, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  59b9454
- refactor: Removed apache-airflow-providers-apache-arrow from airflow all dependencies until it's released
  dabla
  committed
  3e3e1c3
Commits on Aug 21, 2025
Commits on Aug 22, 2025
- refactor: Fixed static checks and mypy issues on AdbcHook
  dabla
  committed
  90d85a8
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  6f080bf
- refactor: Fxied fetch_all_handler
  dabla
  committed
  bde3082
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  f857231
Commits on Aug 28, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  24f04e8
Commits on Sep 9, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  d73a2b9
Commits on Sep 13, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  442ccb6
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  aa0301e
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  899dc5e
Commits on Sep 14, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  fd4f318
Commits on Sep 15, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  fd77c65
Commits on Sep 17, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  8629eea
Commits on Sep 22, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  bae2196
Commits on Sep 24, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  a62c473
Commits on Sep 25, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  7751929
- refactor: Changed required python version check
  dabla
  committed
  a49e018
- refactor: Uncommented apache-arrow in pyproject.toml
  dabla
  committed
  312410f
Commits on Sep 28, 2025
- refactor: Removed min version from arrow
  dabla
  committed
  5a14869
Commits on Oct 4, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  3fabaca
Commits on Oct 7, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  996d96e
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  0129adf
Commits on Oct 8, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  84df206
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  d438807
Commits on Oct 18, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  0f41546
Commits on Oct 28, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  41ae36a
Commits on Oct 29, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  b9b940a
Commits on Oct 30, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  8b192a3
Commits on Nov 4, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  8f25ef6
Commits on Nov 5, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  82c4e29
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  e4518ce
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  9778c9e
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  47b04bf
Commits on Nov 6, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  75efe12
Commits on Nov 12, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  483d7e0
Commits on Nov 13, 2025
- refactor: Updated pyproject.toml and added LICENSE en NOTICE
  dabla
  committed
  90c93fc
- refactor: Updated documentation
  dabla
  committed
  0007ad8
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  3a369e1
- refactor: Added redirect for adbc connections in docs
  dabla
  committed
  bd0ce99
- refactor: Fixed title in index.rst for arrow provider
  dabla
  committed
  dc07166
- refactor: Added Apache Arrow provider docs
  dabla
  committed
  399bbf5
- docs: Added Apache Arrow connection reference in Guides
  dabla
  committed
  15f49bd
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  223dca6
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  614b4de
Commits on Nov 14, 2025
Commits on Dec 4, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  ead913d
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  5a67ee3
Commits on Dec 5, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  3a6a8ad
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  0b2d6e6
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  0b05d77
Commits on Dec 8, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  eef462c
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  dbf7f13
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  d60c08d
Commits on Dec 9, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  9e68499
Commits on Dec 11, 2025
Commits on Dec 16, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  16e6e7b
- refactor: We don't need common compat here
  dabla
  committed
  57ed88a
- refactor: Changed min required airflow version to 2.11.0
  dabla
  committed
  333f38f
Commits on Dec 17, 2025
- refactor: Removed common-compat dev dependency
  dabla
  committed
  5a0ee0e
- refactor: Changed min required Airflow version assertion in arrow provider
  dabla
  committed
  cea45ff
- refactor: Updated docs
  dabla
  committed
  0d5afbb
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  993d73f
- refactor: Reformatted index in docs
  dabla
  committed
  2eef324
Commits on Dec 21, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  c618585
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  09f825b
Commits on Dec 24, 2025
Commits on Dec 25, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  174d0e0
Commits on Dec 26, 2025
Commits on Dec 27, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  b80df9f
Commits on Dec 28, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  3d57bab
Commits on Dec 29, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  9453fc1
Commits on Dec 31, 2025
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  feb03ef
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  4fe184f
Commits on Jan 4, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  234c69e
Commits on Jan 6, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  56e737b
Commits on Jan 7, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  4df55b3
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  525b259
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  7ee4fdb
Commits on Jan 8, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  87fa511
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  7bcdb8b
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  347fca6
Commits on Jan 9, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  0b62f8a
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  facd3bc
Commits on Jan 15, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  592db75
Commits on Mar 3, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  0cf5318
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  5a4ebdf
- refactor: Changed version of ADBC provider to 0.1.0
  dabla
  committed
  d7a07b1
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  3cc7c4c
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  cb646af
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  829d704
- refactor: Added one more logo
  dabla
  committed
  830dedb
Commits on Mar 10, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  b796b2d
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  eeb49dc
- refactor: Removed wrong references to apache-beam
  dabla
  committed
  5bfb9d4
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  0591e0a
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  f334fa5
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  4720bf8
Commits on Mar 16, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  dc3780a
Commits on Mar 17, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  1bf4a44
Commits on Mar 19, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  3487f33
Commits on Mar 20, 2026
- refactor: Updated uv.lock file
  dabla
  committed
  61cae75
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  9021aad
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  c0cba88
Commits on Mar 24, 2026
- refactor: Skip tests if adbc_driver_sqlite isn't available
  dabla
  committed
  7e591c0
- refactor: Optimize insert_rows to check use_native_bind outside for loop
  dabla
  committed
  230c2b9
- refactor: Added unit tests on AdbcHook
  dabla
  committed
  0bea882
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  committed
  5d6706a
- refactor: Fixed param for test_docs_filter
  dabla
  committed
  8f6c30f
Commits on Mar 25, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  dd3d692
- refactor: Must check if host in connection is not None first
  dabla
  committed
  702ab85
- refactor: Updated pyproject
  dabla
  committed
  216eddf
- refactor: Reformatted files
  dabla
  committed
  0ed9c0a
Commits on Mar 26, 2026
- refactor: Updated release references
  dabla
  committed
  f2c03fa
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  70b5e2a
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  c9452ae
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  26b436b
Commits on Mar 27, 2026
- refactor: Reformatted uri method
  dabla
  committed
  4d7efd7
- refactor: Updated pyproject
  dabla
  committed
  cc7c3ac
- refactor: Updated uv.lock file
  dabla
  committed
  88d12d7
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  committed
  9ea765e
- refactor: Updated pyproject
  dabla
  committed
  754d772
Commits on Mar 28, 2026
- refactor: Fixed static checks on AdbcHook
  dabla
  committed
  d3ecae3
- refactor: Added adbc drivers in optional dependencies
  dabla
  committed
  bdaea97
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  a871422
Commits on Mar 30, 2026
- refactor: Added comment for optional dependencies in provider.yaml
  dabla
  committed
  61421be
- refactor: Reformatted replace_placeholders method in adbc module
  dabla
  committed
  10408eb
- refactor: Updated uv.lock
  dabla
  committed
  5cbac82
Commits on Jul 6, 2026
- refactor: Added more-itertools dependency
  dabla
  committed
  9106bc5
- refactor: Moved local imports from _driver_path to top of module
  dabla
  committed
  adf174a
- refactor: Added unit tests for extra resolutions in AdbcHook
  dabla
  committed
  a2273ec
- refactor: Added ADBC connection configuration docs
  dabla
  committed
  6e8f684
- refactor: Fixed PyPi repository reference
  dabla
  committed
  e3b1d22
Commits on Jul 7, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  
  dabla
  authored and
  BKD7702
  committed
  a05f1d5
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  43345b1
- refactor: udpated output references
  
  BKD7702
  authored and
  dabla
  committed
  9966747
- refactor: Fixed spelling errors
  dabla
  committed
  0a14b5a
- refactor: Reorganized imports AdbcHook
  dabla
  committed
  9559c85
- refactor: Updated docs
  dabla
  committed
  2a5cdfb
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  0319770
Commits on Jul 9, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  9ba78be
- refactor: Added apache-arrow in bug report
  dabla
  committed
  034628e
Commits on Jul 11, 2026
- refactor: Updated NOTICE
  dabla
  committed
  5813c35
- refactor: Added .gitignore to arrow provider
  dabla
  committed
  4abb622
- refactor: Added .apache-arrow to boring cyborg
  dabla
  committed
  2bab91f
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  2070409
- refactor: Updated Apache Arrow logo
  dabla
  committed
  a222175
Commits on Jul 12, 2026
- refactor: Fixed logo reference in get_provider_info
  dabla
  committed
  afb5c60
- refactor: Fixed importlib issue
  dabla
  committed
  293b61d
Commits on Jul 13, 2026
- refactor: Removed importlib references in docs Arrow provider
  dabla
  committed
  6acb9d1
- refactor: Removed importlib-resource dependencies from uv.lock for arrow provider
  dabla
  committed
  920da7f
- refactor: Reorganized imports
  dabla
  committed
  2bc1140
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  28da2e5
- refactor: Reference apache-arrow in extra-packages-ref.rst
  dabla
  committed
  6348859
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  3dbae3e
Commits on Jul 14, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  committed
  1480eab
- refactor: Updated output images
  BKD7702
  committed
  971ca64
Commits on Jul 15, 2026
- refactor: Extracted _resolve_execute_batch method from insert_rows
  
  David Blain
  authored and
  dabla
  committed
  fab9aa7
- refactor: Updated documentation
  dabla
  committed
  2c63de3
Commits on Jul 16, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  
  dabla
  authored and
  BKD7702
  committed
  4508f06
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  ff1ec81
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  83fc70a
Commits on Jul 17, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  1958dcc
Commits on Jul 22, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  
  dabla
  authored and
  BKD7702
  committed
  29253c4
Commits on Jul 23, 2026
- Merge branch 'main' into feature/apache-arrow-provider
  dabla
  authored
  7aee127
Commits on Aug 14, 2026
Commits on Aug 22, 2026
- Use public adbc_connection property and set_autocommit() to toggle autocommit
  
  dabla
  and
  Copilot
  committed
  2ec9396
- Add test proving canonical ADBC option names are required in conn_kwargs
  
  dabla
  and
  Copilot
  committed
  8a545ff
- Merge branch 'main' into feature/apache-arrow-provider
  
  dabla
  authored and
  BKD7702
  committed
  cde687d
- Updated version of flit_core to 4.0.2
  dabla
  committed
  5a02501
- Changed spelling of recognised to recognized
  dabla
  committed
  adcf6cf
- Reformatted parameters in test_conn_kwargs_canonical_names_required
  dabla
  committed
  5e0d2f7
Commits on Aug 23, 2026
- Fix conn_kwargs autocommit value in docs to use string "true" instead of boolean
  
  dabla
  and
  Copilot
  committed
  f9f9354
- Remove adbc.connection.autocommit from db_kwargs docs table
  
  dabla
  and
  Copilot
  committed
  4721dcb
- Add spec to MagicMock for cursor and connection in test setup
  
  dabla
  and
  Copilot
  committed
  b6115ec
- Add system test DAG for AdbcHook with SQLite
  
  dabla
  and
  Copilot
  committed
  bb4ae93
- Add operators.rst referencing AdbcHook system test example
  
  dabla
  and
  Copilot
  committed
  1e47d86
Commits on Aug 24, 2026
- Fix test_get_records tests failing with AttributeError on get_messages
  
  dabla
  and
  Copilot
  committed
  c07cf09
- Reformatted SQL in Example ADBC Dag
  dabla
  committed
  436bf79
- Added adbc to the spelling wordlist
  dabla
  committed
  083f80e
- Merge branch 'main' into feature/apache-arrow-provider
  
  dabla
  authored and
  BKD7702
  committed
  b0f8537
Commits on Aug 25, 2026
- Add missing operators.rst how-to-guide reference to apache-arrow provider.yaml
  dabla
  committed
  a451513

Commits

Commits on Aug 4, 2025

Commits on Aug 5, 2025

Commits on Aug 6, 2025

Commits on Aug 7, 2025

Commits on Aug 12, 2025

Commits on Aug 13, 2025

Commits on Aug 14, 2025

Commits on Aug 18, 2025

Commits on Aug 19, 2025

Commits on Aug 20, 2025

Commits on Aug 21, 2025

Commits on Aug 22, 2025

Commits on Aug 28, 2025

Commits on Sep 9, 2025

Commits on Sep 13, 2025

Commits on Sep 14, 2025

Commits on Sep 15, 2025

Commits on Sep 17, 2025

Commits on Sep 22, 2025

Commits on Sep 24, 2025

Commits on Sep 25, 2025

Commits on Sep 28, 2025

Commits on Oct 4, 2025

Commits on Oct 7, 2025

Commits on Oct 8, 2025

Commits on Oct 18, 2025

Commits on Oct 28, 2025

Commits on Oct 29, 2025

Commits on Oct 30, 2025

Commits on Nov 4, 2025

Commits on Nov 5, 2025

Commits on Nov 6, 2025

Commits on Nov 12, 2025

Commits on Nov 13, 2025

Commits on Nov 14, 2025

Commits on Dec 4, 2025

Commits on Dec 5, 2025

Commits on Dec 8, 2025

Commits on Dec 9, 2025