Repository navigation

refactor v3 data types - #2874

Merged

d-v-b merged 164 commits into

zarr-developers:mainfrom

d-v-b:feat/fixed-length-strings

Jun 16, 2025

Merged

refactor v3 data types#2874
d-v-b merged 164 commits into
zarr-developers:mainfrom
d-v-b:feat/fixed-length-strings

Commits on Feb 21, 2025
- modernize typing
  d-v-b
  committed
  f5e3f78
Commits on Feb 24, 2025
- Merge branch 'main' of https://github.com/zarr-developers/zarr-python into feat/fixed-length-strings
  d-v-b
  committed
  b4e71e2
- lint
  d-v-b
  committed
  3c50f54
Commits on Feb 26, 2025
- new dtypes
  d-v-b
  committed
  d74e7a4
- rename base dtype, change type to kind
  d-v-b
  committed
  5000dcb
Commits on Feb 27, 2025
- start working on JSON serialization
  d-v-b
  committed
  9cd5c51
- get json de/serialization largely working, and start making tests pass
  d-v-b
  committed
  042fac1
- tweak json type guards
  d-v-b
  committed
  556e390
- fix dtype sizes, adjust fill value parsing in from_dict, fix tests
  d-v-b
  committed
  b588f70
Commits on Mar 2, 2025
- mid-refactor commit
  d-v-b
  committed
  4ed41c6
- working form for dtype classes
  d-v-b
  committed
  1b2c773
- remove unused code
  d-v-b
  committed
  24930b3
- use wrap / unwrap instead of to_dtype / from_dtype; push into v2 codebase
  d-v-b
  committed
  703e0e1
Commits on Mar 3, 2025
- push into v2
  d-v-b
  committed
  3c232a4
- remove endianness kwarg to methods, make it an instance variable instead
  d-v-b
  committed
  b7fe986
Commits on Mar 4, 2025
- make wrapping safe by default
  d-v-b
  committed
  d9b44b4
- Merge branch 'main' of github.com:zarr-developers/zarr-python into feat/fixed-length-strings
  d-v-b
  committed
  bf24d69
- dtype-specific tests
  d-v-b
  committed
  c1a8566
Commits on Mar 5, 2025
- more tests, fix void type default value logic
  d-v-b
  committed
  2868994
- fix dtype mechanics in bytescodec
  d-v-b
  committed
  9ab0b1e
- Merge branch 'main' into feat/fixed-length-strings
  d-v-b
  authored
  e9f5e26
Commits on Mar 7, 2025
- Merge branch 'main' of https://github.com/zarr-developers/zarr-python into feat/fixed-length-strings
  d-v-b
  committed
  6df84a9
- remove __post_init__ magic in favor of more explicit declaration
  d-v-b
  committed
  e14279d
Commits on Mar 9, 2025
- fix tests
  d-v-b
  committed
  381a264
Commits on Mar 12, 2025
- refactor data types
  d-v-b
  committed
  6a7857b
Commits on Mar 13, 2025
- start design doc
  d-v-b
  committed
  e8fd72c
- more design doc
  d-v-b
  committed
  b22f324
- update docs
  d-v-b
  committed
  b7a231e
- fix sphinx warnings
  d-v-b
  committed
  7dfcd0f
- tweak docs
  d-v-b
  committed
  706e6b6
- info about v3 data types
  d-v-b
  committed
  8fbf673
- adjust note
  d-v-b
  committed
  e9aff64
- fix: use unparametrized types in direct assignment
  d-v-b
  committed
  44e78f5
Commits on Mar 17, 2025
- start fixing config
  d-v-b
  committed
  60cac04
- Update src/zarr/core/_info.py
  
  d-v-b
  and
  jhamman
  authored
  120df57
- add placeholder disclaimer to v3 data types summary
  d-v-b
  committed
  0d9922b
- make example runnable
  d-v-b
  committed
  2075952
- placeholder section for adding a custom dtype
  d-v-b
  committed
  44369d6
- define native data type and native scalar
  d-v-b
  committed
  4f3381f
- update data type names
  d-v-b
  committed
  c8d7680
- fix config test failures
  d-v-b
  committed
  2a7b5a8
- call to_dtype once in blosc evolve_from_array_spec
  d-v-b
  committed
  e855e54
Commits on Mar 19, 2025
Commits on Mar 20, 2025
- adjust type annotations
  d-v-b
  committed
  bb11867
- fix info tests to use zdtype
  d-v-b
  committed
  7a619e0
- remove dead code and add code coverage exemption to zarr format checks
  d-v-b
  committed
  ea2d0bf
- fix: add special check for resolving int32 on windows
  d-v-b
  committed
  042c9e5
- add dtype entry point test
  d-v-b
  committed
  def5eb2
Commits on Mar 21, 2025
- remove default parameters for parametric dtypes; add mixin classes for numpy dtypes; define zdtypelike
  d-v-b
  committed
  1b7273b
- Merge branch 'main' into feat/fixed-length-strings
  d-v-b
  authored
  60b2e9d
Commits on Mar 24, 2025
Commits on Mar 25, 2025
- route object dtype arrays to vlen string dtype when numpy > 2
  d-v-b
  committed
  aa32271
- relax endianness mismatch to a warning instead of an error
  d-v-b
  committed
  617d3f0
- use public dtype module for docs instead of special-casing the core dype module
  d-v-b
  committed
  2b5fd8f
- use public dtype module for docs instead of special-casing the core dype module
  d-v-b
  committed
  1831f20
- silence mypy error about array indexing
  d-v-b
  committed
  a427a16
- add release note
  d-v-b
  committed
  41d7e58
- fix doctests, excluding config tests
  d-v-b
  committed
  c08ffd9
Commits on Mar 26, 2025
- revert addition of linkage between dtype endianness and bytes codec endianness
  d-v-b
  committed
  778d740
- remove Any types
  d-v-b
  committed
  269215e
- add docstring for wrapper module
  d-v-b
  committed
  8af0ce4
- simplify config and docs
  d-v-b
  committed
  df60d05
- update config test
  d-v-b
  committed
  7f54bbf
- fix S dtype test for v2
  d-v-b
  committed
  be83f03
Commits on Apr 28, 2025
- Merge branch 'main' of github.com:zarr-developers/zarr-python into feat/fixed-length-strings
  d-v-b
  committed
  3979746
- fully remove v3jsonencoder
  d-v-b
  committed
  a210f9f
Commits on Apr 29, 2025
- refactor dtype module structure
  d-v-b
  committed
  8fbd29a
- add timedelta64
  d-v-b
  committed
  afc9872
Commits on Apr 30, 2025
- refactor time dtypes
  d-v-b
  committed
  e1bf901
Commits on May 1, 2025
- Merge branch 'main' of https://github.com/zarr-developers/zarr-python into feat/fixed-length-strings
  d-v-b
  committed
  45f0c88
- widen dtype test strategies
  d-v-b
  committed
  890077e
Commits on May 2, 2025
- modify structured dtype fill value rt to avoid to_dict
  d-v-b
  committed
  a3f05f0
- wip: begin creating isomorphic test suite for dtypes
  d-v-b
  committed
  4788f05
- finish common tests
  d-v-b
  committed
  d3f9204
Commits on May 7, 2025
Commits on May 8, 2025
- fill out more tests, and adjust sized dtypes
  d-v-b
  committed
  1458aad
- Merge branch 'main' of https://github.com/zarr-developers/zarr-python into feat/fixed-length-strings
  d-v-b
  committed
  9673997
Commits on May 12, 2025
- wip: json schema test
  d-v-b
  committed
  aa11df4
- Merge branch 'main' of https://github.com/zarr-developers/zarr-python into feat/fixed-length-strings
  d-v-b
  committed
  f706b46
Commits on May 13, 2025
- add casting tests
  d-v-b
  committed
  52518c2
- use relative link for changes
  d-v-b
  committed
  4ab1c58
- typo
  d-v-b
  committed
  e4c89f3
- make bytes codec dtype logic a bit more literate
  d-v-b
  committed
  e386c2b
- increase deadline to 500ms
  d-v-b
  committed
  703192c
- fewer commented sections of problematic lru_store_cache section of the sharding codecs
  d-v-b
  committed
  0fab5e5
- add link to gh issue about lru_cache for sharding codec
  d-v-b
  committed
  2f945bf
- attempt to speed up hypothesis tests by reducing max array size
  d-v-b
  committed
  63a6af4
- clean up docs
  d-v-b
  committed
  56e7c84
- remove placeholder
  d-v-b
  committed
  eee0d7b
- make final example section doctested and more readable
  d-v-b
  committed
  1dc8e72
- revert change to auto chunking
  d-v-b
  committed
  13ca230
- revert quotation of literal type
  d-v-b
  committed
  2a42205
- lint
  d-v-b
  committed
  3f775c8
- Merge branch 'main' of https://github.com/zarr-developers/zarr-python into feat/fixed-length-strings
  d-v-b
  committed
  5320a77
- fix broken code block
  d-v-b
  committed
  b525b8e
- specialize test to handle stringdtype changes coming in numpy 2.3
  d-v-b
  committed
  ec94878
- add docstring to _TestZDType class
  d-v-b
  committed
  3af98aa
Commits on May 15, 2025
Commits on May 16, 2025
- Merge branch 'main' of https://github.com/zarr-developers/zarr-python into feat/fixed-length-strings
  d-v-b
  committed
  3f4d87a
- expand changelog
  d-v-b
  committed
  d8a382a
- tweak docstring
  d-v-b
  committed
  9aa751b
Commits on May 19, 2025
- support v3 nan strings in JSON for float dtypes
  d-v-b
  committed
  e4a0372
Commits on May 21, 2025
- revert removal of metadata chunk grid attribute
  d-v-b
  committed
  8a976d6
Commits on May 22, 2025
Commits on May 23, 2025
- emit warning about unstable dtype when serializing Structured dtype to JSON
  d-v-b
  committed
  e67d4dc
Commits on May 24, 2025
Commits on May 25, 2025
- remove old string logic
  d-v-b
  committed
  c9c8181
Commits on May 26, 2025
- Merge branch 'main' of https://github.com/zarr-developers/zarr-python into feat/fixed-length-strings
  d-v-b
  committed
  1cb7734
- use scale_factor and unit in cast_value for datetime
  d-v-b
  committed
  d80d565
Commits on May 27, 2025
- add regression testing against v2.18
  d-v-b
  committed
  7806563
- truncate U and S scalars in _cast_value_unsafe
  d-v-b
  committed
  39219fa
- docstrings and simplification for regression tests
  d-v-b
  committed
  4a7a550
- changes necessary for linting with regression tests
  d-v-b
  committed
  807c585
Commits on May 29, 2025
- improve method names, refactor type hints with typeddictionaries, fix registry load frequency, add object_codec_id for v2 json deserialization
  d-v-b
  committed
  5150d60
- Merge branch 'main' of github.com:zarr-developers/zarr-python into feat/fixed-length-strings
  d-v-b
  committed
  9ddbe97
- fix storage info discrepancy in docs
  d-v-b
  committed
  d6535d6
- fix docstring that was troubling sphinx
  d-v-b
  committed
  42e14ef
- wip: add vlen-bytes
  d-v-b
  committed
  3991406
- add vlen-bytes
  d-v-b
  committed
  d7da3d9
Commits on Jun 2, 2025
- Merge branch 'main' of github.com:zarr-developers/zarr-python into feat/fixed-length-strings
  d-v-b
  committed
  c3c3288
Commits on Jun 5, 2025
- Merge branch 'main' into feat/fixed-length-strings
  d-v-b
  authored
  d1feaee
Commits on Jun 6, 2025
Commits on Jun 7, 2025
- Merge branch 'main' into feat/fixed-length-strings
  d-v-b
  authored
  7f099a2
- Merge branch 'main' into feat/fixed-length-strings
  d-v-b
  authored
  bf7e2c5
- clean up typeddicts
  d-v-b
  committed
  cbb0b0d
- Merge branch 'main' into feat/fixed-length-strings
  d-v-b
  authored
  8f3aa68
Commits on Jun 9, 2025
- update docstrings
  d-v-b
  committed
  e885869
Commits on Jun 11, 2025
- Update docs/user-guide/data_types.rst
  
  d-v-b
  and
  rabernat
  authored
  63de7c4
Commits on Jun 13, 2025
Commits on Jun 14, 2025
- make method definition order consistent
  d-v-b
  committed
  b2e56c8
- allow structured scalars to be np.void
  d-v-b
  committed
  d26b695
Commits on Jun 15, 2025
- use a common function signature for from_json by packing the object_codec_id in a typeddict for zarr v2 metadata
  d-v-b
  committed
  49f0062
- fix dtype doc example
  d-v-b
  committed
  70da4da
Commits on Jun 16, 2025
- Merge branch 'main' into feat/fixed-length-strings
  d-v-b
  authored
  16b4ac6

Commits

Commits on Feb 21, 2025

Commits on Feb 24, 2025

Commits on Feb 26, 2025

Commits on Feb 27, 2025

Commits on Mar 2, 2025

Commits on Mar 3, 2025

Commits on Mar 4, 2025

Commits on Mar 5, 2025

Commits on Mar 7, 2025

Commits on Mar 9, 2025

Commits on Mar 12, 2025

Commits on Mar 13, 2025

Commits on Mar 17, 2025

Commits on Mar 19, 2025

Commits on Mar 20, 2025

Commits on Mar 21, 2025

Commits on Mar 24, 2025

Commits on Mar 25, 2025

Commits on Mar 26, 2025

Commits on Apr 28, 2025

Commits on Apr 29, 2025

Commits on Apr 30, 2025

Commits on May 1, 2025

Commits on May 2, 2025

Commits on May 7, 2025

Commits on May 8, 2025

Commits on May 12, 2025

Commits on May 13, 2025

Commits on May 15, 2025