TileDB 2.30.0

TileDB v2.30.0 Release Notes

New features

• Support VFS::copy_file across filesystems. #5636
• Add support for copying directories across filesystems. #5666
• Add VFS support for tiledb:// URIs. #5631

Improvements

• Improve performance of listing files in Windows. #5617
• Improve performance when opening arrays. #5651
• Update shuffle and bitshuffle filter implementations to use blosc2. #5620
• Add handling for empty profiles.json. #5685
• Create a reusable workflow for building artifacts. #5691
• Reduce latency when uploading objects on S3 and GCS. #5688
• Fix flaky schema evolution test using explicit timestamp ordering. #5689
• Add cycle detection to Group::dump(). #5693

Deprecations

• Remove deprecated dump APIs. #5585

Defects removed

• Fix building tests with s3 enabled. #5624
• Use function-local static for logger_prefix_ to ensure safe, single-time initialization. #5630
• Check non_empty_domain.sizes size before access. #5650
• 0-byte read GCS bug fix. #5673
• Fix dense global order writer use of max_fragment_size_. #5655
• Do not provide storage URIs in TileDB-Server REST requests. #5687
• Update group URI to Logical URI coming from the Server #5710
• Error if storage location is provided in array / group create request. #5713

API changes

C API

• Move tiledb_ctx_alloc_with_error function to stable APIs header. #5667
• Expose overwrite parameter in tiledb_profile_save. #5695
• Add C API for getting REST data protocol. #5697

C++ API

• Improved error reporting when creating a context fails. #5667
• Expose the overwrite parameter in Profile::save. #5695
• Add C++ API for getting REST data protocol. #5697

Build system changes

• Improve build times when not specifying a build target. #5606
• Acquire nlohmann-json from vcpkg. A vendored copy of the library is removed. #5609
• Fix zip_view default constructor for C++20 concepts compliance. #5611
• Fix compile errors in compilers defaulting to C23. #5612
• Remove vendored Boost code. #5619
• Bump ubuntu version to 24.04. #5574
• Update vcpkg version baseline to microsoft/vcpkg@3b9d086. #5616
• Remove vendored sources of blosc and kiyo-masui/bitshuffle, and add a dependency to blosc2. #5620
• Fixed wrong release artifact names on macOS. #5703

TileDB v2.30.0-rc0

TileDB v2.30.0 Release Notes

New features

• Add support for relative URI remote group members. #5625
• Support VFS::copy_file across filesystems. #5636
• Add support for copying directories across filesystems. #5666
• Add VFS support for tiledb:// URIs. #5631

Improvements

• Improve performance of listing files in Windows. #5617
• Do not retry most SSL-related failures in the REST client. #5618
• Allow adding relative group members to remote groups. #5621
• Always check return codes in Curl::get_data and throw. #5632
• Improve performance when opening arrays. #5651
• Update shuffle and bitshuffle filter implementations to use blosc2. #5620
• Add handling for empty profiles.json. #5685
• Create a reusable workflow for building artifacts. #5691
• Reduce latency when uploading objects on S3 and GCS. #5688
• Fix flaky schema evolution test using explicit timestamp ordering. #5689
• Add cycle detection to Group::dump(). #5693

Deprecations

• Remove deprecated dump APIs. #5585

Defects removed

• Fix building tests with s3 enabled. #5624
• Use function-local static for logger_prefix_ to ensure safe, single-time initialization. #5630
• Check non_empty_domain.sizes size before access. #5650
• 0-byte read GCS bug fix. #5673
• Fix dense global order writer use of max_fragment_size_. #5655
• Do not provide storage URIs in TileDB-Server REST requests. #5687

Build system changes

• Improve build times when not specifying a build target. #5606
• Acquire nlohmann-json from vcpkg. A vendored copy of the library is removed. #5609
• Fix zip_view default constructor for C++20 concepts compliance. #5611
• Fix compile errors in compilers defaulting to C23. #5612
• Remove vendored Boost code. #5619
• Bump ubuntu version to 24.04. #5574
• Update vcpkg version baseline to microsoft/vcpkg@3b9d086. #5616
• Remove vendored sources of blosc and kiyo-masui/bitshuffle, and add a dependency to blosc2. #5620

API changes

C API

• Move tiledb_ctx_alloc_with_error function to stable APIs header. #5667
• Expose overwrite parameter in tiledb_profile_save. #5695
• Add C API for getting REST data protocol. #5697

C++ API

• Improved error reporting when creating a context fails. #5667
• Expose the overwrite parameter in Profile::save. #5695
• Add C++ API for getting REST data protocol. #5697

TileDB 2.29.2

TileDB v2.29.2 Release Notes

Defects removed

• Fix dense fragment domains during global order write with maximum fragment size #5676

TileDB 2.29.1

TileDB v2.29.1 Release Notes

New features

• Add support for Azure Data Lake Storage. #5652

Defects removed

• Fix deserialization of relative group member URI #5654

TileDB 2.29.0

TileDB v2.29.0 Release Notes

Breaking behavior

• Remove experimental features code and build/bootstrap option. #5540
• tiledb_filestore_uri_import and tiledb_filestore_buffer_import no longer auto-detect the file's MIME type. TILEDB_MIME_AUTODETECT will always set the filestore array's MIME type to application/octet-stream. #5605
• tiledb_filestore_uri_import and tiledb_filestore_buffer_import no longer auto-detect the file's encoding. New filestore arrays will always have their encoding metadata set to binary. #5605
• tiledb_filestore_uri_import and tiledb_filestore_buffer_import no longer compresses the filestore array's content. #5605

New features

• Add support for Profiles onto the Config. #5498
• Add support for relative URI remote group members. #5635
• Add ls_recursive_v2 that includes directories in results for all backends. #5602

Improvements

• Finalize Profile feature and add example. #5533
• Use config parameters instead of a config setter to set a profile on a config object. #5539
• Relax Profile parameter constraints for flexibility. #5547
• Adjust global logger default level to align with config.logging_level when no context is created. #5551
• Avoid throwing on missing Profile parameters in getter APIs. #5552
• Improve Fill Value Dumping for Non-Printable Characters. #5556
• Fix Subarray::add_range to validate var_size consistency between range and dimension. #5569
• Class MemFS inherits base class FilesystemBase. #5573
• Class GCS inherits base class FilesystemBase. #5576
• Class Azure inherits base class FilesystemBase. #5575
• Update array create to pass the storage path in payload. #5565
• Class Windows inherits base class FilesystemBase. #5578
• Class VFS inherits base class FilesystemBase. #5584
• Fix empty array name for URIs with trailing slash. #5591
• Refactor class VFS to remove #ifdefs. #5589
• Add support for tiledb_vfs_copy_file and tiledb_vfs_copy_dir on Windows. #5600
• Allow adding relative group members to remote groups. #5623
• Always check return codes in Curl::get_data and throw #5640
• Do not retry most SSL-related failures in the REST client. #5638
• Respect TILEDB_PROFILE_DIR environment variable in Profile save path. #5644

Deprecations

• Deprecate ls_recursive. #5602

Defects removed

• Fix overflow detection errors in double delta and bit width reduction filters. #5506
• Fixed integer overflows. #5518
• Fix a missing newline in array-schema printer. #5522
• Erase param from set_params_ in Config::unset. #5519
• Build error on make examples on M1 Mac for the PNG/Web_P examples. #5529
• Fix segfault race condition at process exit. #5477
• URL encode workspace and teamspace for REST URIs. #5544
• Fixed compile errors in the S3 VFS. #5545
• Fix Subarray::add_point_ranges_var to use the appropriate variable data Range constructor. #5560
• Update to use new route for group creation. #5543
• Fix Rust linter error #5577
• Fixed opening groups on object storage, that contain directory placeholder files. #5558
• Fixed the tiledb_vfs_create_dir function to automatically create non-existent parent directories on POSIX. #5579
• Fixed the tiledb_vfs_create_dir function to not fail when the directory already exists. #5579
• Correctly reset bugdet when initial data already loadad. #5599
• Fixed incorrect documentation of tiledb_vfs_copy_dir. #5600
• Fix build errors with --disable-stats from unused variable warnings. #5603
• Fix zip_view default constructor for C++20 concepts compliance. #5613
• Fixed compile errors in compilers defaulting to C23. #5639

API changes

C API

• Introduce Profile C APIs: tiledb_profile_alloc, tiledb_profile_free, tiledb_profile_get_name, tiledb_profile_get_homedir, tiledb_profile_set_param, tiledb_profile_get_param, tiledb_profile_save, tiledb_profile_load, tiledb_profile_remove, and tiledb_profile_dump_str. #5492
• Introduce tiledb_current_domain_dump_str and tiledb_ndrectangle_dump_str. #5538

C++ API

• Introduce Profile C++ APIs: name, homedir, set_param, get_param, save, load, remove, dump. #5492
• Introduce operator<< overloads for the CurrentDomain and NDRectangle. #5538
• Introduce ls_recursive_v2 that includes directories in results for all backends. #5602

Build System Changes

• Install serialization C API headers regardless of build configuration. #5530
• Removed dependency to libmagic. #5605

TileDB v2.29.0-rc1

TileDB v2.29.0 Release Notes

Breaking behavior

• Remove experimental features code and build/bootstrap option. #5540
• tiledb_filestore_uri_import and tiledb_filestore_buffer_import no longer auto-detect the file's MIME type. TILEDB_MIME_AUTODETECT will always set the filestore array's MIME type to application/octet-stream. #5605
• tiledb_filestore_uri_import and tiledb_filestore_buffer_import no longer auto-detect the file's encoding. New filestore arrays will always have their encoding metadata set to binary. #5605
• tiledb_filestore_uri_import and tiledb_filestore_buffer_import no longer compresses the filestore array's content. #5605

New features

• Add support for Profiles onto the Config. #5498
• Add support for relative URI remote group members. #5635
• Introduce ls_recursive_v2 that includes directories in results for all backends. #5602

Improvements

• Finalize Profile feature and add example. #5533
• Use config parameters instead of a config setter to set a profile on a config object. #5539
• Relax Profile parameter constraints for flexibility. #5547
• Adjust global logger default level to align with config.logging_level when no context is created. #5551
• Avoid throwing on missing Profile parameters in getter APIs. #5552
• Improve Fill Value Dumping for Non-Printable Characters. #5556
• Fix Subarray::add_range to validate var_size consistency between range and dimension. #5569
• Class MemFS inherits base class FilesystemBase. #5573
• Class GCS inherits base class FilesystemBase. #5576
• Class Azure inherits base class FilesystemBase. #5575
• Update array create to pass the storage path in payload. #5565
• Class Windows inherits base class FilesystemBase. #5578
• Class VFS inherits base class FilesystemBase. #5584
• Fix empty array name for URIs with trailing slash. #5591
• Refactor class VFS to remove #ifdefs. #5589
• Add support for tiledb_vfs_copy_file and tiledb_vfs_copy_dir on Windows. #5600
• Allow adding relative group members to remote groups. #5623
• Always check return codes in Curl::get_data and throw #5640
• Do not retry most SSL-related failures in the REST client. #5638

Deprecations

• Deprecate ls_recursive. #5602

Defects removed

• Fix overflow detection errors in double delta and bit width reduction filters. #5506
• Fixed integer overflows. #5518
• Fix a missing newline in array-schema printer. #5522
• Erase param from set_params_ in Config::unset. #5519
• Build error on make examples on M1 Mac for the PNG/Web_P examples. #5529
• Fix segfault race condition at process exit. #5477
• URL encode workspace and teamspace for REST URIs. #5544
• Fixed compile errors in the S3 VFS. #5545
• Fix Subarray::add_point_ranges_var to use the appropriate variable data Range constructor. #5560
• Update to use new route for group creation. #5543
• Fix Rust linter error #5577
• Fixed opening groups on object storage, that contain directory placeholder files. #5558
• Fixed the tiledb_vfs_create_dir function to automatically create non-existent parent directories on POSIX. #5579
• Fixed the tiledb_vfs_create_dir function to not fail when the directory already exists. #5579
• Correctly reset bugdet when initial data already loadad. #5599
• Fixed incorrect documentation of tiledb_vfs_copy_dir. #5600
• Fix build errors with --disable-stats from unused variable warnings. #5603
• Fix zip_view default constructor for C++20 concepts compliance. #5613
• Fixed compile errors in compilers defaulting to C23. #5639

API changes

C API

• Introduce Profile C APIs: tiledb_profile_alloc, tiledb_profile_free, tiledb_profile_get_name, tiledb_profile_get_homedir, tiledb_profile_set_param, tiledb_profile_get_param, tiledb_profile_save, tiledb_profile_load, tiledb_profile_remove, and tiledb_profile_dump_str. #5492
• Introduce tiledb_current_domain_dump_str and tiledb_ndrectangle_dump_str. #5538

C++ API

• Introduce Profile C++ APIs: name, homedir, set_param, get_param, save, load, remove, dump. #5492
• Introduce operator<< overloads for the CurrentDomain and NDRectangle. #5538
• Introduce ls_recursive_v2 that includes directories in results for all backends. #5602

Build System Changes

• Install serialization C API headers regardless of build configuration. #5530
• Removed dependency to libmagic. #5605

TileDB v2.29.0-rc0

TileDB v2.29.0 Release Notes

Breaking behavior

• Remove experimental features code and build/bootstrap option. #5540
• tiledb_filestore_uri_import and tiledb_filestore_buffer_import no longer auto-detect the file's MIME type. TILEDB_MIME_AUTODETECT will always set the filestore array's MIME type to application/octet-stream. #5605
• tiledb_filestore_uri_import and tiledb_filestore_buffer_import no longer auto-detect the file's encoding. New filestore arrays will always have their encoding metadata set to binary. #5605
• tiledb_filestore_uri_import and tiledb_filestore_buffer_import no longer compresses the filestore array's content. #5605

New features

• Add support for Profiles onto the Config. #5498

Improvements

• Finalize Profile feature and add example. #5533
• Use config parameters instead of a config setter to set a profile on a config object. #5539
• Relax Profile parameter constraints for flexibility. #5547
• Adjust global logger default level to align with config.logging_level when no context is created. #5551
• Avoid throwing on missing Profile parameters in getter APIs. #5552
• Improve Fill Value Dumping for Non-Printable Characters. #5556
• Fix Subarray::add_range to validate var_size consistency between range and dimension. #5569
• Class MemFS inherits base class FilesystemBase. #5573
• Class GCS inherits base class FilesystemBase. #5576
• Class Azure inherits base class FilesystemBase. #5575
• Update array create to pass the storage path in payload. #5565
• Class Windows inherits base class FilesystemBase. #5578
• Class VFS inherits base class FilesystemBase. #5584
• Fix empty array name for URIs with trailing slash. #5591
• Refactor class VFS to remove #ifdefs. #5589
• Added support for tiledb_vfs_copy_file and tiledb_vfs_copy_dir on Windows. #5600

Deprecations

• Deprecate ls_recursive. #5602

Defects removed

• Fix overflow detection errors in double delta and bit width reduction filters. #5506
• Fixed integer overflows. #5518
• Fix a missing newline in array-schema printer. #5522
• Erase param from set_params_ in Config::unset. #5519
• Build error on make examples on M1 Mac for the PNG/Web_P examples. #5529
• Fix segfault race condition at process exit. #5477
• URL encode workspace and teamspace for REST URIs. #5544
• Fixed compile errors in the S3 VFS. #5545
• Fix Subarray::add_point_ranges_var to use the appropriate variable data Range constructor. #5560
• Update to use new route for group creation. #5543
• Fix Rust linter error #5577
• Fixed opening groups on object storage, that contain directory placeholder files. #5558
• Fixed the tiledb_vfs_create_dir function to automatically create non-existent parent directories on POSIX. #5579
• Fixed the tiledb_vfs_create_dir function to not fail when the directory already exists. #5579
• Correctly reset bugdet when initial data already loadad. #5599
• Fixed incorrect documentation of tiledb_vfs_copy_dir. #5600
• Fix build errors with --disable-stats from unused variable warnings. #5603

API changes

C API

• Introduce Profile C APIs: tiledb_profile_alloc, tiledb_profile_free, tiledb_profile_get_name, tiledb_profile_get_homedir, tiledb_profile_set_param, tiledb_profile_get_param, tiledb_profile_save, tiledb_profile_load, tiledb_profile_remove, and tiledb_profile_dump_str. #5492
• Introduce tiledb_current_domain_dump_str and tiledb_ndrectangle_dump_str. #5538

C++ API

• Introduce Profile C++ APIs: name, homedir, set_param, get_param, save, load, remove, dump. #5492
• Introduce operator<< overloads for the CurrentDomain and NDRectangle. #5538
• Introduce ls_recursive_v2 that includes directories in results for all backends. #5602

Build System Changes

• Install serialization C API headers regardless of build configuration. #5530
• Removed dependency to libmagic. #5605

TileDB v2.28.1

TileDB v2.28.1 Release Notes

New features

• Add support for Profiles onto the Config. #5570

Improvements

• Finalize Profile feature and add example. #5572
• Update array create to pass the storage path in payload #5582
• Use config parameters instead of a config setter to set a profile on a config object. #5586
• Relax Profile parameter constraints for flexibility. #5587
• Avoid throwing on missing Profile parameters in getter APIs. #5588
• URL encode workspace and teamspace for REST URIs. #5549
• Update to use new route for group creation. #5581
• Fix empty array name for URIs with trailing slash. [#5592] (#5592)

Defects removed

• Fixed compile errors in the S3 VFS. #5554
• Fix Subarray::add_point_ranges_var to use the appropriate variable data Range constructor. #5562
• Fixed integer overflows. #5571
• Fixed opening groups on object storage, that contain directory placeholder files. #5583

API changes

C API

• Introduce Profile C APIs: tiledb_profile_alloc, tiledb_profile_free, tiledb_profile_get_name, tiledb_profile_get_homedir, tiledb_profile_set_param, tiledb_profile_get_param, tiledb_profile_save, tiledb_profile_load, tiledb_profile_remove, and tiledb_profile_dump_str. #5564
• Introduce tiledb_current_domain_dump_str and tiledb_ndrectangle_dump_str. #5561

C++ API

• Introduce Profile C++ APIs: name, homedir, set_param, get_param, save, load, remove, dump. #5564
• Introduce operator<< overloads for the CurrentDomain and NDRectangle. #5561

Build System Changes

• Install serialization C API headers regardless of build configuration. #5559

TileDB v2.28.1-rc1

TileDB v2.28.1 Release Notes

New features

• Add support for Profiles onto the Config. #5570

Improvements

• Finalize Profile feature and add example. #5572
• Update array create to pass the storage path in payload #5582
• Use config parameters instead of a config setter to set a profile on a config object. #5586
• Relax Profile parameter constraints for flexibility. #5587
• Avoid throwing on missing Profile parameters in getter APIs. #5588
• URL encode workspace and teamspace for REST URIs. #5549
• Update to use new route for group creation. #5581
• Fix empty array name for URIs with trailing slash. [#5592] (#5592)

Defects removed

• Fixed compile errors in the S3 VFS. #5554
• Fix Subarray::add_point_ranges_var to use the appropriate variable data Range constructor. #5562
• Fixed integer overflows. #5571
• Fixed opening groups on object storage, that contain directory placeholder files. #5583

API changes

C API

• Introduce Profile C APIs: tiledb_profile_alloc, tiledb_profile_free, tiledb_profile_get_name, tiledb_profile_get_homedir, tiledb_profile_set_param, tiledb_profile_get_param, tiledb_profile_save, tiledb_profile_load, tiledb_profile_remove, and tiledb_profile_dump_str. #5564
• Introduce tiledb_current_domain_dump_str and tiledb_ndrectangle_dump_str. #5561

C++ API

• Introduce Profile C++ APIs: name, homedir, set_param, get_param, save, load, remove, dump. #5564
• Introduce operator<< overloads for the CurrentDomain and NDRectangle. #5561

Build System Changes

• Install serialization C API headers regardless of build configuration. #5559

TileDB v2.28.1-rc0

TileDB v2.28.1 Release Notes

New features

• Add support for Profiles onto the Config. #5570

Improvements

• Finalize Profile feature and add example. #5572
• Update array create to pass the storage path in payload #5582
• Use config parameters instead of a config setter to set a profile on a config object. #5586
• Relax Profile parameter constraints for flexibility. #5587
• Avoid throwing on missing Profile parameters in getter APIs. #5588
• URL encode workspace and teamspace for REST URIs. #5549
• Update to use new route for group creation. #5581
• Fix empty array name for URIs with trailing slash. [#5592] (#5592)

Defects removed

• Fixed compile errors in the S3 VFS. #5554
• Fix Subarray::add_point_ranges_var to use the appropriate variable data Range constructor. #5562
• Fixed integer overflows. #5571
• Fixed opening groups on object storage, that contain directory placeholder files. #5583

API changes

C API

• Introduce Profile C APIs: tiledb_profile_alloc, tiledb_profile_free, tiledb_profile_get_name, tiledb_profile_get_homedir, tiledb_profile_set_param, tiledb_profile_get_param, tiledb_profile_save, tiledb_profile_load, tiledb_profile_remove, and tiledb_profile_dump_str. #5564
• Introduce tiledb_current_domain_dump_str and tiledb_ndrectangle_dump_str. #5561

C++ API

• Introduce Profile C++ APIs: name, homedir, set_param, get_param, save, load, remove, dump. #5564
• Introduce operator<< overloads for the CurrentDomain and NDRectangle. #5561

Build System Changes

• Install serialization C API headers regardless of build configuration. #5559