(issue from pr #1390) SHOW TABLES fails with glue catalog on iceberg tables: Received error 499 while fetching table metadata for existing table #1505
Description
SHOW TABLES fails with glue catalog on iceberg tables.
Failing regression test from #1390 : /iceberg/iceberg engine/glue catalog/feature/show tables queries
Report: https://altinity-build-artifacts.s3.amazonaws.com/REFs/1390/merge/f41c077267c130764a25aa9cd87e6eeff597f00c/regression/x86_64/with_analyzer/zookeeper/without_thread_fuzzer/iceberg2/report.html
Received exception from server (version 26.1.3):
Code: 499. DB::Exception: Received from localhost:9000. DB::Exception: Received error 499 while fetching table metadata for existing table 'iceberg_c64676d0_1bc8_11f1_9fc1_920007579e66.table_1_c64677b4_1bc8_11f1_9fd7_920007579e66'. If you want this error to be ignored, use database_datalake_require_metadata_access=0. Error: Code: 499. DB::Exception: Failed to get object info: No response body.. HTTP response code: 403: while reading data/metadata/00001-fd82babb-befa-4cc7-962d-e30531140b78.metadata.json. (S3_ERROR),. (S3_ERROR)
(query: SHOW TABLES from datalake_c6467754_1bc8_11f1_ac4a_920007579e66
)
Trace:
2026.03.09 16:00:56.483471 [ 45 ] {3a7f07a8-d636-4483-82b7-7c1a51eabe5c} <Error> executeQuery: Code: 499. DB::Exception: Received error 499 while fetching table metadata for existing table 'iceberg_c64676d0_1bc8_11f1_9fc1_920007579e66.table_1_c64677b4_1bc8_11f1_9fd7_920007579e66'. If you want this error to be ignored, use database_datalake_require_metadata_access=0. Error: Code: 499. DB::Exception: Failed to get object info: No response body.. HTTP response code: 403: while reading data/metadata/00001-fd82babb-befa-4cc7-962d-e30531140b78.metadata.json. (S3_ERROR), Stack trace (when copying this message, always include the lines below):
0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:113: Poco::Exception::Exception(String const&, int) @ 0x0000000021f71632
1. ./ci/tmp/build/./src/Common/Exception.cpp:136: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001357fc69
2. ./src/Common/Exception.h:172: DB::Exception::Exception(String&&, int, String, bool) @ 0x000000000b0d150e
3. ./src/Common/Exception.h:58: DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b0d0fc9
4. ./src/IO/S3Common.h:34: DB::S3Exception::S3Exception<String const&, unsigned long>(Aws::S3::S3Errors, FormatStringHelperImpl<std::type_identity<String const&>::type, std::type_identity<unsigned long>::type>, String const&, unsigned long&&) @ 0x00000000179e3041
5. ./ci/tmp/build/./src/IO/S3/getObjectInfo.cpp:169: DB::S3::getObjectInfo(DB::S3::Client const&, String const&, String const&, String const&, bool, bool) @ 0x00000000179e2ad8
6. ./ci/tmp/build/./src/Disks/DiskObjectStorage/ObjectStorages/S3/S3ObjectStorage.cpp:476: DB::S3ObjectStorage::getObjectMetadata(String const&, bool) const @ 0x0000000017c95e70
7. ./ci/tmp/build/./src/Storages/ObjectStorage/StorageObjectStorageSource.cpp:1008: DB::createReadBuffer(DB::RelativePathWithMetadata&, std::shared_ptr<DB::IObjectStorage> const&, std::shared_ptr<DB::Context const> const&, std::shared_ptr<Poco::Logger> const&, std::optional<DB::ReadSettings> const&) @ 0x00000000179abe83
8. ./ci/tmp/build/./src/Storages/ObjectStorage/DataLakes/Iceberg/Utils.cpp:354: DB::Iceberg::getMetadataJSONObject(String const&, std::shared_ptr<DB::IObjectStorage>, std::shared_ptr<DB::IcebergMetadataFilesCache>, std::shared_ptr<DB::Context const> const&, std::shared_ptr<Poco::Logger>, DB::CompressionMethod, std::optional<String> const&)::$_0::operator()() const @ 0x0000000017b9b9f7
9. ./ci/tmp/build/./src/Storages/ObjectStorage/DataLakes/Iceberg/Utils.cpp:375: DB::Iceberg::getMetadataJSONObject(String const&, std::shared_ptr<DB::IObjectStorage>, std::shared_ptr<DB::IcebergMetadataFilesCache>, std::shared_ptr<DB::Context const> const&, std::shared_ptr<Poco::Logger>, DB::CompressionMethod, std::optional<String> const&) @ 0x0000000017b9af99
10. ./ci/tmp/build/./src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergMetadata.cpp:154: DB::IcebergMetadata::initializePersistentTableComponents(std::shared_ptr<DB::StorageObjectStorageConfiguration>, std::shared_ptr<DB::IcebergMetadataFilesCache>, std::shared_ptr<DB::Context const>) @ 0x0000000017ad093c
11. ./ci/tmp/build/./src/Storages/ObjectStorage/DataLakes/Iceberg/IcebergMetadata.cpp:206: DB::IcebergMetadata::IcebergMetadata(std::shared_ptr<DB::IObjectStorage>, std::shared_ptr<DB::StorageObjectStorageConfiguration>, std::shared_ptr<DB::Context const> const&, std::shared_ptr<DB::IcebergMetadataFilesCache>) @ 0x0000000017ad1d2a
12. ./contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:759: DB::IcebergMetadata::create(std::shared_ptr<DB::IObjectStorage> const&, std::weak_ptr<DB::StorageObjectStorageConfiguration> const&, std::shared_ptr<DB::Context const> const&) @ 0x0000000017adaad7
13. ./src/Storages/ObjectStorage/DataLakes/DataLakeConfiguration.h:110: DB::DataLakeConfiguration<DB::StorageS3Configuration, DB::IcebergMetadata, true>::update(std::shared_ptr<DB::IObjectStorage>, std::shared_ptr<DB::Context const>, bool) @ 0x0000000015c96331
14. ./ci/tmp/build/./src/Storages/ObjectStorage/StorageObjectStorageCluster.cpp:137: DB::StorageObjectStorageCluster::StorageObjectStorageCluster(String const&, std::shared_ptr<DB::StorageObjectStorageConfiguration>, std::shared_ptr<DB::IObjectStorage>, DB::StorageID const&, DB::ColumnsDescription const&, DB::ConstraintsDescription const&, boost::intrusive_ptr<DB::IAST> const&, boost::intrusive_ptr<DB::IAST> const&, std::shared_ptr<DB::Context const>, String const&, std::optional<DB::FormatSettings>, DB::LoadingStrictnessLevel, std::shared_ptr<DataLake::ICatalog>, bool, bool, bool, bool) @ 0x000000001795c530
15. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:38: DB::StorageObjectStorageCluster* std::construct_at[abi:ne210105]<DB::StorageObjectStorageCluster, String&, std::shared_ptr<DB::StorageObjectStorageConfiguration> const&, std::shared_ptr<DB::IObjectStorage>, DB::StorageID, DB::ColumnsDescription const&, DB::ConstraintsDescription, std::nullptr_t, std::nullptr_t, std::shared_ptr<DB::Context>&, char const (&) [1], DB::FormatSettings, DB::LoadingStrictnessLevel, std::shared_ptr<DataLake::ICatalog>, bool, bool, bool, bool, DB::StorageObjectStorageCluster*>(DB::StorageObjectStorageCluster*, String&, std::shared_ptr<DB::StorageObjectStorageConfiguration> const&, std::shared_ptr<DB::IObjectStorage>&&, DB::StorageID&&, DB::ColumnsDescription const&, DB::ConstraintsDescription&&, std::nullptr_t&&, std::nullptr_t&&, std::shared_ptr<DB::Context>&, char const (&) [1], DB::FormatSettings&&, DB::LoadingStrictnessLevel&&, std::shared_ptr<DataLake::ICatalog>&&, bool&&, bool&&, bool&&, bool&&) @ 0x0000000018650c83
16. ./contrib/llvm-project/libcxx/include/__memory/construct_at.h:46: std::shared_ptr<DB::StorageObjectStorageCluster> std::allocate_shared[abi:ne210105]<DB::StorageObjectStorageCluster, std::allocator<DB::StorageObjectStorageCluster>, String&, std::shared_ptr<DB::StorageObjectStorageConfiguration> const&, std::shared_ptr<DB::IObjectStorage>, DB::StorageID, DB::ColumnsDescription const&, DB::ConstraintsDescription, std::nullptr_t, std::nullptr_t, std::shared_ptr<DB::Context>&, char const (&) [1], DB::FormatSettings, DB::LoadingStrictnessLevel, std::shared_ptr<DataLake::ICatalog>, bool, bool, bool, bool, 0>(std::allocator<DB::StorageObjectStorageCluster> const&, String&, std::shared_ptr<DB::StorageObjectStorageConfiguration> const&, std::shared_ptr<DB::IObjectStorage>&&, DB::StorageID&&, DB::ColumnsDescription const&, DB::ConstraintsDescription&&, std::nullptr_t&&, std::nullptr_t&&, std::shared_ptr<DB::Context>&, char const (&) [1], DB::FormatSettings&&, DB::LoadingStrictnessLevel&&, std::shared_ptr<DataLake::ICatalog>&&, bool&&, bool&&, bool&&, bool&&) @ 0x0000000018650936
17. ./contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:744: DB::DatabaseDataLake::tryGetTableImpl(String const&, std::shared_ptr<DB::Context const>, bool, bool) const @ 0x0000000018647e55
18. ./ci/tmp/build/./src/Databases/DataLake/DatabaseDataLake.cpp:753: void std::__function::__policy_func<void ()>::__call_func[abi:ne210105]<DB::DatabaseDataLake::getLightweightTablesIterator(std::shared_ptr<DB::Context const>, std::function<bool (String const&)> const&, bool) const::$_0>(std::__function::__policy_storage const*) @ 0x000000001864d49b
19. ./contrib/llvm-project/libcxx/include/__functional/function.h:508: ? @ 0x00000000136c7f0c
20. ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:0: ThreadFromGlobalPoolImpl<false, true>::ThreadFromGlobalPoolImpl<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&&)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&&)::'lambda'()::operator()() @ 0x00000000136cd0e6
21. ./contrib/llvm-project/libcxx/include/__functional/function.h:508: ? @ 0x00000000136c5bf5
22. ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:0: void* std::__thread_proxy[abi:ne210105]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>>(void*) @ 0x00000000136cb47b
23. ? @ 0x0000000000094ac3
24. ? @ 0x0000000000126850
(version 26.1.3.20001.altinityantalya). (S3_ERROR) (version 26.1.3.20001.altinityantalya) (from 127.0.0.1:36708) (query 1, line 1) (in query: SHOW TABLES from datalake_c6467754_1bc8_11f1_ac4a_920007579e66 ), Stack trace (when copying this message, always include the lines below):
0. ./contrib/llvm-project/libcxx/include/__exception/exception.h:113: Poco::Exception::Exception(String const&, int) @ 0x0000000021f71632
1. ./ci/tmp/build/./src/Common/Exception.cpp:136: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001357fc69
2. ./src/Common/Exception.h:171: DB::Exception::Exception(String const&, int, String, bool) @ 0x00000000120ccc4e
3. ./src/Common/Exception.h:185: DB::Exception::createRuntime(int, String&) @ 0x0000000018651526
4. ./ci/tmp/build/./src/Databases/DataLake/DatabaseDataLake.cpp:767: void std::__function::__policy_func<void ()>::__call_func[abi:ne210105]<DB::DatabaseDataLake::getLightweightTablesIterator(std::shared_ptr<DB::Context const>, std::function<bool (String const&)> const&, bool) const::$_0>(std::__function::__policy_storage const*) @ 0x000000001864d610
5. ./contrib/llvm-project/libcxx/include/__functional/function.h:508: ? @ 0x00000000136c7f0c
6. ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:0: ThreadFromGlobalPoolImpl<false, true>::ThreadFromGlobalPoolImpl<void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*>(void (ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool::*&&)(), ThreadPoolImpl<ThreadFromGlobalPoolImpl<false, true>>::ThreadFromThreadPool*&&)::'lambda'()::operator()() @ 0x00000000136cd0e6
7. ./contrib/llvm-project/libcxx/include/__functional/function.h:508: ? @ 0x00000000136c5bf5
8. ./contrib/llvm-project/libcxx/include/__type_traits/invoke.h:0: void* std::__thread_proxy[abi:ne210105]<std::tuple<std::unique_ptr<std::__thread_struct, std::default_delete<std::__thread_struct>>, void (ThreadPoolImpl<std::thread>::ThreadFromThreadPool::*)(), ThreadPoolImpl<std::thread>::ThreadFromThreadPool*>>(void*) @ 0x00000000136cb47b
9. ? @ 0x0000000000094ac3
10. ? @ 0x0000000000126850