anand76 513c8d2f16 Initial implementation of ExternalTableBuilder (#13434) ...

Summary:
This PR adds the ability to use an ExternalTableBuilder through the SstFileWriter to create external tables. This is a counterpart to https://github.com/facebook/rocksdb/issues/13401 , which adds the ExternalTableReader. The support for external tables is confined to ingestion only DBs, with external table files ingested into the bottommost level only. https://github.com/facebook/rocksdb/issues/13431 enforces ingestion only DBs by adding a disallow_memtable_writes column family option.

Pull Request resolved: https://github.com/facebook/rocksdb/pull/13434

Test Plan: New unit tests in table_test.cc

Reviewed By: pdillinger

Differential Revision: D70532054

Pulled By: anand1976

fbshipit-source-id: a837487eadfabed9627a0eceb403bfc5fc2c427c

2025-03-06 09:47:30 -08:00

..

adaptive

Standardize on clang-format version 18 (#13233)

2024-12-19 10:58:40 -08:00

block_based

Require ZSTD >= 1.4.0, greatly simplifying related code (#13362)

2025-02-04 12:03:32 -08:00

cuckoo

Standardize on clang-format version 18 (#13233)

2024-12-19 10:58:40 -08:00

plain

Standardize on clang-format version 18 (#13233)

2024-12-19 10:58:40 -08:00

block_fetcher_test.cc

Standardize on clang-format version 18 (#13233)

2024-12-19 10:58:40 -08:00

block_fetcher.cc

Add ticker stats for read corruption retries (#12923)

2024-08-12 15:32:07 -07:00

block_fetcher.h

Fix stale memory access with FSBuffer and tiered sec cache (#12712)

2024-05-30 12:33:58 -07:00

cleanable_test.cc

Eliminate unnecessary (slow) block cache Ref()ing in MultiGet (#9899)

2022-04-26 21:59:24 -07:00

compaction_merging_iterator.cc

Track the total number of compaction sorted runs from inside CompactionMergingIterator (#13325)

2025-02-06 13:25:51 -08:00

compaction_merging_iterator.h

Track the total number of compaction sorted runs from inside CompactionMergingIterator (#13325)

2025-02-06 13:25:51 -08:00

external_table.cc

Initial implementation of ExternalTableBuilder (#13434)

2025-03-06 09:47:30 -08:00

format.cc

Fix missing cases of corruption retries (#13122)

2024-11-08 12:43:21 -08:00

format.h

Fix a couple of missing cases of retry on corruption (#13007)

2024-09-13 13:56:49 -07:00

get_context.cc

Fix kBlockCacheTier read when merge-chain base value is in a blob file (#12462)

2024-03-21 12:38:53 -07:00

get_context.h

Fix kBlockCacheTier read when merge-chain base value is in a blob file (#12462)

2024-03-21 12:38:53 -07:00

internal_iterator.h

Support returning write unix time in iterator property (#12428)

2024-03-15 15:37:37 -07:00

iter_heap.h

Format files under table/ by clang-format (#10852)

2022-10-25 11:50:38 -07:00

iterator_wrapper.h

Support returning write unix time in iterator property (#12428)

2024-03-15 15:37:37 -07:00

iterator.cc

Fix a bug for surfacing write unix time (#13057)

2024-10-08 11:31:51 -07:00

merger_test.cc

internal_repo_rocksdb (435146444452818992) (#12115)

2023-12-01 11:15:17 -08:00

merging_iterator.cc

Fix possible double-free on TruncatedRangeDelIterator (#12805)

2024-06-24 11:51:16 -07:00

merging_iterator.h

Fix possible double-free on TruncatedRangeDelIterator (#12805)

2024-06-24 11:51:16 -07:00

meta_blocks.cc

Fix missing cases of corruption retries (#13122)

2024-11-08 12:43:21 -08:00

meta_blocks.h

Add some checks at property block creation side (#12898)

2024-07-31 13:28:17 -07:00

mock_table.cc

Record newest_key_time as a table property (#13083)

2024-11-01 10:08:35 -07:00

mock_table.h

Record newest_key_time as a table property (#13083)

2024-11-01 10:08:35 -07:00

multiget_context.h

Standardize on clang-format version 18 (#13233)

2024-12-19 10:58:40 -08:00

persistent_cache_helper.cc

Remove extra semi colon from internal_repo_rocksdb/repo/db/table_cache_sync_and_async.h

2024-03-04 06:34:44 -08:00

persistent_cache_helper.h

Change internal headers with duplicate names (#11408)

2023-05-17 11:27:09 -07:00

persistent_cache_options.h

Change internal headers with duplicate names (#11408)

2023-05-17 11:27:09 -07:00

sst_file_dumper.cc

Record newest_key_time as a table property (#13083)

2024-11-01 10:08:35 -07:00

sst_file_dumper.h

Standardize on clang-format version 18 (#13233)

2024-12-19 10:58:40 -08:00

sst_file_reader_test.cc

Bugfix: Ensure statuses are initialized with OK() in SSTFileReader::MultiGet (#13411)

2025-02-19 19:38:53 -08:00

sst_file_reader.cc

Bugfix: Ensure statuses are initialized with OK() in SSTFileReader::MultiGet (#13411)

2025-02-19 19:38:53 -08:00

sst_file_writer_collectors.h

Add CompactForTieringCollector to support automatically trigger compaction for tiering use case (#12760)

2024-06-18 10:51:29 -07:00

sst_file_writer.cc

Standardize on clang-format version 18 (#13233)

2024-12-19 10:58:40 -08:00

table_builder.h

Standardize on clang-format version 18 (#13233)

2024-12-19 10:58:40 -08:00

table_factory.cc

Remove FactoryFunc from LoadXXXObject (#11203)

2023-02-17 12:54:07 -08:00

table_iterator.h

Add support in SstFileReader to get a raw table iterator (#12385)

2024-04-02 21:23:06 -07:00

table_properties_internal.h

Improve / clean up meta block code & integrity (#9163)

2021-11-18 11:43:44 -08:00

table_properties.cc

Record newest_key_time as a table property (#13083)

2024-11-01 10:08:35 -07:00

table_reader_bench.cc

Record newest_key_time as a table property (#13083)

2024-11-01 10:08:35 -07:00

table_reader.h

Deshim coro in fbcode/internal_repo_rocksdb

2024-09-14 09:48:21 -07:00

table_test.cc

Initial implementation of ExternalTableBuilder (#13434)

2025-03-06 09:47:30 -08:00

two_level_iterator.cc

internal_repo_rocksdb (435146444452818992) (#12115)

2023-12-01 11:15:17 -08:00

two_level_iterator.h

Remove unnecessary, confusing 'extern' (#12300)

2024-01-29 10:38:08 -08:00

unique_id_impl.h

Derive cache keys from SST unique IDs (#10394)

2022-08-12 13:49:49 -07:00

unique_id.cc

internal_repo_rocksdb (435146444452818992) (#12115)

2023-12-01 11:15:17 -08:00