database/rocksdb
1
0
Fork 0
mirror of https://github.com/facebook/rocksdb.git synced 2026-10-23 08:09:02 +03:00
Code Activity
Files
42fca1bb390655147cbdbd4e395ec60f06efdeaf
rocksdb/util
History
Anand Ananthabhotla 92a6308300 Verify compressed block bytes after checksum computation (#15098) 
Summary:
Pull Request resolved: https://github.com/facebook/rocksdb/pull/15098

Compute the base block checksum in `CompressAndVerifyBlock()` before `verify_compression` decompresses the compressed output. Parallel compression stores that base checksum on the block rep so worker threads can keep the CPU-heavy checksum and verification work off the ordered write path; the writer only applies the offset context modifier before writing the trailer.

Update the regression test to cover both serial and parallel compression paths.

Reviewed By: pdillinger

Differential Revision: D115950785

fbshipit-source-id: b5e47f7d7c41680e7e7907443fc805bc0d043d6e
2026-08-17 12:34:23 -07:00
..
aligned_buffer.h
Add read-scoped block buffers for scan reads (#14806)
2026-06-08 14:26:46 -07:00
aligned_storage.h
Fix compile errors in C++23 (#12106)
2024-05-28 15:33:57 -07:00
async_file_reader.cc
propagate request_id from app -> Rocks -> FS (#13616)
2025-05-16 21:25:50 -07:00
async_file_reader.h
Add read-scoped block buffers for scan reads (#14806)
2026-06-08 14:26:46 -07:00
atomic.h
Blob direct write v1: write-path blob separation with partitioned files (reduced scope) (#14535)
2026-04-02 07:31:56 -07:00
auto_tune_compressor.cc
Integrated and ratio-aware compression auto-skip (#15079)
2026-08-11 14:29:51 -07:00
auto_tune_compressor.h
Integrated and ratio-aware compression auto-skip (#15079)
2026-08-11 14:29:51 -07:00
autovector_test.cc
Standardize on clang-format version 18 (#13233)
2024-12-19 10:58:40 -08:00
autovector.h
Standardize on clang-format version 18 (#13233)
2024-12-19 10:58:40 -08:00
bit_fields.h
Clarify/rename atomic wrapper stuff + blog post (#14213)
2026-01-05 20:47:46 -08:00
bloom_impl.h
Reformat source files (#14331)
2026-02-13 11:56:22 -08:00
bloom_test.cc
Add SST build context: is_remote_compaction, db_name, kSstFileWriter (#15085)
2026-08-12 14:31:47 -07:00
build_version.cc.in
Remove RocksDB LITE (#11147)
2023-01-27 13:14:19 -08:00
cast_util.h
Fix quadratic point-in-time MANIFEST recovery in VersionBuilder (#14929)
2026-07-15 13:34:03 -07:00
channel.h
Fix and detect headers with missing dependencies (#8893)
2021-09-10 10:00:26 -07:00
cleanable.cc
Add read-scoped block buffers for scan reads (#14806)
2026-06-08 14:26:46 -07:00
coding_lean.h
New stable, fixed-length cache keys (#9126)
2021-12-16 17:15:13 -08:00
coding_test.cc
Add prefix varint codec and tests (#14692)
2026-05-06 19:27:14 -07:00
coding.cc
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
coding.h
Separate keys and values in data blocks (#14287)
2026-02-23 12:42:05 -08:00
compaction_job_stats_impl.cc
Rename and clarify CompactionJobStats::has_num_input_records for clarity and set true by default (#13929)
2025-09-11 12:19:11 -07:00
comparator.cc
Support read timestamp in ldb (#12641)
2024-05-13 15:43:12 -07:00
compression_context_cache.cc
internal_repo_rocksdb (435146444452818992) (#12115)
2023-12-01 11:15:17 -08:00
compression_context_cache.h
Replace namespace name "rocksdb" with ROCKSDB_NAMESPACE (#6433)
2020-02-20 12:09:57 -08:00
compression_test.cc
Verify compressed block bytes after checksum computation (#15098)
2026-08-17 12:34:23 -07:00
compression.cc
Integrated and ratio-aware compression auto-skip (#15079)
2026-08-11 14:29:51 -07:00
compression.h
Unify LZ4 and LZ4HC compression levels (#14819)
2026-06-11 14:10:21 -07:00
concurrent_task_limiter_impl.cc
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
concurrent_task_limiter_impl.h
Remove 'virtual' when implied by 'override' (#12319)
2024-01-31 13:14:42 -08:00
core_local.h
Add some more bit operations to internal APIs (#11660)
2023-08-02 11:30:10 -07:00
coro_stats_util.cc
Add native coroutine read dispatch to RocksDB (#15073)
2026-08-10 09:43:05 -07:00
coro_stats_util.h
Add native coroutine read dispatch to RocksDB (#15073)
2026-08-10 09:43:05 -07:00
coro_utils.h
Add native coroutine read dispatch to RocksDB (#15073)
2026-08-10 09:43:05 -07:00
crc32c_arm64.cc
Reformat source files (#14331)
2026-02-13 11:56:22 -08:00
crc32c_arm64.h
Reformat source files (#14331)
2026-02-13 11:56:22 -08:00
crc32c_ppc_asm.S
Fix Compilation on ppc64le using Clang 11 (#7713)
2020-12-01 11:21:44 -08:00
crc32c_ppc_constants.h
Remove PATENTS text from a few straggler files (#5326)
2019-05-21 16:22:35 -07:00
crc32c_ppc.c
Standardize on clang-format version 18 (#13233)
2024-12-19 10:58:40 -08:00
crc32c_ppc.h
Reformat source files (#14331)
2026-02-13 11:56:22 -08:00
crc32c_test.cc
Run internal cpp modernizer on RocksDB repo (#12398)
2024-03-04 10:08:32 -08:00
crc32c.cc
Run internal cpp modernizer on RocksDB repo (#12398)
2024-03-04 10:08:32 -08:00
crc32c.h
Remove unnecessary, confusing 'extern' (#12300)
2024-01-29 10:38:08 -08:00
data_structure.cc
Allow SmallEnumSet on larger enum types (#13657)
2025-06-03 19:03:38 -07:00
defer_test.cc
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
defer.h
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
dirty_tracked.h
Fix check-sources.sh non-ASCII check and remove non-ASCII from sources (#14729)
2026-05-11 17:02:22 -07:00
distributed_mutex.h
Fix race in options taking effect (#11929)
2023-10-12 10:05:23 -07:00
duplicate_detector.h
Remove RocksDB LITE (#11147)
2023-01-27 13:14:19 -08:00
dynamic_bloom_test.cc
Reformat source files (#14331)
2026-02-13 11:56:22 -08:00
dynamic_bloom.cc
Use safer atomic APIs for some memtable code (#13844)
2025-08-14 21:54:52 -07:00
dynamic_bloom.h
Use safer atomic APIs for some memtable code (#13844)
2025-08-14 21:54:52 -07:00
fastrange.h
Fix and detect headers with missing dependencies (#8893)
2021-09-10 10:00:26 -07:00
file_checksum_helper.cc
Offline file checksum manifest retriever (#13178)
2024-12-06 13:29:52 -08:00
file_checksum_helper.h
Extract shared CopyEngine [2/4] (#14946) (#14946)
2026-07-23 19:07:17 -07:00
file_reader_writer_test.cc
Support Super Block Alignment (#13909)
2025-10-01 18:20:35 -07:00
filelock_test.cc
Remove extra semi colon from internal_repo_rocksdb/repo/util/filelock_test.cc
2024-03-19 16:17:57 -07:00
filter_bench.cc
Reformat source files (#14331)
2026-02-13 11:56:22 -08:00
gflags_compat.h
Reformat source files (#14331)
2026-02-13 11:56:22 -08:00
hash128.h
Upgrade xxhash, add Hash128 (#8634)
2021-08-20 18:41:51 -07:00
hash_containers.h
Meta-internal folly integration with F14FastMap (#9546)
2022-04-13 07:34:01 -07:00
hash_map.h
Change HashMap::Insert()'s value to a const reference (#6567)
2020-03-20 14:59:54 -07:00
hash_test.cc
Reformat source files (#14331)
2026-02-13 11:56:22 -08:00
hash.cc
Experimental support for SST unique IDs (#8990)
2021-10-18 23:32:01 -07:00
hash.h
Remove unnecessary, confusing 'extern' (#12300)
2024-01-29 10:38:08 -08:00
heap_test.cc
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
heap.h
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
interval_test.cc
Start development 11.4 (#14747)
2026-05-18 13:35:11 -07:00
io_dispatcher_imp.cc
Measure IODispatcher async read latency (#15001)
2026-07-24 13:51:09 -07:00
io_dispatcher_imp.h
Introduce Memory restrictions for IO Dispatcher. (#14300)
2026-02-06 11:29:30 -08:00
io_dispatcher_test.cc
Measure IODispatcher async read latency (#15001)
2026-07-24 13:51:09 -07:00
kv_map.h
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
log_write_bench.cc
Group SST write in flush, compaction and db open with new stats (#11910)
2023-12-29 15:29:23 -08:00
math128.h
Add some more bit operations to internal APIs (#11660)
2023-08-02 11:30:10 -07:00
math.h
math.h BottomNBits: Fix integer underflow (#14231)
2026-01-27 01:26:28 -08:00
murmurhash.cc
Remove extra semi colon from internal_repo_rocksdb/repo/util/murmurhash.cc (#12270)
2024-01-24 07:39:59 -08:00
murmurhash.h
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
mutexlock.h
Fix range tombstone conversion + ingest sst and re-enable crash tests (#14654)
2026-04-23 18:59:14 -07:00
overload.h
Fix copyright header in util/overload.h (#11826)
2023-09-13 09:50:44 -07:00
ppc-opcode.h
Standardize on clang-format version 18 (#13233)
2024-12-19 10:58:40 -08:00
prefix_varint.h
Add prefix varint codec and tests (#14692)
2026-05-06 19:27:14 -07:00
random_test.cc
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
random.cc
Fix compile errors in C++23 (#12106)
2024-05-28 15:33:57 -07:00
random.h
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
rate_limiter_impl.h
Extract shared CopyEngine [2/4] (#14946) (#14946)
2026-07-23 19:07:17 -07:00
rate_limiter_test.cc
Three misc CI fixes (#14910)
2026-07-01 19:04:40 -07:00
rate_limiter.cc
Add RocksDB rate limiter I/O usage metrics (#14884)
2026-06-29 16:22:57 -07:00
repeatable_thread_test.cc
Prefer static_cast in place of most reinterpret_cast (#12308)
2024-02-07 10:44:11 -08:00
repeatable_thread.h
Use SystemClock* instead of std::shared_ptr<SystemClock> in lower level routines (#8033)
2021-03-15 04:34:11 -07:00
ribbon_alg.h
Reformat source files (#14331)
2026-02-13 11:56:22 -08:00
ribbon_config.cc
Run internal cpp modernizer on RocksDB repo (#12398)
2024-03-04 10:08:32 -08:00
ribbon_config.h
Refine Ribbon configuration, improve testing, add Homogeneous (#7879)
2021-02-26 08:50:42 -08:00
ribbon_impl.h
Remove extra semi colon from internal_repo_rocksdb/repo/util/ribbon_impl.h (#12269)
2024-01-24 08:20:50 -08:00
ribbon_test.cc
util/ribbon_test.cc: avoid ambiguous reversed operator error in c++20 (#11371)
2023-04-12 13:24:34 -07:00
semaphore.h
Revamp of parallel compression (#13910)
2025-09-14 07:38:00 -07:00
set_comparator.h
Fix and detect headers with missing dependencies (#8893)
2021-09-10 10:00:26 -07:00
simple_mixed_compressor.cc
Support pre-defined compression dictionaries (#14253)
2026-01-23 10:01:50 -08:00
simple_mixed_compressor.h
Support pre-defined compression dictionaries (#14253)
2026-01-23 10:01:50 -08:00
single_thread_executor.h
add a missing include (#11624)
2023-07-18 15:38:52 -07:00
slice_test.cc
Start format_version=8 development toward new features (#15104)
2026-08-17 12:08:59 -07:00
slice_transform_test.cc
Remove deprecated DB::Open raw pointer variants (and more) (#14335)
2026-02-17 23:33:39 -08:00
slice.cc
Fix PinnableSlice move construction from pinned slices (#14998)
2026-07-25 14:18:27 -07:00
status.cc
Support abort background compaction jobs. (#14227)
2026-01-30 05:53:04 -08:00
stderr_logger.cc
Fix truncating last character in the StderrLogger (#12620)
2024-05-06 08:53:06 -07:00
stderr_logger.h
fix the non initialized bug in StderrLogger. (#12839)
2024-07-08 15:59:02 -07:00
stop_watch.h
Pass statistics and fix null clock in SstFileReader::MultiGet (#14393)
2026-02-26 19:16:12 -08:00
string_util_test.cc
Make StringToMap entries self-contained for direct round-trip (#14805)
2026-06-01 17:07:11 -07:00
string_util.cc
Make StringToMap entries self-contained for direct round-trip (#14805)
2026-06-01 17:07:11 -07:00
string_util.h
Publish/support format_version=7, related enhancements (#13713)
2025-06-20 17:39:47 -07:00
thread_guard.h
Introduce a ThreadGuard class and use it in ExternalSSTFileTest.PickedLevelBug (#8112)
2021-03-25 22:08:58 -07:00
thread_list_test.cc
Fix and check for potential ODR violations (#14096)
2025-11-04 19:47:42 -08:00
thread_local_test.cc
Remove RocksDB LITE (#11147)
2023-01-27 13:14:19 -08:00
thread_local.cc
Run internal cpp modernizer on RocksDB repo (#12398)
2024-03-04 10:08:32 -08:00
thread_local.h
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
thread_operation.h
Lazy wide-column byte-range (partial) blob reads (#15067)
2026-08-07 12:08:03 -07:00
threadpool_imp.cc
Fix and check for potential ODR violations (#14096)
2025-11-04 19:47:42 -08:00
threadpool_imp.h
Remove 'virtual' when implied by 'override' (#12319)
2024-01-31 13:14:42 -08:00
timer_queue_test.cc
Backport internal changes (#13752)
2025-07-02 17:31:16 -07:00
timer_queue.h
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
timer_test.cc
Print stack traces on frozen tests in CI (#10828)
2022-10-18 00:35:35 -07:00
timer.h
clang-format cache/ and util/ directories (#10867)
2022-10-26 12:08:20 -07:00
udt_util_test.cc
PinnableWideColumns support for >1 backing buffer to avoid re-serialization (#14943)
2026-07-20 16:32:42 -07:00
udt_util.cc
PinnableWideColumns support for >1 backing buffer to avoid re-serialization (#14943)
2026-07-20 16:32:42 -07:00
udt_util.h
Add a new GetNewestUserDefinedTimestamp API (#13547)
2025-04-17 13:19:52 -07:00
user_comparator_wrapper.h
Make UserComparatorWrapper not Customizable (#10837)
2022-10-21 12:27:50 -07:00
vector_iterator.h
Remove 'virtual' when implied by 'override' (#12319)
2024-01-31 13:14:42 -08:00
work_queue_test.cc
Print stack traces on frozen tests in CI (#10828)
2022-10-18 00:35:35 -07:00
work_queue.h
Fix and detect headers with missing dependencies (#8893)
2021-09-10 10:00:26 -07:00
write_batch_util.cc
Add utils to use for handling user defined timestamp size record in WAL (#11451)
2023-05-22 14:28:58 -07:00
write_batch_util.h
Add timestamp support in dump_wal/dump/idump (#12690)
2024-05-23 20:26:57 -07:00
xxhash.cc
Manual interventions for clang-format util/ (#10870)
2022-10-26 12:08:20 -07:00
xxhash.h
Remove extra semi colon from internal_repo_rocksdb/repo/util/xxhash.h
2024-06-26 07:26:20 -07:00
xxph3.h
Force-inline xxph3 mix helpers on the NPHash64/Hash64 hot path (#14981)
2026-07-29 14:21:15 -07:00