Sean Bartell
80af41e08a
[contrib/pzstd] Prevent hangs when there are errors
...
When two threads are using a WorkQueue and the reader thread exits due
to an error, it must call WorkQueue::finish() to wake up the writer
thread. Otherwise, if the queue is full and the writer thread is waiting
for a free slot, it could hang forever.
This can happen in pratice when decompressing a large, corrupted file
that does not contain pzstd skippable frames.
2025-01-13 17:24:41 -05:00
W. Felix Handte
5d693cc38c
Coalesce Almost All Copyright Notices to Standard Phrasing
...
```
for f in $(find . \( -path ./.git -o -path ./tests/fuzz/corpora -o -path ./tests/regression/data-cache -o -path ./tests/regression/cache \) -prune -o -type f); do sed -i '/Copyright .* \(Yann Collet\)\|\(Meta Platforms\)/ s/Copyright .*/Copyright (c) Meta Platforms, Inc. and affiliates./' $f; done
git checkout HEAD -- build/VS2010/libzstd-dll/libzstd-dll.rc build/VS2010/zstd/zstd.rc tests/test-license.py contrib/linux-kernel/test/include/linux/xxhash.h examples/streaming_compression_thread_pool.c lib/legacy/zstd_v0*.c lib/legacy/zstd_v0*.h
nano ./programs/windres/zstd.rc
nano ./build/VS2010/zstd/zstd.rc
nano ./build/VS2010/libzstd-dll/libzstd-dll.rc
```
2022-12-20 12:52:34 -05:00
W. Felix Handte
7f12f24cf4
Rewrite Copyright Date Ranges from -present
to -2022
...
Apparently it's better. Somehow.
```
for f in $(find . \( -path ./.git -o -path ./tests/fuzz/corpora -o -path ./tests/regression/data-cache -o -path ./tests/regression/cache \) -prune -o -type f); do echo $f; sed -i 's/\-present/-2022/' $f; done
g co HEAD -- build/meson/
```
2022-12-20 12:44:56 -05:00
W. Felix Handte
8927f985ff
Update Copyright Headers 'Facebook' -> 'Meta Platforms'
...
```
for f in $(find . \( -path ./.git -o -path ./tests/fuzz/corpora \) -prune -o -type f);
do
sed -i 's/Facebook, Inc\./Meta Platforms, Inc. and affiliates./' $f;
done
```
2022-12-20 12:37:57 -05:00
Nick Terrell
e9797b5dc5
[pzstd] Fixes for Windows build
...
* Add `Portability.h` to fix min/max issues.
* Fix conversion warnings
* Assert that windowLog <= 23, which is currently always the case.
This could be loosened, but we aren't looking to add new functionality.
Fixes on top of PR #3375 by @eli-schwartz, which added Windows CI for contrib & programs.
2022-12-19 14:09:43 -08:00
Stephen Kitt
adb54293ab
Stop using deprecated reset?Stream functions
...
These are replaced by the corresponding context resets. When
converting resetCStream, CCtx_setPledgedSrcSize isn't called if the
source size is "unknown".
This helps reduce the reliance on "static only" symbols, as well as
reducing the use of deprecated functions.
Signed-off-by: Stephen Kitt <steve@sk2.org>
2021-02-23 21:56:01 +01:00
Nick Terrell
5aa5aa4df7
[pzstd] Fix compilation error in MinGW
2020-05-22 22:26:02 -07:00
Josh Soref
a880ca239b
Spelling ( #1582 )
...
* spelling: accidentally
* spelling: across
* spelling: additionally
* spelling: addresses
* spelling: appropriate
* spelling: assumed
* spelling: available
* spelling: builder
* spelling: capacity
* spelling: compiler
* spelling: compressibility
* spelling: compressor
* spelling: compression
* spelling: contract
* spelling: convenience
* spelling: decompress
* spelling: description
* spelling: deflate
* spelling: deterministically
* spelling: dictionary
* spelling: display
* spelling: eliminate
* spelling: preemptively
* spelling: exclude
* spelling: failure
* spelling: independence
* spelling: independent
* spelling: intentionally
* spelling: matching
* spelling: maximum
* spelling: meaning
* spelling: mishandled
* spelling: memory
* spelling: occasionally
* spelling: occurrence
* spelling: official
* spelling: offsets
* spelling: original
* spelling: output
* spelling: overflow
* spelling: overridden
* spelling: parameter
* spelling: performance
* spelling: probability
* spelling: receives
* spelling: redundant
* spelling: recompression
* spelling: resources
* spelling: sanity
* spelling: segment
* spelling: series
* spelling: specified
* spelling: specify
* spelling: subtracted
* spelling: successful
* spelling: return
* spelling: translation
* spelling: update
* spelling: unrelated
* spelling: useless
* spelling: variables
* spelling: variety
* spelling: verbatim
* spelling: verification
* spelling: visited
* spelling: warming
* spelling: workers
* spelling: with
2019-04-12 11:18:11 -07:00
Yann Collet
123fac6b6d
fix pzstd compatibility with mingw
...
some details changed with introduction of gcc7
2018-09-21 17:36:00 -07:00
Yann Collet
b0cb081dc8
last batch of header files changed to reflect new license ( #825 )
...
only remains to update contrib/linux-kernel (@terrelln)
2017-08-31 12:20:50 -07:00
Nick Terrell
f570609286
[pzstd] Fix deadlock in the case of errors
...
Fixes #720 .
2017-06-22 18:09:42 -07:00
Pádraig Brady
38a3428b37
support -Werror=format-security
...
Fedora now enables this option by default, resulting
in the following build failure:
Logging.h: In instantiation of
'void pzstd::Logger::operator()(int, const char*, Args ...)
Pzstd.cpp:413:48: required from here
Logging.h:46:17: error: format not a string literal and no format arguments
[-Werror=format-security]
std::fprintf(out_, fmt, args...);
~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~
2017-03-05 19:42:51 -08:00
Nick Terrell
bcd61586a8
[pzstd] Cast unused parameters to void
2016-11-15 17:46:28 -08:00
Nick Terrell
f147fccd0c
[pzstd] Fix frame size for small files + add logging
2016-11-15 16:39:09 -08:00
Nick Terrell
baa152e56e
[pzstd] Add Logger class
2016-10-14 15:26:55 -07:00
Nick Terrell
e9e151ce31
[pzstd] Reuse ZSTD_{C,D}Stream
2016-10-14 15:26:55 -07:00
Nick Terrell
48294b57c3
[pzstd] Put ErrorHolder into SharedState
2016-10-14 15:26:55 -07:00
Nick Terrell
9b603ee284
[pzstd] Run the reading thread separately
2016-10-14 15:26:55 -07:00
Nick Terrell
96e0702c00
[pzstd] Print the correct width ints
2016-10-14 15:26:55 -07:00
Nick Terrell
b0f6d73002
[pzstd] Remove empty else statement
2016-10-06 12:58:23 -07:00
Nick Terrell
3980167488
[pzstd] Add status update for MB written
2016-09-23 15:47:26 -07:00
Nick Terrell
d249889b9f
[pzstd] Print (de)compression results
2016-09-23 13:42:50 -07:00
Nick Terrell
5eaf5da723
[pzstd] Turn on warnings + quiet them
2016-09-22 16:12:29 -07:00
Nick Terrell
0a5910b23b
[pzstd] Fix and test 32 bit support
2016-09-21 17:47:09 -07:00
Nick Terrell
5c9adff7f8
[pzstd] Check if input is a directory
2016-09-21 16:25:08 -07:00
Nick Terrell
1c209a4feb
[pzstd] Reduce memory usage to 60-75% of previous
2016-09-21 15:12:23 -07:00
Nick Terrell
254c5b1692
[pzstd] Make CLI compatible with zstd
2016-09-21 14:29:47 -07:00
Nick Terrell
4d4d1ad3b3
Fix minor potential narrowing bug
2016-09-06 20:27:11 -07:00
Nick Terrell
823bf3d08d
Fix invalid narrowing conversion to size_t
2016-09-06 20:11:02 -07:00
Nick Terrell
378d12bb0c
[pzstd] Changes to compile on VS2015
2016-09-06 12:43:07 -07:00
Nick Terrell
9622fe499d
Fix memory usage issues.
2016-09-02 20:11:22 -07:00
Nick Terrell
c932520960
Add PZstandard to contrib/
2016-09-01 15:25:31 -07:00