lib/zstd

mirror of https://github.com/facebook/zstd.git synced 2025-11-25 23:43:06 +03:00

Files

Elliot Gorokhovsky 2a402626dd External matchfinder API (#3333 )

* First building commit with sample matchfinder

* Set up ZSTD_externalMatchCtx struct

* move seqBuffer to ZSTD_Sequence*

* support non-contiguous dictionary

* clean up parens

* add clearExternalMatchfinder, handle allocation errors

* Add useExternalMatchfinder cParam

* validate useExternalMatchfinder cParam

* Disable LDM + external matchfinder

* Check for static CCtx

* Validate mState and mStateDestructor

* Improve LDM check to cover both branches

* Error API with optional fallback

* handle RLE properly for external matchfinder

* nit

* Move to a CDict-like model for resource ownership

* Add hidden useExternalMatchfinder bool to CCtx_params_s

* Eliminate malloc, move to cwksp allocation

* Handle CCtx reset properly

* Ensure seqStore has enough space for external sequences

* fix capitalization

* Add DEBUGLOG statements

* Add compressionLevel param to matchfinder API

* fix c99 issues and add a param combination error code

* nits

* Test external matchfinder API

* C90 compat for simpleExternalMatchFinder

* Fix some @nocommits and an ASAN bug

* nit

* nit

* nits

* forward declare copySequencesToSeqStore functions in zstd_compress_internal.h

* nit

* nit

* nits

* Update copyright headers

* Fix CMake zstreamtest build

* Fix copyright headers (again)

* typo

* Add externalMatchfinder demo program to make contrib

* Reduce memory consumption for small blockSize

* ZSTD_postProcessExternalMatchFinderResult nits

* test sum(matchlen) + sum(litlen) == srcSize in debug builds

* refExternalMatchFinder -> registerExternalMatchFinder

* C90 nit

* zstreamtest nits

* contrib nits

* contrib nits

* allow block splitter + external matchfinder, refactor

* add windowSize param

* add contrib/externalMatchfinder/README.md

* docs

* go back to old RLE heuristic because of the first block issue

* fix initializer element is not a constant expression

* ref contrib from zstd.h

* extremely pedantic compiler warning fix, meson fix, typo fix

* Additional docs on API limitations

* minor nits

* Refactor maxNbSeq calculation into a helper function

* Fix copyright

2022-12-28 16:45:14 -05:00

cmake

External matchfinder API (#3333 )

2022-12-28 16:45:14 -05:00

meson

External matchfinder API (#3333 )

2022-12-28 16:45:14 -05:00

single_file_libs

Coalesce Almost All Copyright Notices to Standard Phrasing

2022-12-20 12:52:34 -05:00

VS2008

AsyncIO compression part 1 - refactor of existing asyncio code (#3021 )

2022-01-24 14:43:02 -08:00

VS2010

Coalesce Almost All Copyright Notices to Standard Phrasing

2022-12-20 12:52:34 -05:00

VS_scripts

add msvc2019 to build.generic.cmd

2021-09-19 10:28:16 +08:00

.gitignore

fix gitignore errors

2019-07-09 21:08:13 +08:00

LICENSE

Add support for --output-dir-flat

2019-10-02 11:08:20 -04:00

README.md

added back documentation/notification for VS2005 in build directory

2017-06-02 10:25:30 -07:00

README.md

Projects for various integrated development environments (IDE)

Included projects

The following projects are included with the zstd distribution:

cmake - CMake project contributed by Artyom Dymchenko
VS2005 - Visual Studio 2005 Project (this project has been moved to the contrib directory and will no longer be supported)
VS2008 - Visual Studio 2008 project
VS2010 - Visual Studio 2010 project (which also works well with Visual Studio 2012, 2013, 2015)
VS_scripts - command line scripts prepared for Visual Studio compilation without IDE

How to compile zstd with Visual Studio

Install Visual Studio e.g. VS 2015 Community Edition (it's free).
Download the latest version of zstd from https://github.com/facebook/zstd/releases
Decompress ZIP archive.
Go to decompressed directory then to projects then VS2010 and open zstd.sln
Visual Studio will ask about converting VS2010 project to VS2015 and you should agree.
Change Debug to Release and if you have 64-bit Windows change also Win32 to x64.
Press F7 on keyboard or select BUILD from the menu bar and choose Build Solution.
If compilation will be fine a compiled executable will be in projects\VS2010\bin\x64\Release\zstd.exe

Projects available within zstd.sln

The Visual Studio solution file visual\VS2010\zstd.sln contains many projects that will be compiled to the visual\VS2010\bin\$(Platform)_$(Configuration) directory. For example zstd set to x64 and Release will be compiled to visual\VS2010\bin\x64_Release\zstd.exe. The solution file contains the following projects:

zstd : Command Line Utility, supporting gzip-like arguments
datagen : Synthetic and parametrable data generator, for tests
fullbench : Precisely measure speed for each zstd inner functions
fuzzer : Test tool, to check zstd integrity on target platform
libzstd : A static ZSTD library compiled to libzstd_static.lib
libzstd-dll : A dynamic ZSTD library (DLL) compiled to libzstd.dll with the import library libzstd.lib
fullbench-dll : The fullbench program compiled with the import library; the executable requires ZSTD DLL

Using ZSTD DLL with Microsoft Visual C++ project

The header file lib\zstd.h and the import library visual\VS2010\bin\$(Platform)_$(Configuration)\libzstd.lib are required to compile a project using Visual C++.

The path to header files should be added to Additional Include Directories that can be found in Project Properties of Visual Studio IDE in the C/C++ Property Pages on the General page.
The import library has to be added to Additional Dependencies that can be found in Project Properties in the Linker Property Pages on the Input page. If one will provide only the name libzstd.lib without a full path to the library then the directory has to be added to Linker\General\Additional Library Directories.

The compiled executable will require ZSTD DLL which is available at visual\VS2010\bin\$(Platform)_$(Configuration)\libzstd.dll.