1
0
mirror of https://github.com/tensorchord/pgvecto.rs.git synced 2025-04-18 21:44:00 +03:00

316 Commits

Author SHA1 Message Date
Keming
2b290b34e8
docs: update to ghcr in README (#642)
Signed-off-by: Keming <kemingyang@tensorchord.ai>
2025-02-26 14:11:26 +00:00
Keming
ca3e144d03
docs: add 'migrate to vectorchord' in readme (#640)
Signed-off-by: Keming <kemingyang@tensorchord.ai>
2025-02-24 05:34:48 +00:00
Keming
8ebab135a1
chore: fix ghcr release (#639)
* test ghcr action

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* fix if

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* fix test

Signed-off-by: Keming <kemingyang@tensorchord.ai>

---------

Signed-off-by: Keming <kemingyang@tensorchord.ai>
2025-02-24 04:36:17 +00:00
Keming
490fd2396d
chore: run rust test on ubuntu 22.04 (#638)
Signed-off-by: Keming <kemingyang@tensorchord.ai>
2025-02-24 04:09:41 +00:00
Tobias Diez
0dccfb49d0
feat: push docker image also to Github registry (#605)
* feat: push docker image also to Github registry

* align the image name

Signed-off-by: Keming <kemingyang@tensorchord.ai>

---------

Signed-off-by: Keming <kemingyang@tensorchord.ai>
Co-authored-by: Keming <kemingyang@tensorchord.ai>
2025-02-24 11:57:20 +08:00
Keming
eb9fbaee14
docs: fix discord and x badge (#632)
Signed-off-by: Keming <kemingyang@tensorchord.ai>
2025-01-17 20:07:41 +08:00
Ce Gao
ae115754d9
chore: Fix links (#627)
Signed-off-by: Ce Gao <gaocegege@hotmail.com>
2025-01-01 17:36:50 +08:00
cutecutecat
06e1c76898
fix: confict typmod for _vectors_cast_array_to_vecf32 (#617)
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>
v0.4.0
2024-11-21 11:51:00 +00:00
cutecutecat
21656e4912
release: v0.4.0 (#615)
* release: v0.4.0

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>

* fix by comment

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>

---------

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>
2024-11-20 11:00:00 +00:00
xieydd
93e5cf4eb1
Release enterprise ci (#613)
* fix aarch64 ci

Signed-off-by: xieydd <xieydd@gmail.com>

* add arch to pg-slim image

Signed-off-by: xieydd <xieydd@gmail.com>

* trunk not support pg17 yet

Signed-off-by: xieydd <xieydd@gmail.com>

* trunk not support pg17 yet

Signed-off-by: xieydd <xieydd@gmail.com>

* set lib dir

Signed-off-by: xieydd <xieydd@gmail.com>

* fix env error

Signed-off-by: xieydd <xieydd@gmail.com>

* fix ARG error

Signed-off-by: xieydd <xieydd@gmail.com>

* delete arm64

Signed-off-by: xieydd <xieydd@gmail.com>

* give postgres tmp permission

Signed-off-by: xieydd <xieydd@gmail.com>

* delete aarch64 binary release

Signed-off-by: xieydd <xieydd@gmail.com>

* delete tmp dir chmod

Signed-off-by: xieydd <xieydd@gmail.com>

* change postgres default datadir to var/lib/postgresql/data/tensorchord

Signed-off-by: xieydd <xieydd@gmail.com>

* delete slim arm support

Signed-off-by: xieydd <xieydd@gmail.com>

* fix

Signed-off-by: xieydd <xieydd@gmail.com>

* fix

Signed-off-by: xieydd <xieydd@gmail.com>

* debug

Signed-off-by: xieydd <xieydd@gmail.com>

* debug

Signed-off-by: xieydd <xieydd@gmail.com>

* debug

Signed-off-by: xieydd <xieydd@gmail.com>

* debug

Signed-off-by: xieydd <xieydd@gmail.com>

* debug

Signed-off-by: xieydd <xieydd@gmail.com>

* debug

Signed-off-by: xieydd <xieydd@gmail.com>

* debug

Signed-off-by: xieydd <xieydd@gmail.com>

* add exts suffix avoid cover old image

Signed-off-by: xieydd <xieydd@gmail.com>

---------

Signed-off-by: xieydd <xieydd@gmail.com>
2024-11-20 03:23:23 +00:00
xieydd
cc4776fec0
fix dockerfile pg version error (#611)
Signed-off-by: xieydd <xieydd@gmail.com>
2024-11-05 07:49:15 +00:00
xieydd
1b97989740
fix docker build ci context error (#610)
Signed-off-by: xieydd <xieydd@gmail.com>
2024-11-05 07:24:32 +00:00
xieydd
60cedfa06e
change requirement fix security issue (#609)
Signed-off-by: xieydd <xieydd@gmail.com>
2024-11-04 11:35:01 +00:00
xieydd
e5904efc94
ci: add pg slim, cnpg Dockerfile and add ci (#608)
* ci: add pg slim, cnpg Dockerfile and add ci

Signed-off-by: xieydd <xieydd@gmail.com>

* manual trigger

Signed-off-by: xieydd <xieydd@gmail.com>

* add plpython3u to default package extensions

Signed-off-by: xieydd <xieydd@gmail.com>

* delete test image

Signed-off-by: xieydd <xieydd@gmail.com>

* fix in comments

Signed-off-by: xieydd <xieydd@gmail.com>

---------

Signed-off-by: xieydd <xieydd@gmail.com>
2024-11-04 03:57:21 +00:00
usamoi
c6da93927b
fix: aarch64 release CI (#606)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-10-15 09:03:36 +00:00
usamoi
f7c766d68e
chore: update pgrx to 0.12.5 & add pg17 in check and release (#600)
* chore: update pgrx to 0.12.5 & add pg17 in check and release

Signed-off-by: usamoi <usamoi@outlook.com>

* chore: update vendor

* fix: set pgrx version

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: clippy

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: do not use mul_add

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: temporarily removes the test that fails on PostgreSQL 17

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-10-09 08:40:22 +00:00
usamoi
b3d32439a6
feat: mark GUC prefix reserved (#599)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-09-24 03:47:51 +00:00
usamoi
64c5a7d92e
refactor: improve SQ&PQ scan performance (#598)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-09-23 11:15:29 +00:00
usamoi
1d723fe248
refactor: make SQ build & preprocess faster (#596)
* chore: rename inverted_index to sparse_inverted_index

Signed-off-by: usamoi <usamoi@outlook.com>

* refactor: make scalar quantization faster

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-09-23 07:50:33 +00:00
usamoi
22904a69ef
fix: reduce length of directory name (#588)
Signed-off-by: usamoi <usamoi@outlook.com>
v0.4.0-alpha.2
2024-09-23 01:57:51 +00:00
usamoi
b4f5870ce3
refactor: use transposed centroids in PQ preprocess (#594)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-09-20 10:55:40 +00:00
JulyOS
003e065191
docs: delete sparse vector search comparison in readme (#595)
Signed-off-by: jinweios <jinwei.peng@beingthink.com>
2024-09-20 07:08:27 +00:00
usamoi
12aca46ff6
refactor: rabitq (#593)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-09-19 03:42:33 +00:00
cutecutecat
bb461896c6
feat: add metrics dot and cos (#566)
* feat: add metrics dot and cos

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>

* add option residual_quantization

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>

* deprecate residual except l2

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>

* fix by comments

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>

---------

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>
2024-09-18 07:58:09 +00:00
usamoi
1ed47d8e00
refactor: rework quantization abstraction (#591)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-09-18 02:48:27 +00:00
usamoi
8abfd8229b
fix: set correct svecf32 header while creating SVecf32Output (#590)
Signed-off-by: usamoi <usamoi@outlook.com>
v0.4.0-alpha.1
2024-09-05 02:11:08 +00:00
usamoi
2e20358503
fix: use correct intrinsics for fp16 in AVX (#589)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-09-04 08:24:35 +00:00
Keming
f72c5a82c1
fix: detect simd in cli (#586)
Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-09-02 12:41:50 +00:00
usamoi
897b9a320c
fix: filter zeros in creating normalized vector (#585)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-09-02 11:27:57 +00:00
usamoi
1fb14c8b92
feat: speed rabitq building (#584)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-09-02 09:59:06 +00:00
usamoi
3b7c6946c2
feat: do not generate slow-scan lookup table if fast-scan is enabled (#583)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-09-02 09:54:32 +00:00
usamoi
590a9d60b2
fix: use u32 for rabitq quantized sum for DIM > 4369 (#582)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-09-02 09:09:51 +00:00
usamoi
4bac4847ce
fix: use residual vector for encoding (#581)
* refactor: merge IvfNaive and IvfResidual

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: use residual vector for encoding

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-09-02 04:33:00 +00:00
Keming
827c7c3af4
fix build in enterprise ci (#580)
Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-08-30 17:51:48 +08:00
usamoi
f24bef2785
feat: disable kmeans++ in IVF (#579)
* feat: disable kmeans++ in IVF

Signed-off-by: usamoi <usamoi@outlook.com>

* test: remove flasky test

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-30 08:56:11 +00:00
Keming
a71e9ef80b
chore: add enterprise release (#578)
---------

Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-08-30 15:37:56 +08:00
usamoi
8727ce3679
refactor: improve RaBitQ performance (#576)
* feat: mark Distance::from_f32 and Distance::to_f32 as const

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: compute rough distances on boundary by fast scan if fast scan is used

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: visit IVF centroids in order

Signed-off-by: usamoi <usamoi@outlook.com>

* refactor: rabitq abs

Signed-off-by: usamoi <usamoi@outlook.com>

* refactor: rewrite error-based reranker

Signed-off-by: usamoi <usamoi@outlook.com>

* feat: compute all distances from vectors to centroids in IVF parallelly

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: speed computing x2 in preprocessing

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: speed gen in preprocessing

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: parallelize kmeans++

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: add prefer_multithreading to k_means

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: increase kmeans samples in IVF

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: move spherical operation after split_clusters in kmeans

Signed-off-by: usamoi <usamoi@outlook.com>

* test: strengthen AVX2/AVX512 code tests and remove flasky bvector test

Signed-off-by: usamoi <usamoi@outlook.com>

* feat: fallback version of fast scan

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: rename mul_add to mul_add_round

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-30 04:16:14 +00:00
usamoi
b7e1a7a010
feat: SIMD version of quantizing (#574)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-27 10:19:05 +00:00
usamoi
165b7de9c9
fix: vectorize as much code as possible (#569)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-27 02:15:04 +00:00
usamoi
d259b24da3
refactor: introduce Distance type for comparing (#568)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-22 11:28:34 +00:00
usamoi
86bbed2bff
chore: update pgrx to v0.12.1 (#567)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-22 04:54:33 +00:00
usamoi
ab1edc9777
feat: pyo3 bindings of indexing (#565)
* feat: pyo3 bindings of indexing

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: ci

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-20 02:01:07 +00:00
usamoi
20e84ca9a2
refactor: reduce cost about sort and quantization virtual function call (#560)
* refactor: use internal id and reduce cost on sort

Signed-off-by: usamoi <usamoi@outlook.com>

* refactor: reduce cost of quantization virtual function call

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: hnsw nan behavior

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-15 03:46:36 +00:00
usamoi
813c04d797
fix: add v4, v3 for vecf32 dot, sl2 (#559)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-14 11:12:40 +00:00
usamoi
94e4e2f970
fix: hnsw rebuilding (#558)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-14 03:38:45 +00:00
Ce Gao
835c4a7172
chore: Refine readme (#553)
* chore: Refine

Signed-off-by: Ce Gao <cegao@tensorchord.ai>

* chore: Address comments

Signed-off-by: Ce Gao <cegao@tensorchord.ai>

---------

Signed-off-by: Ce Gao <cegao@tensorchord.ai>
2024-08-14 10:22:03 +08:00
usamoi
286c3c9679
test: fix cos test by comparing shorter result list (#557)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-13 08:58:09 +00:00
usamoi
8c9080d506
fix: rabitq (#556)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-13 08:22:00 +00:00
usamoi
487ea6ba49
refactor: remove indexing on cosine similarity on backend (#555)
* fix: remove indexing on cosine distance on backend

Signed-off-by: usamoi <usamoi@outlook.com>

* refactor: removes unused cosine code

Signed-off-by: usamoi <usamoi@outlook.com>

* add tests

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-12 09:24:17 +00:00
usamoi
be5221958a
fix: add spherical_centroids & residual_quantization option to ivf (#551)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-08-09 10:49:19 +00:00