1
0
mirror of https://github.com/tensorchord/pgvecto.rs.git synced 2025-07-29 08:21:12 +03:00
Commit Graph

192 Commits

Author SHA1 Message Date
44f295ce63 fix index out of bounds for large bvector
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>
v0.2.1-alpha.2
2024-02-21 17:38:21 +08:00
16c8f2c127 fix invalid cmp
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>
v0.2.1-alpha.1
2024-02-21 10:19:51 +08:00
1bd49d76b6 cargo fmt
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>
2024-02-21 01:14:45 +08:00
90e9a91ce8 cargo clippy
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>
2024-02-21 01:11:30 +08:00
3dae8dd9e6 remove unused feature
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>
2024-02-21 01:00:29 +08:00
50824d64e5 remove crate bitvec
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>
2024-02-21 00:59:06 +08:00
20f13e25fd add simd for binary vector
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>
2024-02-21 00:01:16 +08:00
c5dc49193e merge 'main' into 'feat/binary-vector'
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>
2024-02-20 17:02:04 +08:00
d50a75beb5 feat: support binary vector
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>
2024-02-20 16:33:08 +08:00
42fa5835d1 refactor: add crate "base" (#367)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-20 07:35:49 +00:00
d6e0545b93 ci: fix "cache save failed" (#366)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-20 03:59:47 +00:00
6e6902ec5c fix: python test (#365)
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>
2024-02-20 03:13:38 +00:00
10c40c052b fix docker tag (#364)
Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>
2024-02-19 11:33:49 +00:00
f0a0d4d7bc ci: increase concurrency (#362)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-19 10:12:55 +00:00
7b9ae2eef0 refactor: define detailed error types (#356)
* refactor: define detailed error types

Signed-off-by: usamoi <usamoi@outlook.com>

* do not check version in _vectors_main

Signed-off-by: usamoi <usamoi@outlook.com>

* rename NORMAL to STARTED

Signed-off-by: usamoi <usamoi@outlook.com>

* fix MacOS and FreeBSD implementation

Signed-off-by: usamoi <usamoi@outlook.com>

* fix 512KB memory leak for each session

Signed-off-by: usamoi <usamoi@outlook.com>

* remove skip on delete_threshold for fixing bincode

Signed-off-by: usamoi <usamoi@outlook.com>

* add WorkerOperations and InstanceViewOperations for name conflicts

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-19 09:36:16 +00:00
915f956ff0 fix comparsion of svector (#357)
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>
2024-02-18 09:42:24 +00:00
e7e808e835 chore: drop support for pg12, pg13 (#344)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-18 07:38:51 +00:00
d7a490c900 feat: support sparse vector (#299)
* basic support

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* cargo clippy

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* optimize for ivf

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* patch for merge

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* set vector cast to non-implicit

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* add dimension in sparse vector

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* support creating sparse vector from spilt array and kv string

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* cargo clippy

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* move vector type from Storage trait to G trait

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* export svector function by schema manually

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* spilt index and value for sparse vector

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* update offsets from u32 to usize

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* align SVecf32 to 8 && make SVecf32 support binary

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* cargo clippy

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* convert the computation to branchless

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* refactor

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* cargo fmt

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

* update to_svector arguments name

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>

---------

Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>
2024-02-18 07:16:32 +00:00
c6dabc79ea chore: consistent slice behavior with python (#352)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-07 08:09:34 +00:00
1a36641145 chore: add '-c logging_collector=on' to docker CMD (#353)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-07 08:09:30 +00:00
a4f5d28c10 refactor: refine delete RPC (#351)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-07 02:31:40 +00:00
6d4745b3ed chore: use latest commit SHA to trigger the nightly release (#342)
Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-02-05 10:47:25 +00:00
35701dd2c6 feat: support binary representation (#314)
* feat: support binary representation

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: check data corruption in send/recv

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-05 08:04:06 +00:00
ca9a1b90ea ci: fix cargo-install for pgrx patch (#341)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-05 07:03:22 +00:00
c2a1fefb23 chore: fix the nightly trigger condition (#306)
* chore: fix the nightly trigger condition

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* chore: fix the nightly trigger condition

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* change tz to shanghai

Signed-off-by: Keming <kemingyang@tensorchord.ai>

---------

Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-02-05 05:37:59 +00:00
4eb1f87ae6 fix: remove ctor (#339)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-02 10:37:07 +00:00
7ec3c88c1e feat: support vector subscript (#329)
* feat: support vector subscript

Signed-off-by: usamoi <usamoi@outlook.com>

* test: tests for vector subscript

Signed-off-by: usamoi <usamoi@outlook.com>

* test: pg14 tests

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-02 08:52:15 +00:00
b9ca5ee3c3 fix: remove openai embedding (#336)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-02 07:22:35 +00:00
c975c74314 chore: set storage = EXTERNAL by default for vector types (#321)
* chore: set storage = EXTERNAL by default for vector types

Signed-off-by: usamoi <usamoi@outlook.com>

* test: test setting storage by users

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-02 07:22:06 +00:00
b22cd7887e refactor: faster algorithm for parsing vector strings (#316)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-02 07:21:54 +00:00
f26ffba75d refactor: replace heap of heaps with loser tree in merging results (#315)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-02-02 07:21:45 +00:00
be5a816810 chore: set vbase as default search mode (#332)
Signed-off-by: Usamoi <usamoi@outlook.com>
v0.2.0
2024-02-01 10:05:08 +00:00
5b2626691e chore: nicer cast error message (#322)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-30 09:34:17 +00:00
f0cb212911 fix: workaround for upgrading from version <= 0.1.11 (#323)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-30 09:10:05 +00:00
bb80544407 fix: add schema for referring vector_index_stat (#319)
* fix: add schema for referring vector_index_stat

Signed-off-by: usamoi <usamoi@outlook.com>

* test: add test for out-of-search_path usage

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-30 07:57:28 +00:00
8efe622c35 refactor: refine upgrade process (#313)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-29 09:06:19 +00:00
48f02fcb98 chore: add rootless image (#304)
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>
2024-01-26 01:29:49 +00:00
7db181673a chore: nightly token that can trigger the release workflow (#303)
* chore: allow tag to have a v-prefix

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* debug output

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* set job output

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* fix needs

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* fix nightly token

Signed-off-by: Keming <kemingyang@tensorchord.ai>

---------

Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-01-24 06:19:18 +00:00
3b06670b9d fix: check if prefilter enabled (#302)
Signed-off-by: Usamoi <usamoi@outlook.com>
Co-authored-by: cutecutecat <junyuchen@tensorchord.ai>
2024-01-23 13:58:43 +00:00
f9277818f2 chore: allow tag to have a v-prefix (#301)
* chore: allow tag to have a v-prefix

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* debug output

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* set job output

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* fix needs

Signed-off-by: Keming <kemingyang@tensorchord.ai>

---------

Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-01-23 13:06:43 +00:00
f5e2d3e217 chore: fix release ci gh upload tag parameter (#300)
Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-01-23 10:08:30 +00:00
0aebef5dff chore: update the release & nightly action (#288)
* chore: update the release & nightly action

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* make download artifact reliable

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* verify semver

Signed-off-by: Keming <kemingyang@tensorchord.ai>

---------

Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-01-23 08:47:50 +00:00
fc93a64b75 feat: support pgvector gucs compact (#296)
* feat: support pgvector gucs compact

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>

* Update src/gucs/executing.rs

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>
Signed-off-by: usamoi <usamoi@outlook.com>
Co-authored-by: Usamoi <usamoi@outlook.com>
2024-01-22 10:06:38 +00:00
132b304811 fix: checking of user options (#297)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-22 10:02:48 +00:00
c95f99f846 fix: prevent overflow at kmeans (#287)
* fix: prevent overflow at kmeans

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>

* fix

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>

---------

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>
2024-01-22 03:24:01 +00:00
01a5774eaf chore: upload --0.2.0 schema update script (#290)
* chore: upload --0.2.0 schema update script

Signed-off-by: usamoi <usamoi@outlook.com>

* chore: simplify schema upgrade script

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-22 02:40:10 +00:00
3c3ec7119e fix: correct fp16 dot operation (#291)
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com>
2024-01-20 06:28:33 +00:00
b1590e9ff4 chore: upload 0.2.0 schema install script (#289)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-19 08:59:42 +00:00
32fcf4ec3d feat: add compat with pgvector (#256)
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>
2024-01-19 04:33:51 +00:00
b12962fc7c chore: Add test for dropping index when indexing (#283)
Signed-off-by: xieydd <xieydd@gmail.com>
2024-01-18 13:01:00 +00:00