44f295ce63
fix index out of bounds for large bvector
...
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
v0.2.1-alpha.2
2024-02-21 17:38:21 +08:00
16c8f2c127
fix invalid cmp
...
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
v0.2.1-alpha.1
2024-02-21 10:19:51 +08:00
1bd49d76b6
cargo fmt
...
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
2024-02-21 01:14:45 +08:00
90e9a91ce8
cargo clippy
...
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
2024-02-21 01:11:30 +08:00
3dae8dd9e6
remove unused feature
...
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
2024-02-21 01:00:29 +08:00
50824d64e5
remove crate bitvec
...
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
2024-02-21 00:59:06 +08:00
20f13e25fd
add simd for binary vector
...
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
2024-02-21 00:01:16 +08:00
c5dc49193e
merge 'main' into 'feat/binary-vector'
...
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
2024-02-20 17:02:04 +08:00
d50a75beb5
feat: support binary vector
...
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
2024-02-20 16:33:08 +08:00
42fa5835d1
refactor: add crate "base" ( #367 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-20 07:35:49 +00:00
d6e0545b93
ci: fix "cache save failed" ( #366 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-20 03:59:47 +00:00
6e6902ec5c
fix: python test ( #365 )
...
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai >
2024-02-20 03:13:38 +00:00
10c40c052b
fix docker tag ( #364 )
...
Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai >
2024-02-19 11:33:49 +00:00
f0a0d4d7bc
ci: increase concurrency ( #362 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-19 10:12:55 +00:00
7b9ae2eef0
refactor: define detailed error types ( #356 )
...
* refactor: define detailed error types
Signed-off-by: usamoi <usamoi@outlook.com >
* do not check version in _vectors_main
Signed-off-by: usamoi <usamoi@outlook.com >
* rename NORMAL to STARTED
Signed-off-by: usamoi <usamoi@outlook.com >
* fix MacOS and FreeBSD implementation
Signed-off-by: usamoi <usamoi@outlook.com >
* fix 512KB memory leak for each session
Signed-off-by: usamoi <usamoi@outlook.com >
* remove skip on delete_threshold for fixing bincode
Signed-off-by: usamoi <usamoi@outlook.com >
* add WorkerOperations and InstanceViewOperations for name conflicts
Signed-off-by: usamoi <usamoi@outlook.com >
---------
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-19 09:36:16 +00:00
915f956ff0
fix comparsion of svector ( #357 )
...
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
2024-02-18 09:42:24 +00:00
e7e808e835
chore: drop support for pg12, pg13 ( #344 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-18 07:38:51 +00:00
d7a490c900
feat: support sparse vector ( #299 )
...
* basic support
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* cargo clippy
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* optimize for ivf
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* patch for merge
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* set vector cast to non-implicit
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* add dimension in sparse vector
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* support creating sparse vector from spilt array and kv string
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* cargo clippy
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* move vector type from Storage trait to G trait
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* export svector function by schema manually
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* spilt index and value for sparse vector
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* update offsets from u32 to usize
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* align SVecf32 to 8 && make SVecf32 support binary
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* cargo clippy
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* convert the computation to branchless
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* refactor
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* cargo fmt
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
* update to_svector arguments name
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
---------
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
2024-02-18 07:16:32 +00:00
c6dabc79ea
chore: consistent slice behavior with python ( #352 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-07 08:09:34 +00:00
1a36641145
chore: add '-c logging_collector=on' to docker CMD ( #353 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-07 08:09:30 +00:00
a4f5d28c10
refactor: refine delete RPC ( #351 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-07 02:31:40 +00:00
6d4745b3ed
chore: use latest commit SHA to trigger the nightly release ( #342 )
...
Signed-off-by: Keming <kemingyang@tensorchord.ai >
2024-02-05 10:47:25 +00:00
35701dd2c6
feat: support binary representation ( #314 )
...
* feat: support binary representation
Signed-off-by: usamoi <usamoi@outlook.com >
* fix: check data corruption in send/recv
Signed-off-by: usamoi <usamoi@outlook.com >
---------
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-05 08:04:06 +00:00
ca9a1b90ea
ci: fix cargo-install for pgrx patch ( #341 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-05 07:03:22 +00:00
c2a1fefb23
chore: fix the nightly trigger condition ( #306 )
...
* chore: fix the nightly trigger condition
Signed-off-by: Keming <kemingyang@tensorchord.ai >
* chore: fix the nightly trigger condition
Signed-off-by: Keming <kemingyang@tensorchord.ai >
* change tz to shanghai
Signed-off-by: Keming <kemingyang@tensorchord.ai >
---------
Signed-off-by: Keming <kemingyang@tensorchord.ai >
2024-02-05 05:37:59 +00:00
4eb1f87ae6
fix: remove ctor ( #339 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-02 10:37:07 +00:00
7ec3c88c1e
feat: support vector subscript ( #329 )
...
* feat: support vector subscript
Signed-off-by: usamoi <usamoi@outlook.com >
* test: tests for vector subscript
Signed-off-by: usamoi <usamoi@outlook.com >
* test: pg14 tests
Signed-off-by: usamoi <usamoi@outlook.com >
---------
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-02 08:52:15 +00:00
b9ca5ee3c3
fix: remove openai embedding ( #336 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-02 07:22:35 +00:00
c975c74314
chore: set storage = EXTERNAL by default for vector types ( #321 )
...
* chore: set storage = EXTERNAL by default for vector types
Signed-off-by: usamoi <usamoi@outlook.com >
* test: test setting storage by users
Signed-off-by: usamoi <usamoi@outlook.com >
---------
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-02 07:22:06 +00:00
b22cd7887e
refactor: faster algorithm for parsing vector strings ( #316 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-02 07:21:54 +00:00
f26ffba75d
refactor: replace heap of heaps with loser tree in merging results ( #315 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-02-02 07:21:45 +00:00
be5a816810
chore: set vbase
as default search mode ( #332 )
...
Signed-off-by: Usamoi <usamoi@outlook.com >
v0.2.0
2024-02-01 10:05:08 +00:00
5b2626691e
chore: nicer cast error message ( #322 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-01-30 09:34:17 +00:00
f0cb212911
fix: workaround for upgrading from version <= 0.1.11 ( #323 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-01-30 09:10:05 +00:00
bb80544407
fix: add schema for referring vector_index_stat ( #319 )
...
* fix: add schema for referring vector_index_stat
Signed-off-by: usamoi <usamoi@outlook.com >
* test: add test for out-of-search_path usage
Signed-off-by: usamoi <usamoi@outlook.com >
---------
Signed-off-by: usamoi <usamoi@outlook.com >
2024-01-30 07:57:28 +00:00
8efe622c35
refactor: refine upgrade process ( #313 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-01-29 09:06:19 +00:00
48f02fcb98
chore: add rootless image ( #304 )
...
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai >
2024-01-26 01:29:49 +00:00
7db181673a
chore: nightly token that can trigger the release workflow ( #303 )
...
* chore: allow tag to have a v-prefix
Signed-off-by: Keming <kemingyang@tensorchord.ai >
* debug output
Signed-off-by: Keming <kemingyang@tensorchord.ai >
* set job output
Signed-off-by: Keming <kemingyang@tensorchord.ai >
* fix needs
Signed-off-by: Keming <kemingyang@tensorchord.ai >
* fix nightly token
Signed-off-by: Keming <kemingyang@tensorchord.ai >
---------
Signed-off-by: Keming <kemingyang@tensorchord.ai >
2024-01-24 06:19:18 +00:00
3b06670b9d
fix: check if prefilter enabled ( #302 )
...
Signed-off-by: Usamoi <usamoi@outlook.com >
Co-authored-by: cutecutecat <junyuchen@tensorchord.ai >
2024-01-23 13:58:43 +00:00
f9277818f2
chore: allow tag to have a v-prefix ( #301 )
...
* chore: allow tag to have a v-prefix
Signed-off-by: Keming <kemingyang@tensorchord.ai >
* debug output
Signed-off-by: Keming <kemingyang@tensorchord.ai >
* set job output
Signed-off-by: Keming <kemingyang@tensorchord.ai >
* fix needs
Signed-off-by: Keming <kemingyang@tensorchord.ai >
---------
Signed-off-by: Keming <kemingyang@tensorchord.ai >
2024-01-23 13:06:43 +00:00
f5e2d3e217
chore: fix release ci gh upload tag parameter ( #300 )
...
Signed-off-by: Keming <kemingyang@tensorchord.ai >
2024-01-23 10:08:30 +00:00
0aebef5dff
chore: update the release & nightly action ( #288 )
...
* chore: update the release & nightly action
Signed-off-by: Keming <kemingyang@tensorchord.ai >
* make download artifact reliable
Signed-off-by: Keming <kemingyang@tensorchord.ai >
* verify semver
Signed-off-by: Keming <kemingyang@tensorchord.ai >
---------
Signed-off-by: Keming <kemingyang@tensorchord.ai >
2024-01-23 08:47:50 +00:00
fc93a64b75
feat: support pgvector gucs compact ( #296 )
...
* feat: support pgvector gucs compact
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai >
* Update src/gucs/executing.rs
Signed-off-by: usamoi <usamoi@outlook.com >
---------
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai >
Signed-off-by: usamoi <usamoi@outlook.com >
Co-authored-by: Usamoi <usamoi@outlook.com >
2024-01-22 10:06:38 +00:00
132b304811
fix: checking of user options ( #297 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-01-22 10:02:48 +00:00
c95f99f846
fix: prevent overflow at kmeans ( #287 )
...
* fix: prevent overflow at kmeans
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai >
* fix
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai >
---------
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai >
2024-01-22 03:24:01 +00:00
01a5774eaf
chore: upload --0.2.0 schema update script ( #290 )
...
* chore: upload --0.2.0 schema update script
Signed-off-by: usamoi <usamoi@outlook.com >
* chore: simplify schema upgrade script
Signed-off-by: usamoi <usamoi@outlook.com >
---------
Signed-off-by: usamoi <usamoi@outlook.com >
2024-01-22 02:40:10 +00:00
3c3ec7119e
fix: correct fp16 dot operation ( #291 )
...
Signed-off-by: Mingzhuo Yin <yinmingzhuo@gmail.com >
2024-01-20 06:28:33 +00:00
b1590e9ff4
chore: upload 0.2.0 schema install script ( #289 )
...
Signed-off-by: usamoi <usamoi@outlook.com >
2024-01-19 08:59:42 +00:00
32fcf4ec3d
feat: add compat with pgvector ( #256 )
...
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai >
2024-01-19 04:33:51 +00:00
b12962fc7c
chore: Add test for dropping index when indexing ( #283 )
...
Signed-off-by: xieydd <xieydd@gmail.com >
2024-01-18 13:01:00 +00:00