1
0
mirror of https://github.com/tensorchord/pgvecto.rs.git synced 2025-07-30 19:23:05 +03:00
Commit Graph

192 Commits

Author SHA1 Message Date
2b95a23325 fix: promise flushing when committing (#280)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-17 12:37:07 +00:00
727d69feab feat: transactional CREATE/DROP (#279)
* feat: transactional CREATE/DROP

Signed-off-by: usamoi <usamoi@outlook.com>

* test: transaction ddl

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-17 11:47:02 +00:00
db44d237b4 fix: docker CMD instruction (#278)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-17 03:49:10 +00:00
da6686e823 chore: set schema and search_path (#273)
* chore: set schema and search_path

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: remove unnecessary changes

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: set search_path for docker

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: ci

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: docker

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: search_path search order

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-16 07:34:10 +00:00
0e5fb8b029 docs: Refine readme (#274)
* update readme

Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>

* Refined pgvecto.rs features and documentation

Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>

* Fix formatting in README.md

Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>

* Update pgvecto.rs capabilities

Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>

---------

Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>
2024-01-16 07:30:27 +00:00
30a0f7043b chore: add test for partition/partial/fp16 index (#276)
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>
2024-01-16 06:00:53 +00:00
5906085651 docs: add JoePassanante as a contributor for code (#271)
* docs: update README.md

* docs: update .all-contributorsrc

---------

Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com>
2024-01-15 16:15:57 +08:00
e1fde86249 feat: Add vector to vecf16 CAST (#266)
Signed-off-by: jepassanante <j.e.passanante@gmail.com>
2024-01-14 04:26:59 +00:00
64af11e8cf docs: advice developers to setup all PostgreSQL versions (#265)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-13 09:02:36 +00:00
97ebbf7996 chore: stable schema generation (#254)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-11 07:23:52 +00:00
4bdf192412 refactor: orthogonal support of vbase and prefilter (#248)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-10 12:22:19 +00:00
98622ed077 chore: add crash test (#242)
* chore: add crash test

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>

* fix

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>

---------

Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>
2024-01-09 08:13:13 +00:00
cbd42caa89 refactor: rework vbase (#238)
* refactor: rework vbase abstraction and remove HNSW vbase implementation

Signed-off-by: usamoi <usamoi@outlook.com>

* refactor: rework HNSW vbase implementation

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-08 02:25:58 +00:00
5b16fc2311 fix: simpler logic for IPC connection reusing (#240)
* fix: set correct size for UDS ancillary buffer

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: simpler logic for IPC connection reusing

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-07 16:41:42 +00:00
4aafd8c312 fix: cosine distance (#231)
* fix: cosine distance

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* fix sq and pq

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* fix doc

Signed-off-by: Keming <kemingyang@tensorchord.ai>

---------

Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-01-06 14:23:21 +00:00
f30a10c27b fix: typo (#237)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-06 12:02:18 +00:00
a7a9a592c1 chore: Refine readme (#234)
Signed-off-by: Ce Gao <cegao@tensorchord.ai>
2024-01-05 12:27:39 +00:00
57f3725ce8 docs: add cutecutecat as a contributor for code (#235)
* docs: update README.md

* docs: update .all-contributorsrc

---------

Co-authored-by: allcontributors[bot] <46447321+allcontributors[bot]@users.noreply.github.com>
2024-01-05 17:51:00 +08:00
1411fefccf docs: development docs (#226)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-05 08:45:30 +00:00
dde112a37a chore: friendly OOM message (#223)
Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-05 02:36:46 +00:00
eb44c263b6 chore: fix typos (#228)
Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-01-04 06:24:45 +00:00
16af21314b chore: fix python action image tag (#229)
* chore: fix python action image tag

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* add gh token

Signed-off-by: Keming <kemingyang@tensorchord.ai>

---------

Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-01-04 06:24:23 +00:00
d0349f1aa8 chore: fine-grained upgrade hint (#220)
* chore: upgrade instruction for every index

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: soft_version check

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: index_stat view if need upgrade

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: size info of write segment

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-03 09:19:11 +00:00
3ae8ff2ad9 chore: upgrade scripts for unsupported version (#221)
* chore: upgrade scripts for unsupported version

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: release ci

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2024-01-03 09:19:00 +00:00
5669253a98 feat: show index size in index info table (#222)
* feat: show index size in index info table

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* fix clippy

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* compute all the file for sealed segments

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* fix dir_size

Signed-off-by: Keming <kemingyang@tensorchord.ai>

* display the sum size in the table

Signed-off-by: Keming <kemingyang@tensorchord.ai>

---------

Signed-off-by: Keming <kemingyang@tensorchord.ai>
2024-01-03 07:39:58 +00:00
e530742f0f feat: add nprobe into guc (#212)
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
2023-12-29 07:14:04 +00:00
2dc6b721f3 chore: move memfd detect to detect crate (#213)
Signed-off-by: usamoi <usamoi@outlook.com>
2023-12-28 11:14:55 +00:00
4d34b45b23 fix: upgrade instructions (#203)
* fix: upgrade instructions

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: rename scripts to install

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: ipc error-handling

Signed-off-by: usamoi <usamoi@outlook.com>

* feat: soft version

Signed-off-by: usamoi <usamoi@outlook.com>

* chore: freebsd

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2023-12-28 08:16:22 +00:00
78cc08b49d chore: stable latest (#209)
Signed-off-by: cutecutecat <junyuchen@tensorchord.ai>
2023-12-28 06:32:13 +00:00
4f60c4c824 feat: allow user to set vbase range (#206)
* feat: allow user to set vbase range

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* separate the enable_vbase and vbase_range settings

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

---------

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>
2023-12-27 06:32:23 +00:00
7a2eb0a635 fix: fallback for memfd (kernel 3.17) (#204)
Signed-off-by: usamoi <usamoi@outlook.com>
2023-12-19 15:05:54 +00:00
5bd1792ee0 fix: do not config cross compilation in config.toml, document it in docs (#198)
* fix: do not config cross compilation in config.toml, document it in docs

Signed-off-by: usamoi <usamoi@outlook.com>

* docs: improve install-from-source-code instructions

Signed-off-by: usamoi <usamoi@outlook.com>

* ci: enable all checks for all PRs

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2023-12-18 09:38:31 +00:00
9e46faa91d ci: fix nightly release timezone (#189)
Signed-off-by: usamoi <usamoi@outlook.com>
2023-12-17 05:40:59 +00:00
db1597690b ci: fix release ci (#187)
[skip ci]

Signed-off-by: usamoi <usamoi@outlook.com>
2023-12-16 15:25:46 +00:00
ebd276e834 ci: bump release version (#186)
* ci: bump release version

[skip ci]

Signed-off-by: usamoi <usamoi@outlook.com>

* ci: bot git name and email

[skip ci]

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2023-12-16 15:08:23 +00:00
cc1b7d0f17 feat: deny unknown field in options (#184)
* fix: deny unknown options

Signed-off-by: usamoi <usamoi@outlook.com>

* test: deny unknown options

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
v0.1.12 v0.0.0-nightly.20231216
2023-12-15 11:02:04 +00:00
c50912e87d C code tests & avx512f f16 implement (#183)
* test: add tests for c code

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: relax EPSILON for tests

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2023-12-15 08:00:08 +00:00
2869fbd44c fix: cast test (#182)
Signed-off-by: usamoi <usamoi@outlook.com>
v0.0.0-nightly.20231215
2023-12-14 10:52:49 +00:00
a4be4c66a3 fix: allow NAN, INFINITY, case case insensitive in parsing (#181)
Signed-off-by: usamoi <usamoi@outlook.com>
2023-12-14 09:56:40 +00:00
5c0450274d feat: fp16 vector (#178)
* feat: fp16 vector

Signed-off-by: usamoi <usamoi@outlook.com>

* feat: detect avx512fp16

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: install clang-16 for ci

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: clippy

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: rename c to pgvectorsc

Signed-off-by: usamoi <usamoi@outlook.com>

* feat: hand-writing avx512fp16

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: index on fp16

Signed-off-by: usamoi <usamoi@outlook.com>

* feat: hand-writing avx2

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: clippy

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: add rerun in build script

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: cross compilation

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: do not leave uninitialized bytes in datatype input function

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: compiler built-in function calling convention workaround

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: cross compile on aarch64

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: fix detect avx512fp16

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: avx512 codegen by multiversion

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: enable more target features for c

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: use tensorchord/stdarch

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: ci

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: remove no-run cross test

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: vbase

Signed-off-by: usamoi <usamoi@outlook.com>

* fix: error and document

Signed-off-by: usamoi <usamoi@outlook.com>

* [skip ci]

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
2023-12-14 09:50:52 +00:00
2ab76118fc feat: vbase optimization (#177)
* feat: vbase optimization

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* cargo fmt && cargo clippy

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* fix

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* make the second progress generate by using heap

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* move filter out of algorrithm

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* cargo fmt

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* return all points in the first stage

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* change heap to a vec to be sorted

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* fix

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

---------

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>
v0.0.0-nightly.20231212
2023-12-11 03:01:27 +00:00
14fb89f0d9 fix: empty nightly github release (#175)
* fix: do not allow creating nightly github release without binary

Signed-off-by: usamoi <usamoi@outlook.com>

* chore: divide ci release to two jobs

Signed-off-by: usamoi <usamoi@outlook.com>

---------

Signed-off-by: usamoi <usamoi@outlook.com>
v0.0.0-nightly.20231130
2023-11-29 14:23:18 +00:00
282727e1c9 fix: pg16 updates RelFileNode to RelFileLocator (#174)
Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>
v0.0.0-nightly.20231129
2023-11-28 14:20:11 +00:00
189fe96b1d fix: reindex failed due to existing old index (#169)
* fix: reindex failed due to existing old index

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* fix: destory index according to smgrGetPendingDeletes list

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* update pgrx repo url

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* remove incorrect panic

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* typo

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* replace rpc id from indexoid to relfileid

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* remove optimize_handle

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

---------

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>
2023-11-28 13:23:00 +00:00
d5954e6b4a feat: progress information on index creation (#165)
* add waiting_secs for IndexBackground

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* progress information on index creation

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* cargo fmt

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* remove waiting_secs

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* include the full index configuration

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* hide private config

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* rename rel to table and index

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* typo

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* avoid spinning when optimize is impossible

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* update readme

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* update memory order

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* refactor atomic to thread parker

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* cargo fmt

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* merge stat info in one function

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* remove OnceLock

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* remove unpark

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

* avoid inconsistency data

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>

---------

Signed-off-by: silver-ymz <yinmingzhuo@gmail.com>
v0.0.0-nightly.20231127 v0.0.0-nightly.20231128 v0.1.11 v0.0.0-nightly.20231126 v0.0.0-nightly.20231125
2023-11-24 05:14:46 +00:00
6dc6b98b56 doc: fix wrong layout (#167)
Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>
v0.0.0-nightly.20231124
2023-11-23 18:13:14 +08:00
20b6e0081f feat: enhance the __init__ of client (#164)
* enhance the __init__ of client

Signed-off-by: 盐粒 Yanli <mail@yanli.one>

* bump version

Signed-off-by: 盐粒 Yanli <mail@yanli.one>

---------

Signed-off-by: 盐粒 Yanli <mail@yanli.one>
2023-11-23 15:32:07 +08:00
eafb2f66f2 doc: Update readme and add filter docs (#161)
* doc: Update readme and add filter docs

Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>

* improve docs

Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>

* improve doc

Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>

* improve readme

Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>

* docs: refactor README and documentation

Signed-off-by: usamoi <usamoi@outlook.com>

* docs: add info about filtering

Signed-off-by: usamoi <usamoi@outlook.com>

* docs: add half sentence

Signed-off-by: usamoi <usamoi@outlook.com>

* docs: fix typo

Signed-off-by: usamoi <usamoi@outlook.com>

* docs: mpve comparsion table back

Signed-off-by: usamoi <usamoi@outlook.com>

* minor change

Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>

---------

Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>
Signed-off-by: usamoi <usamoi@outlook.com>
Co-authored-by: usamoi <usamoi@outlook.com>
2023-11-23 15:29:19 +08:00
a0762daa9a fix: envd (#166)
Signed-off-by: usamoi <usamoi@outlook.com>
2023-11-23 06:44:09 +00:00
682327e18f ci: fix latest image (#159)
Signed-off-by: Jinjing.Zhou <allenzhou@tensorchord.ai>
2023-11-23 09:34:53 +08:00