44 Commits

Author SHA1 Message Date
Kishore Nallan
a282aafe65 Remove ARM lg page size for jemalloc.
Some checks failed
tests / test (push) Has been cancelled
2024-12-11 21:07:23 +05:30
Kishore Nallan
57e1548acb Fix error: add flag for jemalloc for cache oblivious. 2024-12-11 20:49:07 +05:30
Kishore Nallan
61ebe244aa Add flag for jemalloc for cache oblivious. 2024-12-11 20:31:42 +05:30
Harisaran G
70dae01e24
add: support for .tar.gz files (#2028)
Some checks are pending
tests / test (push) Waiting to run
* add: support for .tar.gz files

* refactor: binary_body parsing and move content-type to http_server.h

* add: libarchive

* update: BUILD file

* fxi: bazel convecntions

* add: archive utils helper classes

* fix: memory leaks

* refactor: change the flow to cleanup everything at last

* add: archiver tests

* rm: test endpoints

* fix: set data-dir on ArchiveUtilsTest

* add: a const value in http_data.h

* fix: a const value in http_data.h
2024-10-25 12:35:15 +05:30
Ozan Armağan
002b188b56
Force whisper to not transcribe punctuations (#1771)
* Force whisper to not transcribe punctuations

* Fix the test
2024-06-05 14:53:39 +05:30
Kishore Nallan
36056fe68e Use 64K page size for jemalloc on arm64 / linux. 2024-04-23 19:32:53 +05:30
Kishore Nallan
0013c50ffd Fix mac arm build. 2024-02-22 10:11:00 +05:30
Ozan Armağan
670b97dbcd
Fix snowball bazel file for MacOS (#1566) 2024-02-21 16:03:54 +05:30
Ozan Armağan
0f54bf7101
Add stemming support for fields (#1498)
* Add stemming support for fields

* Add tests for stemming

* Check if the stemmer is  loaded correctly

* Add mutex for stemmer initialization and usage

* Fix get_stemmer_mutex() function signature

* Add StemmerManager class and refactor field.cpp and index.cpp

* Add mutex for thread safety in StemmerManager

* update delete_all_stemmers()

* Update field property name from "stemming" to "stem"
2024-01-20 21:18:54 +05:30
ozanarmagan
319c40a95f Update whisper build to make GPU inference optional with runtime dynamic liking 2024-01-12 18:36:34 +03:00
ozanarmagan
2caca963fe Remove RelWithDebInfo for whisper.cpp 2024-01-10 13:58:14 +03:00
ozanarmagan
eeb5f047cf Fix voice query model references and error messages 2024-01-10 13:35:10 +03:00
ozanarmagan
76181abe2f Fix whisper build 2024-01-10 01:26:47 +03:00
ozanarmagan
3c8b79781d Add support for audio query 2024-01-09 22:41:45 +03:00
ozanarmagan
b0e677e221 Remove -g copt 2023-12-12 17:46:30 +03:00
ozanarmagan
bfc799c5c0 Use new CLIPTokenizer 2023-12-12 17:32:55 +03:00
ozanarmagan
0442b78c54 move onnxruntime to separate BUILD file 2023-11-21 22:05:28 +03:00
Kishore Nallan
cf592caf3c Sentencepiece: use build tmp dir instead of install dir. 2023-08-05 15:14:30 +05:30
Kishore Nallan
770c192e97 Add onnx patch for arm gpu for T4 2023-08-02 07:15:40 +05:30
ozanarmagan
8f1480d322 Use arch independent path for sentencepiece 2023-06-03 19:04:24 +03:00
ozanarmagan
61a58c3ccb Adding CUDA Support + batching 2023-05-31 13:07:59 +03:00
Ozan Armağan
0f5abfc5fa
Merge branch 'v0.25-join' into v0.25-join 2023-05-20 02:24:45 +03:00
Kishore Nallan
10ba8f72bf Fix conflicting declaration of C function in brpc. 2023-05-14 20:16:42 +05:30
Kishore Nallan
d3f9f64ef2 Patch brpc for ARM mac. 2023-05-13 19:59:13 +05:30
ozanarmagan
b713a12be1 Fix bug for sentencepiece build 2023-05-09 11:29:58 +03:00
ozanarmagan
b486ee8cd3 Fix for sentencepiece build with Bazel 2023-05-09 00:58:40 +03:00
Kishore Nallan
c27c20f4f3 Fix brpc + glog logging issues. 2023-05-06 21:57:22 +05:30
ozanarmagan
cfcf95d5dd Added support for XLMRoBERTa tokenizer 2023-05-01 21:50:50 +03:00
Kishore Nallan
2f7328c5ca Enable proper stack trace with symbols. 2023-04-03 12:01:01 +05:30
Kishore Nallan
b98a9f008a
Merge pull request #946 from ozanarmagan/v0.25
Update onnxruntime submodule branches
2023-03-22 11:37:53 +05:30
ozanarmagan
e5e65524ad onnxruntime submodule branch updates 2023-03-22 03:41:20 +03:00
Kishore Nallan
6381709555 Fix static linking. 2023-03-11 21:19:58 +05:30
Kishore Nallan
b03c84cb4a Merge branch 'v0.25' into v0.25-join 2023-03-05 09:30:45 +05:30
Kishore Nallan
bdb667eb03 Build: account for gcc/g++ versioned binary names 2023-02-21 10:33:26 +05:30
ozanarmagan
9c6ea38c50 Added patch files 2023-02-16 14:47:17 +03:00
ozanarmagan
4f921a3040 Auto vector generation & Hybrid Search 2023-02-16 14:47:17 +03:00
Kishore Nallan
fc36321ae7
Merge branch 'v0.25' into v0.25 2023-02-13 18:28:27 +05:30
Kishore Nallan
8ee4b010ff Bazel: static server build on Linux. 2023-02-09 12:33:40 +05:30
ozanarmagan
3f7390d02e Added ONNX Runtime dependency 2023-02-05 15:18:35 +03:00
Kishore Nallan
29b5573dcb Fix Rocksdb bazel build: must use snappy 2023-01-11 14:36:49 +05:30
0x2Adr1
887b556bfe
bump rocksdb and rules_perl version and fix curl (#849) 2023-01-09 15:48:55 +05:30
Kishore Nallan
60aafae585 Fix for clion/bazel not finding klib. 2022-12-23 19:51:14 +05:30
Kishore Nallan
652472f32a Cmake compatible bazel build. 2022-12-18 20:49:51 +05:30
0x2Adr1
bbebb1a567
Bazel (#736) 2022-12-15 21:09:06 +05:30