78 Commits

Author SHA1 Message Date
Harisaran G
70dae01e24
add: support for .tar.gz files (#2028)
Some checks are pending
tests / test (push) Waiting to run
* add: support for .tar.gz files

* refactor: binary_body parsing and move content-type to http_server.h

* add: libarchive

* update: BUILD file

* fxi: bazel convecntions

* add: archive utils helper classes

* fix: memory leaks

* refactor: change the flow to cleanup everything at last

* add: archiver tests

* rm: test endpoints

* fix: set data-dir on ArchiveUtilsTest

* add: a const value in http_data.h

* fix: a const value in http_data.h
2024-10-25 12:35:15 +05:30
Kishore Nallan
b903ef014b Properly exclude config api from resource checks.
Some checks failed
tests / test (push) Has been cancelled
2024-10-08 13:32:10 +05:30
Kishore Nallan
da663087fa Refactor api action string generation. 2024-03-15 12:37:05 +05:30
Kishore Nallan
72d1e62e20 Log GET params as well for query logging of multi_search. 2024-03-08 11:02:38 +05:30
ozanarmagan
6963aa3ece Add support for Cloudflare Workers AI 2023-12-26 19:25:37 +03:00
Kishore Nallan
3aa9bad0b1 Merge branch 'v0.25-join' into v0.26-facets
# Conflicts:
#	include/collection.h
#	include/http_data.h
#	test/tokenizer_test.cpp
2023-07-06 12:22:17 +05:30
Kishore Nallan
974280a4d5 Fix response streaming regression.
Introduced during export memory usage fix.
2023-07-04 15:55:27 +05:30
krunal1313
aa32ad0345 end zstream for client disconnection 2023-06-26 16:24:10 +05:30
krunal1313
828e43cbcd adding zstream stuffs to request object 2023-06-26 16:14:32 +05:30
Kishore Nallan
c074ef1300 Handle changes in req routes. 2023-05-26 09:46:58 +05:30
Kishore Nallan
b7f29aeed1 Evented query aggregation skeleton. 2023-05-22 17:52:52 +05:30
Kishore Nallan
9c8b2eed72 Fix http streaming on upgraded h2o lib. 2023-03-29 17:36:03 +05:30
Kishore Nallan
a4b75ac108 Merge branch 'v0.24-nested' into v0.25 2023-01-25 18:13:47 +05:30
Kishore Nallan
c4355ed123 Return 529 for overloaded search requests. 2023-01-25 17:29:08 +05:30
Kishore Nallan
cd5cfc5445 Merge branch 'v0.24-nested' into v0.25
# Conflicts:
#	include/collection.h
#	src/collection.cpp
#	src/collection_manager.cpp
#	src/index.cpp
2023-01-09 16:06:34 +05:30
Kishore Nallan
aec1e6cff0 Use http lib timestamp separately as conn_ts. 2023-01-07 19:06:53 +05:30
Kishore Nallan
5c75d1553a Merge branch 'bazel-build' into v0.25 2023-01-03 11:02:09 +05:30
Kishore Nallan
f380bd5fa9 Take care of underlying req being null. 2023-01-02 19:33:43 +05:30
Kishore Nallan
1a66a25e2f Enable slow searches logging by default (30s cutoff) 2023-01-02 18:53:36 +05:30
Kishore Nallan
652472f32a Cmake compatible bazel build. 2022-12-18 20:49:51 +05:30
Kishore Nallan
c5b55a4ca3 More careful handling of custom request data destruction. 2022-09-06 19:16:50 +05:30
Kishore Nallan
2925b2e8d1 Store auth inside request. 2022-07-07 09:37:27 +05:30
Kishore Nallan
b115caa23a Fix ip address in slow request logging. 2022-07-01 12:52:06 +05:30
Kishore Nallan
1e241e970d Better synchronization during slow request logging.
We also log slow requests >= 0 ms now.
2022-06-24 09:38:55 +05:30
Kishore Nallan
d83745a6eb Log address in slow request logs. 2022-05-12 13:10:07 +05:30
Kishore Nallan
b3b591d9dd Option to log requests. 2022-04-27 16:53:15 +05:30
Kishore Nallan
31c8a030c7 Handle per-search API key for multi search. 2022-02-25 21:19:24 +05:30
Kishore Nallan
4549e09063 Handle response write race condition with h2o dispose. 2022-02-14 13:38:51 +05:30
Kishore Nallan
a2ae8199f0 Per request cache ttl. 2021-10-20 18:17:30 +05:30
Kishore Nallan
952b83f3a8 Handle v0.21 and below import serialization. 2021-10-16 19:49:41 +05:30
Kishore Nallan
a8a8c60e0f Wrap last chunk aggregate flag with atomic. 2021-10-12 20:44:54 +05:30
Kishore Nallan
87f18b03f3 Address concurrency edge case in import streaming.
Manage concurrent access by the req/res variables between batch indexer and http response threads.
2021-10-07 19:38:54 +05:30
Kishore Nallan
6da39ff51c Expose write stats. 2021-10-02 18:54:30 +05:30
Kishore Nallan
82514683ba Fix variable init. 2021-08-31 15:49:10 +05:30
Kishore Nallan
ced4163062 Handle stack trace on batched indexing. 2021-08-22 08:43:32 +05:30
Kishore Nallan
8c46fed1b4 Return error if import is attempted on unsupported curl version. 2021-08-10 20:55:37 +05:30
Kishore Nallan
35409f8493 Batched background indexer.
Enables write parallelism across collections.
2021-07-31 21:44:06 +05:30
Kishore Nallan
9679895ee3 Add optional LRU + TTL cache for searches. 2021-05-09 20:31:24 +05:30
Kishore Nallan
0ae663ab02 Implement rate limiting to protect from write lag. 2021-04-22 07:35:51 +05:30
Kishore Nallan
6b793afbae Refactor deferring of batched writes during import. 2021-04-09 16:47:42 +05:30
Kishore Nallan
073667e844 Fix blocking of http thread during writes. 2021-04-08 17:57:02 +05:30
kishorenc
cfc922c6f0 Remove use of doc meta key as it's not needed anymore. 2021-02-28 19:23:41 +05:30
kishorenc
95ee14350a Use shared_ptr to handle req/res life cycles. 2021-02-28 12:48:20 +05:30
kishorenc
09530e3415 Fix race condition in condition variable notify/wait. 2021-02-15 18:23:42 +05:30
Jason Bosco
c8b4d5fbed Address multi search quirks 2021-01-24 08:04:23 -08:00
Jason Bosco
8b4e07cb81 Configuration to log slow requests 2021-01-23 07:44:59 -08:00
Jason Bosco
bcea70ebfd Add windowed stats endpoint 2021-01-22 16:52:27 -08:00
kishorenc
3189c1c4cc Fix import follower hang. 2020-09-09 17:35:50 +05:30
kishorenc
58b52687ea Handle disconnects during import. 2020-09-04 15:12:09 +05:30
kishorenc
6d7c6b2ea0 Implemented import streaming end-to-end on follower. 2020-09-03 20:44:39 +05:30