1823 Commits

Author SHA1 Message Date
Zhe Wang
83f42e13d9
Make BulkDump work with S3 (#11822)
* init

* Add bulkdump to blobstore:// (s3)

* cmake/CompileBoost.cmake
 Add boost url. Needed parsing blobstore:// urls.

* documentation/sphinx/source/bulkdump.rst
 Minor edit to allow addition of blobstore target.

* fdbcli/BulkDumpCommand.actor.cpp
* fdbclient/BulkDumping.cpp
 s/blobstore/s3/ -- more generic and aligns with
 how backup/restore refers to "s3" thingies.

* fdbclient/include/fdbclient/S3Client.actor.h
* fdbclient/S3Client.actor.cpp
 Add batch upload handler.

* fdbclient/tests/seaweedfs_fixture.sh
 Add  run seaweed method. Also look for
 weed and if installed use it else download.

* fdbserver/BulkDumpUtil.actor.cpp
 appendToPath does the right thing when passed an URL
 Add bulkDumpTransportBlobstore_impl.
 Add upload to blobstore.

* tests/loopback_cluster/run_custom_cluster.sh
 Complain if unrecognized arguments.

* Add ctest for bulkload with simple bulkdump test for now.

* Add new test to ctest list

* fix bugs

* nit

* nits

* nits

---------

Co-authored-by: stack <stack@duboce.com>
2024-12-18 13:29:36 -08:00
Zhe Wang
1ae1f07fb6 address comments 2024-12-03 22:12:31 -08:00
Zhe Wang
f0c964f8ad address comments 2024-12-03 22:01:07 -08:00
Zhe Wang
ad0f48cba2 add fdbcli support and fix bugs 2024-12-03 22:01:07 -08:00
Zhe Wang
8288d4cbda address comments 2024-12-03 22:01:07 -08:00
Zhe Wang
ebce2b0199 add bulkdump doc 2024-12-03 22:01:07 -08:00
Giuseppe
6e5fc2a31d
docs: mention -1 and 2 as values read/written for the data_distribution special key (#11789)
A value of -1 means never initialized, but in this case DD is considered enabled.
A value of 2 is used to enable a security mode which disables data moves but allows auditStorage part.
The rebalance_ignored subkey allows using integers since 7.1
2024-11-20 20:20:40 -08:00
flowguru
0d328a7922
Add 7.3.56, 7.3.57 release notes (#11795)
* Add 7.3.56, 7.3.57 release notes

* Address comments

---------

Co-authored-by: Hao <fdbflowguru@gmail.com>
2024-11-20 14:56:34 -08:00
Syed Paymaan Raza
1f8b72c066
Gray failure machine readable status (#11758) 2024-11-12 15:50:08 -08:00
Jingyu Zhou
d41eabf7cb
Update download page for documentation (#11750) 2024-11-04 10:38:23 -08:00
Sreenath Bodagala
5bc2d7aeb3
Add 7.3.54 and 7.3.55 release notes (#11740)
* - Add 7.3.54 and 7.3.55 release notes

* - Address a review comment
2024-10-28 16:39:29 -07:00
Sreenath Bodagala
a303a66693 - Add 7.3.52 and 7.3.53 release notes 2024-10-11 15:52:50 +00:00
Sepeth
39172d7dc4
Remove Python 2.7 support and six.py (#11418) 2024-10-02 21:12:51 -07:00
Jingyu Zhou
9d36d6f7f3
Add 7.3.50, 7.3.51 release notes (#11690) 2024-09-30 11:45:44 -07:00
Jingyu Zhou
f845b10d79
Remove rpm packaging related to el6 (#11687) 2024-09-26 21:26:48 -07:00
Jingyu Zhou
39d895d700 Add 7.3.44-7.3.49 release notes 2024-08-16 09:41:45 -07:00
Syed Paymaan Raza
68b6489052
[fdbmonitor] Add environment variable support (#11552) 2024-08-03 11:06:44 -07:00
Jingyu Zhou
a95cb5cdfa
Merge pull request #11483 from xis19/assert
Add release notes for 7.3.20 thru 7.3.23
2024-07-11 08:58:16 -07:00
Xiaoge Su
8c8ec661c6 fixup! 2024-07-10 21:42:15 -07:00
Xiaoge Su
848bb0ce1c
Update documentation/sphinx/source/release-notes/release-notes-730.rst
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2024-07-10 21:37:18 -07:00
Xiaoge Su
05219be804
Update documentation/sphinx/source/release-notes/release-notes-730.rst
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2024-07-10 21:36:33 -07:00
Xiaoge Su
adc788ccf3
Update documentation/sphinx/source/release-notes/release-notes-730.rst
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2024-07-10 21:36:09 -07:00
Zhe Wang
e31d92458f
update dcc doc (#11495) 2024-07-09 16:24:10 -07:00
Xiaoge Su
6b5016e963 fixup! 2024-07-02 06:58:17 -07:00
Xiaoge Su
02a75d71b8 fixup! 2024-07-02 06:44:53 -07:00
Xiaoge Su
96d444c31b fixup! 2024-07-02 06:23:21 -07:00
Xiaoge Su
62a8f8fae8 fixup! 2024-07-02 04:58:19 -07:00
Xiaoge Su
32c8dfea21
Update documentation/sphinx/source/release-notes/release-notes-730.rst
Co-authored-by: Giuseppe <16498973+gm42@users.noreply.github.com>
2024-07-02 04:32:57 -07:00
Xiaoge Su
051f21d118 Add release notes for 7.3.20 thru 7.3.23 2024-07-01 17:02:25 -07:00
Jingyu Zhou
8b61d76ed3 Added 7.3.38 to 7.3.43 release notes 2024-05-21 13:18:10 -07:00
Jingyu Zhou
c33402caea Add 7.1.58 to 7.1.61 release notes 2024-05-16 09:59:27 -07:00
Pierre Zemb
58ce2092b3 Add documentation about experimental features 2024-05-03 07:18:53 +00:00
neethuhaneesha
adf0e8fa18
Rocksdb metrics in status json (#11321) 2024-04-18 22:00:58 -07:00
Jingyu Zhou
2f50c4989f
Merge pull request #11287 from kakaiu:consistency-check-urgent-doc
Add consisteny check urgent doc
2024-04-09 12:07:53 -07:00
Zhe Wang
c700f9ad5c improve 2024-04-08 16:16:18 -07:00
Zhe Wang
59681e4031 improve 2024-04-08 16:15:00 -07:00
Zhe Wang
0ace28e4a4 improve 2024-04-08 16:12:38 -07:00
Zhe Wang
a3ef5d84bd fix escape char 2024-04-08 16:07:29 -07:00
Zhe Wang
2676f11856 address comments 2024-04-08 15:50:55 -07:00
Zhe Wang
4b0ea9902d fix 2024-04-08 14:08:42 -07:00
Zhe Wang
36d958470f add consisteny check urgent doc 2024-04-08 14:06:28 -07:00
Jingyu Zhou
c6988fff09 Add 7.1.32 - 7.1.37 release notes 2024-04-08 12:37:03 -07:00
Aaron Molitor
12fa060fb3
Update release-notes-730.rst 2024-04-08 10:16:21 -05:00
Xiaoge Su
5b587d3c61 fixup! Update the document of Machine-Readable Status
The key has to be of byte type in Python, not str.
2024-04-03 13:22:33 -07:00
Zhe Wang
9c788b9854 cherry-pick-pr-11209 2024-03-21 08:39:09 -07:00
Jingyu Zhou
f73d2f17b2 Add 7.3.28 to 7.3.31 release notes 2024-03-14 20:20:36 -07:00
Sreenath Bodagala
0ff9bd8066 - Simple correction 2024-02-15 16:25:17 +00:00
Sreenath Bodagala
10d2e39049 - Address a review comment 2024-02-15 16:20:54 +00:00
Sreenath Bodagala
6d63e382c9 - Correct documentation 2024-02-14 20:07:20 +00:00
Jingyu Zhou
27d55d653d
Merge pull request #11184 from jzhou77/main
Add 7.1.44 to 7.1.55 release notes
2024-02-07 08:41:39 -08:00