gcc build randomly crashes because the StorageServer structure exceeded 16KB
size, but is still FastAllocated. Thus, LatencySample can overwrite memory
during initialization, causing random segfaults.
Added a static assertion to catch this problem for future modifications to the
structure.
* init
* Add bulkdump to blobstore:// (s3)
* cmake/CompileBoost.cmake
Add boost url. Needed parsing blobstore:// urls.
* documentation/sphinx/source/bulkdump.rst
Minor edit to allow addition of blobstore target.
* fdbcli/BulkDumpCommand.actor.cpp
* fdbclient/BulkDumping.cpp
s/blobstore/s3/ -- more generic and aligns with
how backup/restore refers to "s3" thingies.
* fdbclient/include/fdbclient/S3Client.actor.h
* fdbclient/S3Client.actor.cpp
Add batch upload handler.
* fdbclient/tests/seaweedfs_fixture.sh
Add run seaweed method. Also look for
weed and if installed use it else download.
* fdbserver/BulkDumpUtil.actor.cpp
appendToPath does the right thing when passed an URL
Add bulkDumpTransportBlobstore_impl.
Add upload to blobstore.
* tests/loopback_cluster/run_custom_cluster.sh
Complain if unrecognized arguments.
* Add ctest for bulkload with simple bulkdump test for now.
* Add new test to ctest list
* fix bugs
* nit
* nits
* nits
---------
Co-authored-by: stack <stack@duboce.com>
* Rename error variable in go tests to err #8829
renamed the variables from e to err as mentioned in the https://go.dev/doc/effective_go
* Update packaging/docker/samples/golang/app/main.go
* fixed accidental renames, renamed file from directoryLayer.go to directory_layer.go, to work on go formatting
* Rename error variable in go tests to err #8829
renamed the variables from e to err as mentioned in the https://go.dev/doc/effective_go
* fixed accidental renames, renamed file from directoryLayer.go to directory_layer.go, to work on go formatting
* Update packaging/docker/samples/golang/app/main.go
* renamed directoryPartition.go -> directory_partition.go and directorySubspace.go -> directory_subspace.go
* updated: comments in files that were renamed, fixed accidental rename in bindings/go/src/fdb/fdb.go
* Update doc.go
Removed unintentional whitespaces due to formatter
* Update get_encryption_keys.go
removed unintentional whitespaces in get_encryption_keys.go
* removed accidental whitespaces in get_encryption_keys.go
* fixed few minor issues while renaming variable
* updated: minor tweaks, typos
* updated: CMakeLists
* removed: named return value
* handling nil Pointer exception
---------
Co-authored-by: Vishesh Yadav <vishesh3y@gmail.com>
* Implement gRPC support
* Move some CMake stuff around.
* Fix typo
* Add some test
* Add async client
* Add test for checking destroy
* [testing] Automatically discover unit-test and register as ctest
This patch adds `collect_unit_tests()` to CMake which searches over
the codebase and finds all the unit-tests written using Flow's TEST_CASE
macro and register as ctest.
The test then can be then run using ctest command or directly via Test
Explorer in VSCode.
* Fix some tests
* Use NetworkAddress
* Add another variant of call method
* Add a failed call test
* Refactor
* Cleanup shutdown
* Start working on streaming
* Implement server streaming
* Cleanup some unnecessary templating
* Cleanup some tests
* WIP Client Streaming
* WIP
* File Transfer WIP
* Remove UnitTest.h
* Take grpc addresses from command line
* startup grpc in fdbserver
* Cancel if future ref is 0
* noop
* Update some Cmake files
* Fix some build/run issues
* Review comments and remove file transfer
* Compile with gRPC present
* format
* Address review comments
* Add assert
* fix FLOW_GRPC_ENABLED flag
* include grpc/proto headers for generated files
* fix arm build not finding generated proto
* add debug message for protobuf generation
* add generated dir again
* add check for protoc compiler
is based over "TagData::popped" to decide how long to keep the disk
queue positions of versions in memory (instead of using the logic that
is based over "LogData::persistentDataVersion", which is applicable to
spill by value case).
Seaweed is started in a subprocess so setting the global had no
effect. Instead write the pid to a file so its available at
cleanup time.
Found by Zhe Wang.
Co-authored-by: michael stack <stack@duboce.com>
Bug introduced by recent refactor adding being able to specify
storage as an option.
Found by Paymaan Raza.
Co-authored-by: michael stack <stack@duboce.com>
version only after receiving a commit version reply from the sequencer.
Advancing the min committed version prior to that point may result in
invalid DBRecoveryDurability errors (if a recovery happens after the
advancement) in simulation tests.
fdbclient so can be used in fdbclient. Remove the copies of
BackupTLSConfig we had in place named BlobTLSConfig.*.
Keep the old name though it a little clunky.
