2217 Commits

Author SHA1 Message Date
Nim Wijetunga
3e45b6657c
Merge pull request #7714 from sfc-gh-nwijetunga/nim/tenant-encryption-property
Encryption as a tenant property
2022-07-29 11:30:19 -07:00
Junhyun Shim
83e94781b4
Merge pull request #6842 from sfc-gh-mpilman/features/authz
Authorization
2022-07-28 19:50:24 +02:00
Junhyun Shim
631cca6560 More code review suggestions 2022-07-28 01:04:15 +02:00
Junhyun Shim
144bb4e110
Apply suggestions from code review
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2022-07-28 00:45:31 +02:00
Nim Wijetunga
6181d89767 fix test 2022-07-27 13:36:55 -07:00
Junhyun Shim
c6342a6e5b
Merge branch 'main' into features/authz 2022-07-27 20:51:32 +02:00
Junhyun Shim
27e2bf60c6 Handle case where exception is thrown before tenant prefix is prepended 2022-07-27 20:13:25 +02:00
Nim Wijetunga
2cd73242de fix merge conflict 2022-07-27 10:58:41 -07:00
Nim Wijetunga
6b525ec053 format 2022-07-27 10:55:58 -07:00
Jon Fu
af7a644037 Merge branch 'main' of github.com:apple/foundationdb into jfu-tenant-rename-special-keys 2022-07-27 09:37:38 -07:00
A.J. Beamon
d39c0b773a Add a limit to the number of tenants that can be created in a cluster 2022-07-27 08:21:03 -07:00
Nim Wijetunga
50391c35b1 Merge branch 'main' of github.com:sfc-gh-nwijetunga/foundationdb into nim/tenant-encryption-property
* 'main' of github.com:sfc-gh-nwijetunga/foundationdb: (42 commits)
  Get ShardedRocks ready for simulation test. (#7679)
  fixing specific unit test
  formatting
  addressing review comments
  Fix incorrect deserialization of FdbClientLogEvents::Event (#7707)
  Fix a crash bug during CC shutdown process (#7705)
  addressing review comments
  remove runAfter
  Add comments explaining the use of the TransactionState tenant() and hasTenant() functions
  Make sure resumeFromDataMoves() starts after resumeFromShards().
  Fix: during recovery, it was possible for tenant operations to briefly fail because the tenant mode is not known
  formatting
  Fixed granule purging bug and improved debugging for purging
  making purge failures fail test
  cleanup and polish
  Bug fix and cleanup
  First version of key-sorted delta files
  Added full granule read unit test
  Completed delta format unit test
  delta file test and delta generation
  ...
2022-07-27 08:13:30 -07:00
A.J. Beamon
dec6dbfbfb
Merge pull request #7549 from sfc-gh-ajbeamon/feature-tenant-groups
Add support for tenant groups
2022-07-27 07:56:27 -07:00
Josh Slocum
cf0fadab85
Merge pull request #7655 from sfc-gh-jslocum/improved_cf_testing
Improved change feed testing
2022-07-27 08:04:37 -05:00
He Liu
edbc373815
Get ShardedRocks ready for simulation test. (#7679)
* Disabled tests for ShardedRocks.

Cleaned up ShardedRocks TraceEvent.

Added assertion in ShardManager::validate().

* Added test trace.

* Make sure TraceEvent contains `ShardedRocks`.

Co-authored-by: He Liu <heliu@apple.com>
2022-07-26 21:49:33 -07:00
Josh Slocum
1ea43aa878 Merge branch 'main' into improved_cf_testing 2022-07-26 18:12:58 -05:00
Jon Fu
f0687237fb update comments 2022-07-26 15:41:40 -07:00
Junhyun Shim
5169616b16 Fix unresolved merge conflicts 2022-07-27 00:38:16 +02:00
Junhyun Shim
e2a3fedfc7
Merge branch 'main' into features/authz 2022-07-27 00:08:57 +02:00
Jon Fu
a3b56ebadc reject overlap in transaction case 2022-07-26 15:04:18 -07:00
Josh Slocum
8b5b7a9b92
Merge pull request #7689 from sfc-gh-jslocum/purge_fixes
Granule Purge Fixes
2022-07-26 17:02:24 -05:00
Josh Slocum
0609aa57d1 Merge branch 'main' into improved_cf_testing 2022-07-26 16:44:13 -05:00
Jon Fu
6ff90c83b1 remove extra parameters 2022-07-26 13:58:19 -07:00
Jon Fu
6dbaf46ec8 restructure test workload impl and map 2022-07-26 13:53:04 -07:00
Xiaoxi Wang
7cf6037191 remove runAfter 2022-07-26 12:12:56 -07:00
Jon Fu
0950d82fe5 add documentation and fix merge errors 2022-07-26 11:58:49 -07:00
Nim Wijetunga
5fbebac26c modify test 2022-07-26 11:53:07 -07:00
Jon Fu
21309c2af8 Merge branch 'feature-tenant-groups' of github.com:sfc-gh-ajbeamon/foundationdb into jfu-tenant-rename-special-keys 2022-07-26 11:15:56 -07:00
Nim Wijetunga
33f236a068 merge 2022-07-26 10:37:26 -07:00
Nim Wijetunga
7cc58cb1af fix pr issues 2022-07-26 10:14:59 -07:00
A.J. Beamon
35fd459002 Some test fixes 2022-07-26 09:04:29 -07:00
A.J. Beamon
a64693518a Add support for tenant groups 2022-07-26 09:04:29 -07:00
Nim Wijetunga
26d233c0f8 encryption as a tenant property 2022-07-25 17:19:14 -07:00
Renxuan Wang
dc9599f2e9
Get network interfaces ready for https proxy. (#7556)
* Move HTTP from fdbclient/ to fdbrpc/.

* Move md5 and libb64 to contrib/.

* Get network interfaces ready for https proxy.

* Rebase
2022-07-25 17:08:32 -07:00
He Liu
118c2ae806
Fixed memory leak for RocksDb and CheckpointReader. (#7665)
* Fixed memory leak for RocksDb and CheckpointReader.

* Close kvStore at the end of StorageServerCheckpointRestoreTest.
2022-07-25 12:36:29 -07:00
Josh Slocum
6115a406d4 formatting 2022-07-25 13:52:47 -05:00
Josh Slocum
af60e2ea32 Fixed granule purging bug and improved debugging for purging 2022-07-25 12:19:41 -05:00
Josh Slocum
ee1b0cdd43 making purge failures fail test 2022-07-23 13:10:03 -05:00
Jon Fu
1d3a129070 fix compile errors from merge 2022-07-22 16:09:08 -07:00
Jon Fu
43c7146d86 Merge branch 'feature-tenant-groups' of github.com:sfc-gh-ajbeamon/foundationdb into jfu-tenant-rename-special-keys 2022-07-22 15:21:13 -07:00
A.J. Beamon
f6e3019a10 Merge branch 'main' into feature-tenant-groups 2022-07-22 14:09:55 -07:00
A.J. Beamon
9459d0c6ca
Merge pull request #7661 from sfc-gh-ajbeamon/tenant-metadata-key-backed-types
Use key-backed types for tenants
2022-07-22 14:01:45 -07:00
Jon Fu
818a9fb057 fix some test logic to account for some missing error handling in special keys and txn case 2022-07-22 13:24:59 -07:00
A.J. Beamon
193a0dbf4f Some test fixes 2022-07-22 12:28:42 -07:00
He Liu
7a8be255cd
Ss shard management (#7340)
* Storage server shard management with physical shards.

* Cleanup.

* Resolved comments.

* Added `UnlimintedCommitBytes`.

Co-authored-by: He Liu <heliu@apple.com>
2022-07-22 09:30:44 -07:00
A.J. Beamon
237081905d Add support for tenant groups 2022-07-22 09:27:31 -07:00
A.J. Beamon
17146c484b Use key-backed types for tenants. Add a tenant state field that will be used in upcoming work. Some other tenant related refactoring. 2022-07-21 20:33:28 -07:00
Andrew Noyes
89141d4b3a
Validate subrange reads in simulation (#7597)
* Add extra validation to special key space reads in simulation

* Fix bugs turned up by validating subrange reads

* Change to validateSpecialSubrangeRead

It is in general not safe to expect that a read from the special key
space returns the same results if performed again, since the
transaction may be being modified concurrently.

* Add comment

* Add comment
2022-07-21 14:42:08 -07:00
Josh Slocum
7101578d05 Cleanup 2022-07-21 08:19:05 -05:00
Josh Slocum
6a707e95ab removing incorrect check 2022-07-21 08:08:07 -05:00