46 Commits

Author SHA1 Message Date
Johannes Scheuermann
2753f4e2b2
fdb-kubernetes-monitor: Ensure that the annotations are updated when the correct configuration is already loaded (#11486) 2024-07-04 12:50:31 +02:00
Johannes Scheuermann
ffd43514f4
Add support for the isolate process group annotation to shutdown fdbserver processes (#11464)
* Add support for the isolate process group annotation to shutdown fdbserver processes
2024-06-24 17:01:23 +02:00
Johannes Scheuermann
dd7ce328d7
fdbkubernetesmonitor: Retry update pod annotations in case of an error (#11458) 2024-06-18 11:02:09 +02:00
Nicole Morales
491ea62c94 move certloader to internal folder 2024-06-14 17:02:49 +01:00
Nicole Morales
4d09fa1379 review fixes 2024-06-14 17:01:43 +01:00
Nicole Morales
74d37299cf add TLS ability to fdb kubernetes monitor 2024-06-14 17:01:10 +01:00
Johannes Scheuermann
3c4f5f655c
Add a mechanism to allow to specifiy the command line flags over env variables (#11462) 2024-06-14 17:44:21 +02:00
Johannes Scheuermann
d2dd3bce5a
Add support in the fdb-kubernetes-monitor to read node labels (#11431)
* Add support in the fdb-kubernetes-monitor to read node labels
2024-06-14 06:41:48 +01:00
Johannes Scheuermann
1ab7a33bcf
Initial add of custom prometheus metrics (#11451) 2024-06-12 18:34:16 +02:00
Johannes Scheuermann
1a7f1c9452
fdbkubernetesmonitor: Update the pod annotation if the cluster file changes (#11455) 2024-06-12 17:12:08 +02:00
Johannes Scheuermann
e7f19ab870
Remove some steps are only needed once (#11450) 2024-06-12 11:08:12 +02:00
Johannes Scheuermann
970db3896e
Add exponential backoff mechanism for restarting fdbserver processes in the monitor (#11447) 2024-06-11 15:51:15 +02:00
Johannes M. Scheuermann
f4cf5ac7bf Revert variable renaming 2024-05-24 14:55:24 +02:00
Johannes M. Scheuermann
300db7df41 Correct the path where the fdb-kubernetes-monitor copies the binary into when running in sidecar mode 2024-05-23 14:17:32 +02:00
Johannes M. Scheuermann
af4fab4d06 Update the config for golangci-lint and remove unused variables 2024-04-30 07:54:37 +02:00
dependabot[bot]
73ad0d1361
Bump golang.org/x/net from 0.17.0 to 0.23.0 in /fdbkubernetesmonitor (#11322)
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.17.0 to 0.23.0.
- [Commits](https://github.com/golang/net/compare/v0.17.0...v0.23.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-22 07:00:13 +01:00
Johannes M. Scheuermann
728c7a7e92 Correct the docker image name in fdb-kubernetes-monitor docs 2024-04-18 15:06:13 -05:00
Johannes Scheuermann
3643906535
Change the way how the fdb kubernetes monitor is copying files (#11109)
* Change the way how the fdb kubernetes monitor is copying files

* Add additional tests for the copy setup
2024-03-15 14:57:43 +01:00
dependabot[bot]
0ccef7eb0f
Bump google.golang.org/protobuf in /fdbkubernetesmonitor (#11249)
Bumps google.golang.org/protobuf from 1.30.0 to 1.33.0.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-03-14 09:48:45 +01:00
dependabot[bot]
2ce84f2c63
Bump golang.org/x/net from 0.7.0 to 0.17.0 in /fdbkubernetesmonitor (#11137)
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.7.0 to 0.17.0.
- [Commits](https://github.com/golang/net/compare/v0.7.0...v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-14 12:28:21 -08:00
Dimitris Apostolou
a88114c222
Fix typos 2024-02-07 01:16:00 +02:00
Johannes Scheuermann
ea5f521f15
Refactor code to make use of the controller-runtime and allow delayed shutdown of the monitor process (#11108) 2024-01-18 08:00:26 +01:00
dependabot[bot]
c41d7c6451
Bump golang.org/x/net in /fdbkubernetesmonitor (#10975)
Bumps [golang.org/x/net](https://github.com/golang/net) from 0.0.0-20220127200216-cd36cc0744dd to 0.17.0.
- [Commits](https://github.com/golang/net/commits/v0.17.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-12 10:31:07 +02:00
dependabot[bot]
e81cf16676
Bump gopkg.in/yaml.v3 in /fdbkubernetesmonitor (#10850)
Bumps gopkg.in/yaml.v3 from 3.0.0-20210107192922-496545a6307b to 3.0.0.

---
updated-dependencies:
- dependency-name: gopkg.in/yaml.v3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-06 12:17:11 +02:00
dependabot[bot]
1d0ce7c5a7
Bump golang.org/x/text from 0.3.7 to 0.3.8 in /fdbkubernetesmonitor
Bumps [golang.org/x/text](https://github.com/golang/text) from 0.3.7 to 0.3.8.
- [Release notes](https://github.com/golang/text/releases)
- [Commits](https://github.com/golang/text/compare/v0.3.7...v0.3.8)

---
updated-dependencies:
- dependency-name: golang.org/x/text
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-02-23 09:51:56 +00:00
dependabot[bot]
905af6ccf8
Bump github.com/emicklei/go-restful in /fdbkubernetesmonitor (#9336)
Bumps [github.com/emicklei/go-restful](https://github.com/emicklei/go-restful) from 2.9.5+incompatible to 2.16.0+incompatible.
- [Release notes](https://github.com/emicklei/go-restful/releases)
- [Changelog](https://github.com/emicklei/go-restful/blob/v3/CHANGES.md)
- [Commits](https://github.com/emicklei/go-restful/compare/v2.9.5...v2.16.0)

---
updated-dependencies:
- dependency-name: github.com/emicklei/go-restful
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-10 08:15:57 +01:00
John Brownlee
90e02e76ce Move the IP list selection into LookupEnv so that the correct IP gets put in the launcher environment annotation. 2022-07-28 10:54:07 -07:00
John Brownlee
123dc7bb32 Include environment variables from the additional env file in the environment annotation. 2022-07-28 10:54:07 -07:00
John Brownlee
a7978ce009 Add a special IP family argument type to support multiple pod IPs on Kubernetes. 2022-07-28 10:54:07 -07:00
Johannes M. Scheuermann
e388fd622d Add docs for how to run the operator with the unified image 2022-07-04 15:25:25 +01:00
Johannes Scheuermann
7bff4af14a
Initial support for Prometheus endpoint and pprof for debugging (#7359)
* Initial support for Prometheus endpoint and pprof for debugging
2022-06-22 08:07:48 +01:00
Johannes Scheuermann
c9b4ff3302
Add support for lumberjack in logging and update example to 7.1 (#7357) 2022-06-15 19:41:01 +01:00
Stitch-Zhang
2275127d8c
fix(fdbkubernetesmonitor): unclosed file description (#7356)
Closing additional environment file description as soon as read it completely
2022-06-13 13:16:26 -07:00
A.J. Beamon
f29f487823
Unify flags (#25)
* Unify flags implementation and change help text in backup.actor.cpp
Description

Testing

* Keep LOG_GROUP unchanged

Description

Testing

* Transfer the hyphens to underscores for internal options and user's input, EXCEPT leading hyphens

Description

Testing

* Use a deep copy of the user's input flag to do the match

Description

Testing

* Convert the _ to - in Option arrays of backup.actor.cpp

Description

Testing

* Transter _ to - for files:
        TLSConfig.actor.h, fdbcli.actor.cpp, fdbserver.actor.cpp, FileConverter.h, FileConverter.cpp

Description

Testing

* Change another way to unify flag: using SO_O_ICASE_HYPHEN_AND_UNDERSCORE to determine whether we do the conversion in function IsEqual

Description

Testing

* Change the config command's name from SO_O_ICASE_HYPHEN_AND_UNDERSCORE to SO_O_HYPHEN_TO_UNDERSCORE

Description

Testing

* Update the comment for the SO_O_HYPHEN_TO_UNDERSCORE

Description

Testing

* Fix left underscore in SOption arrays

Description

Testing

* Convert _ to - in several files for commands

Description

Testing

* Make the FDBService and fdbmonitor backward compatible

Description

Testing

* Fix bugs about pointers

Description

Testing

* Check underscore and hyphen at the same time for --knob_, --localily_ and --test_
And fix bugs in fdbmonitor and FDBService
Description

Testing

* Simplify the function in fdbmonitor and FDBService about retrieving arguments.
And fix some documents in masterserver.actor.cpp

Description

Testing

* Convert _ to - for knob in the setKnob functions

Description

Testing

* Convert - to _ in the setKnob functions

Description
Since key in the knob related maps only contain _

Testing

* Rename varialbe name in the fdbmonitor and FDBService for clarification

Description

Testing

Co-authored-by: Chang Liu <chang.liu@snowflake.com>
2021-12-14 08:44:39 -08:00
Aaron Molitor
124e7eb4f2 refactor docker directory
- make release images ALL based from centos:7
- keep eks images that are based from amazonlinux:2, but create strong alignment with release (centos7) images
- use multi-stage Dockerfile(s)
- have a single build-images script
- remove per image directories (which would only contain scripts that are copied into images)
- remove empty requirements.txt file for sidecar.py (the pip command, package and version are in the Dockerfile)
- don't copy docker into PROJECT_BINARY_DIR
- incorporate latest changes already in master
2021-11-17 16:29:07 -08:00
John Brownlee
2f2e5219da Move the config file scheme into a separate package so it can be imported by the operator.
Move the argument for the number of servers per pod into a command-line argument so we can use the same config file at different storage server densities.
2021-11-12 11:58:38 -08:00
John Brownlee
5767701e1d Fix bugs with missing logger. 2021-11-02 18:53:25 -07:00
John Brownlee
ee292e2df7 Update based on PR feedback. 2021-10-28 17:40:05 -07:00
John Brownlee
a6b903e7f8 Move the new Kubernetes image to centos 7. 2021-10-28 17:40:05 -07:00
John Brownlee
1a5069a047 Use an write-and-rename pattern when copying files for atomicity.
Restructure the usage of the mutex in the monitor class.
2021-10-28 17:40:05 -07:00
John Brownlee
f8ec3cc27d Add an option to load an additional file of environment variables in fdb-kubernetes-monitor. 2021-10-28 17:40:05 -07:00
John Brownlee
c7858d2441 Add the init and sidecar modes for fdb-kubernetes-monitor.
Add support for using a special binary path during upgrades in fdb-kubernetes-monitor.
2021-10-28 17:40:05 -07:00
John Brownlee
7c36123cf8 Adds structured logging in fdb-kubernetes-monitor.
Adds a backoff window when restarting processes in fdb-kubernetes-monitor.
2021-10-28 17:40:05 -07:00
John Brownlee
95ad5854be Add a mechanism to post updates from fdb-kubernetes-monitor to pod annotations.
Remove some of the local test data for fdb-kubernetes-monitor in favor of testing through a Kuberentes statefulset.
2021-10-28 17:40:05 -07:00
John Brownlee
0f173edb47 Add a dockerfile for fdb-kubernetes-monitor. 2021-10-28 17:40:05 -07:00
John Brownlee
fd0aeaf48e Add a new process launcher for FDB on Kube. 2021-10-28 17:40:05 -07:00