Hi, i have am testing medusa on a three node cluster, i have taken a backup to s3 bucket and deleted existing data from the cluster and restored from S3.
I have tried to increase the cluster size to 4 but the medusa-restore on the newly created pod fails with below error
2023-07-20 12:32:39,058] DEBUG: Blob test1/demo-dc1-default-sts-3/medusa-backup2/meta/schema.cql was not found in cache.
DEBUG:root:[Storage] Getting object test1/demo-dc1-default-sts-3/medusa-backup2/meta/schema.cql
[2023-07-20 12:32:39,058] DEBUG: [Storage] Getting object test1/demo-dc1-default-sts-3/medusa-backup2/meta/schema.cql
DEBUG:urllib3.connectionpool:https://s3.amazonaws.com:443 "HEAD /kiran-cassandra HTTP/1.1" 200 0
[2023-07-20 12:32:39,077] DEBUG: https://s3.amazonaws.com:443 "HEAD /kiran-cassandra HTTP/1.1" 200 0
DEBUG:urllib3.connectionpool:https://s3.amazonaws.com:443 "HEAD /kiran-cassandra/test1/demo-dc1-default-sts-3/medusa-backup2/meta/schema.cql HTTP/1.1" 404 0
[2023-07-20 12:32:39,101] DEBUG: https://s3.amazonaws.com:443 "HEAD /kiran-cassandra/test1/demo-dc1-default-sts-3/medusa-backup2/meta/schema.cql HTTP/1.1" 404 0
ERROR:root:No such backup
[2023-07-20 12:32:39,102] ERROR: No such backup
Downloading backup medusa-backup2 to /var/lib/cassandra
What is the best practice to increase and decrease the Cassandra node count when using medusa backup