Hello!
We are experiencing a storage issue in the Netherlands affecting some IWstack instances. As a result, some volumes are being lost for a yet unknown cause, probably related to how Cloudstack handles migration internally. This is a complex bug which might take a while to sort out.
If your instance is stopped and not restarting, then this is most likely as a result of this bug. Please create a new instance and attach the data disks of the old one.
In theory, the snapshots should be possible to restore, but the attempt is made on the node which is down, resulting in a host not found error.
We will update this announcement when we have more information.
Please remember we do not own the NL datacenter and depending on the remote hands there which can create further delays.
We are sorry for the inconvenience.
Update on the work October 9th 2024:
Some of the stopped instances should be able to start now. Most of the snapshots should be restorable, but please try to start the instance first and only attempt a restore if it doesn't start. There is a small number of instances where more work is needed and we are not sure about the outcome.
Update October 10th 2024:
We consider this issue closed at this time. If you are still experiencing issues, it is most likely because the storage problem occurred at a bad time (snapshot or heavy disk activity). If your instance is still affected, please open/reply a ticket so we can give you more detailed information pertaining to your case. That being said, all snapshots must be restorable, UNLESS they occurred exactly when the storage was unavailable. There should be a very limited number in that category, most likely less than a handful.
Tuesday, October 8, 2024
Powered by WHMCompleteSolution
