Affecting System - Ryzen1.egc.fra.luxvps.net Outage
23:23:
Ryzen1.egc.fra.luxvps.net Outage
We are currently experiencing a failure of the Ryzen node Ryzen1.egc.fra.luxvps.net. We are already working on it.
01:32:
We expect to have found and fixed the problem. We apologize for any inconvenience caused.
All KVM servers on this host system have already been started by us.
22-06-2024 23.02
We are currently seeing sporadic load peaks on the system.
We're waiting for the new hardware to fully replace the system. And we assume that we will be able to migrate all customers to the new system, live on Wednesday. As soon as this is completed, all affected customers will be credited with 14 days of runtime.
The incident will be updated again once all customers have been migrated.
26-06-2024 17.55
All customers have been migrated. 14 Days of runtime has also been added to all servers on that node
Affecting System - Ryzen11
We are currently investigating an issue on Ryzen11
---
15.52
The problem should be resolved, we are currently monitoring the system.
If you continue to experience problems, please contact our support.
26-06-2024 17.47
The issue has been fully resolved.
Affecting Other - EGC, Combahton
Information on the outage on 07.06.2024
Due to a failure of Combahton's core router (core01.ffm3, Interxion), our EGC location was unavailable on June 07, 2024, from 12:10 to 15:17.
Status reports:
Combahton: https://status.combahton.net/incidents/xrndsf14gjbx
EGC: https://enormategreencenter.statuspage.io/incidents/bl35xwht2h5m
Luxvps: https://status.luxvps.net / https://billing.luxvps.net/serverstatus.php?view=resolved
The longer downtime of our site compared to competitors using the same core can be explained by the lack of redundancies, such as a backup connection, which should take effect in the event of a Combahton outage. This is surprising, as we assumed that such a measure should already be in place.
The EGC website puts it as follows:
"Enormate-Green offers you a high quality network with a connection of over 400 Gbit/s and an uptime of 99.99%. Our locations at Interxion & Equinix meet the highest requirements and guarantee a smooth service. Thanks to a direct connection to DE-CIX, the world's largest internet exchange, and our traffic mix structure, we are able to prevent downtime and provide you with a reliable connection."
https://www.enormate-green.center/network-services
As you may already know, we are planning to leave our EGC site. The recent outage confirms our decision. Further information on the move will follow; this is planned for November 2024 and will be to the Tornado DC.
Despite a downtime of 187 minutes, our SLA of 99.2% was not undercut. No refunds or credits are therefore currently planned. Should we receive a credit note from the data center, we will pass this on accordingly.
However, we currently have no further information on any developments in this regard.
If you have any further questions, please open a support ticket.
Affecting Server - Luxvps
Ryzen8 is currently not reachable. As the DC has no 24/7 staff currently, we are waiting for a technician to check the system.
Ryzen8 is up and running again.
We will now migrate all customers from ryzen8 to new ryzen Gen3 Nodes and decommission ryzen8.
All Customers have been credited with 3 Days of runtime as compensation.
The Migration is live and the customers will not notice it.
Affecting Other - EQ7 Network
Currently, the network in our EQ7 location is not reachable.
22.06
Fixed, the issue was something with the upstream of the DDoS protection provider.
Affecting Other - Premium Protection
Servers with Premium Protection could not resolve any DNS records.
Affecting System - Ryzen 8
Ryzen8 Outage
Currently, ryzen8 is unreachable.
20.22 Update
Ryzen8 is available again, after a cold reboot by the technician.
Affecting Server - Luxvps
The Ryzen10 node was frozen and can be accessed again after a hard reset by a technician.
Affecting Server - Luxvps
Our EGC Location had an issue, we are currently starting all servers. Currently we have no statement on what happend.
EQ7 Customers are not affected by this.
All VMs on the following Hosts are currently started. (You can for the most part also start your kvm yourself)
epyc1
ryzen20
ryzen15
vhost1.egc 1-8
All but one Xeon Host (vhost28) is now up and running. Ryzen KVM will now all be started.
All ryzen KVMs are starting.
Everything is now up and running again. If you're service still is down, please contact us.
Affecting System - Billing Portal
Our billing portal will be down for a short period while we change our main domain to billing.luxvps.net instead of billing.luxvps.xyz
After it's done, all links from billing.luxvps.xyz will be sent to billing.luxvps.net automatically.
Affecting Other - Eypc1 & billing portal
Maintenance work on epyc1
Due to a hardware upgrade, the system will not be available at the specified time.
Start: 24.02.2024 6:00 PM ((UTC+01:00) Europe/Copenhagen)
End: 24.02.2024 7:00 PM ((UTC+01:00) Europe/Copenhagen)
Affecting Server - Luxvps
Maintenance work on storage1
Due to a hardware upgrade, the system will not be available at the specified time.
Start: 10-02-2023 12:00 AM ((UTC+01:00) Europe/Copenhagen)
End: 10-02-2023 1:00 PM ((UTC+01:00) Europe/Copenhagen)
Affecting System - EGC
There is currently a problem with some servers at our EGC site. The datacenter is currently investigating where the problem lies.
Do not open a ticket, the problems are known.
update:
The datacenter reports a power loss in the 1st rack due to a phase failure. (Exact cause is still being investigated)
The servers are now being started one by one. There are currently 9 hosts + Epyc in this rack. All other KVMs will be accessible again as soon as the routers in the 1st rack are online again, the others will then be started.
Update:
Router in the 1st rack is online again. This means that the 2nd rack is accessible again.
Servers in Rack1 are currently starting.
Update:
All hosts except Epyc1 are running again, the VMs will be started gradually. However, you can already start your VM yourself.
Update:
Epyc1 is now online again.
This means that everything has been fixed.
Affecting System - Ryzen19
Ryzen19 is currently unavailable, a technician is already investigating the problem.
Node is accessible again, servers on the node are currently starting.
Affecting System - ryzen11, ryzen19, ryzen13, ryzen21, ryzen10
Due to a small move to another shelf, your service will not be available during this time. We ask for your understanding.
Affecting System - storage1, vhost6, vhost8, vhost26, vhost27, vhost28, epyc1
During the specified time, your service may be unavailable. We apologize for any inconvenience this may cause and appreciate your understanding.
Start: 27.11.2023 02:00 PM (UTC+01:00) Europe/Berlin)
End: 27.11.2023 05:00 PM (UTC+01:00) Europe/Berlin)
Reason: Due to the move to our new location, our servers will be relocated. Servers will not be available during this time. We ask for your understanding.
Affecting System - ITP/EGC
Maintenance work on the network infrastructure ITP/EGC.
On 10-11-2023 at 23:00 GMT+01:00, maintenance work will be carried out on the core infrastructure of the ITP/EGC.
The maintenance work is scheduled for one hour, a downtime of more than 10 minutes should be not expected.
Primarily, the core network will be changed so that traffic will no longer go through the ITP, as is currently the case.
All servers in the ITP and EGC are affected. Also, our website and API.
Servers in EQ7 are not affected.
Affecting System - Ryzen 15
Ryzen 15 down, we're already working on it.
Affecting System - Control panel, API, Reseller panels
We're doing some maintenance work on the following:
- Control panel (control.luxvps.net)
- API (backend.control.luxvps.net)
- Reseller Panels
Maintenance time:
17/09/2023 1:00 am - 17/09/2023 3:00 am
Affecting Server - Luxvps
vHost10 is currently down due to 2 fan failures.
10:21
VMs on the node have been distributed to other nodes, but currently have to be restarted by the customer. At the moment it doesn't look like vhost10 can be used again.
10:30
Ceph rebalance has also been completed. So we give the all-clear. Orders may be reactivated later.
17:38
Orders for Xeon will be possible again from tomorrow evening. 14-08-2023
Affecting Server - Luxvps
Partial failure EGC.
We have been experiencing a partial failure of the EGC data center for a few minutes. The following KVM nodes are currently affected:
ryzen11,ryzen12, ryzen13,ryzen19.
Update 08:22
VMs on Ryzen11 starting again
VMs on Ryzen13 starting again
VMs on ryzen19 are starting again
09:35
The EGC has been completely down for a few minutes now, we're waiting for info from the data center.
09:56
EGC is accessible again. KVMs start again. May take a few minutes before everything is running as usual again.
Affected were:
ryzen11, ryzen12, ryzen13,ryzen19,ryzen20,ryzen21.
22:07
Only some ryzen customers are affected, please open a ticket to know if you're affected.
Dear customers,
due to a phase interruption, which occurred yesterday Monday in the power grid of the energy supplier, there will be an interruption of the power grid on Wednesday, 09.08.2023 between 08:00 and 15:00
During this time, the power company will carry out measurements in the entire area of the EGC data center in order to localize the problem.
For these measurements, it is necessary that the entire district is without power.
As soon as the problem is localized, it will be corrected by the power company.
After power is restored to the district, we will reboot all systems.
Please note that this will take some time.
Since we are not able to bring all systems online at the same time, we have to act with a small time delay.
We are very sorry for the emergency maintenance and apologize for any inconvenience this may cause.
We are in constant direct contact with the energy provider to keep the downtime as low as possible.
14:18 09-08-2023
KVMs starting on most nodes, only one missing.
14:20
Ryzen21, Ryzen11 running fine again ✅
Ryzen12 ✅
Ryzen13 ✅
Ryzen20 ✅
Ryzen19 ✅
✅Systems should be running again✅
Affecting Server - Luxvps
Ryzen20 maintenance.
Due to a hardware defect on Ryzen20, the system will be maintained on Monday and will be unavailable for a short period of time:
Start: 19.06.2023 12:00 PM ((UTC+02:00) Europe/Copenhagen)
End: 19.06.2023 12:30 PM ((UTC+02:00) Europe/Copenhagen)
Reason: Hardware change due to hardware defect.
Only a few is affected by this.
Affecting Other - Billing and Landing page Maintenance
Affecting Other - Some Ryzen systems and Storage Servers
18.11
Outage - Some Ryzen systems and Storage Servers.
Due to a defective power supply, the systems listed above are currently not accessible.
A technician on site is already checking where the problem is and will then start the systems again.
18.47
Everything is starting again. It will take some minutes.
19.10
Everything is online again.
Affecting Other - Datacenter Network issues
Hello dear customers,
Looks like our datacenter had network issues but it should all be working again.
We're very sorry for the inconveniences.
