All Systems Operational
Azure SQL Databases Operational
Management Portal Operational
Web Workers Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
Autoupgrade for Deploy 3.5.x Dec 1, 08:00-17:00 CET
Umbraco Deploy 3.5.2 will be released on Tuesday next week.
Release notes can be found on Our (https://our.umbraco.com/packages/developer-tools/umbraco-deploy/)

Projects running Deploy 3.5.x will be automatically upgraded.
The upgrade will be available as a minor upgrade for sites using a previous minor.

Expected release date: December 1st - 2020, 8:00 CET
Expected upgrade window: December 1st - 2020, 8:00-17:00 CET
Posted on Nov 26, 09:29 CET
Past Incidents
Nov 28, 2020

No incidents reported today.

Nov 27, 2020

No incidents reported.

Nov 26, 2020
Completed - The scheduled maintenance has been completed.
Nov 26, 12:00 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 16, 06:00 CET
Scheduled - (Rescheduled maintenance with new maintenance-window)

On November 16th until November 27th (weekdays only), we will perform scheduled maintenance on the remainder of Umbraco Cloud sites that need to have media moved to Azure Blob Storage.

During the announced maintenance-window, your project is expected to restart once causing short temporary unavailability of your site.

An email will be sent out today to the affected projects with more information about the rescheduling.

During the maintenance, we’ll be moving media to Azure Blob Storage which is a more modern, faster and future-proof way of storing media data. A move that’ll also allow for future infrastructural improvements on Umbraco Cloud.


Why have we rescheduled the maintenance?

Given recent incidents on Umbraco Cloud, we’re prioritising all efforts to improve the infrastructure of Umbraco Cloud in order to provide better performance stability.

Migrating Umbraco Cloud sites to blob storage is one of these efforts which is why we’ve found it necessary to move up this scheduled maintenance. We ask for your understanding and apologise for any inconvenience this rescheduling may cause.
Nov 13, 13:51 CET
Nov 25, 2020

No incidents reported.

Nov 24, 2020

No incidents reported.

Nov 23, 2020

No incidents reported.

Nov 22, 2020

No incidents reported.

Nov 21, 2020
Completed - The scheduled maintenance has been completed.
Nov 21, 09:29 CET
Update - The maintenance has been successfully completed and operations are back to normal.
We continue to verify the effect of the maintenance and ensure that all services continue to run as expected.
Nov 21, 08:00 CET
Update - Maintenance of Umbraco Cloud is still ongoing and on schedule.

A few sites may experience downtime as we complete the final steps of the maintenance.
Nov 21, 06:45 CET
Update - Scheduled maintenance is still in ongoing and on schedule.

- The Umbraco Cloud Portal is now open and cloud services has been enabled.
- Some websites will still be recovering from downtime as we complete the maintenance.

Thank you for your patience.
Nov 21, 04:28 CET
Update - Maintenance of Umbraco Cloud is still ongoing and on schedule.

As previously announced partial and temporary downtime of sites is expected during the maintenance window.

We will update here when the maintenance is completed and operations are back to normal.
Nov 21, 01:29 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 21, 00:00 CET
Update - Management Portal is now unavailable as maintenance is initiated.
Nov 20, 23:54 CET
Update - Further information regarding this maintenance: The Umbraco Cloud portal and services will be unavailable from 23:45 and throughout the maintenance window.

You are still able to access your site and the Umbraco backoffice directly while the website is online.

Due to the nature of this maintenance, partial and temporary downtime is expected throughout the maintenance window.
Nov 20, 12:33 CET
Update - Clarification: There was an error in the original notification regarding the timing of the upcoming maintenance.

The maintenance window starts at midnight, 00:00 CET between Friday, November 20th and Saturday November 21st. and ends 8 hours later at 08:00 CET November 21st.

We are sorry for the confusion.
Nov 17, 20:08 CET
Scheduled - On the night from Friday to Saturday at 00:00 CET we will initiate additional emergency maintenance for Umbraco Cloud related to recent issues with hosting performance.

A central component of Umbraco Cloud hosting management will be replaced during this maintenance to ensure continued stability and performance of website hosting on Umbraco Cloud in the future.

Due to the nature of this maintenance, partial and temporary downtime is expected throughout the maintenance window.

To ensure full recovery of all Umbraco Cloud hosted websites the window is open until 08:00 am CET, but we will recover each hosted website as fast as possible to complete the maintenance and limit the impact.

We are aware that this is a short notice and we do apologize for the inconvenience. We are doing this as it is a necessary step to ensure stable operations going forward.

As announced with the incident on November 12th, we’re hosting a live post-mortem webinar tomorrow, Wednesday November 18th. The webinar will give you a thorough overview of the work we have planned going forward to prevent incidents like the once we’ve experienced lately. We’re hosting the webinar twice so you can pick a time that suits you.

- Wednesday November 18th at 10:00 CET: https://umbraco.zoom.us/webinar/register/WN_up_InRstR8qv8y0Lx_XdcQ

- Wednesday November 18th at 17:00 CET: https://umbraco.zoom.us/webinar/register/WN_JjZIVZTtTuS7eY-h5XcBLA
Nov 17, 17:32 CET
Nov 20, 2020

No incidents reported.

Nov 19, 2020

No incidents reported.

Nov 18, 2020

No incidents reported.

Nov 17, 2020
Completed - The scheduled maintenance has been completed.
Nov 17, 00:00 CET
Verifying - Maintenance was successfully executed without any negative impact on our hosting services.
We are currently verifying all changes and expect to close the maintenance window at 00:00.
Nov 16, 22:31 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 16, 22:00 CET
Scheduled - Tonight at 22:00 CET we will initiate additional emergency maintenance for Umbraco Cloud related to recent issues with production incidents. The maintenance is not expected to cause downtime but may result in temporary and partial downtime for our hosted websites. The maintenance window is expected complete no later than 04:00 am CET

As announced with the incident on November 12th, we’re hosting a live post-mortem webinar on Wednesday November 18th. The webinar will give you a thorough overview of the work we have planned going forward to prevent incidents like the once we’ve experienced lately. We’re hosting the webinar twice so you can pick a time that suits you.

- Wednesday November 18th at 10:00 CET: https://umbraco.zoom.us/webinar/register/WN_up_InRstR8qv8y0Lx_XdcQ

- Wednesday November 18th at 17:00 CET: https://umbraco.zoom.us/webinar/register/WN_JjZIVZTtTuS7eY-h5XcBLA
Nov 16, 14:33 CET
Nov 16, 2020
Nov 15, 2020

No incidents reported.

Nov 14, 2020
Postmortem - Read details
Nov 18, 11:57 CET
Resolved - All sites are now up and running. 

Rest assured that we will keep taking all the necessary steps to prevent incidents from happening in the future. This is important to us, and we are pursuing multiple ways of ensuring stable operations. 

Earlier today, we shared a Management Statement regarding the incident. You can read it right here: https://umbraco.com/blog/umbraco-cloud-incident-1311-14112020/

If you're experiencing any issues, please contact the Umbraco Cloud support at contact@umbraco.com, and they’ll be ready to help. Furthermore, a postmortem will be available within 5 workdays.

We sincerely apologize for the inconvenience caused.
Nov 14, 13:16 CET
Update - All sites are now up and running and we continue to monitor.

Next update will be no later than at 13:30 CET.
Nov 14, 11:48 CET
Monitoring - All sites are now up and running and we continue to monitor.

Next update will be no later than at 13:30 CET.
Nov 14, 11:19 CET
Update - We still have a handful of sites being down and are working on getting them up and running.

Next update will be no later than at 11:30 CET.
Nov 14, 10:29 CET
Update - We continue to see a decrease in the number of sites being down, and we keep working on getting the last sites up and running.

Next update will be no later than at 10:30 CET.
Nov 14, 09:25 CET
Update - We still have a decreasing number of sites being down after the maintenance and are working to get the last sites up and running.

Next update will be no later than at 09:30 CET.
Nov 14, 08:28 CET
Update - We are done with the maintenance tasks and during the night we have made several upgrades to the hosting setup in collaboration with Microsoft and external consultants. We still see a subset of sites being down and we are working on getting them online before we close the maintenance.

Next update will be no later than at 08:30 CET
Nov 14, 07:27 CET
Update - We are done implementing the changes we planned for the maintenance.

A subset of sites are not responding yet as a consequence of them having been offline for the maintenance operations, but the number of sites online is continuously increasing and we expect all sites to be back to normal operations soon.

We will not end the maintenance window before all sites are back online again.

Next update will be no later than 07:30 CET
Nov 14, 06:31 CET
Update - The maintenance is taking slightly longer than expected. We estimate that we are able to close the maintenance window at 07:30.

Next update will be no later than at 06:30 CET
Nov 14, 05:25 CET
Update - Work is continuing as planned for the maintenance. We still expect periods where sites can become unavailable within the maintenance window.

Next update will be no later than 05:30 CET
Nov 14, 04:22 CET
Update - Maintenance is continuing as planned. Like mentioned earlier we still expect there to be periodic downtime while we perform the work.

Next update will be no later than at 04:30 CET
Nov 14, 03:20 CET
Update - Maintenance is still going according to plan and we have performed the first tasks successfully. We still expect sites to go down within the maintenance window as we need to perform more work that can't be done while the sites are running.

Next update will be no later than at 03:30 CET
Nov 14, 02:24 CET
Update - The maintenance is continuing as planned. During the upcoming time we expect sites to become unavailable as part of the maintenance as they are restarting.

We will update here no later than 02:30 CET
Nov 14, 01:26 CET
Update - We are continuing to work on the underlaying issue for the recent incidents in the maintenance window.

Next update will be no later than at 01:30 CET
Nov 14, 00:21 CET
Update - As you know we have previously announced a scheduled maintenance at 01:00 CET aiming to improve the current performance however we will commence at 23:30 CET and keep the window open until 06:00 CET 14-11-2020

We expect additional downtime of sites during the maintenance.

We are painstakingly aware of how bad the current situation is for you and your customers.

We have external consultants on board and are in dialogue with Microsoft on the issue.

We are of course actively monitoring the situation closely and are ready to mitigate any negative impact during and after the maintenance.

After the maintenance we will know more and reassess which further actions might need to be taken.

We don’t have all the answers right now but rest assured that we will give full disclosure once we do and will keep you updated on statuspage as soon as we have new information to share.

Our sincere apologies

Kim Sneum Madsen - CEO
Nov 13, 23:20 CET
Identified - The majority of sites are running normally at this point. We are continuing work on getting all sites back to normal and on implementing a long term solution.

Next update will be no later than at 23:45 CET.
Nov 13, 22:45 CET
Update - We still have a number of sites down and are investigating the issue as well as potential options to resolve it.

Next update will be no later than at 23:30 CET.
Nov 13, 22:27 CET
Update - We are currently seeing a number of Cloud sites being unavailable and are investigating the issue.

Next update will be no later than at 22:30 CET.
Nov 13, 21:26 CET
Investigating - We are currently investigating this issue.
Nov 13, 20:20 CET
Completed - The scheduled maintenance has been completed.
Nov 14, 11:52 CET
Update - Active maintenance is completed. We are currently in the verifying stage and we're working on making sure that all sites are up and running.
Nov 14, 11:50 CET
Verifying - Active maintenance is completed. We are currently in the verifying stage and we're working on making sure that all sites are up and running.
Nov 14, 10:26 CET
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 13, 23:30 CET
Scheduled - On Friday, November 13th 23:30 PM - Saturday, November 16th 10:00 AM, we will perform scheduled maintenance on Umbraco Cloud.

Whereas previously we expected no downtime during this maintenance we have decided to extend the work we do during this maintenance window due to the recent incidents as announced in the incident update 23:20 CET.

This maintenance is related to the recent incidents on Umbraco Cloud.

The work does not end with this maintenance - this is one of more actions in order to provide you with a stable hosting platform.
Nov 12, 15:57 CET