Earlier today https://app.speckle.systems encountered an approximately 10 minute outage. All services were affected.
This started at approximately 09:39 UTC and was fully resolved at 09:52 UTC.
We would like to apologise for the unscheduled outage.
This outage was caused by a routine upgrade to our server coinciding with planned database maintenance activity. Both processes required exclusive locks on certain database tables and were in conflict. This eventually resulted in all available database connections becoming ‘blocked’, and subsequently the inability of Speckle to make further connections to the database. We resolved the outage by pausing the database maintenance activity, which allowed the upgrade to complete.
To prevent further recurrences, we have paused upgrades until the database maintenance activity is complete.
The Speckle Team