Massive Google outage impacting some site functionality

Incident Report for HOA Express

Postmortem

A detailed write-up from Google explaining how the outage occurred is available on Google’s status page. Cloudflare, whose outage was caused by Google’s, wrote their own detailed write-up from their perspective. Both explained the steps they’re taking to prevent this kind of outage from occurring again.

Posted Jun 16, 2025 - 08:52 CDT

Resolved

The outages appear to have been resolved by Google and Cloudflare, at least as far as they impact our platform and services. As suspected, the root cause of the Cloudflare outage appears to have been the massive global Google outage.
Posted Jun 12, 2025 - 16:22 CDT

Update

We are continuing to monitor updates from both Google & Cloudflare. As it stands:

- Most file-related functionality has been restored by Google.
- Some sections of the Admin Portal are unavailable.
- The sign in process, which is protected by Google’s security products, has elevated rates of errors.
Posted Jun 12, 2025 - 14:11 CDT

Update

While they haven’t shared an update yet, Google appears to have made progress, allowing some site functionality related to viewing & uploading files to work properly again. Other companies appear to be noticing improvements from Google as well.
Posted Jun 12, 2025 - 13:56 CDT

Identified

Posted Jun 12, 2025 - 13:48 CDT

Update

Our company website and the Admin Portal appear to be available again, though Cloudflare is noting they’re seeing “intermittent” outages.
Posted Jun 12, 2025 - 13:37 CDT

Update

Cloudflare has posted about the outage on their end: https://www.cloudflarestatus.com/incidents/25r9t0vz99rp. Still no update from Google.
Posted Jun 12, 2025 - 13:36 CDT

Update

Google has yet to post about the massive outage on their end: https://status.cloud.google.com/. Our engineering team continues to watch the situation closely and hopes Google’s team is able to resolve the outage quickly.
Posted Jun 12, 2025 - 13:26 CDT

Update

Our investigation points to a massive outage with Google’s widely used “Cloud Storage” product, impacting a large portion of the internet, including Spotify, Etsy, Mailchimp, Box, YouTube, Gmail, IKEA, Shopify, and Wells Fargo, to name a few.
Posted Jun 12, 2025 - 13:24 CDT

Update

The outage appears to have expanded, causing our company website, Admin Portal, and other front ends to be unreachable.
Posted Jun 12, 2025 - 13:20 CDT

Update

The outage appears to be impacting Google’s own products, like Google Drive.
Posted Jun 12, 2025 - 13:13 CDT

Investigating

Google and Cloudflare, two companies that power part of our infrastructure, appear to be having simultaneous and potentially related outages that are impacting some site functionality, including uploading files. Neither company has posted about the outage yet, so we are unclear as to the full extent of the outage.
Posted Jun 12, 2025 - 13:09 CDT
This incident affected: Community websites, Admin Portal, Company website, Third parties and Behind-the-scenes components (Data storage).