Saturday November 1, 2025

Summary

Between 1:00 AM PDT and 2:45 AM PDT on November 1, 2025, some users were unable to upload files or create/use canvases in Slack, often resulting in an error.

We traced this back to an unexpected spike in error rates for the files.upload API endpoint, caused by database timeouts stemming from an ongoing backend job.

We temporarily paused the job to reduce traffic to the affected database and implemented additional logic handling to properly balance volume. This allowed the database to recover and correctly serve requests, resolving the issue for all affected users.

9:13 AM PST

Resolved

At around 1:00 AM PDT on November 1, 2025, we observed an error related to file upload. Users experienced issues while uploading files. This problem was caused by an ongoing incident triggered by a migration job running on the database. The issue self-resolved, consequently fixing the file upload problem. The issue was resolved at 2:45 AM PDT.

We've adjusted this entry to properly reflect impact & resolution timestamps. We apologize for any confusion.

3:13 AM PST