Sauce Status - Incident history https://sauceapp.instatus.com Sauce Fri, 8 Aug 2025 02:45:00 +0000 Scheduled maintenance Type: Maintenance Duration: 10 minutes Affected Components: Web App Aug 8, 02:45:00 GMT+0 - Identified - We are upgrading our systems. This requires a short app down-time. Aug 8, 02:45:00 GMT+0 - Identified - We are upgrading our systems. This requires a short app down-time. Aug 8, 02:55:00 GMT+0 - Completed - Maintenance has completed successfully Type: Maintenance

Duration: 10 minutes

Affected Components:

<p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>02:45:00</var> GMT+0</small><br><strong>Identified</strong> - We are upgrading our systems. This requires a short app down-time..</p> <p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>02:45:00</var> GMT+0</small><br><strong>Identified</strong> - We are upgrading our systems. This requires a short app down-time..</p> <p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>02:55:00</var> GMT+0</small><br><strong>Completed</strong> - Maintenance has completed successfully.</p> ]]> Fri, 8 Aug 2025 02:45:00 +0000 https://sauceapp.instatus.com/maintenance/cme283cqi0005xfvcu3viz6it https://sauceapp.instatus.com/maintenance/cme283cqi0005xfvcu3viz6it Max RDS CPU usage reached Type: Incident Duration: 3 hours and 23 minutes Affected Components: Web App, API Jul 29, 02:58:58 GMT+0 - Resolved - This incident has been resolved. Jul 29, 01:31:14 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Jul 28, 23:36:00 GMT+0 - Investigating - We are currently investigating this incident. Jul 29, 00:04:00 GMT+0 - Identified - We have found the root cause and are continuing to work on a fix for this incident. Type: Incident

Duration: 3 hours and 23 minutes

Affected Components: ,

<p><small>Jul <var data-var='date'> 29</var>, <var data-var='time'>02:58:58</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Jul <var data-var='date'> 29</var>, <var data-var='time'>01:31:14</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> <p><small>Jul <var data-var='date'> 28</var>, <var data-var='time'>23:36:00</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>Jul <var data-var='date'> 29</var>, <var data-var='time'>00:04:00</var> GMT+0</small><br><strong>Identified</strong> - We have found the root cause and are continuing to work on a fix for this incident..</p> ]]> Mon, 28 Jul 2025 23:36:00 +0000 https://sauceapp.instatus.com/incident/cmdnrzdww00zdl8ad8e8y4vyg https://sauceapp.instatus.com/incident/cmdnrzdww00zdl8ad8e8y4vyg Highlight retrieval coming back as empty Type: Incident Duration: 1 hour and 15 minutes Affected Components: Web App May 27, 07:10:00 GMT+0 - Identified - We are continuing to work on a fix for this incident. May 27, 08:25:18 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 1 hour and 15 minutes

Affected Components:

<p><small>May <var data-var='date'> 27</var>, <var data-var='time'>07:10:00</var> GMT+0</small><br><strong>Identified</strong> - We are continuing to work on a fix for this incident..</p> <p><small>May <var data-var='date'> 27</var>, <var data-var='time'>08:25:18</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Tue, 27 May 2025 07:10:00 +0000 https://sauceapp.instatus.com/incident/cmb68ngda000pvrq11p9ueglr https://sauceapp.instatus.com/incident/cmb68ngda000pvrq11p9ueglr Search experience degradation for subset of users Type: Incident Duration: 19 minutes Affected Components: Web App May 15, 06:58:20 GMT+0 - Investigating - We are currently investigating this incident. May 15, 07:00:36 GMT+0 - Identified - We've found the root cause and is deploying a fix May 15, 07:17:32 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 19 minutes

Affected Components:

<p><small>May <var data-var='date'> 15</var>, <var data-var='time'>06:58:20</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>May <var data-var='date'> 15</var>, <var data-var='time'>07:00:36</var> GMT+0</small><br><strong>Identified</strong> - We've found the root cause and is deploying a fix.</p> <p><small>May <var data-var='date'> 15</var>, <var data-var='time'>07:17:32</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Thu, 15 May 2025 06:58:20 +0000 https://sauceapp.instatus.com/incident/cmap0q0ra007hhy3yrw5sw6lb https://sauceapp.instatus.com/incident/cmap0q0ra007hhy3yrw5sw6lb Service outage Type: Incident Duration: 20 minutes Affected Components: Web App, Analysis Pipeline, API May 1, 14:05:00 GMT+0 - Identified - Sauce services have experienced some downtime. This resulted in a period of application inaccessibility. We've identified that this was caused by a set of expensive and unusually frequent queries being run that were consuming over resource capacity. We're working on putting together a mitigation strategy so this no longer impacts the service. May 1, 14:25:00 GMT+0 - Resolved - The issue is resolved however we are monitoring this for any further degradation in the service. Type: Incident

Duration: 20 minutes

Affected Components: , ,

<p><small>May <var data-var='date'> 1</var>, <var data-var='time'>14:05:00</var> GMT+0</small><br><strong>Identified</strong> - Sauce services have experienced some downtime. This resulted in a period of application inaccessibility. We've identified that this was caused by a set of expensive and unusually frequent queries being run that were consuming over resource capacity. We're working on putting together a mitigation strategy so this no longer impacts the service..</p> <p><small>May <var data-var='date'> 1</var>, <var data-var='time'>14:25:00</var> GMT+0</small><br><strong>Resolved</strong> - The issue is resolved however we are monitoring this for any further degradation in the service..</p> ]]> Thu, 1 May 2025 14:05:00 +0000 https://sauceapp.instatus.com/incident/cma5h9oxr002lnbpfibwbelnm https://sauceapp.instatus.com/incident/cma5h9oxr002lnbpfibwbelnm Space page down Type: Incident Duration: 30 minutes Affected Components: Web App Apr 30, 07:41:44 GMT+0 - Identified - We are continuing to work on a fix for this incident. Apr 30, 07:50:10 GMT+0 - Resolved - This incident has been resolved. Apr 30, 07:20:00 GMT+0 - Investigating - We are currently resolving this incident. Type: Incident

Duration: 30 minutes

Affected Components:

<p><small>Apr <var data-var='date'> 30</var>, <var data-var='time'>07:41:44</var> GMT+0</small><br><strong>Identified</strong> - We are continuing to work on a fix for this incident..</p> <p><small>Apr <var data-var='date'> 30</var>, <var data-var='time'>07:50:10</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Apr <var data-var='date'> 30</var>, <var data-var='time'>07:20:00</var> GMT+0</small><br><strong>Investigating</strong> - We are currently resolving this incident..</p> ]]> Wed, 30 Apr 2025 07:20:00 +0000 https://sauceapp.instatus.com/incident/cma3mmng2007d12s5dqj8xldb https://sauceapp.instatus.com/incident/cma3mmng2007d12s5dqj8xldb Search term filtering down Type: Incident Duration: 5 hours and 17 minutes Affected Components: Web App Dec 11, 23:18:00 GMT+0 - Identified - There is an ongoing incident with a third-party we depend on that is causing our search term filters to fail. We are closely monitoring the situation and exploring ways of diversifying this bottleneck so that this dependency doesn't cause this kind of widespread issue. Dec 12, 04:35:20 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 5 hours and 17 minutes

Affected Components:

<p><small>Dec <var data-var='date'> 11</var>, <var data-var='time'>23:18:00</var> GMT+0</small><br><strong>Identified</strong> - There is an ongoing incident with a third-party we depend on that is causing our search term filters to fail. We are closely monitoring the situation and exploring ways of diversifying this bottleneck so that this dependency doesn't cause this kind of widespread issue..</p> <p><small>Dec <var data-var='date'> 12</var>, <var data-var='time'>04:35:20</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Wed, 11 Dec 2024 23:18:00 +0000 https://sauceapp.instatus.com/incident/cm4kkm4q8001apfqnu81y29bw https://sauceapp.instatus.com/incident/cm4kkm4q8001apfqnu81y29bw Search performance heavily degraded with semantic options. Type: Incident Duration: 16 hours and 55 minutes Affected Components: Web App Oct 4, 06:05:21 GMT+0 - Investigating - We are aware of an issue impacting our search feature. There is a large increase in delay for results to be returned. We are currently investigating this incident. Oct 4, 09:09:59 GMT+0 - Identified - We've identified that this issue exists in our service handling semantic searching. We are currently working on a fix. Oct 4, 13:52:59 GMT+0 - Monitoring - We implemented a fix and are currently monitoring the result. Oct 4, 14:00:00 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 16 hours and 55 minutes

Affected Components:

<p><small>Oct <var data-var='date'> 4</var>, <var data-var='time'>06:05:21</var> GMT+0</small><br><strong>Investigating</strong> - We are aware of an issue impacting our search feature. There is a large increase in delay for results to be returned. We are currently investigating this incident..</p> <p><small>Oct <var data-var='date'> 4</var>, <var data-var='time'>09:09:59</var> GMT+0</small><br><strong>Identified</strong> - We've identified that this issue exists in our service handling semantic searching. We are currently working on a fix..</p> <p><small>Oct <var data-var='date'> 4</var>, <var data-var='time'>13:52:59</var> GMT+0</small><br><strong>Monitoring</strong> - We implemented a fix and are currently monitoring the result..</p> <p><small>Oct <var data-var='date'> 4</var>, <var data-var='time'>14:00:00</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Fri, 4 Oct 2024 06:05:21 +0000 https://sauceapp.instatus.com/incident/cm1ubmxim0006darfjnswl4m0 https://sauceapp.instatus.com/incident/cm1ubmxim0006darfjnswl4m0 Various timeouts when fetching data Type: Incident Duration: 8 days, 3 hours and 35 minutes Affected Components: Web App Apr 29, 00:00:00 GMT+0 - Investigating - We are currently investigating this incident. Apr 29, 00:30:00 GMT+0 - Identified - We've identified that the cause of the issue is due to an exhaustion of database connections disallowing new query execution. Apr 29, 01:19:04 GMT+0 - Identified - We have resolved a portion of the issue that was impacting data fetching, however there is still a remaining issue with insights not being retrieved. We are continuing to work on a fix. Apr 29, 03:15:34 GMT+0 - Resolved - We've implemented a fix that has resolved the issue. We'll be monitoring for any further issues. Apr 29, 09:41:05 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 8 days, 3 hours and 35 minutes

Affected Components:

<p><small>Apr <var data-var='date'> 29</var>, <var data-var='time'>00:00:00</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>Apr <var data-var='date'> 29</var>, <var data-var='time'>00:30:00</var> GMT+0</small><br><strong>Identified</strong> - We've identified that the cause of the issue is due to an exhaustion of database connections disallowing new query execution..</p> <p><small>Apr <var data-var='date'> 29</var>, <var data-var='time'>01:19:04</var> GMT+0</small><br><strong>Identified</strong> - We have resolved a portion of the issue that was impacting data fetching, however there is still a remaining issue with insights not being retrieved. We are continuing to work on a fix..</p> <p><small>Apr <var data-var='date'> 29</var>, <var data-var='time'>03:15:34</var> GMT+0</small><br><strong>Resolved</strong> - We've implemented a fix that has resolved the issue. We'll be monitoring for any further issues..</p> <p><small>Apr <var data-var='date'> 29</var>, <var data-var='time'>09:41:05</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Mon, 29 Apr 2024 00:00:00 +0000 https://sauceapp.instatus.com/incident/clvk9m2lf51062binjlzdzjqs9 https://sauceapp.instatus.com/incident/clvk9m2lf51062binjlzdzjqs9 TEST - SQS events failing to be processed Type: Incident Affected Components: Analysis Pipeline Mar 18, 07:06:00 GMT+0 - Monitoring - We've identified the issue and confirmed that it is no longer occurring. Mar 18, 07:06:00 GMT+0 - Investigating - We are currently investigating this incident. Mar 18, 07:06:00 GMT+0 - Resolved - The issue has been resolved Type: Incident

Affected Components:

<p><small>Mar <var data-var='date'> 18</var>, <var data-var='time'>07:06:00</var> GMT+0</small><br><strong>Monitoring</strong> - We've identified the issue and confirmed that it is no longer occurring..</p> <p><small>Mar <var data-var='date'> 18</var>, <var data-var='time'>07:06:00</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident..</p> <p><small>Mar <var data-var='date'> 18</var>, <var data-var='time'>07:06:00</var> GMT+0</small><br><strong>Resolved</strong> - The issue has been resolved.</p> ]]> Mon, 18 Mar 2024 07:06:00 +0000 https://sauceapp.instatus.com/incident/clu56fduy423716b5ol4s8nezrb https://sauceapp.instatus.com/incident/clu56fduy423716b5ol4s8nezrb Errors with analysis pipeline. Type: Incident Mar 12, 23:32:02 GMT+0 - Resolved - This incident has been resolved. Mar 12, 23:05:00 GMT+0 - Investigating - We are currently investigating this incident. We're seeing a high rate of errors encountered in a part of our feedback analysis pipeline. Type: Incident

<p><small>Mar <var data-var='date'> 12</var>, <var data-var='time'>23:32:02</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> <p><small>Mar <var data-var='date'> 12</var>, <var data-var='time'>23:05:00</var> GMT+0</small><br><strong>Investigating</strong> - We are currently investigating this incident. We're seeing a high rate of errors encountered in a part of our feedback analysis pipeline..</p> ]]> Tue, 12 Mar 2024 23:05:00 +0000 https://sauceapp.instatus.com/incident/cltp0b3vn41109b9n3j4du8kan https://sauceapp.instatus.com/incident/cltp0b3vn41109b9n3j4du8kan Recurring API 503 Errors Type: Incident Duration: 19 minutes Affected Components: API, Web App Feb 28, 23:50:00 GMT+0 - Identified - We've identified the cause of the problem and are working on a fix. Feb 29, 00:00:00 GMT+0 - Resolved - We've applied the fix and services have returned to Operational status. Feb 28, 23:41:00 GMT+0 - Investigating - We've identified an issue where the API is responding with intermittent 503 errors. We're currently investigating the cause of this. Type: Incident

Duration: 19 minutes

Affected Components: ,

<p><small>Feb <var data-var='date'> 28</var>, <var data-var='time'>23:50:00</var> GMT+0</small><br><strong>Identified</strong> - We've identified the cause of the problem and are working on a fix..</p> <p><small>Feb <var data-var='date'> 29</var>, <var data-var='time'>00:00:00</var> GMT+0</small><br><strong>Resolved</strong> - We've applied the fix and services have returned to Operational status..</p> <p><small>Feb <var data-var='date'> 28</var>, <var data-var='time'>23:41:00</var> GMT+0</small><br><strong>Investigating</strong> - We've identified an issue where the API is responding with intermittent 503 errors. We're currently investigating the cause of this..</p> ]]> Wed, 28 Feb 2024 23:41:00 +0000 https://sauceapp.instatus.com/incident/clt6jm0r469539azorugxhtoem https://sauceapp.instatus.com/incident/clt6jm0r469539azorugxhtoem Issues with Exploring and filtering Type: Incident Duration: 2 hours and 3 minutes Affected Components: Web App Nov 26, 23:40:18 GMT+0 - Monitoring - We've implemented a fix and are currently rolling it out. We will continue to monitor until we are satisfied that it is resolved. Nov 26, 23:59:31 GMT+0 - Resolved - We've deployed the fix and verified that functionality has returned to normal. This incident has been resolved. Nov 26, 21:56:07 GMT+0 - Identified - There is an issue impacting the web application that causes it to crash when taking certain actions. The places we currently know of that are impacted: - Explore: Performing a search in Explore is causing the app to crash - Teams: Some orgs are experiencing an app crash when opening the Team Settings tab. - Feeds: Filtering highlights on the Feed page is not properly filtering the highlights We've identified the cause of the issue and are working on a fix. Type: Incident

Duration: 2 hours and 3 minutes

Affected Components:

<p><small>Nov <var data-var='date'> 26</var>, <var data-var='time'>23:40:18</var> GMT+0</small><br><strong>Monitoring</strong> - We've implemented a fix and are currently rolling it out. We will continue to monitor until we are satisfied that it is resolved..</p> <p><small>Nov <var data-var='date'> 26</var>, <var data-var='time'>23:59:31</var> GMT+0</small><br><strong>Resolved</strong> - We've deployed the fix and verified that functionality has returned to normal. This incident has been resolved..</p> <p><small>Nov <var data-var='date'> 26</var>, <var data-var='time'>21:56:07</var> GMT+0</small><br><strong>Identified</strong> - There is an issue impacting the web application that causes it to crash when taking certain actions. The places we currently know of that are impacted: - Explore: Performing a search in Explore is causing the app to crash - Teams: Some orgs are experiencing an app crash when opening the Team Settings tab. - Feeds: Filtering highlights on the Feed page is not properly filtering the highlights We've identified the cause of the issue and are working on a fix..</p> ]]> Sun, 26 Nov 2023 21:56:07 +0000 https://sauceapp.instatus.com/incident/clpg0ra6s33046b9mv0wnthgiv https://sauceapp.instatus.com/incident/clpg0ra6s33046b9mv0wnthgiv Website temporarily unavailable Type: Incident Duration: 1 hour and 35 minutes Affected Components: Web App Jul 4, 01:01:24 GMT+0 - Identified - We are continuing to work on a fix for this incident. Jul 4, 01:02:59 GMT+0 - Resolved - We're rolling out some significant changes to our storage architecture. The impacted sections of the application are: - Insights - Feedback - Features - Outcomes We estimate this will be fixed within 5 minutes of when the outage began. Type: Incident

Duration: 1 hour and 35 minutes

Affected Components:

<p><small>Jul <var data-var='date'> 4</var>, <var data-var='time'>01:01:24</var> GMT+0</small><br><strong>Identified</strong> - We are continuing to work on a fix for this incident..</p> <p><small>Jul <var data-var='date'> 4</var>, <var data-var='time'>01:02:59</var> GMT+0</small><br><strong>Resolved</strong> - We're rolling out some significant changes to our storage architecture. The impacted sections of the application are: - Insights - Feedback - Features - Outcomes We estimate this will be fixed within 5 minutes of when the outage began..</p> ]]> Tue, 4 Jul 2023 01:01:24 +0000 https://sauceapp.instatus.com/incident/cljnl3vmn162598brodw8ukszvj https://sauceapp.instatus.com/incident/cljnl3vmn162598brodw8ukszvj Feedback and feature links not displaying correctly Type: Incident Duration: 21 minutes Affected Components: Web App Jun 30, 12:38:32 GMT+0 - Identified - We are continuing to work on a fix for this incident. Jun 30, 12:59:03 GMT+0 - Resolved - This incident has been resolved. Type: Incident

Duration: 21 minutes

Affected Components:

<p><small>Jun <var data-var='date'> 30</var>, <var data-var='time'>12:38:32</var> GMT+0</small><br><strong>Identified</strong> - We are continuing to work on a fix for this incident..</p> <p><small>Jun <var data-var='date'> 30</var>, <var data-var='time'>12:59:03</var> GMT+0</small><br><strong>Resolved</strong> - This incident has been resolved..</p> ]]> Fri, 30 Jun 2023 12:38:32 +0000 https://sauceapp.instatus.com/incident/cljik927k336130x0ohogc1u9qu https://sauceapp.instatus.com/incident/cljik927k336130x0ohogc1u9qu