tag:status.webpagetest.org,2005:/historyWebpagetest Status - Incident History2024-03-28T18:39:42ZWebpagetesttag:status.webpagetest.org,2005:Incident/202158832024-03-18T19:00:56Z2024-03-18T19:00:56ZPlanned Datacenter Maintenance - Monday, March 18th 06:00 PM ET to 07:00 PM ET.<p><small>Mar <var data-var='date'>18</var>, <var data-var='time'>19:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>18</var>, <var data-var='time'>18:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>15:01</var> UTC</small><br><strong>Scheduled</strong> - Catchpoint will be performing planned maintenance at our Las Vegas datacenter on Monday, March 18th 06:00 PM ET to 07:00 PM ET.<br /> <br />All WebPageTest services will continue to operate during the maintenance. <br />However, we are expecting a brief downtime of 10-15 minutes during the maintenance window. <br /><br />For questions, please reach out to us at support@catchpoint.com.</p>tag:status.webpagetest.org,2005:Incident/200506322024-02-29T19:00:56Z2024-02-29T19:00:56ZPlanned Datacenter Maintenance - Thursday, February 29th 06:00 PM ET to 07:00 PM ET.<p><small>Feb <var data-var='date'>29</var>, <var data-var='time'>19:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>29</var>, <var data-var='time'>18:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>22</var>, <var data-var='time'>18:42</var> UTC</small><br><strong>Scheduled</strong> - Catchpoint will be performing planned maintenance at our Las Vegas datacenter on Thursday, February 29th 06:00 PM ET to 07:00 PM ET.<br /> <br />All WebPageTest services will continue to operate during the maintenance. <br />However, we are expecting a brief downtime of 10-15 minutes during the maintenance window. <br /><br />For questions, please reach out to us at support@catchpoint.com.</p>tag:status.webpagetest.org,2005:Incident/200667592024-02-24T21:45:43Z2024-02-24T21:45:43ZEmergency Datacenter Maintenance - Saturday, February 24th from 16:30 to 17:30 EST<p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>21:45</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>21:30</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>20:06</var> UTC</small><br><strong>Scheduled</strong> - During the maintenance window, WebPageTest user management and test history may be unavailable for a short period.<br /><br />For questions, please reach out to us at support@catchpoint.com</p>tag:status.webpagetest.org,2005:Incident/199687122024-02-24T15:00:56Z2024-02-24T15:00:56ZPlanned Datacenter Maintenance - Saturday, February 24th from 13:00 to 15:00 EST<p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>15:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>24</var>, <var data-var='time'>13:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>12</var>, <var data-var='time'>18:37</var> UTC</small><br><strong>Scheduled</strong> - During the maintenance window, Catchpoint Portal and API will have intermittent periods of limited functionality. WebPageTest user management and test history may be unavailable.<br /><br />For questions, please reach out to us at support@catchpoint.com</p>tag:status.webpagetest.org,2005:Incident/198017062024-01-23T17:54:37Z2024-01-23T17:54:37ZWebPageTest Issue<p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>17:54</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>04:11</var> UTC</small><br><strong>Monitoring</strong> - WPT was down for about 30 min from around 22:03 till 22:33 EST. Things are back up and stable right now and we are monitoring.</p>tag:status.webpagetest.org,2005:Incident/191909462023-11-21T18:30:00Z2023-11-21T23:10:01ZWebPageTest Issue<p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>18:30</var> UTC</small><br><strong>Resolved</strong> - We are aware of a brief issue with WebPageTest UI where users would not have been able to run tests between 1PM ET and 1:30 PM ET. There is an issue with our subscription management vendor and they are actively working on resolving this issue.<br /><br />Please contact us at support@catchpoint.com if you have any questions.</p>tag:status.webpagetest.org,2005:Incident/180208652023-08-01T14:39:45Z2023-08-01T14:39:45ZWPT test not running intermittently<p><small>Aug <var data-var='date'> 1</var>, <var data-var='time'>14:39</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'> 1</var>, <var data-var='time'>14:19</var> UTC</small><br><strong>Identified</strong> - We have identified and remedied an issue where WPT tests were not running intermittently and return a “Test Not Found”. We’re actively working on the root cause, will provide more updates here as they become available.<br /><br />Please contact us at support@catchpoint.com if you have any questions.</p>tag:status.webpagetest.org,2005:Incident/163556992023-03-07T03:15:33Z2023-03-07T13:19:03ZWebPageTest Server Down<p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>03:15</var> UTC</small><br><strong>Resolved</strong> - We've resolved the issue and all services have been restored.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>00:00</var> UTC</small><br><strong>Monitoring</strong> - The issue has been resolved and we're now monitoring. Login services will remain down for a little while as we monitor and ensure functionality is stable.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>19:00</var> UTC</small><br><strong>Update</strong> - WebPageTest appears to be suffering from a Distributed Denial of Service attack. We're currently working on shutting down the attack and getting service restored.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>17:51</var> UTC</small><br><strong>Identified</strong> - We believe we have identified the issue and are deploying a fix.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>16:26</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>16:25</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Mar <var data-var='date'> 6</var>, <var data-var='time'>16:00</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating this issue.</p>tag:status.webpagetest.org,2005:Incident/159695882023-01-29T23:49:46Z2023-01-29T23:49:46ZWebPageTest performance degradation<p><small>Jan <var data-var='date'>29</var>, <var data-var='time'>23:49</var> UTC</small><br><strong>Resolved</strong> - WebPageTest.org and WebPageTest monitors in the Catchpoint Portal experienced a performance degradation from 4:40 PM EST to 6:37 PM EST, we have resolved the issue.<br /><br />Please contact us at support@catchpoint.com if you have any questions.</p>tag:status.webpagetest.org,2005:Incident/123222972022-10-27T01:00:28Z2022-10-27T01:00:28ZPlanned Datacenter Maintenance - Wednesday, October 26th 08:00 PM ET to 09:00 PM ET.<p><small>Oct <var data-var='date'>27</var>, <var data-var='time'>01:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'>27</var>, <var data-var='time'>00:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'>19</var>, <var data-var='time'>18:24</var> UTC</small><br><strong>Scheduled</strong> - Catchpoint will be performing planned maintenance at our Las Vegas datacenter on Wednesday, October 26th, at 08:00 PM ET to 09:00 PM ET. <br /><br />All Webpagetest services will continue to operate during the maintenance. However, we are expecting a brief downtime of 10-15 minutes during the maintenance window.<br /><br />For questions, please reach out to us at support@catchpoint.com.</p>tag:status.webpagetest.org,2005:Incident/112380232022-10-08T12:00:00Z2022-10-08T12:00:00ZPlanned Datacenter Maintenance - Saturday, October 8th 10:00 AM to 12:00 PM ET<p><small>Oct <var data-var='date'> 8</var>, <var data-var='time'>12:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'> 8</var>, <var data-var='time'>10:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>23</var>, <var data-var='time'>18:44</var> UTC</small><br><strong>Scheduled</strong> - Catchpoint will be performing a planned maintenance at our Las Vegas datacenter on Saturday, October 8th 10:00 AM to 12:00 PM ET.<br />All Catchpoint services will continue to operate during the maintenance. However, we are expecting a brief downtime of 10-15 minutes during the maintenance window.<br /><br />During the maintenance we expect the following features to be unavailable for up to 10 minutes.<br />- Registering as a User<br />- Signing up for the API version<br />- Viewing new items in Test History<br /><br />All tests will continue to run as normal during this period, and once the maintenance is complete, all tests, including tests run during the maintenance window, will show in history.</p>tag:status.webpagetest.org,2005:Incident/110353552022-09-10T11:00:34Z2022-09-10T12:23:48ZPlanned Datacenter Maintenance - Saturday, September 10th 9:00 AM to 11:00 AM ET<p><small>Sep <var data-var='date'>10</var>, <var data-var='time'>11:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been postponed. We will create a new post once we have the next schedule.</p><p><small>Sep <var data-var='date'>10</var>, <var data-var='time'>09:01</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'> 1</var>, <var data-var='time'>18:44</var> UTC</small><br><strong>Scheduled</strong> - Catchpoint will be performing a planned maintenance at our Las Vegas datacenter on Saturday, September 10th 9:00 AM to 11:00 AM ET.<br />All Catchpoint services will continue to operate during the maintenance. However, we are expecting a brief downtime of 5-10 minutes during the maintenance window.<br /><br />During the maintenance we expect the following features to be unavailable for up to 10 minutes.<br />- Registering as a User<br />- Signing up for the API version<br />- Viewing new items in Test History<br /><br />All tests will continue to run as normal during this period, and once the maintenance is complete, all tests, including tests run during the maintenance window, will show in history.</p>tag:status.webpagetest.org,2005:Incident/108410852022-08-16T22:38:19Z2022-08-16T22:38:19ZWebpagetest test run issue<p><small>Aug <var data-var='date'>16</var>, <var data-var='time'>22:38</var> UTC</small><br><strong>Resolved</strong> - A configuration change at 16:53 EDT impacted the ability for users that were logged in to run tests in the user interface or the API. We have reverted the change at 18:05 and is investigating why it had an unintended effect.<br /><br />Please contact us at support@webpagetest.org if you have any questions.<br /><br />Thanks.</p>tag:status.webpagetest.org,2005:Incident/108044352022-08-11T17:55:22Z2022-08-11T17:55:22ZWebpage Test<p><small>Aug <var data-var='date'>11</var>, <var data-var='time'>17:55</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'>11</var>, <var data-var='time'>12:01</var> UTC</small><br><strong>Monitoring</strong> - Fix has been deployed and we are monitoring webpagetest.org portal.</p><p><small>Aug <var data-var='date'>11</var>, <var data-var='time'>11:52</var> UTC</small><br><strong>Investigating</strong> - We noticed connectivity issues to our core data center that affected Webpage Test portal.</p>tag:status.webpagetest.org,2005:Incident/107108852022-07-28T18:30:12Z2022-07-28T21:27:33ZIntermittent failures on webpagetest.org<p><small>Jul <var data-var='date'>28</var>, <var data-var='time'>18:30</var> UTC</small><br><strong>Resolved</strong> - The servers has remained stable and the issue is now being marked as resolved.</p><p><small>Jul <var data-var='date'>28</var>, <var data-var='time'>17:35</var> UTC</small><br><strong>Monitoring</strong> - The intermittent failures were triggered by an AWS issue (https://health.aws.amazon.com/health/status). All servers are back up and running and we're monitoring to make sure everything remains stable.</p><p><small>Jul <var data-var='date'>28</var>, <var data-var='time'>17:22</var> UTC</small><br><strong>Investigating</strong> - There are some intermittent failures occurring on www.webpagetest.org. We're in the process of investigating the root cause.</p>tag:status.webpagetest.org,2005:Incident/94536742022-03-14T22:00:23Z2022-03-14T22:00:23ZPlanned Datacenter Network Maintenance - Monday, March 14th from 9PM to 10PM ET<p><small>Mar <var data-var='date'>14</var>, <var data-var='time'>22:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>14</var>, <var data-var='time'>21:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 3</var>, <var data-var='time'>15:30</var> UTC</small><br><strong>Scheduled</strong> - Catchpoint will be performing a planned network maintenance at our Las Vegas datacenter on Monday, March 14th from 9PM to 10PM ET.<br />During the maintenance we expect a loss of connectivity of up to 15 minutes.<br /><br />During the maintenance we expect the following features to be unavailable for up to 15 minutes.<br />- Registering as a User<br />- Signing up for the API version<br />- Viewing new items in Test History<br /><br />All tests will continue to run as normal during this period, and once the maintenance is complete, all tests, including tests run during the maintenance window, will show in history.<br /><br />All functionality will be available again after 10pm.</p>tag:status.webpagetest.org,2005:Incident/91728722022-01-27T03:06:38Z2022-01-27T03:06:38ZNetwork Maintenance - Wednesday, January 26th from 9:15PM to 10PM ET.<p><small>Jan <var data-var='date'>27</var>, <var data-var='time'>03:06</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>27</var>, <var data-var='time'>02:41</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>27</var>, <var data-var='time'>02:08</var> UTC</small><br><strong>Scheduled</strong> - Catchpoint will be performing a network maintenance at our Las Vegas datacenter on Wednesday, January 26th from 9PM to 10PM ET.<br /><br />During the maintenance we expect the following features to be unavailable for up to 30 minutes.<br />- Registering as a User<br />- Signing up for the API version<br />- Viewing new items in Test History<br /><br />All tests will continue to run as normal during this period, and once the maintenance is complete, all tests, including tests run during the maintenance window, will show in history.<br /><br />All functionality will be available again after 10pm.</p>tag:status.webpagetest.org,2005:Incident/83736182021-11-02T04:25:21Z2021-11-02T04:25:21ZTest History Rollback - November 1<p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>04:25</var> UTC</small><br><strong>Resolved</strong> - All test history for the past 6 days has been backfilled. We'll be releasing the rolled back changes in the coming days.</p><p><small>Nov <var data-var='date'> 1</var>, <var data-var='time'>23:35</var> UTC</small><br><strong>Identified</strong> - In order to fix an issue with the history that some new registered users were facing, we rolled back a recent code change.<br /><br />With the rollback we also have removed the history for last 6 days. We are working as we speak on backfilling the history of the last 6 days.<br /><br />We plan to fix the defect and release the rolled back features in the coming days.</p>tag:status.webpagetest.org,2005:Incident/83102992021-10-25T17:15:47Z2021-10-27T16:16:06ZAPI and Test History Outage<p><small>Oct <var data-var='date'>25</var>, <var data-var='time'>17:15</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved. UPDATE AS OF 10/26: The test history for all manual tests from during this incident have been added to the database. Only the "Run By" field is empty, everything else has been successfully backfilled.</p><p><small>Oct <var data-var='date'>25</var>, <var data-var='time'>13:48</var> UTC</small><br><strong>Monitoring</strong> - Due to a misconfiguration, the API was unable to authenticate and test results were not showing in the test history, starting at 5:00 PM EDT on October 23. We've identified the issue and applied the fix. We're working on backfilling all manual test data during the down period.</p><p><small>Oct <var data-var='date'>25</var>, <var data-var='time'>13:32</var> UTC</small><br><strong>Identified</strong> - We've identified an issue with the test history not returning new tests, and tests run via the API not being able to run (manual testing still works as expected). We're working on a fix.</p>tag:status.webpagetest.org,2005:Incident/82977572021-10-23T21:00:36Z2021-10-23T21:00:36ZDatabase Maintenance - October 23 12:00-17:00 EST<p><small>Oct <var data-var='date'>23</var>, <var data-var='time'>21:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'>23</var>, <var data-var='time'>16:03</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'>23</var>, <var data-var='time'>12:40</var> UTC</small><br><strong>Scheduled</strong> - On Saturday, October 23rd, WebPageTest will be doing maintenance on 12:00pm-5:00pm Eastern Time.<br /><br />During this time the following capabilities will be disabled: <br /><br />- Registering as a User<br />- Signing up for the API version<br />- Viewing new items in Test History <br /><br />All tests will continue to run as normal during this period, and once the maintenance is complete, all tests, including tests run during the maintenance window, will show in history. <br /><br />All functionality will be available again after 5pm.</p>