tag:status.avax.network,2005:/historyAvalanche Status - Incident History2024-03-29T03:55:25ZAvalanchetag:status.avax.network,2005:Incident/200568142024-02-23T17:43:08Z2024-02-23T17:43:08ZBlock Finalization Stall<p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>17:43</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>17:36</var> UTC</small><br><strong>Update</strong> - A significant % of stake weight has upgraded to AvalancheGo@v1.11.1 and block finalization is stable. We will continue monitoring for further regressions.</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>16:36</var> UTC</small><br><strong>Monitoring</strong> - Block finalization on the Primary Network is beginning to resume. Stability will fluctuate as validators continue updating to AvalancheGo@v1.11.1.<br /><br />You can monitor block finalization here: https://subnets.avax.network/c-chain</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>15:59</var> UTC</small><br><strong>Identified</strong> - 🚨🚨 Attention Avalanche Validators 🚨🚨<br /><br />Please upgrade your node to AvalancheGo to v1.11.1: https://github.com/ava-labs/avalanchego/releases/tag/v1.11.1<br /><br />This release disables logic added in v1.10.18 that lead to validators sending an excessive amount of gossip to each other.<br /><br />Avalanche Validators provision a stake-weighted bandwidth allocation for each peer and this buggy logic led to each node saturating their allocation with useless transaction gossip. This dynamic prevented pull queries issued by the validator from being processed in a timely manner and led to consensus stalling (as no polls were being handled).<br /><br />As soon as a sufficient amount of stake upgrades to this release, consensus should return to normal.</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>11:30</var> UTC</small><br><strong>Investigating</strong> - Developers across the community are currently investigating a stall in block finalization that is preventing blocks from being accepted on the Primary Network.<br /><br />Updates will be posted here as the issue is investigated.</p>tag:status.avax.network,2005:Incident/198861932024-02-01T20:30:58Z2024-02-01T21:57:11ZBlock Ingestion Delayed<p><small>Feb <var data-var='date'> 1</var>, <var data-var='time'>20:30</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'> 1</var>, <var data-var='time'>18:34</var> UTC</small><br><strong>Update</strong> - Most services have recovered, however, some ingestion pipelines are still catching up to the latest blocks.</p><p><small>Feb <var data-var='date'> 1</var>, <var data-var='time'>18:05</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Feb <var data-var='date'> 1</var>, <var data-var='time'>15:31</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Feb <var data-var='date'> 1</var>, <var data-var='time'>15:30</var> UTC</small><br><strong>Investigating</strong> - Due to an issue with an infrastructure provider, block ingestion across the Primary Network and Subnets is delayed. This means that subnets.avax.network, Core, and stats.avax.network will not show the latest activity. Public APIs hosted by Ava Labs are still accessible.<br /><br />This outage does not affect the performance or stability of the Avalanche Network or any Subnets. You can view recent transaction activity on https://snowtrace.io or https://avascan.info.</p>tag:status.avax.network,2005:Incident/191917822023-11-22T03:24:03Z2023-11-22T03:24:03ZSnowTrace Block Ingestion Delayed<p><small>Nov <var data-var='date'>22</var>, <var data-var='time'>03:24</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>22</var>, <var data-var='time'>03:09</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and Etherscan is monitoring the results.</p><p><small>Nov <var data-var='date'>22</var>, <var data-var='time'>02:10</var> UTC</small><br><strong>Investigating</strong> - Block processing is delayed on https://snowtrace.io/. The Etherscan team is currently investigating.<br /><br />This outage does not affect the Avalanche Network. You can view recent transaction activity on https://43114.snowtrace.dev/ or https://subnets.avax.network/c-chain.</p>tag:status.avax.network,2005:Incident/189716872023-10-30T20:36:56Z2023-10-30T20:36:56ZNumerous Websites Inaccessible<p><small>Oct <var data-var='date'>30</var>, <var data-var='time'>20:36</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>30</var>, <var data-var='time'>20:22</var> UTC</small><br><strong>Monitoring</strong> - Cloudflare implemented a fix that is restoring service to the impacted sites. We are monitoring stability.</p><p><small>Oct <var data-var='date'>30</var>, <var data-var='time'>20:12</var> UTC</small><br><strong>Investigating</strong> - Due to an ongoing Cloudflare incident (https://www.cloudflarestatus.com/incidents/l6x2h1zp69bc), some websites are inaccessible. We are working with Cloudflare to restore service as soon as possible.<br /><br />This outage does not affect the Avalanche Network. You can view current transaction activity here: https://snowtrace.io/</p>tag:status.avax.network,2005:Incident/184231502023-09-08T21:15:47Z2023-09-08T21:15:47ZBitcoin Bridge Maintenance<p><small>Sep <var data-var='date'> 8</var>, <var data-var='time'>21:15</var> UTC</small><br><strong>Resolved</strong> - The Avalanche Bitcoin Bridge maintenance is now complete.</p><p><small>Sep <var data-var='date'> 7</var>, <var data-var='time'>20:27</var> UTC</small><br><strong>Identified</strong> - The Avalanche Bitcoin Bridge maintenance window is scheduled to continue until September 8th around approximately 15:00 UTC. During this time, transactions between Avalanche and Bitcoin may be delayed.<br /><br />This processing issue does not affect Ethereum transfers on the Avalanche Bridge or the Avalanche Network.</p><p><small>Sep <var data-var='date'> 7</var>, <var data-var='time'>15:10</var> UTC</small><br><strong>Investigating</strong> - The Avalanche Bitcoin Bridge is under maintenance. During this time, transactions between Avalanche and Bitcoin may be delayed.<br /><br />This processing issue does not affect Ethereum transfers on the Avalanche Bridge or the Avalanche Network.</p>tag:status.avax.network,2005:Incident/169941562023-04-28T15:08:59Z2023-04-28T15:08:59ZDelayed SnowTrace Block Ingestion<p><small>Apr <var data-var='date'>28</var>, <var data-var='time'>15:08</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Apr <var data-var='date'>28</var>, <var data-var='time'>14:31</var> UTC</small><br><strong>Investigating</strong> - Block ingestion on SnowTrace is currently delayed. The Etherscan team is currently investigating the issue.<br /><br />This outage does not affect the Avalanche Network. To view ongoing C-Chain activity, you can visit:<br />* https://subnets.avax.network/c-chain<br />* https://avascan.info/blockchain/c/home</p>tag:status.avax.network,2005:Incident/168428692023-04-13T00:41:40Z2023-04-13T00:41:40ZSnowTrace Outage<p><small>Apr <var data-var='date'>13</var>, <var data-var='time'>00:41</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Apr <var data-var='date'>13</var>, <var data-var='time'>00:13</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Apr <var data-var='date'>12</var>, <var data-var='time'>23:30</var> UTC</small><br><strong>Investigating</strong> - SnowTrace is currently inaccessible. The Etherscan team is currently investigating the issue.<br /><br />This outage does not affect the Avalanche Network. To view ongoing C-Chain activity, you can visit:<br />* https://subnets.avax.network/c-chain<br />* https://avascan.info/blockchain/c/home</p>tag:status.avax.network,2005:Incident/166508182023-03-26T12:36:25Z2023-03-26T12:36:25ZBridge Node Instability<p><small>Mar <var data-var='date'>26</var>, <var data-var='time'>12:36</var> UTC</small><br><strong>Resolved</strong> - Bridge Node stability has been restored. Transfers are being processed as expected.</p><p><small>Mar <var data-var='date'>26</var>, <var data-var='time'>12:14</var> UTC</small><br><strong>Monitoring</strong> - Bridge Node stability has improved and any pending transfers have been processed by the network. We are continuing to monitor the situation.</p><p><small>Mar <var data-var='date'>26</var>, <var data-var='time'>11:48</var> UTC</small><br><strong>Investigating</strong> - We are investigating an issue affecting the stability of Avalanche Bridge nodes. Bridge transfers may be delayed.</p>tag:status.avax.network,2005:Incident/166111632023-03-23T13:04:55Z2023-03-23T13:04:55ZBridge Node Instability<p><small>Mar <var data-var='date'>23</var>, <var data-var='time'>13:04</var> UTC</small><br><strong>Resolved</strong> - All Avalanche Bridge nodes have updated. Bridge transfers are being processed normally.</p><p><small>Mar <var data-var='date'>23</var>, <var data-var='time'>03:21</var> UTC</small><br><strong>Identified</strong> - Avalanche Bridge nodes are updating to the latest AvalancheGo release (v1.9.14) to restore stability. Avalanche Bridge transfers will be delayed until a sufficient threshold of independent nodes have been updated, which is expected within the next 12 hours.</p><p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>21:42</var> UTC</small><br><strong>Investigating</strong> - We are investigating an issue affecting the stability of Avalanche Bridge nodes. Bridge transfers may be delayed.</p>tag:status.avax.network,2005:Incident/165818152023-03-22T15:39:30Z2023-03-22T15:39:30ZDelayed Block Ingestion on P-Chain Explorer<p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>15:39</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>21</var>, <var data-var='time'>21:12</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.</p><p><small>Mar <var data-var='date'>20</var>, <var data-var='time'>22:42</var> UTC</small><br><strong>Investigating</strong> - Block ingestion is currently delayed on the P-Chain Block Explorer (https://subnets.avax.network/p-chain). In the meantime, please use AvaScan's P-Chain Block Explorer (https://avascan.info/blockchain/p/home).<br /><br />We are currently investigating the issue. The Avalanche Network is operating as expected.</p>tag:status.avax.network,2005:Incident/158132432023-01-10T19:57:34Z2023-01-10T19:57:34ZDegraded Performance on Core Web<p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>19:57</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>19:37</var> UTC</small><br><strong>Investigating</strong> - Our automated alerting tools identified us of degraded performance on https://core.app. Some pages may not load or may take awhile to load.</p>tag:status.avax.network,2005:Incident/156833032022-12-22T16:21:35Z2022-12-22T16:21:35ZIntermittent Connectivity Issues with Core Backend<p><small>Dec <var data-var='date'>22</var>, <var data-var='time'>16:21</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'>20</var>, <var data-var='time'>23:02</var> UTC</small><br><strong>Identified</strong> - We are monitoring intermittent connectivity issues with Core's backend. This issue may cause elevated load times when using Core.<br /><br />We have identified the issue and are working with our partners to resolve it.<br /><br />This does not affect the Avalanche Network, API, Explorer, or Bridge.</p>tag:status.avax.network,2005:Incident/122628522022-10-28T17:26:17Z2022-10-28T17:26:17ZValidator Health Check Under Maintenance<p><small>Oct <var data-var='date'>28</var>, <var data-var='time'>17:26</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>18</var>, <var data-var='time'>19:21</var> UTC</small><br><strong>Identified</strong> - The Validator Health Check is currently under maintenance. In the meantime, you can use https://check.allnodes.com/avax/[NodeID] or https://avascan.info/staking/validator/[NodeID] to check the health of your validator.<br /><br />This issue does not affect the Avalanche Network.</p>tag:status.avax.network,2005:Incident/118365902022-10-11T18:14:22Z2022-10-11T18:14:22ZStats Page Inaccessible<p><small>Oct <var data-var='date'>11</var>, <var data-var='time'>18:14</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>11</var>, <var data-var='time'>17:43</var> UTC</small><br><strong>Identified</strong> - We have identified the issue and are working with our partners to bring https://stats.avax.network back online.<br /><br />This issue does not affect the Avalanche Network. In the meantime, checkout the stats on https://subnets.avax.network/stats.</p>tag:status.avax.network,2005:Incident/117834912022-10-10T13:43:55Z2022-10-10T13:43:55ZBitcoin Transfers Delayed<p><small>Oct <var data-var='date'>10</var>, <var data-var='time'>13:43</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>10</var>, <var data-var='time'>05:41</var> UTC</small><br><strong>Identified</strong> - Bitcoin transfer processing on the Avalanche Bridge is delayed. The issue has been identified and the team is working to restore service. During this time, transactions between Avalanche and Bitcoin may be delayed.<br /><br />This processing issue does not affect Ethereum transfers on the Avalanche Bridge or the Avalanche Network.</p>tag:status.avax.network,2005:Incident/117638942022-10-09T22:48:24Z2022-10-09T22:48:24ZBitcoin Transfers Delayed<p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>22:48</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>22:37</var> UTC</small><br><strong>Identified</strong> - Bitcoin transfer processing on the Avalanche Bridge is delayed. The issue has been identified and the team is working to restore service. During this time, transactions between Avalanche and Bitcoin may be delayed.<br /><br />This processing issue does not affect Ethereum transfers on the Avalanche Bridge or the Avalanche Network.</p>tag:status.avax.network,2005:Incident/112143822022-09-22T14:16:15Z2022-09-22T14:16:15ZBridge Partial Outage<p><small>Sep <var data-var='date'>22</var>, <var data-var='time'>14:16</var> UTC</small><br><strong>Resolved</strong> - Bridge nodes have been updated to the latest AvalancheGo release and are now stable.</p><p><small>Sep <var data-var='date'>22</var>, <var data-var='time'>01:54</var> UTC</small><br><strong>Investigating</strong> - We are investigating instability with bridge nodes. All funds are safe. The processing of new transfers across the bridge may be delayed.</p>tag:status.avax.network,2005:Incident/111089342022-09-15T07:28:44Z2022-09-15T07:28:44ZEthereum Merge Activation<p><small>Sep <var data-var='date'>15</var>, <var data-var='time'>07:28</var> UTC</small><br><strong>Completed</strong> - The Merge activation was successful! The Avalanche Bridge has been re-enabled.</p><p><small>Sep <var data-var='date'>14</var>, <var data-var='time'>21:01</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>12</var>, <var data-var='time'>15:16</var> UTC</small><br><strong>Scheduled</strong> - Transfers to and from the Ethereum network will be disabled on the Avalanche Bridge during the Ethereum's transition from proof-of-work to proof-of-stake. For more information, see: https://support.avax.network/en/articles/6523367-ethereum-merge-faq-what-avalanche-users-need-to-know</p>tag:status.avax.network,2005:Incident/110806362022-09-08T21:00:57Z2022-09-08T22:57:29ZBridge Node Instability<p><small>Sep <var data-var='date'> 8</var>, <var data-var='time'>21:00</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'> 8</var>, <var data-var='time'>20:46</var> UTC</small><br><strong>Monitoring</strong> - Bridge nodes have been update to the latest AvalancheGo release version. Bridge transfers are now being processed again. We are continuing to monitor stability.</p><p><small>Sep <var data-var='date'> 8</var>, <var data-var='time'>12:24</var> UTC</small><br><strong>Investigating</strong> - We are investigating instability with bridge nodes. All funds are safe. New transfers across the bridge will not be processed until the issue is resolved.</p>tag:status.avax.network,2005:Incident/110673922022-09-07T05:21:23Z2022-09-07T05:21:23ZBridge Maintenance<p><small>Sep <var data-var='date'> 7</var>, <var data-var='time'>05:21</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>20:45</var> UTC</small><br><strong>Investigating</strong> - The bridge is current disabled while we are monitoring network stability. Transfers across the bridge will not be processed.</p>tag:status.avax.network,2005:Incident/110608412022-09-06T20:29:59Z2022-09-06T20:29:59ZBridge Maintenance<p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>20:29</var> UTC</small><br><strong>Completed</strong> - The network upgrade activated successfully and the bridge is again operational.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>19:45</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>00:58</var> UTC</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance as the network update is activated per: https://github.com/ava-labs/avalanchego/releases/tag/v1.8.1.<br /><br />We expect the bridge to be available shortly after the network update is successful.</p>tag:status.avax.network,2005:Incident/110601732022-09-06T17:04:53Z2022-09-06T17:04:53ZBridge Maintenance<p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>17:04</var> UTC</small><br><strong>Resolved</strong> - All bridge nodes have been successfully updated. All pending transfers from during the maintenance window have been processed. The bridge is operational. Please note the short scheduled maintenance window scheduled for 4 PM ET today when the Avalanche network update activates (see https://github.com/ava-labs/avalanchego/releases/tag/v1.8.2 for more information).</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>00:16</var> UTC</small><br><strong>Update</strong> - We are continuing to deploy the fix for this issue.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>00:14</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and the fix is being deployed. Transfers across the bridge will not be processed until all systems are updated, which is expect around 12 PM ET on 09/06/2022.</p><p><small>Sep <var data-var='date'> 5</var>, <var data-var='time'>21:44</var> UTC</small><br><strong>Update</strong> - We are working on completing the bridge maintenance as quickly as possible.</p><p><small>Sep <var data-var='date'> 5</var>, <var data-var='time'>21:43</var> UTC</small><br><strong>Investigating</strong> - The bridge is under maintenance. Transfers across the bridge will not be processed until it is complete.</p>tag:status.avax.network,2005:Incident/110534732022-09-05T14:18:59Z2022-09-05T14:18:59ZBridge Maintenance<p><small>Sep <var data-var='date'> 5</var>, <var data-var='time'>14:18</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Sep <var data-var='date'> 5</var>, <var data-var='time'>14:15</var> UTC</small><br><strong>Update</strong> - The maintenance is now complete, and both the Bitcoin and Ethereum bridges are operating normally. All pending transfers from during the maintenance window have also been processed.</p><p><small>Sep <var data-var='date'> 4</var>, <var data-var='time'>21:03</var> UTC</small><br><strong>Investigating</strong> - The BTC/ETH Bridges are currently undergoing some maintenance. During this time, transactions between Avalanche and Bitcoin/Ethereum may be delayed.<br /><br />This maintenance does not affect the Avalanche Network.</p>tag:status.avax.network,2005:Incident/107318542022-08-01T02:08:23Z2022-08-01T02:08:23ZBalances Not Loading<p><small>Aug <var data-var='date'> 1</var>, <var data-var='time'>02:08</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'> 1</var>, <var data-var='time'>01:44</var> UTC</small><br><strong>Update</strong> - Balances on the legacy Wallet, Core, and the Explorer are not loading because of an upstream issue with CoinGecko (https://status.coingecko.com/).</p><p><small>Aug <var data-var='date'> 1</var>, <var data-var='time'>01:43</var> UTC</small><br><strong>Update</strong> - Balances on the legacy Wallet, Core, and the Explorer are not loading because of an upstream issue with CoinGecko (https://status.coingecko.com/).</p><p><small>Aug <var data-var='date'> 1</var>, <var data-var='time'>01:41</var> UTC</small><br><strong>Investigating</strong> - Balances on the legacy Wallet, Core, and the Explorer are not loading because of an upstream issue with CoinGecko (https://status.coingecko.com/).</p>tag:status.avax.network,2005:Incident/107316572022-08-01T01:09:42Z2022-08-01T01:09:42ZBTC Balances/Transactions Unavailable<p><small>Aug <var data-var='date'> 1</var>, <var data-var='time'>01:09</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'> 1</var>, <var data-var='time'>00:51</var> UTC</small><br><strong>Investigating</strong> - BTC Balances and Transactions in Core are unavailable because of an issue with an upstream provider. We are currently working on fixing the issue and apologize for the inconvenience.</p>