tag:status.cellsynt.com,2005:/historyCellsynt AB Status - Incident History2024-03-29T06:23:31+01:00Cellsynt ABtag:status.cellsynt.com,2005:Incident/110631482022-09-07T08:17:19+02:002022-09-07T08:17:19+02:00Premium SMS: 3 Sweden charging issues<p><small>Sep <var data-var='date'> 7</var>, <var data-var='time'>08:17</var> CEST</small><br><strong>Resolved</strong> - The incident was resolved at 2022-09-06 23:38.<br />We have monitored the situation since then and can confirm everything is back to normal.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>17:17</var> CEST</small><br><strong>Identified</strong> - 3 Sweden just provided us with a short update:<br /><br />"The database restore is progressing according to plan but ETR has been moved to 2022-09-07 at 00:00 CEST (so another ~7 hours from now). Further updates will be sent when we have more information."</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>12:03</var> CEST</small><br><strong>Update</strong> - We will continue to monitor the situation and let you know if we receive updates on the development of the situation.</p><p><small>Sep <var data-var='date'> 6</var>, <var data-var='time'>09:45</var> CEST</small><br><strong>Investigating</strong> - 3 Sweden is currently experiencing technical issues which affects the majority of all charged transactions for their subscribers. The root cause is a corrupt database in 3's technical platform which they are now in the process of restoring. Unfortunately, restoring the database is expected to take some time and current expected time of completion is 20:00.<br /><br />Our platform automatically retries charging a number of times before giving up and during this time the transaction status will be seen as "unknown". Eventually, if we are unable to charge a subscriber, transaction status will be updated to "failed".</p>tag:status.cellsynt.com,2005:Incident/96000072022-03-22T14:30:54+01:002022-03-22T14:31:32+01:00Premium SMS: Telenor Sweden charging issues<p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>14:30</var> CET</small><br><strong>Resolved</strong> - Everything has continued to look good so we will therefore now conclude this incident to be resolved.</p><p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>13:49</var> CET</small><br><strong>Monitoring</strong> - Telenor just reported that the problem should be resolved since 12:58 CET.<br />Based on our monitoring we can confirm that everything looks good from our end as well.<br /><br />We will continue to monitor the situation for a while to make sure everything is stable before marking this incident as resolved.</p><p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>11:41</var> CET</small><br><strong>Update</strong> - Unfortunately the disturbance is still ongoing. We are continuing to monitor the situation and are in contact with Telenor to make sure the problem gets resolved as soon as possible.</p><p><small>Mar <var data-var='date'>22</var>, <var data-var='time'>09:19</var> CET</small><br><strong>Identified</strong> - Telenor Sweden is currently experiencing technical issues which affects the majority of all charged transactions for their subscribers. The problem started as a side-effect after a planned maintenance last night.<br /><br />We have been assured by Telenor that they are currently working with the highest priority to get the problem resolved.<br /><br />Our platform automatically retries charging a number of times before giving up and during this time the transaction status will be seen as "unknown". Eventually, if we are unable to charge a subscriber, transaction status will be updated to "failed".</p>tag:status.cellsynt.com,2005:Incident/95650202022-03-18T08:14:56+01:002022-03-18T08:14:56+01:00Premium SMS: Telia Sweden charging issues<p><small>Mar <var data-var='date'>18</var>, <var data-var='time'>08:14</var> CET</small><br><strong>Resolved</strong> - Since 23:40 we have observed that everything is stable and back to normal again.</p><p><small>Mar <var data-var='date'>17</var>, <var data-var='time'>16:06</var> CET</small><br><strong>Monitoring</strong> - Although we have not yet received any communication from Telia stating that the problem has been resolved we can see that since 13:55 the situation has stabilized. Currently the majority of all transactions complete immediately.<br /><br />We will continue to monitor the situation to make sure everything eventually returns back to normal.</p><p><small>Mar <var data-var='date'>17</var>, <var data-var='time'>13:05</var> CET</small><br><strong>Identified</strong> - Telia Sweden are currently experiencing internal IT problems which means charging of their subscribers has not worked properly from time to time during the day. We have been assured that Telia is working with the highest priority on addressing the problems.<br /><br />Our platform automatically retries charging a number of times before giving up and during this time transaction status will be seen as "unknown". Eventually, if we are not able to charge a subscriber, the transaction status will be updated to "failed".<br /><br />As soon as Telia's platform is available, charging of their subscribers will automatically start working.<br />Charging via all other operators (3, Tele2 and Telenor) is unaffected by this incident.</p>tag:status.cellsynt.com,2005:Incident/62425202021-02-11T11:58:27+01:002021-02-11T11:58:27+01:00Premium SMS: Telia Sweden charging issues<p><small>Feb <var data-var='date'>11</var>, <var data-var='time'>11:58</var> CET</small><br><strong>Resolved</strong> - Everything has continued to be stable since our last update and Telia have now also officially confirmed that the problem has been resolved.</p><p><small>Feb <var data-var='date'>11</var>, <var data-var='time'>09:53</var> CET</small><br><strong>Monitoring</strong> - Although Telia has not yet communicated any progress update we can see in our monitoring that since 09:40 CET a majority of all transactions are successful again.<br />We will continue to monitor the situation and provide an update as soon as we have more information.</p><p><small>Feb <var data-var='date'>11</var>, <var data-var='time'>08:59</var> CET</small><br><strong>Identified</strong> - Telia Sweden has experienced a database crash resulting in that charging of subscribers in their network does not currently work. We have been assured that Telia is working with the highest priority to restore functionality.<br /><br />Our platform automatically retries charging a number of times before giving up and during this time the transaction status will be seen as "unknown". Eventually, if we are not able to charge a subscriber, the transaction status will be updated to "failed".<br /><br />As soon as Telia's platform becomes available again, charging of their subscribers will automatically start working.<br />Charging via the other three operators (3, Tele2 and Telenor) is unaffected by this incident.</p>tag:status.cellsynt.com,2005:Incident/46001102020-07-13T13:06:38+02:002020-07-13T13:06:38+02:00Telenor Sweden SMS delivery issues<p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>13:06</var> CEST</small><br><strong>Resolved</strong> - Telenor has confirmed that this issue has now been resolved.</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>11:29</var> CEST</small><br><strong>Update</strong> - This issue is unfortunately still ongoing. Telenor has confirmed this is an issue within their SMSCs and they are working with the highest priority to fix the issue.</p><p><small>Jul <var data-var='date'>13</var>, <var data-var='time'>10:26</var> CEST</small><br><strong>Identified</strong> - Telenor Sweden is currently experiencing technical issues within their network which is causing delivery delays for SMS sent to some of their subscribers. The error has been reported to the operator and we have received confirmation that this is currently being worked on with the highest priority.</p>tag:status.cellsynt.com,2005:Incident/41363542020-05-18T13:47:29+02:002020-05-18T13:50:53+02:00Telenor Sweden SMS delivery issues<p><small>May <var data-var='date'>18</var>, <var data-var='time'>13:47</var> CEST</small><br><strong>Resolved</strong> - Telenor has confirmed this issue to be resolved. The issue was ongoing between 08:18-11:42 CEST (UTC +2). Messages sent during this time frame have been delivered, although sometimes with a delay. We apologize for any negative impact this has had for you and your customers.</p><p><small>May <var data-var='date'>18</var>, <var data-var='time'>11:30</var> CEST</small><br><strong>Monitoring</strong> - We have not yet received any official information from Telenor regarding a solution to the problem but we can see that during the last 20 minutes the delivery situation has improved a lot. We will be continuing to monitor the situation until we see it stabilize and receive feedback from Telenor.</p><p><small>May <var data-var='date'>18</var>, <var data-var='time'>09:30</var> CEST</small><br><strong>Update</strong> - Telenor has now posted an update on their official status page (https://www.telenor.se/kundservice/driftinformation/) with information about the incident.</p><p><small>May <var data-var='date'>18</var>, <var data-var='time'>08:56</var> CEST</small><br><strong>Identified</strong> - Telenor Sweden is currently experiencing technical issues within their network which is causing delivery delays for SMS sent to their subscribers. We have received confirmation that this is currently being worked on with the highest priority.</p>tag:status.cellsynt.com,2005:Incident/18897222018-09-09T04:00:33+02:002018-09-09T04:00:33+02:00Infrastructure maintenance<p><small>Sep <var data-var='date'> 9</var>, <var data-var='time'>04:00</var> CEST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'> 9</var>, <var data-var='time'>00:00</var> CEST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'> 3</var>, <var data-var='time'>14:33</var> CEST</small><br><strong>Scheduled</strong> - We will be performing maintenance to our infrastructure to further enhance the reliability of our services. While we expect the maintenance to not last more than an hour we have set out a four hour maintenance window in case anything unexpected comes up.<br />During the maintenance our web applications (for sending SMS and administrating PSMS campaigns) and the PSMS API (se-2) will be unavailable for short periods of time. The API for sending SMS (se-1) will not be affected by this maintenance.</p>tag:status.cellsynt.com,2005:Incident/17746302018-06-18T15:05:57+02:002018-06-18T15:05:57+02:00Telenor Sweden SMS delivery issues<p><small>Jun <var data-var='date'>18</var>, <var data-var='time'>15:05</var> CEST</small><br><strong>Resolved</strong> - The problem has now been resolved according to Telenor SE.<br />We can confirm this in our monitoring, in fact message delivery has been working fine for the last 1½ hours.<br /><br />We will in any case continue monitoring the situation at our side to make sure everything continues to be stable.<br />On behalf of Telenor we sincerely apologize for any inconvenience this has resulted in for you and your customers.</p><p><small>Jun <var data-var='date'>18</var>, <var data-var='time'>13:42</var> CEST</small><br><strong>Update</strong> - We are continuing to monitor the situation and we can see that during the 10-15 last minutes the delivery situation has improved a lot. Telenor has however not yet said anything about any resolution.<br /><br />They are posting more information about this incident at https://www.telenor.se/kundservice/driftinformation/mobiltelefoni-och-mobilt-bredband/information-om/driftstorningar/</p><p><small>Jun <var data-var='date'>18</var>, <var data-var='time'>12:02</var> CEST</small><br><strong>Identified</strong> - Telenor Sweden is currently experiencing technical issues within their network which is causing delivery delays for sent SMS to their subscribers. We have received confirmation from Telenor that they are currently working on getting this resolved with the highest priority.</p>tag:status.cellsynt.com,2005:Incident/15959212018-02-08T16:36:54+01:002018-02-08T16:36:54+01:00Telenor Sweden SMS delivery issues<p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>16:36</var> CET</small><br><strong>Resolved</strong> - The delivery situation has continued to be stable so as far as it concerns us and our customers we now deem the problem to be resolved (although Telenor has not yet officially announced the problem as resolved).</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>14:34</var> CET</small><br><strong>Monitoring</strong> - The situation has stabilized and delivery times appear to be back to normal. We are awaiting official information from Telenor though and will not mark the problem as resolved until then.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>13:10</var> CET</small><br><strong>Update</strong> - The situation with issues in Telenor's network is unfortunately continuing. We are monitoring the situation for progress and will provide an update as soon as we have more information.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>10:50</var> CET</small><br><strong>Update</strong> - We are seeing improvements for message delivery to Telenor but the situation has still not fully recovered. We will continue monitoring the situation.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>08:24</var> CET</small><br><strong>Identified</strong> - Telenor Sweden is currently experiencing technical issues within their network which is causing delivery delays for sent messages to their subscribers. We have escalated the issue to the operator and they are currently working on getting this resolved with the highest priority.
<br />More information about this disturbance can be found at https://www.telenor.se/kundservice/drift-och-tackning/driftinformation/driftstorningar/</p>tag:status.cellsynt.com,2005:Incident/9569172016-10-22T00:38:00+02:002016-10-22T10:12:35+02:00Availability issues due to DDoS attack against DNS servers<p><small>Oct <var data-var='date'>22</var>, <var data-var='time'>00:38</var> CEST</small><br><strong>Resolved</strong> - Our upstream DNS provider Dyn has reported that this issue now has been resolved. This is consistent with our previous status update that from what we've seen the situation has been stable since 22:30 CEST.
<br />
<br />We are sorry for any negative impact this has had to you and your services. Please do not hesitate reaching out to us if you have any questions or concerns.</p><p><small>Oct <var data-var='date'>21</var>, <var data-var='time'>23:17</var> CEST</small><br><strong>Monitoring</strong> - Although Dyn has not yet reported the issue to be over we can see that during the last 30 minutes everything has been stable again.
<br />We will of course continue to monitor the situation and you are more than welcome contacting us on support@cellsynt.com if you have any questions.
<br />You can also follow Dyn's incident report detailing the underlying issue directly at https://www.dynstatus.com/incidents/nlr4yrr162t8</p><p><small>Oct <var data-var='date'>21</var>, <var data-var='time'>20:23</var> CEST</small><br><strong>Identified</strong> - Like for many other companies (PayPal, Twitter, Spotify etc) our customers may currently experience problems reaching our services due to a large DDoS (distributed denial of service) attack on the company Dyn's DNS services which is a affecting a lot of Internet services right now. Updates regarding this attack can be followed at https://www.dynstatus.com/incidents/nlr4yrr162t8
<br />
<br />All our services / platforms are working as they should but as this attack hits the DNS servers it means lookups from names (e.g. www.cellsynt.com) to IP addresses (e.g. 1.2.3.4) do not work reliably and causes intermittent problems reaching our services.</p>tag:status.cellsynt.com,2005:Incident/7590752016-09-05T18:12:23+02:002016-09-05T18:12:23+02:00Availability issues<p><small>Sep <var data-var='date'> 5</var>, <var data-var='time'>18:12</var> CEST</small><br><strong>Resolved</strong> - The intermittent network availability issues our hosting provider Rackspace encountered were resolved at 18:08 CEST.
<br />Everything is now working as it should again.
<br />We are deeply sorry for any problems this caused to you and your customers!</p><p><small>Sep <var data-var='date'> 5</var>, <var data-var='time'>17:45</var> CEST</small><br><strong>Investigating</strong> - We are currently investigating an availability issue of our platform due to network issues at our hosting provider with the highest priority. We appreciate your patience while we are looking into this.</p>tag:status.cellsynt.com,2005:Incident/3660762015-11-28T17:51:14+01:002015-11-28T17:51:14+01:00Availability issues<p><small>Nov <var data-var='date'>28</var>, <var data-var='time'>17:51</var> CET</small><br><strong>Resolved</strong> - Everything is up and running again.
<br />We apologize for any inconvenience this availability issue might have caused to you and your clients.</p><p><small>Nov <var data-var='date'>28</var>, <var data-var='time'>17:22</var> CET</small><br><strong>Investigating</strong> - We are currently investigating an availability issue of part our platform with the highest priority. It affects some of our web interfaces as well as PSMS API. Regular SMS messaging (including API) is not affected.
<br />We sincerely appreciate your patience while we are looking into this.</p>