[Resolved] Issue with all network services, 2nd Oct 2013

[Admin48]

---

We are currently experiencing a major outage across our network resulting in the failure of calls, texts and data.  As soon as the issue started at 4:25pm this afternoon, we engaged our service provider, Ericsson, to fix the problem.  So far they have yet to identify a fix, but are working with all available resources to do so. We have escalated this to the highest level within the Ericsson organisation so that the very best engineers are working on it.

We are very sorry for the inconvenience this is causing, we know this is bad and particularly so given the issues last Friday. All we can say at this point is that we are pushing as hard as we can to get this resolved as soon as possible. We will continue to provide hourly updates on progress here on the Community.

---

TROUBLESHOOTING:

For some of you who still don't have any coverage after services have been restored this morning, please try the following workaround which has solved the problem for many members:

Search for networks manually, find 48 and connect to it. 

UPDATES:

Final update - 07/10/13 @ 17:16

This issue is now marked as resolved.  All services successfully returned from 4:40am on Thursday morning.  We have put extra monitoring in place since the outage and all services have been working as normal.  Please see this update for further technical information on the outage.

Previous updates:

(click on "more info")

More Info

03/10/13 @ 02:45

While we have been seeing some successful connections on the network, this has been intermittent and we are not seeing a return for all services.  We are continuing to work on a number of fixes to restore service on the network.  These fixes will take some time to implement tonight, so it will be a number of hours before we have another update about the success of these changes.  Our next update will be before 8:00am.

03/10/13 @ 01:38

Some of you have been reporting the gradual return of services.  This is happening intermittently and we will continue to monitor this very closely.  However, it may still take some time before full services are back up and running as we need to ensure the network is stable before allowing full traffic onto the network.

03/10/13 @ 12:35

Calls, texts and data remain stable and we will continue to closely monitor all traffic on the network to ensure that this issue does not occur again.  If you are still having problems please restart your phone and try again.

We are still experiencing delays registering new customers and customers porting their number in or out of 48 (transferring your number to or from 48).  This is an urgent priority for us and we are working hard with our engineers to get this resolved as soon as possible. 

Thanks for sticking with us and being so patient.

03/10/13 @ 07:51

Calls, texts and data are now back fully operational and the services have gradually been coming back online since 4:40am this morning.   You should now be able to pick up a network signal as normal.  If you are still having problems please restart your phone and try again.

We are investigating reports of issues with new customers who joined the network yesterday.  We will keep you updated on our investigation into these issues.

We would like to simply say sorry for inconvenience this has caused since yesterday afternoon, the issues we had yesterday and on Friday are simply just not acceptable.  We will be closely monitoring the services with our service providers, including Ericsson, throughout the day and also in the coming days to ensure this is does not happen again.  We will be in touch later on in the morning with further information and follow up on your outstanding queries.

03/10/13 @ 00:06

We will be implementing a fix in the next hour which will gradually re-introduce traffic onto our platform.    If this is successful we will see service gradually return for customers. We will continue to keep you updated on the progress of this work.

02/10/13 @ 23:27

Investigations have identified a possible cause and we are working on implementing a solution to restore service.  If this fix works, we will have to gradually bring back service, so it will be the early hours of tomorrow morning before full service is restored.  We will update you here on the progress of this.

02/10/13 @ 22:05

The Ericsson engineers are continuing to work on this.  We have our next call with them at 10:45pm and we will provide a further update then.

02/10/13 @ 21:05

Ericsson are continuing to investigate the issue and we don’t have any further information at this point.  We will update you again at 10pm.

02/10/13 @ 20:10

Unfortunately we have been just told service will be down until 9pm at the earliest.  Things ae happening in the background and I will have a further update around 9pm.

02/10/13 @ 19:31

Sorry folks but we have still not managed to get this sorted yet.  We will have a further update shortly after 8pm.  The minute we have further news we will let you all know.

02/10/13 @ 18:55

Still no good news I'm afraid.  We are still working on this and I hope to have an update direct from the engineers any minute now

02/10/13@ 18:22

Our technical staff are still working towards getting this resolved.  They are fairly confident that incoming calls and texts should return soon.  I'll update as soon as I hear anything else.

02/10/13 @ 17:48

We are in the process of making a few changes and are hopeful this will restore your ability to receive calls and texts again.  I will post here when I have further news.

02/10/13 @ 17:25

Unfortunately things have taken a turn for the worse.  Now all network services are unavailable.  So making and receive any calls and texts are not working.  You will also be unable to use the internet.  This has been give the highest priority and every available resource is working on it.  We will have further updates soon.

[Anon]

WAITING AN HOUR FOR A DIFFERENT UPDATE ONLY TO BE LET DOWN AGAIN... GRRRRR HOW BOUT AN UPDATE WHERE YE TELL US WAT TIME TO EXPECT SERVICE TO WORK AGAIN!!

[Anon]

get the finger out 48..i only switched to 48 for the last week or 2 and i have not been impressed at all..constantly limited network..are you not using the o2 network?..starting to wonder its cheap for a reason ..please resolve or you will loose a valued customer

david

[niamhr]

Lucky that most of their customers are broke students, otherwise they would go bust!!

[shannon2]

Absolutely sickened! If this happened only once maybe we could understand! But its happened twice since I changed to 48 which as been less than a month ago 😮 so for the people that have no life (like myself)and rely on their phone to have human contact this is a pure sickener  not on atall like

[fbtn]

I also demand to be compensated for this incredible insult to me, my family and my friends as we cannot communicate because of this terrible atrocity that has been inflicted on us, on this dark day for both 48 and technology in general.

I want a ham and cheese sandwich on brown bread, the double DVD set of the Royal Wedding ( know the wan with both Chaz and Di and Wills and Kate's big days?) and one of those hat and glove packs from Pennies.

Do you want my address or do you want me to call to the 48 office and pick up?

[Anon]

ahh god lads!!!...whatb is going on i demand for everyone to get a months free membership!!!:D...this is outragous!!!!! (y) when will it be sorted? 😮

[Anon]

WHAT THE HELL?!?!? HAVE YOU TRIED TURNING IT ON AND OFF AGAIN????

also i agree with extending our deals by one month as an apology!!!

[Anon]

Do we get extra days membership for this cut off?

[brandaisy]

ok so one for the conspiracy theorists

Could what is really happening here be this :
Telefonica looks to run both both the premium O2 and budget 48 brand in Ireland
The growth in subscribers to 48 looks to have been exponential (e.g. take a look at how recent the Registered date of the people posting here are)

This is great for the 48 brand but what if too many premium o2 users start to switch to 48?
Result : it costs Telefonica money as the high profits it makes from premium o2 subsribers are not offset by what it charges the same customers on the cheaper 48 network.

So what if 48 has been wildly more successful than Telefonica had initially planned ?

Could it make sense to make your budget offering look a bit less attractive to switch?

Would it be the worst thing in the world to have a few major network issues which would stem the tide of switchers?

Of course the easy way to rule this possibility out would be to check if the O2 network (across which 48 runs). But guess what - if you check out the o2 community page there is no mention of the premium o2 users experiencing any issues today

I'm certain that can't be what is really happening here.

Although if it really was true then 48 subscribers could look forward to lots more of the same .....

[kill175]

im dying in a field...i need to ring a docto