Jump to content


Network Outage

1 reply to this topic

#1 Head Guru

Head Guru

    Bill Kish Head Guru

  • Admins
  • PipPipPipPip
  • 6,878 posts

Posted 02 November 2007 - 07:36 AM

At around 5:12AM EST today we experienced a routing issue between our main cisco router and our upstream provider, causing all our traffic between our core router and our upstreams to fall into a unstable status. After initial investigation we were able to determine the issue was not internal and we were required to contact our upstream providers.

After contacting our upstream we learned the issue was due to a misconfiguration on the route handoffs for our IP blocks. This was corrected and our traffic started to resume to normal levels.

This event is highly unusual and should not have happened. However as we have been growing in our tchnoc we have been using some very advanced routing tables to route our traffic. This was due to the fact that we were not fully routing all of our own layer 3 traffic. A majority of the traffic was being routed by the upstream and they were passing the traffic to us. Back in the middle of september TCH made a major investment and purchased our own Cisco layer 3 routing equipment and we had been in the testing phases for some time. We had planned on taking the hand off of all our layer 3 traffic on Decemeber 1. It was my view that we simply wanted to test the equipement fully and then implement it. I wanted to be fully sure that things were setup correctly.

Over the past month we have been segmenting our IP block into smaller segments. We have been working hard to complete this transition, with the end result being better perfomance and quality for our network. Now that this transition is complete, we are already seeing improved performance overall.

Long story short our upstreams handed off our direct route to us for our IP block. So that huge Cisco router we bought is now in full operation.

I hope that this clears up our short outage from this morning and I assure you that we are working hard to provide the best possible service that we can provide.

Bill Kish

Head Cook and Bottle Washer

If you need help with your account or have any questions, please feel free to contact me using any of the contact methods below.  I can be reached 24 hours a day seven days per week.

Office :: 800-930-0485 x211
Mobile :: 248-632-3243

email: bill(at)totalchoicehosting.com

Instant Messenger -
AOL Instant Messenger: tchgurubill
Yahoo Messenger : tchgurubill
MSN Messenger : tchgurubill@hotmail.com

Thank you for your support and continued business

#2 youneverknow


    Immediate Family

  • Members
  • PipPipPipPip
  • 706 posts

Posted 02 November 2007 - 07:59 PM

I have been a TCH customer for many years and it only gets better and better......congratulations Bill and staff for making TCH
the place to be. :)
In a world without walls or fences who needs windows or gates?

Reply to this topic


0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users