Tag Archives: Downtime

Rebuilding Our Network – Part 4

I think we are finally done restructuring our entire network (for now). There are a few IPv6 that need to be resolved on our front-ends, but that should really be it for now. I would like to relocate our search daemon and place it on its own dedicated hardware to minimize some of our ongoing issues, but we lack the budget to fulfill that objective. However, there is a possibility of that changing in the future though. We will have to deal with the random service interruptions caused by the search daemon until then.
Continue reading

Unexpected Backend Downtime

We just had an unexpected downtime due to our database server being inaccessible and unresponsive. It appears that we only lost connectivity with it for approximately an hour so hopefully nothing much happened. Anyway, our system logs doesn’t contain anything that would explain the network inaccessibility, but I will continue to look into the incident.

Rebuilding Our Network – Part 2

It’s ALL GOOD! We were able to gather enough funds (by the staff) to push forward with our plans of upgrading our outdated servers! It will take some time, but I will try my best to minimize the amount of downtime as much as possible. I can’t guarantee that it won’t go off without a hitch though. It is never easy migrating a large amount of data.
Continue reading

Search Downtime

It has been a few months since the last time we’ve regenerated our Sphinx Indexes. As of this moment, we have some fairly large transitional and delta indexes which impacts the performance of our server whenever new data is being indexed. We are now taking this time to regenerate our indexes in order to optimize the transitional and delta indexes for now. However, we will be looking into a better method of indexing to avoid this issue in the future. The old implementation from the Fuuka days worked fairly well for us over the years, but it is time for us to look for better methods. We will be researching better alternatives when time permits, but it won’t be done any time soon.
Continue reading