Re: [dnswl-users] Partial outage dnswl.org infrastructure

[Matthias Leisi <matthias@xxxxxxxxx>]

Status:
* All services are up and running again.
* Any emails pending in outgoing queues should soon clear up.
* Any changes done in the meantime will be exported during the next hourly
export run.
* Incident closed.

Incident root cause:
A change to a network interface (adding a certain IPv6 configuration)
caused the network stack on the affected machine to stop responding. That
was an unexpected effect, since the same operation went without this issue
on earlier occasions.

Incident effects:
* Partial outage of public services for about 2 1/2 hours

Incident fix:
* Analysis, restarting network stack

Incident follow-up:
* Improve process to enable remote access console

-- Matthias, for the dnswl.org project



On Wed, Jan 16, 2013 at 9:55 PM, Matthias Leisi <matthias@xxxxxxxxx> wrote:

> dnswl.org has a partial outage in its infrastructure.
>
> Affected services:
> * Public website (incl request form)
> * Subscription website
> * Abuse reporting
> * Export of newly added / changed data
> * Incoming emails to the request tracker
>
> Unaffected services:
> * Public nameservers / DNS mirrors
> * rsync download
> * Internal systems / database
> * Public update mirror for the SpamAssassin project
>
> Status:
> We are working with the provider to get the affected box up and running
> again. Outage expected to be fixed during the next 4 to 6 hours.
>
> -- Matthias, for the dnswl.org project
>
>