uwaterloo.ca mail lookup failure

Type

Incident

Description

One of the 6 LDAP slaves had database issues. When alerted staff removed the node from the cluster and then fixed the issue.
During the period before it was removed some mail to valid campus addresses would have bounced. The sender would receive a bounce and should now try again.

Example bounce message is below
=====================================
Action: failed
Status: 5.1.1
Remote-MTA: DNS; mxer.uwaterloo.ca
Diagnostic-Code: SMTP; 550 5.1.1 ... User unknown

Start time

Thursday, October 16, 2014 3:40 PM

End time

Thursday, October 16, 2014 4:40 PM

Impact

LDAP lookups / mail bounces

Resolution

Reinitialized corrupt LDAP database

Notice submitted

Friday, October 17, 2014 7:45 AM