Investigating - We've seen evidence of occasional timeouts and slow resolution specific to one Chicago location (ORD). One other chicago location, QORD5, is not affected.
Resolved -
All locations should now have full services/performance restored.
We apologize for the time it took to fully resolve this matter, as this required a significant amount of investigation that spanned several days.
If you are still experiencing issues relating to these locations, please contact us: support@quad9.net
Feb 5, 23:19 UTC
Identified -
After replacing/updating core software components in our resolver stack yesterday, a few locations started experiencing service degradation.
We have identified the root cause and are working on a resolution.
* Marseille Issue Start: 13:30 UTC, Jan 30th * Boston Issue Start: 19:30 UTC, Jan 30th * Sofia Issue Start: 20:40 UTC, Jan 30th --> Sofia Issue Stop: 16:10 UTC, Jan 31st - Taken offline until a server upgrade can be organized. * Lisbon Issue Start: 23:00 UTC, Jan 30th * Warsaw Issue Start: 23:30 UTC, Jan 30th * Manchester Issue Start: 5:00 UTC, Jan 31st
Jan 31, 10:59 UTC
Resolved -
We experienced some packet loss due to one of our systems going down and not triggering an alert. We are investigating the lack of alerting so this does not occur again.
Issue Start: 13:20 UTC, Feb 1st Issue Stop: 9:50 UTC, Feb 2nd
Feb 2, 09:58 UTC