From around 19:00 on Wednesday 27th November the MOLE front ends started to exhibit software failures which are still continuing.
The failures are the same on all four front ends. The failed component is detected & automatically restarted - taking about 10 mins to return to service.
The impact on staff and students is difficult to determine. When a front end node is about to fail responses get slower. When it does fail user sessions are redirected to one of the remaining servers. However, if more than two servers fail at the same time then users may experience poor performance - or in an extreme situation - no performance.
The failures have been raised with the suppliers, Blackboard. We're continuing to try help to diagnose the root cause and/or detour the problem.