Serval - Elevated Error Rates – Incident details

All systems operational

Elevated Error Rates

Resolved
Degraded performance
Started 2 months agoLasted 1 day

Affected

Third Party: OpenAI

Operational from 3:36 PM to 3:56 PM, Degraded performance from 3:56 PM to 4:08 PM, Operational from 4:08 PM to 7:33 PM

Third Party: OpenAI → APIs → Chat Completions

Operational from 3:36 PM to 3:56 PM, Degraded performance from 3:56 PM to 4:08 PM, Operational from 4:08 PM to 7:33 PM

Third Party: OpenAI → APIs → Responses

Operational from 3:36 PM to 3:56 PM, Degraded performance from 3:56 PM to 4:08 PM, Operational from 4:08 PM to 7:33 PM

Updates
  • Resolved
    UTC
    Resolved

    All impacted services have now fully recovered.

  • Monitoring
    UTC
    Monitoring

    We have applied the mitigation and are monitoring the recovery.

  • Update
    UTC
    Update

    We are investigating the issue for the listed services.

  • Investigating
    UTC
    Investigating

    We are investigating the issue for the listed services.

  • Monitoring
    UTC
    Monitoring

    We have applied the mitigation and are monitoring the recovery.

  • Investigating
    UTC
    Investigating

    We are investigating the issue for the listed services.

  • Monitoring
    UTC
    Monitoring

    We have applied the mitigation and are monitoring the recovery.

  • Update
    UTC
    Update

    We are continuing to work on implementing a mitigation.

  • Update
    UTC
    Update

    We are continuing to work on implementing a mitigation.

  • Update
    UTC
    Update

    We have identified that users are experiencing elevated errors for the impacted services.

    We are working on implementing a mitigation with the downstream infrastructure provider.

  • Update
    UTC
    Update

    We have identified that users are experiencing elevated errors for the impacted services.

    We are working on implementing a mitigation.

  • Identified
    UTC
    Identified

    We have identified that users are experiencing elevated errors for the impacted services.

    We are working on implementing a mitigation.

  • Investigating
    UTC
    Investigating

    We are investigating the issue for the listed services.