Podium - Contact CSV Uploads may not be uploading – Incident details

Contact CSV Uploads may not be uploading

ResolvedMajor outage9 hours 8 minutes

Affected

Contacts

Degraded performance from 4:45 PM to 1:53 AM

  • ResolvedUTC

    We've seen all accounts return to a stable speed. We apologize for how long this incident took, we'll be taking learning from these and implementing for better reliability in the future.

  • UpdateUTC

    Most users should no longer be affected by this incident. We are seeing about 5-6% of our accounts still seeing some residue lag. We're still actively monitoring and attempting to remove this lag entirely

  • MonitoringUTC

    We implemented a fix and are currently monitoring the result. Verification of a resolution should be coming shortly.

  • UpdateUTC

    We're still testing our hypothesis for new lead creation being delayed in Podium. We're getting closer to resolution but will provide an update as soon as our results start to show positive results

  • IdentifiedUTC

    We believe we've identified the cause of the issue and are working to test our theory, hopefully resolving the issue. We'll continue to provide updates as we learn more.

  • UpdateUTC

    We have discovered that contacts being created from all sources—CSV uploads, Integrations, and other Lead Sources are delayed. We're pulling in more engineering hands to help us resolve this incident. We'll provide an update soon.

  • InvestigatingUTC
    We are investigating an issue where contact uploads through CSV Uploads are getting stuck in processing and not completing.