Resolution: Thursday, August 31st 3:17PM EST
Summary:
Freshop experienced an issue with processing certain jobs. The issue was identified during our routine daily monitoring when several jobs threw errors. After reviewing the errors, we quickly developed, tested, and deployed a fix. The failed jobs were subsequently rerun.
Impact:
All errored jobs were re-processed. Due to the delay between the job request and the rerun, some time-sensitive notification jobs, such as last-mile delivery notifications and push-to-pos jobs may have been unsuccessful.
Root Cause:
The underlying cause of this issue was a modification in our job queuing process, which was required as part of our migration to Google Cloud Platform (GCP). This change had been tested in multiple environments before it was pushed to production and did not produce any issues during testing.
Action Items:
Please contact the Freshop Helpdesk if you have missing orders that require being pushed-to-pos.
We are currently reviewing our test cases to prevent a similar issue from occurring in the future.
