Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Date

Authors

Joseph (Pepe) Kelly Cai Willis

Status

Ongoing

Summary

Revalidation production login delay and logout redirecting to stage and localhost

Impact

An admin user was having issues to submit recommendation

...

  • ??:?? - Responding to a query about submitting recommendations, we noticed that the login process was very slow

  • ??:?? -

  • ??:?? -

  • 11:30 - Forced redeployment tasks

...

Root Cause(s)

  • Request to taking a long time but not always

  • The request for a string value goes through a number of services

  • Sometimes get redirected to stage

...

Action Items

Action Items

Owner

Set autoscaling auto-scaling {with min/max the same value?}

Prod API Gateway needs to send metrics & logging sent on to CloudWatch

Monitor & Alert on something that indicates a problem, e.g. HTTP Errors/Latency in API Gateway?

TBD: Put the variable in a resource with wider availability (across availability zones)

...

Lessons Learned