Versions Compared

Old Version 5

changes.mady.by.user Reuben Roberts

Saved on

compared with

New Version 6

changes.mady.by.user Joseph (Pepe) Kelly

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Restarted Service

  • Reran NDW and GMC jobs

...

Timeline

  • ???

  • : 00:17 BST - Jenkins stopped logging

  • : 06:55 BST - Super-Scrum master flagged not only downtime but also additional consequences

    • There was an unrelated failure mentioned (STAGE PersonSync job)

  • : 07:25 BST - Jenkins restarted

  • : 07:30 BST - NDW jobs restarted

  • : 08:24 BST - Question about Revalidation jobs raised on MS Teams

  • : 08:25 BST - NDW jobs finished

  • : 08:50- BST - gmc-sync jobs rerun

  • : 09:27 BST - confirmed with reval users data had been refreshed

  • : 10:27 BST - Downstream NDW ETLs finished

...

Action Items

Owner

Ticket ref

Establish how to manage dependabot PRs:

  • what manual tests/checks?

  • should we routinely rebase?

  • what do we do with failing PR builds?

This might be best to cover in the Dev Handbook.

Change the dependabot config: don’t auto-rebase (Existing dependabot Tech Improvement)

  • ESR to start with.

Move nightly jobs away from Jenkins/build server i.e. ECS

[Unrelated] Check Elastic Search snapshots are configured as needed: Maintenance windows avoid Sync job on stage and Prod

...

Lessons Learned