...
- This is a manual job only
- Can deploy any service in any environment
- Deploys the version in platform.yml
...
- Run by other jenkins jobs
- Creates JAR and Docker inages
- Put them into the registry
...
Project | Jenkins job | Purpose | SCM triggered | cron | environment | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
ANY | service-env-deploy |
| no | Any | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ANY | service-pipeline |
| no | None/Dev | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ESR | esr |
| no | None/Dev | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ESR-ETL | tis-esr-etl |
| no | None/Dev | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
tis-esr-parameterized |
| no | Any | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| "yes" | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
tis-esr-etl-param-apc-import |
|
| stage | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
tis-esr-etl-param-applicant-load |
|
| stage | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
tis-esr-etl-param-applicant-export |
|
| stage | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
tis-esr-etl-param-notification-export |
|
| stage | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
tis-esr-etl-param-notification-daily-load |
|
| stage | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
esr-etl | disabled because tis-esr-etl does the same thing | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
NDW-ETL | ndw-etl |
| no | None/Dev | ESR-ETLDev | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
tis- | esrndw-etl-parameterized |
| the main job for esrno | None/Dev | tis-esr
|
| Prod | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
chris-tis-ndw |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
service-pipeline-ndw-etl | disabled because this was a poor attempt to change service-pipeline | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Generic Upload | tis-generic-upload-parameterized |
| parameter like the date or the type of load needed
| any
| no | Any |
| "yes" | tis-esr-etl-param-apc-import |
|
| stage | tis-esr-etl-param-applicant-load |
|
| stage | tis-esr-etl-param-applicant-export |
|
| stage | tis-esr-etl-param-notification-export |
|
| stage | tis-esr-etl-param-notification-daily-load |
|
| stage | esr-etl | disabled because tis-esr-etl does the same thing | NDW-ETL | ndw-etl | This is the main job for NDW-ETL | Any | ||||||||||||||||||||||||||||||||||||||||
tis-generic-upload |
| no | None/Dev | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
TCS | tcs |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
tcs-paramameterized | disabled because this was a poor attempt to change service-pipeline | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
admins-ui | admins-ui |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
TIS-ADMINS-UI |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
admins-ui-e2e |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
admins-ui-uat |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
chris-admins-ui |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
TIS-ADMINS-UI |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
reference | reference |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
profile | profile |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
profile-parent |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
assessments | assessments | TIS-ADMINS-UI |
| reference | reference
| no | None/Dev | tis-ndw-etl-parameterized |
|
| Prod | chris-tis-ndw |
| service-pipeline-ndw-etl | disabled because this was a poor attempt to change service-pipeline | Generic Upload | tis-generic-upload-parameterized |
| no | Any | tis-generic-upload |
| no | None/Dev | TCS | tcs |
| tcs-paramameterized | disabled because this was a poor attempt to change service-pipeline | admins-ui | admins-ui |
| TIS-ADMINS-UI |
| admins-ui-e2e |
| admins-ui-uat |
| chris-admins-ui |
|
| |||||||||||||||||||||||||||||||||
audit | audit-logs-backup-dev |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
audit-logs-backup-prod |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
revalidation | revalidation |
| yes | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
intrepid-reval-etl-dev/stage/uidev |
| no | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| no | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
intrepid-reval-etl-all-prod |
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
ci_test | ci_test |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
release-tag | release-tag |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
fayaz-pl | fayaz-pl |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Trainee-UI | trainee-ui |
| yes | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
profileNotifications | profilenotifications |
| yes | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
common | common |
| assessments | assessments |
| audit | audit-logs-backup-dev |
| audit-logs-backup-prod |
| revalidation | revalidation | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Intrepid | intrepid-load |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
intrepid-dr-model |
| yes | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
intrepid-dr-tools |
| yes | intrepid-reval-etl-dev/stage/uidev |
| yes | no | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
intrepid-load-etl |
| no | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
intrepid-anonymizer |
| no | no | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
intrepid-reval-etl-all-uat Runs ansible |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| yes | no | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
intrepid-reval-etl-all-prod |
|
|
| ci_test | ci_test |
| release-tag | release-tag |
| fayaz-pl | fayaz-pl |
| Trainee-UI | trainee-ui |
| yes | Notifications | notifications |
| yes | common | common |
| Intrepid | intrepid-load |
| yes | no | ||||||||||||||||||||||||||||||||||||||||||||||
intrepid-load-stage |
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
intrepid-etl-pipeine | Quote:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| no |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
intrepid-extract-all |
| no | no | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| no |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
-model |
| yes | no | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
drtools |
| yes | no | intrepid-load
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
anonymizerruns ansible code ansible | intrepid-anonymizer-new
| no | no |
| no |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Code Block |
---|
Anonymise intrepid data to populate the anonymized mirror |
- This is the main job for intrepid-anonymizer
- It is triggered by a push into TIS-DATA-ANONYMIZER github repo
- It creates the JAR and Docker image by running service-pipeline
- When FINALTAG is set, it deploys generic-upload into dev
- runs ansible/tasks/intrepid-reval-etl-all.yml in STAGE
- runs ansible/tasks/intrepid-reval-etl-all.yml in UIDEV
- It is triggered by a push into TIS-INTREPIDDB-CORETO-MODELCSV github repoIt creates the JAR and Docker image by running
- mvn2dockertriggers the job intrepid-extract-docker
- triggered by intrepid-etl-pipeine
- runs ansible playbook ansible/tasks/intrepid-load.yml in STAGE
Quote:
Code Block |
---|
Runs intrepid-extract and load each morning. Intrepid extract: grabs data from intrepid places in into CSV files (db-to-csv). Intrepid remap: changes column names on CSV files (intrepid-remap-col-structure) - we could remove it Intrepid load: grabs CSV data and places it into the mirror (csv-diff) creates a delta file and then uploads to db Intrepid conosolidated etl: points to the mirror and populates the TIS system
|
- pipeline script from SCM
- SCM: TIS-DEVOPS
- script: jenkins/intrepid-etl-prod.groovy
- jenkins/intrepid-etl-prod.groovy can run intrepid-extract-all, intrepid-remapper-structure, intrepid-load, intrepid-extract-upload, intrepid-compare-stats
- pipeline script from SCM
- SCM: TIS-DEVOPS
- script: jenkins/intrepid-etl-prod-new.groovy
- jenkins/intrepid-etl-prod-new.groovy runs ansible/tasks/intrepid-extract-new.yml with intrepid_dr_settings=<dr2|mirror-prod> schema=R1 mirror_settings=mirror-prod
batch_size=20
- 2h45
- daily
- runs ansible/tasks/intrepid-extract-all.yml in PROD
- ansible/tasks/intrepid-extract-all.yml: deploys docker image repository.tis.nhs.uk:5000/hee/intrepid-extract:{{ versions['intrepid-extract'] }}
- disabled, last successful run 2017 Nov 30th
- runs ansible/tasks/intrepid-extract-new.yml on ETL hosts in PROD
- midnight
- daily
- This is the main job for notifications
- It is triggered by a push into TIS-INTREPID-DR-ETL github repo
- It creates the JAR and Docker image by running service-pipeline
- When FINALTAG is set, it deploys generic-upload into dev
- triggered by intrepid-etl-pipeine
- runs ansible/tasks/intrepid-compare-stats.yml in PROD
- runs mvn on ETL hosts to create jarfile, then java -jar jarfile
- compares count of items in the prod dr against the mirror
- disabled, last run 2017 Nov 9th
- runs ansible/tasks/intrepid-compare-stats.yml in PROD, with DEVOPS_BASE=/datadrive/data/fayaz/master/devops
- runs ansible/tasks/intrepid-extract-clean.yml --limit 10.140.0.1 in PROD on ETL
- runs automatically
- removes old files from /datadrive/data/intrepid
- midnight
- daily
- runs ansible/tasks/intrepid-reval-etl-all.yml in DEV
- runs ansible/tasks/intrepid-reval-etl-all.yml in STAGE
- runs ansible/tasks/intrepid-reval-etl-all.yml in UIDEV
- It is triggered by a push into TIS-DB-TO-CSV github repo
- triggers the job intrepid-extract-docker
- It is triggered by a push into TIS-DB-TO-CSV github repo
- It can be triggered by db-to-csv-parent
- It runs mvn clean install -e on TIS-DB-TO-CSV/db-to-csv pom.xml file
- It runs ansible/tasks/spring-boot-build.yml in DEV on localhost
- it runs mvn2docker to create an image named intrepid-extract
- When FINALTAG is set, it deploys generic-upload into dev ????
- triggered by intrepid-etl-pipeine
- compresses and uploads intrepid databases to azure blob storage ???
- runs ansible/tasks/intrepid-extract-upload.yml in PROD on ETL hosts
- uses export DEVOPS_BASE=/datadrive/data/fayaz/master/devops in PROD
- last run 2017 November 9th
- deploys docker image repository.tis.nhs.uk:5000/hee/intrepid-extract:{{ versions['intrepid-extract'] }}
- extracts intrepid databases
Code Block |
---|
compares the schema csv exports daily to make sure that the structure hasn't changed. |
- watches intrepid-etl-pipeine as a trigger
- runs ansible/tasks/intrepid-schema-validation.yml on Localhost
- runs mvn on ETL hosts to create jarfile, then java -jar jarfile
Code Block |
---|
Runs the second part of the pipeline for intrepid-etl on the mirror stage
Intrepid data anonymizer - takes data from ssh hee-build-azure -> /datadrive/data/intrepid/prod/ (full+delta) anonymises it then places it into /datadrive/data/intrepid/stage/ (full+delta)
Intepid Load Mirror -> takes data from /datadrive/data/intrepid/stage/ , creates a delta file then loads it into mirror stage
Intrepid revalidation stage -> the reval etl on stage |
- It is triggered by a push into TIS-DB-TO-CSV github repo
- It can be triggered by db-to-csv-parent
- It runs mvn clean install -e on TIS-DB-TO-CSV/db-to-csv pom.xml file
- It runs ansible/tasks/spring-boot-build.yml in DEV on localhost
- it runs mvn2docker to create an image named intrepid-extract
- When FINALTAG is set, it deploys generic-upload into dev ????
- triggered by intrepid-etl-pipeine
- compresses and uploads intrepid databases to azure blob storage ???
- runs ansible/tasks/intrepid-extract-upload.yml in PROD on ETL hosts
- uses export DEVOPS_BASE=/datadrive/data/fayaz/master/devops in PROD
- last run 2017 November 9th
- deploys docker image repository.tis.nhs.uk:5000/hee/intrepid-extract:{{ versions['intrepid-extract'] }}
- extracts intrepid databases
Code Block |
---|
compares the schema csv exports daily to make sure that the structure hasn't changed. |
- watches intrepid-etl-pipeine as a trigger
- runs ansible/tasks/intrepid-schema-validation.yml on Localhost
- runs mvn on ETL hosts to create jarfile, then java -jar jarfile
Code Block |
---|
Runs the second part of the pipeline for intrepid-etl on the mirror stage
Intrepid data anonymizer - takes data from ssh hee-build-azure -> /datadrive/data/intrepid/prod/ (full+delta) anonymises it then places it into /datadrive/data/intrepid/stage/ (full+delta)
Intepid Load Mirror -> takes data from /datadrive/data/intrepid/stage/ , creates a delta file then loads it into mirror stage
Intrepid revalidation stage -> the reval etl on stage |
- watches intrepid-etl-pipeine as a trigger
- pipeline script from SCM
- SCM: TIS-DEVOPS
- script: jenkins/intrepid-etl-stage.groovy
- jenkins/intrepid-etl-stage.groovy runs jenkins jobs intrepid-anonymizer, intrepid-load-stage, intrepid-reval-etl-stage
intrepid-etl-pipeline-stage-new
Code Block |
---|
Runs the second part of the pipeline for intrepid-etl on the mirror stage
Intrepid data anonymizer - takes data from ssh hee-build-azure -> /datadrive/data/intrepid/prod/ (full+delta) anonymises it then places it into /datadrive/data/intrepid/stage/ (full+delta)
Intepid Load Mirror -> takes data from /datadrive/data/intrepid/stage/ , creates a delta file then loads it into mirror stage
Intrepid revalidation stage -> the reval etl on stage |
- watches intrepid-etl-pipeine as a trigger
- pipeline script from SCM
- SCM: TIS-DEVOPS
- script: jenkins/intrepid-etl-stage-new.groovy
- jenkins/intrepid-etl-stage-new.groovy: runs ansible/tasks/intrepid-anonymizer-new.yml --extra-vars='intrepid_dr_settings=dr2 mirror_settings=mirror-stage batch_size=20 in DEV by default
- disabled, last successful run 2017 Nov 9th
Code Block |
---|
compresses and uploads intrepid databases in azure |
- runs ansible/tasks/intrepid-extract-upload.yml in PROD using DEVOPS_BASE=/datadrive/data/fayaz/master/devops
Code Block |
---|
Remaps the Intrepid DR structure |
- runs ansible/tasks/intrepid-remapper-structure.yml with inventory=localhost on ETL hosts
- runs mvn on ETL hosts to create jarfile, then java -jar jarfile
- runs ansible/tasks/intrepid-remapper-structure.yml with inventory localhost
- ansible/tasks/intrepid-remapper-structure.yml: runs mvn on ETL hosts to create jarfile, then java -jar jarfile
- can be run by intrepid-etl-pipeine
- runs ansible/tasks/intrepid-extract-consolidated.yml in PROD
- ansible/tasks/intrepid-extract-consolidated.yml does not exist
- last successfull run: 2017-07-23
intrepid-remapper-structure-etl
- disabled, last run 2017 Nov 9th
- runs ansible/tasks/intrepid-remapper-structure.yml with DEVOPS_BASE=/datadrive/data/fayaz/master/devops
intrepid-reval-etltype-schema-env
- runs ansible/tasks/intrepid-reval-etl-all.yml --extra-vars="etl_type=${ETLTYPE}"
- ETLTYPE= <arcp|connectionDiscrepancies|contactDetails|placements|revalidation|selfDeclaration|traineeCard>
- ansible/tasks/intrepid-reval-etl-all.yml deploys repository.tis.nhs.uk:5000/hee/intrepid-dr-etl:{{ versions['intrepid-reval-etl'] }}
- disabled, last run 2017 March 13th
- runs /opt/mssql-tools/bin/sqlcmd
- pipeline script from SCM
- SCM: TIS-DEVOPS
- script:
- jenkins/
- consolidated-dr-etl
- .groovy
- jenkins/
- consolidated-dr-etl
- .groovy
intrepid-etl-pipeline-stage-new
Code Block |
---|
Runs the second part of the pipeline for intrepid-etl on the mirror stage
Intrepid data anonymizer - takes data from ssh hee-build-azure -> /datadrive/data/intrepid/prod/ (full+delta) anonymises it then places it into /datadrive/data/intrepid/stage/ (full+delta)
Intepid Load Mirror -> takes data from /datadrive/data/intrepid/stage/ , creates a delta file then loads it into mirror stage
Intrepid revalidation stage -> the reval etl on stage |
- watches intrepid-etl-pipeine as a trigger
- pipeline script from SCM
- SCM: TIS-DEVOPS
- script: jenkins/intrepid-etl-stage-new.groovy
- jenkins/intrepid-etl-stage-new.groovy: runs ansible/tasks/intrepid-anonymizer-new.yml --extra-vars='intrepid_dr_settings=dr2 mirror_settings=mirror-stage batch_size=20 in DEV by default
- disabled, last successful run 2017 Nov 9th
Code Block |
---|
compresses and uploads intrepid databases in azure |
- runs ansible/tasks/intrepid-extract-upload.yml in PROD using DEVOPS_BASE=/datadrive/data/fayaz/master/devops
Code Block |
---|
Remaps the Intrepid DR structure |
- runs ansible/tasks/intrepid-remapper-structure.yml with inventory=localhost on ETL hosts
- runs mvn on ETL hosts to create jarfile, then java -jar jarfile
- runs ansible/tasks/intrepid-remapper-structure.yml with inventory localhost
- ansible/tasks/intrepid-remapper-structure.yml: runs mvn on ETL hosts to create jarfile, then java -jar jarfile
- can be run by intrepid-etl-pipeine
- runs ansible/tasks/intrepid-extract-consolidated.yml in PROD
- ansible/tasks/intrepid-extract-consolidated.yml does not exist
- last successfull run: 2017-07-23
intrepid-remapper-structure-etl
- disabled, last run 2017 Nov 9th
- runs ansible/tasks/intrepid-remapper-structure.yml with DEVOPS_BASE=/datadrive/data/fayaz/master/devops
intrepid-reval-etltype-schema-env
- runs ansible/tasks/intrepid-reval-etl-all.yml --extra-vars="etl_type=${ETLTYPE}"
- ETLTYPE= <arcp|connectionDiscrepancies|contactDetails|placements|revalidation|selfDeclaration|traineeCard> ansible/tasks/intrepid-reval-etl-all.yml
- : runs ansible/tasks/consolidated-dr-etl-old.yml or ansible/tasks/consolidated-dr-etl-all.yml
- disabled
Code Block This is to test a new parameter for consolidated-dr-etl-all-parameterised-dev The new parameter is POST_PROGRAMME_STEP_ENABLED We use a new branch named TISDEV-4305-POST_PROGRAMME_STEP_ENABLED of TIS-DEVOPS and a modified version of jenkins/consolidated-dr-etl.groovy
- collects lots of parameters
- runs jenkins/consolidated-dr-etl.groovy
- jenkins/consolidated-dr-etl.groovy: runs ansible/tasks/consolidated-dr-etl-old.yml or ansible/tasks/consolidated-dr-etl-all.yml
- by default, ENVIRONMENT=prod
consolidated-dr-etl-all-parameterised-prod
- collects lots of parameters
- runs jenkins/consolidated-dr-etl.groovy
- jenkins/consolidated-dr-etl.groovy: runs ansible/tasks/consolidated-dr-etl-old.yml or ansible/tasks/consolidated-dr-etl-all.yml
- by default, ENVIRONMENT=prod
- 05h30
- daily
- This is the main job for intrepid-core-model
- It is triggered by a push into TIS-CONSOLIDATED-DR-ETL github repo
- It creates the JAR and Docker image by running mvn2docker
- This is the main job for intrepid-core-model
- It is triggered by a push into TIS-CONSOLIDATED-DR-ETL-OLD github repo
- It creates the JAR and Docker image by running mvn2docker
- runs ansible/tasks/consolidated-dr-etl-all.yml in DEV
- runs ansible/tasks/consolidated-dr-etl-old.yml --limit 10.150.0.137 in DEV
- runs ansible/tasks/consolidated-dr-etl-all.yml in PROD
- deploys repository.tis.nhs.uk:5000/hee/intrepidconsolidated-dr-etl:{{ versions['intrepid-reval-etl'] }}
- disabled, last run 2017 March 13th
- runs /opt/mssql-tools/bin/sqlcmd
- consolidated-dr-etl'] }}
consolidated-dr-etl-allold-parameterised-dev
Code Block |
---|
NOTE THIS IS THE OLD CONSOLIDATED DR JOB |
- runs --limit 10.170.0.138 ansible/tasks/consolidated-dr-etl
- -old.yml in PROD
- ansible/tasks/consolidated-dr-etl-old.yml
- deploys repository.tis.nhs.uk:5000/hee/consolidated-dr-etl-
- old:{{ versions['consolidated-dr-etl-
- old'] }}
- runs ansible/tasks/consolidated-dr-etl.groovy -all.yml in STAGE
- ansible/tasks/consolidated-dr-etl-all
- collects lots of parameters
- runs jenkins/.yml: deploys repository.tis.nhs.uk:5000/hee/consolidated-dr-etl:{{ versions['consolidated-dr-etl'] }}
- runs ansible/tasks/consolidated-dr-etl.groovy: runs -all.yml in UIDEV
- ansible/tasks/consolidated-dr-etl-oldall.yml or ansible/tasks: deploys repository.tis.nhs.uk:5000/hee/consolidated-dr-etl-all.yml
- by default, ENVIRONMENT=prod
- :{{ versions['consolidated-dr-etl'] }}
consolidated-dr-etl-allold-parameterised-prod
Code Block |
---|
NOTE THIS IS THE OLD CONSOLIDATED DR JOB
https://github.com/Health-Education-England/TIS-CONSOLIDATED-DR-ETL-OLD |
- runs --limit 10.160.0.138 ansible/tasks/consolidated-dr-etl-old.yml
- 05h30
- daily
- old.yml deploys repository.tis.nhs.uk:5000/hee/consolidated-dr-etl
- This is the main job for intrepid-core-model
- It is triggered by a push into TIS-CONSOLIDATED-DR-ETL github repo
- It creates the JAR and Docker image by running mvn2docker
- -old:{{ versions['consolidated-dr-etl-old'] }}
Code Block NOTE THIS IS THE OLD CONSOLIDATED DR JOB https://github.com/Health-Education-England/TIS-CONSOLIDATED-DR-ETL-OLD
- runs ansible/tasks/consolidated-dr-etl-
- old.yml in UIDEV
- ansible/tasks/consolidated-dr-etl-
- old.yml deploys repository.tis.nhs.uk:5000/hee/consolidated-dr-etl-old
- :{{ versions['consolidated-dr-etl-old
- '] }}
- ANY environment
- runs ansible/tasks/consolidated-dr-etl-all.yml in PRODyml --extra-vars="schema=${SCHEMA}"
- deploys repository.tis.nhs.uk:5000/hee/consolidated-dr-etl:{{ versions['consolidated-dr-etl'] }}
Code Block |
---|
NOTE THIS IS THE OLD CONSOLIDATED DR JOB |
- DISABLED
- uses /datadrive/data/fayaz/master/devops to run ansible/tasks/consolidated-dr-etl-
- all.
- yml in PROD
- runs /usr/local/bin/ansible -i /home/jenkins/data/devops/ansible/
- runs ansible/tasks/consolidated-dr-etl-all.yml in STAGE
- ansible/tasks/consolidated-dr-etl-all.yml: deploys repository.tis.nhs.uk:5000/hee/consolidated-dr-etl:{{ versions['consolidated-dr-etl'] }}
- runs ansible/tasks/consolidated-dr-etl-all.yml in UIDEV
- ansible/tasks/consolidated-dr-etl-all.yml: deploys repository.tis.nhs.uk:5000/hee/consolidated-dr-etl:{{ versions['consolidated-dr-etl'] }}
Code Block |
---|
NOTE THIS IS THE OLD CONSOLIDATED DR JOB
https://github.com/Health-Education-England/TIS-CONSOLIDATED-DR-ETL-OLD |
- runs --limit 10.160.0.138 ansible/tasks/consolidated-dr-etl-old.yml in STAGE
- ansible/tasks/consolidated-dr-etl-old.yml deploys repository.tis.nhs.uk:5000/hee/consolidated-dr-etl-old:{{ versions['consolidated-dr-etl-old'] }}
Code Block |
---|
NOTE THIS IS THE OLD CONSOLIDATED DR JOB
https://github.com/Health-Education-England/TIS-CONSOLIDATED-DR-ETL-OLD |
- ANY environment
- runs ansible/tasks/consolidated-dr-etl-all.yml --extra-vars="schema=${SCHEMA}"
- deploys repository.tis.nhs.uk:5000/hee/consolidated-dr-etl:{{ versions['consolidated-dr-etl'] }}
- DISABLED
- uses /datadrive/data/fayaz/master/devops to run ansible/tasks/consolidated-dr-etl-all.yml in PROD
- runs /usr/local/bin/ansible -i /home/jenkins/data/devops/ansible/inventory/all -m setup --tree /datadrive/data/ansible-cmdb/ all
- 7h15
- daily
bdd_tests_staging
- last run on Nov 29, 2016 5:57:22 PM
- uses TIS-REVALIDATION repo
- runs "npm install && gulp bs" in DEV ???
- last run Jun 19, 2017 4:02 PM
- uses TIS-REVALIDATION repo
- runs the ci-stage-pipeline pipeline
- last run Jun 19, 2017 4:02:41 PM
- runs a pipeline script which runs a "mvn verify" on REVALIDATION, CONCERNS and NOTIFICATIONS
- last run Feb 20, 2017 4:46:10 PM
- watches site-stage
- triggers intrepid-reval-etl-stage
- uses TIS-REVALIDATION repo
- run "mvn verify"
- triggers release-tag jenkins job
- last run Feb 21, 2017 2:42:59 PM
- uses TIS-CONCERNS git repo
- runs "mvn verify"
ci_tests_parallel
- DISABLED
- last run Sep 27, 2016 8:48:22 AM
- uses TIS-REVALIDATIONS git repo
- watches jenkins job revalidation-dev-deploy which does not exist
ci_tests_tagging
- DISABLED
- Never run
- uses TIS-REVALIDATIONS git repo
- runs selenium
- triggers non existing git-tag jenkins job
csv-diff
- uses db-to-csv git repo
- runs ansible/tasks/spring-boot-build.yml ansible playbook with ARTIFACT_ID="intrepid-load"
- ansible/tasks/spring-boot-build.yml runs mvn2docker
- last run Nov 15, 2017 10:15:45 AM
- uses csv-to-db git repo
- runs ansible/tasks/spring-boot-build.yml ansible playbook with ARTIFACT_ID="intrepid-load"
- ansible/tasks/spring-boot-build.yml runs mvn2docker
- last run Nov 15, 2017 10:15:45 AM
- last run Apr 18, 2017 10:06:07 AM
- Rebuilds the Curator docker Image
- uses TIS-CURATOR git repo
- runs /home/jenkins/data/devops/bin/docker-build-push.sh which runs docker build|push|tag|rmi
- last run Nov 15, 2017 10:15:45 AM
- uses db-to-csv git repo
- runs ansible/tasks/spring-boot-build.yml ansible playbook with ARTIFACT_ID="intrepid-load"
- ansible/tasks/spring-boot-build.yml runs mvn2docker
- DISABLED
- uses db-to-csv git repo
- last run Mar 16, 2017 12:54:04 PM
db-to-csv-parent
- last run Nov 15, 2017 10:15:45 AM
- uses TIS-DB-TO-CSV git repo
- triggers intrepid-extract-docker jenkins job
- DISABLED
- last run Mar 20, 2017 1:51:27 PM
- uses db-to-csv git repo
- runs /tmp/fayaz/TIS-DEVOPS/ansible/tasks/spring-boot-build.yml
dev-api-load-test
- never run
- uses TIS-JMETER git repo
- watches ci-staging
- runs "./jmeter.sh -n -t load.jmx -l testresults.jtl"
- uses TIS-DEVOPS git repo
- runs python "${WORKSPACE}/ansible/inventory/tests.py"
- and then runs rsync -av --delete "${WORKSPACE}/" --exclude ".git" /home/jenkins/data/devops/
- and rsync -ave 'ssh' --delete "${WORKSPACE}/" --exclude ".git" $(/home/jenkins/data/devops/bin/ip etl-stage):/home/heetis/data/devops/
- inventory/all -m setup --tree /datadrive/data/ansible-cmdb/ all
- 7h15
- daily
bdd_tests_staging
- last run on Nov 29, 2016 5:57:22 PM
- uses TIS-REVALIDATION repo
- runs "npm install && gulp bs" in DEV ???
- last run Jun 19, 2017 4:02 PM
- uses TIS-REVALIDATION repo
- runs the ci-stage-pipeline pipeline
- last run Jun 19, 2017 4:02:41 PM
- runs a pipeline script which runs a "mvn verify" on REVALIDATION, CONCERNS and NOTIFICATIONS
- last run Feb 20, 2017 4:46:10 PM
- watches site-stage
- triggers intrepid-reval-etl-stage
- uses TIS-REVALIDATION repo
- run "mvn verify"
- triggers release-tag jenkins job
- last run Feb 21, 2017 2:42:59 PM
- uses TIS-CONCERNS git repo
- runs "mvn verify"
ci_tests_parallel
- DISABLED
- last run Sep 27, 2016 8:48:22 AM
- uses TIS-REVALIDATIONS git repo
- watches jenkins job revalidation-dev-deploy which does not exist
ci_tests_tagging
- DISABLED
- Never run
- uses TIS-REVALIDATIONS git repo
- runs selenium
- triggers non existing git-tag jenkins job
csv-diff
- uses db-to-csv git repo
- runs ansible/tasks/spring-boot-build.yml ansible playbook with ARTIFACT_ID="intrepid-load"
- ansible/tasks/spring-boot-build.yml runs mvn2docker
- last run Nov 15, 2017 10:15:45 AM
- uses csv-to-db git repo
- runs ansible/tasks/spring-boot-build.yml ansible playbook with ARTIFACT_ID="intrepid-load"
- ansible/tasks/spring-boot-build.yml runs mvn2docker
- last run Nov 15, 2017 10:15:45 AM
- last run Apr 18, 2017 10:06:07 AM
- Rebuilds the Curator docker Image
- uses TIS-CURATOR git repo
- runs /home/jenkins/data/devops/bin/docker-build-push.sh which runs docker build|push|tag|rmi
- last run Nov 15, 2017 10:15:45 AM
- uses db-to-csv git repo
- runs ansible/tasks/spring-boot-build.yml ansible playbook with ARTIFACT_ID="intrepid-load"
- ansible/tasks/spring-boot-build.yml runs mvn2docker
- DISABLED
- uses db-to-csv git repo
- last run Mar 16, 2017 12:54:04 PM
db-to-csv-parent
- last run Nov 15, 2017 10:15:45 AM
- uses TIS-DB-TO-CSV git repo
- triggers intrepid-extract-docker jenkins job
- DISABLED
- last run Mar 20, 2017 1:51:27 PM
- uses db-to-csv git repo
- runs /tmp/fayaz/TIS-DEVOPS/ansible/tasks/spring-boot-build.yml
dev-api-load-test
- never run
- uses TIS-JMETER git repo
- watches ci-staging
- runs "./jmeter.sh -n -t load.jmx -l testresults.jtl"
- uses TIS-DEVOPS git repo
- runs python "${WORKSPACE}/ansible/inventory/tests.py"
- and then runs rsync -av --delete "${WORKSPACE}/" --exclude ".git" /home/jenkins/data/devops/
- and rsync -ave 'ssh' --delete "${WORKSPACE}/" --exclude ".git" $(/home/jenkins/data/devops/bin/ip etl-stage):/home/heetis/data/devops/
- DISABLED
- last run Dec 16, 2017 12:41:00 AM
- uses docker-alpine-java git repo
- runs /home/jenkins/data/devops/bin/docker-build-push.sh
- /home/jenkins/data/devops/bin/docker-build-push.sh runs docker build|push|tag|rmi
- midnight
- daily
- DISABLED
- last run Sep 26, 2017 12:15:06 PM
Code Block Runs regularly to tidy up stray docker artifacts such as "<none>" images, old stopped containers and anonymous volumes
- uses BUILD ansible inventory
- runs ansible/tasks/docker-clean.yml playbook
- ansible/tasks/docker-clean.yml: runs docker system prune -af
- 23h00
- friday
Code Block |
---|
Runs regularly to tidy up stray docker artifacts such as "<none>" images, old stopped containers and anonymous volumes |
- uses DEV ansible inventory
- runs ansible/tasks/docker-clean.yml playbook
- ansible/tasks/docker-clean.yml: runs docker system prune -af
- 23h00
- friday
Code Block Runs regularly to tidy up stray docker artifacts such as "<none>" images, old stopped containers and anonymous volumes
- uses PROD ansible inventory
- runs ansible/tasks/docker-clean.yml playbook
- ansible/tasks/docker-clean.yml: runs docker system prune -af
- 23h00
- daily
docker-clean-stage
Code Block Runs regularly to tidy up stray docker artifacts such as "<none>" images, old stopped containers and anonymous volumes
- uses STAGE ansible inventory
- runs ansible/tasks/docker-clean.yml playbook
- ansible/tasks/docker-clean.yml: runs docker system prune -af
- 23h00
- daily
docker-clean-uidev
Code Block |
---|
Runs regularly to tidy up stray docker artifacts such as "<none>" images, old stopped containers and anonymous volumes |
- uses UIDEV ansible inventory
- runs ansible/tasks/docker-clean.yml playbook
- ansible/tasks/docker-clean.yml: runs docker system prune -af
- 23h00
- daily
Code Block |
---|
Freezes docker images on a given platform |
- uses the DEV ansible inventory
- runs ansible/tasks/docker-freeze.yml -vvv
- ansible/tasks/docker-freeze.yml runs bin/docker-freeze.py --tag {{ platform }}"
- bin/docker-freeze.py runs docker push|tag
docker-freeze-prod
Code Block Freezes docker images on a given platform
- uses the DEV ansible inventory
- runs ansible/tasks/docker-freeze.yml -vvv
- ansible/tasks/docker-freeze.yml runs bin/docker-freeze.py --tag {{ platform }}"
- bin/docker-freeze.py runs docker push|tag
docker-registryui-cert-renew
- DISABLED
- last run Jun 11, 2017 6:06:00 AM
Code Block renew the jenkins cert
- uses ansible DEV inventory
- runs ansible/tasks/docker-registryui-cert-renew.yml ansible playbook
- ansible/tasks/docker-registryui-cert-renew.yml
- 6h06
- sunday