Page Comparison

• This is a manual job only
• Can deploy any service in any environment
• Deploys the version in platform.yml

• Run by other jenkins jobs
• Creates JAR and Docker inages
• Put them into the registry

• This is the main job for esr
• It is triggered by a push into github
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys esr-etl into dev

• This is the main job for esr
• It is triggered by a push into github
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys esr-etl into dev

• This is for manual run only
• One runs it to pass a parameter like the date or the type of load needed
• It does not create any JAR file or docker image
• It just deploys whatever is in platform.yml into the selected environment
• One can pass any parameter to the job, unlike service-env-deploy

tis-esr-etl-param-cron

• 17h00
• daily

• This is a cron job in jenkins
• It runs ansible/esr-etl.yml with -

• -

• This is a cron job in jenkins
• It runs tis-esr-parameterized with LOAD_TYPE=notification-export
• Disabled while extra-vars="LOAD_TYPE=${LOAD_TYPE}"
• Depending on the time, the value of LOAD_TYPE varies
• This deprecates the below tis-esr-etl-param-cron is being tested

• 02h00
• daily

• XXXXX jenkins jobs

• This is

• a cron job in jenkins
• It runs tis-esr-parameterized with LOAD_TYPE=apc-import
• Disabled while tis-esr-etl-param-cron is being tested

• 20h00
• daily

• This is the main job for generic-upload
• It is triggered by a push into github
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• This is a cron job in Jenkins
• It can take a parameter: the environment
• It will by default run in prod

• 07h00
• daily

• Uses jenkinsfile
• Can run against all our github repositories
• configured to use tis-ndw-etl github repo

• This is for manual run only
• One runs it to pass a DEBUG parameter which allows one to attach to port 5005TCP
• It does not create any JAR file or docker image
• It just deploys whatever is in platform.yml into the selected environment
• One can pass the debug parameter to the job, unlike service-env-deploy

• jenkins
• It runs tis-esr-parameterized with LOAD_TYPE=applicant-load
• Disabled while tis-esr-etl-param-cron is being tested

• 15h00
• daily

• This is a cron job in jenkins
• It runs tis-esr-parameterized with LOAD_TYPE=applicant-export
• Disabled while tis-esr-etl-param-cron is being tested

• 17h00
• daily

• This is a cron job in jenkins
• It runs tis-esr-parameterized with LOAD_TYPE=notification-export
• Disabled while tis-esr-etl-param-cron is being tested

• 17h00
• daily

• This is a cron job in jenkins
• It runs tis-esr-parameterized with LOAD_TYPE=notification-export
• Disabled while tis-esr-etl-param-cron is being tested

• 02h00
• daily

• This is the main job for tcsNDW-ETL
• It is triggered by a push into github
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys genericesr-upload etl into dev

• This is the main job for admins-ui
• It is triggered by a push into TIS-ADMINS-UI github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• This is a cron job in Jenkins
• It can take a parameter: the environment
• It will by default run in prod

• 07h00
• daily

• Uses jenkinsfile
• Can run against all our github repositories
• configured to use tis-ndw-etl github repo

• runs End to End tests
• active but not a single successfull run
• last issue: access to selenium server http://hub-cloud.browserstack.com/wd/hub
• DECISION REQUIRED

• This is a clone of the main job for admins-ui
• It used to be triggered by a push into TIS-ADMINS-UI github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev
• DECISION REQUIRED - last run was on 2018 March 7th

• this is a different implementation of a pipeline
• It uses groovy pipeline directly implemented in the GUI
• It never succeded, last run was on 2018 March 18th
• Last error: java.lang.NoSuchMethodError: No such DSL method 'post' found among steps
• DECISION REQUIRED

• Uses jenkinsfile
• Can run against all our github repositories
• configured to use TIS-ADMINS-UI github repo

• This is for manual run only
• One runs it to pass a DEBUG parameter which allows one to attach to port 5005TCP
• It does not create any JAR file or docker image
• It just deploys whatever is in platform.yml into the selected environment
• One can pass the debug parameter to the job, unlike service-env-deploy

• This is the main job for generic-upload
• It is triggered by a push into github
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• This is the main job for referencetcs
• It is triggered by a push into TIS-REFERENCE github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• This is the main job for profile
• It is triggered by a push into TIS-PROFILE github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• This is the main job for profileadmins-ui
• It is triggered by a push into TIS-ADMINS-PROFILEUI github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev
• DUPLICATE ???

• This is the main job for assessments
• It is triggered by a push into TIS-ASSESSMENTS github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• runs ansible task tasks/audit-logs-backup.yml in dev
• backs audt logs to azure storage container heetislogsbackup, container audit-logs-dev

• runs ansible task tasks/audit-logs-backup.yml in prod
• backs audt logs to azure storage container heetislogsbackup, container audit-logs-prod

• This is the main job for revalidation
• It is triggered by a push into TIS-REVALIDATION github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev
• triggers ci-test jenkins job 

• Runs ansible/tasks/intrepid-reval-etl-all.yml in dev, stage, uidev
• creates docker instance intrepid-dr-etl:{{ versions['intrepid-reval-etl'] }}

intrepid-reval-etl-all-uat

• Runs ansible/tasks/intrepid-reval-etl-all.yml in UAT
• creates docker instance intrepid-dr-etl:{{ versions['intrepid-reval-etl'] }}

• Runs ansible/tasks/intrepid-reval-etl-all.yml in prod with --limit 10.170.0.137
• creates docker instance intrepid-dr-etl:{{ versions['intrepid-reval-etl'] }}

• 5h30
• daily

intrepid-reval-etltype-schema-env

• takes ETLTYPE and ENVIRONMENT parameters
• Runs ansible/tasks/intrepid-reval-etl-all.yml --extra-vars="etl_type=${ETLTYPE}"
• creates docker instance intrepid-dr-etl:{{ versions['intrepid-reval-etl'] }}

• runs mvn verify
• triggers release-tag

• is triggered by the likes of ci_test
• takes the following parameters GIT_TAG_URL, GIT_TAG_BRANCH, GIT_TAG_VALUE
• tags the repo GIT_TAG_URL with tag GIT_TAG_VALUE

• DECISION REQUIRED -  last run 2017 Feb 27
• pipeline script
• takes a git repo, runs maven on it then runs mvn2docker

• This is the main job for reference
• It is triggered by a push into TIS-TRAINEE-UI github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• This is the main job for notifications
• It is triggered by a push into TIS-NOTIFICATIONS github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• This is the main job for common
• It is triggered by a push into TIS-COMMON github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• runs in PROD
• runs ansible code ansible/tasks/intrepid-load.yml
• does not use any git repo, apat from tis-devops
• ansible/tasks/intrepid-load.yml: deploys docker image repository.tis.nhs.uk:5000/hee/csv-diff:{{ versions['intrepid-load'] }}

• It is triggered by a push into TIS-INTREPID-DR-MODEL github repo
• runs mvn clean install -e

• It is triggered by a push into TIS-INTREPID-DR-TOOLS github repo
• runs mvn clean install -e then mvn2docker

• disabled, last run 2017 Nov 9th
• runs ansible playbook ansible/tasks/intrepid-load.yml in PROD

• runs ansible code ansible/tasks/intrepid-anonymizer.yml against localhost
• deploys docker image repository.tis.nhs.uk:5000/hee/anonymizer:{{ versions['intrepid-anonymizer'] }}
  

intrepid-anonymizer-new

• runs ansible/tasks/intrepid-anonymizer-new.yml in STAGE
• never run

• last run 2017 January 9th
• This is the main job for intrepid-core-model
• It is triggered by a push into TIS-INTREPID-CORE-MODEL github repo
• It creates the JAR and Docker image by running mvn2docker

• triggered by intrepid-etl-pipeine
• runs ansible playbook ansible/tasks/intrepid-load.yml in STAGE

Quote:

Runs intrepid-extract and load each morning. Intrepid extract: grabs data from intrepid places in into CSV files (db-to-csv). Intrepid remap: changes column names on CSV files (intrepid-remap-col-structure) - we could remove it Intrepid load: grabs CSV data and places it into the mirror (csv-diff) creates a delta file and then uploads to db Intrepid conosolidated etl: points to the mirror and populates the TIS system

• pipeline script from SCM
• SCM: TIS-DEVOPS
• script: jenkins/intrepid-etl-prod.groovy

• runs ansible/tasks/intrepid-extract-all.yml in PROD
• ansible/tasks/intrepid-extract-all.yml: deploys docker image repository.tis.nhs.uk:5000/hee/intrepid-extract:{{ versions['intrepid-extract'] }}

• disabled, last successful run 2017 Nov 30th
• runs ansible/tasks/intrepid-extract-new.yml on ETL hosts in PROD

• midnight
• daily

intrepid-dr-etl-build

• This is the main job for notifications
• It is triggered by a push into TIS-INTREPID-DR-ETL github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

intrepid-compare-stats

• runs ansible/tasks/intrepid-extract-clean.yml --limit 10.140.0.1 in PROD on ETL 
• runs automatically
• removes old files from /datadrive/data/intrepid
  

• midnight
• daily

intrepid-reval-etl-dev

• runs ansible/tasks/intrepid-reval-etl-all.yml in DEV

• runs ansible/tasks/intrepid-reval-etl-all.yml in STAGE

• runs ansible/tasks/intrepid-reval-etl-all.yml in UIDEV

db-to-csv-parent

• It is triggered by a push into TIS-DB-TO-CSV github repo
• triggers the job intrepid-extract-docker

intrepid-extract-docker

• Uses jenkinsfile
• Can run against all our github repositories
• configured to use ndw-etl github repo

• runs End to End tests
• active but not a single successfull run
• last issue: access to selenium server http://hub-cloud.browserstack.com/wd/hub
• DECISION REQUIRED

• This is a clone of the main job for admins-ui
• It used to be triggered by a push into TIS-ADMINS-UI github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev
• DECISION REQUIRED - last run was on 2018 March 7th

• this is a different implementation of a pipeline
• It uses groovy pipeline directly implemented in the GUI
• It never succeded, last run was on 2018 March 18th
• Last error: java.lang.NoSuchMethodError: No such DSL method 'post' found among steps
• DECISION REQUIRED

• Uses jenkinsfile
• Can run against all our github repositories
• configured to use TIS-ADMINS-UI github repo

• This is the main job for reference
• It is triggered by a push into TIS-REFERENCE github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• This is the main job for profile
• It is triggered by a push into TIS-PROFILE github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• This is the main job for profile
• It is triggered by a push into TIS-PROFILE github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev
• DUPLICATE ???

• This is the main job for assessments
• It is triggered by a push into TIS-ASSESSMENTS github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• runs ansible task tasks/audit-logs-backup.yml in dev
• backs audt logs to azure storage container heetislogsbackup, container audit-logs-dev

• runs ansible task tasks/audit-logs-backup.yml in prod
• backs audt logs to azure storage container heetislogsbackup, container audit-logs-prod

• This is the main job for revalidation
• It is triggered by a push into TIS-REVALIDATION github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev
• triggers ci-test jenkins job 

• Runs ansible/tasks/intrepid-reval-etl-all.yml in dev, stage, uidev
• creates docker instance intrepid-dr-etl:{{ versions['intrepid-reval-etl'] }}

intrepid-reval-etl-all-uat

• Runs ansible/tasks/intrepid-reval-etl-all.yml in UAT
• creates docker instance intrepid-dr-etl:{{ versions['intrepid-reval-etl'] }}

• Runs ansible/tasks/intrepid-reval-etl-all.yml in prod with --limit 10.170.0.137
• creates docker instance intrepid-dr-etl:{{ versions['intrepid-reval-etl'] }}

• 5h30
• daily

intrepid-reval-etltype-schema-env

• takes ETLTYPE and ENVIRONMENT parameters
• Runs ansible/tasks/intrepid-reval-etl-all.yml --extra-vars="etl_type=${ETLTYPE}"
• creates docker instance intrepid-dr-etl:{{ versions['intrepid-reval-etl'] }}

• runs mvn verify
• triggers release-tag

• is triggered by the likes of ci_test
• takes the following parameters GIT_TAG_URL, GIT_TAG_BRANCH, GIT_TAG_VALUE
• tags the repo GIT_TAG_URL with tag GIT_TAG_VALUE

• DECISION REQUIRED -  last run 2017 Feb 27
• pipeline script
• takes a git repo, runs maven on it then runs mvn2docker

• This is the main job for reference
• It is triggered by a push into TIS-TRAINEE-UI github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• This is the main job for notifications
• It is triggered by a push into TIS-NOTIFICATIONS github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• This is the main job for common
• It is triggered by a push into TIS-COMMON github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• runs in PROD
• runs ansible code ansible/tasks/intrepid-load.yml
• does not use any git repo, apat from tis-devops
• ansible/tasks/intrepid-load.yml: deploys docker image repository.tis.nhs.uk:5000/hee/csv-diff:{{ versions['intrepid-load'] }}

• It is triggered by a push into TIS-INTREPID-DR-MODEL github repo
• runs mvn clean install -e

• It is triggered by a push into TIS-INTREPID-DR-TOOLS github repo
• runs mvn clean install -e then mvn2docker

• disabled, last run 2017 Nov 9th
• runs ansible playbook ansible/tasks/intrepid-load.yml in PROD

• runs ansible code ansible/tasks/intrepid-anonymizer.yml against localhost
• deploys docker image repository.tis.nhs.uk:5000/hee/anonymizer:{{ versions['intrepid-anonymizer'] }}
  

intrepid-anonymizer-new

• runs ansible/tasks/intrepid-anonymizer-new.yml in STAGE
• never run

intrepid-anonymizer-build

Anonymise intrepid data to populate the anonymized mirror

• This is the main job for intrepid-anonymizer
• It is triggered by a push into TIS-DATA-ANONYMIZER github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

• last run 2017 January 9th
• This is the main job for intrepid-core-model
• It is triggered by a push into TIS-INTREPID-CORE-MODEL github repo
• It creates the JAR and Docker image by running mvn2docker

• triggered by intrepid-etl-pipeine
• runs ansible playbook ansible/tasks/intrepid-load.yml in STAGE

Quote:

Runs intrepid-extract and load each morning. Intrepid extract: grabs data from intrepid places in into CSV files (db-to-csv). Intrepid remap: changes column names on CSV files (intrepid-remap-col-structure) - we could remove it Intrepid load: grabs CSV data and places it into the mirror (csv-diff) creates a delta file and then uploads to db Intrepid conosolidated etl: points to the mirror and populates the TIS system

• pipeline script from SCM
• SCM: TIS-DEVOPS
• script: jenkins/intrepid-etl-prod.groovy
• jenkins/intrepid-etl-prod.groovy can run intrepid-extract-all, intrepid-remapper-structure, intrepid-load, intrepid-extract-upload, intrepid-compare-stats
  

• runs ansible/tasks/intrepid-extract-all.yml in PROD
• ansible/tasks/intrepid-extract-all.yml: deploys docker image repository.tis.nhs.uk:5000/hee/intrepid-extract:{{ versions['intrepid-extract'] }}

intrepid-extract-dr2

• disabled, last successful run 2017 Nov 30th
• runs ansible/tasks/intrepid-extract-new.yml on ETL hosts in PROD

• midnight
• daily

intrepid-dr-etl-build

• This is the main job for notifications
• It is triggered by a push into TIS-INTREPID-DR-ETL github repo
• It creates the JAR and Docker image by running service-pipeline
• When FINALTAG is set, it deploys generic-upload into dev

intrepid-compare-stats

intrepid-extract-clean

• runs ansible/tasks/intrepid-extract-clean.yml --limit 10.140.0.1 in PROD on ETL 
• runs automatically
• removes old files from /datadrive/data/intrepid
  

• midnight
• daily

intrepid-reval-etl-dev

• runs ansible/tasks/intrepid-reval-etl-all.yml in DEV

• runs ansible/tasks/intrepid-reval-etl-all.yml in STAGE

• runs ansible/tasks/intrepid-reval-etl-all.yml in UIDEV

db-to-csv-parent

• It is triggered by a push into TIS-DB-TO-CSV github repo
• triggers the job intrepid-extract-docker

intrepid-extract-docker

• It is triggered by a push into TIS-DB-TO-CSV github repo
• It can be triggered by db-to-csv-parent
• It runs mvn clean install -e on TIS-DB-TO-CSV/db-to-csv pom.xml file
• It runs ansible/tasks/spring-boot-build.yml in DEV on localhost
• it runs mvn2docker to create an image named intrepid-extract
• When FINALTAG is set, it deploys generic-upload into dev ????

intrepid-extract-upload

• triggered by intrepid-etl-pipeine
• compresses and uploads intrepid databases to azure blob storage ???
• runs ansible/tasks/intrepid-extract-upload.yml in PROD on ETL hosts

intrepid-extract-all-etl

• uses export DEVOPS_BASE=/datadrive/data/fayaz/master/devops in PROD
• last run 2017 November 9th
• deploys docker image repository.tis.nhs.uk:5000/hee/intrepid-extract:{{ versions['intrepid-extract'] }}
  
• extracts intrepid databases

intrepid-remapper-structure

• runs ansible/tasks/intrepid-remapper-structure.yml with inventory localhost
• ansible/tasks/intrepid-remapper-structure.yml: runs mvn on ETL hosts to create jarfile, then java -jar jarfile
• can be run by  intrepid-etl-pipeine

intrepid-remapper-structure-etl

• disabled, last successful run 2017 Nov 9th
• runs ansible/tasks/intrepid-remapper-structure.yml in PROD
• ansible/tasks/intrepid-remapper-structure.yml: runs mvn on ETL hosts to create jarfile, then java -jar jarfile