Project | Jenkins job | Purpose | SCM triggered | cron | Action |
---|
| tis-esr-etl-param-apc-import | - This is a cron job in jenkins
- It runs tis-esr-parameterized with LOAD_TYPE=apc-import
- Disabled
| no | | - DELETE
- Deleted on 2018 May 18
|
---|
| tis-esr-etl-param-applicant-load | - This is a cron job in jenkins
- It runs tis-esr-parameterized with LOAD_TYPE=applicant-load
- Disabled
| no | | - DELETE
- Deleted on 2018 May 18
|
---|
| tis-esr-etl-param-applicant-export | - This is a cron job in jenkins
- It runs tis-esr-parameterized with LOAD_TYPE=applicant-export
- Disabled
| no | | - DELETE
- Deleted on 2018 May 18
|
---|
| tis-esr-etl-param-notification-export | - This is a cron job in jenkins
- It runs tis-esr-parameterized with LOAD_TYPE=notification-export
- Disabled
| no | | - DELETE
- Deleted on 2018 May 18
|
---|
| tis-esr-etl-param-notification-daily-load | - This is a cron job in jenkins
- It runs tis-esr-parameterized with LOAD_TYPE=notification-export
- Disabled
| no | | - DELETE
- Deleted on 2018 May 18
|
---|
| esr-etl | - disabled because tis-esr-etl does the same thing
- uses TIS-ESR-ETL git repo
runs mvn - then triggers mvn2docker jenkins job
| yes | no | |
---|
|
|
|
|
|
|
---|
| service-pipeline-ndw-etl | disabled because this was a poor attempt to change service-pipeline | no | no | - DELETE
- Deleted on 2018 May 18
|
---|
|
|
|
|
|
|
---|
| tcs-paramameterized | disabled because this was a poor attempt to change service-pipeline |
|
| - DELETE
- Deleted on 2018 May 18
|
---|
|
|
|
|
|
|
---|
| admins-ui-uat | - This is a clone of the main job for admins-ui
- It used to be triggered by a push into TIS-ADMINS-UI github repo
- It creates the JAR and Docker image by running service-pipeline
- When FINALTAG is set, it deploys admins-ui into dev
- DECISION REQUIRED - last run was on 2018 March 7th
| no | no | |
---|
| profile-parent | - This is the main job for profile
- It is triggered by a push into TIS-PROFILE github repo
- It creates the JAR and Docker image by running service-pipeline
- When FINALTAG is set, it deploys generic-upload into dev
- triggers profile
- DUPLICATE ???
| yes | no | |
---|
|
|
|
|
|
|
---|
ci_test | ci_test | - runs mvn verify
- triggers release-tag
- last run Apr 19, 2017 1:11:45 PM
| no | no | |
---|
|
|
|
|
|
|
---|
fayaz-pl | fayaz-pl | - last run 2017 Feb 27
- pipeline script
- takes a git repo, runs maven on it then runs mvn2docker
| no | no | - DISABLE??
- Disabled on 2018 May 18
|
---|
|
|
|
|
|
|
---|
| intrepid-load-etl | - disabled, last run 2017 Nov 9th
- runs ansible playbook ansible/tasks/intrepid-load.yml in PROD
- uses old DEVOPS repo
| no | no | |
---|
| intrepid-etl-pipeine | Quote:
Runs intrepid-extract and load each morning. Intrepid extract: grabs data from intrepid places in into CSV files (db-to-csv). Intrepid remap: changes column names on CSV files (intrepid-remap-col-structure) - we could remove it Intrepid load: grabs CSV data and places it into the mirror (csv-diff) creates a delta file and then uploads to db Intrepid conosolidated etl: points to the mirror and populates the TIS system
- DISABLED
- pipeline script from SCM
- SCM: TIS-DEVOPS
- script: jenkins/intrepid-etl-prod.groovy
- jenkins/intrepid-etl-prod.groovy can run intrepid-extract-all, intrepid-remapper-structure, intrepid-load, intrepid-extract-upload, intrepid-compare-stats
| no | no | |
---|
| intrepid-extract-dr2 | - disabled, last successful run 2017 Nov 30th
- runs ansible/tasks/intrepid-extract-new.yml on ETL hosts in PROD
| no | | |
---|
| intrepid-compare-stats-etl | - disabled, last run 2017 Nov 9th
- runs ansible/tasks/intrepid-compare-stats.yml in PROD, with DEVOPS_BASE=/datadrive/data/fayaz/master/devops
| no | no | |
---|
| intrepid-extract-all-etl
| - uses export DEVOPS_BASE=/datadrive/data/fayaz/master/devops in PROD
- last run 2017 November 9th
- deploys docker image repository.tis.nhs.uk:5000/hee/intrepid-extract:{{ versions['intrepid-extract'] }}
- extracts intrepid databases
| no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
| intrepid-extract-upload-etl | - disabled, last successful run 2017 Nov 9th
compresses and uploads intrepid databases in azure
- runs ansible/tasks/intrepid-extract-upload.yml in PROD using DEVOPS_BASE=/datadrive/data/fayaz/master/devops
| no | no | |
---|
| intrepid-extract-consolidated
| - runs ansible/tasks/intrepid-extract-consolidated.yml in PROD
- ansible/tasks/intrepid-extract-consolidated.yml does not exist
- last successfull run: 2017-07-23
| no | no | |
---|
| intrepid-remapper-structure-etl
| - disabled, last run 2017 Nov 9th
- runs ansible/tasks/intrepid-remapper-structure.yml with DEVOPS_BASE=/datadrive/data/fayaz/master/devops
| no | no | |
---|
| test-intrepid-connection | - disabled, last run 2017 March 13th
- runs /opt/mssql-tools/bin/sqlcmd
| no | no | |
---|
|
|
|
|
|
|
---|
Consolidated-DR-ETL | consolidated-dr-etl-all-parameterised-dev | - DISABLED
- pipeline script from SCM
- SCM: TIS-DEVOPS
- script: jenkins/consolidated-dr-etl.groovy
- jenkins/consolidated-dr-etl.groovy: runs ansible/tasks/consolidated-dr-etl-old.yml or ansible/tasks/consolidated-dr-etl-all.yml
| no | no | |
---|
| consolidated-dr-etl-all-parameterised-dev-tisdev4305 | - disabled
This is to test a new parameter for consolidated-dr-etl-all-parameterised-dev
The new parameter is POST_PROGRAMME_STEP_ENABLED
We use a new branch named TISDEV-4305-POST_PROGRAMME_STEP_ENABLED of TIS-DEVOPS and a modified version of jenkins/consolidated-dr-etl.groovy
| no | no | |
---|
| consolidated-dr-etl-all-prod-etl | - DISABLED
- uses /datadrive/data/fayaz/master/devops to run ansible/tasks/consolidated-dr-etl-all.yml in PROD
| no | no | |
---|
|
|
|
|
|
|
---|
Misc | bdd_tests_staging | folder /datadrive/data/jenkins/jobs/bdd_tests_staging/ exists but no job in jenkins
| no | no | |
---|
| browserstack-cucumber
| - last run on Nov 29, 2016 5:57:22 PM
- uses TIS-REVALIDATION repo
- runs "npm install && gulp bs" in DEV ???
| no | no | - DELETE
- Disabled on 2018 May 22
|
---|
|
|
|
|
|
|
---|
CI | ci-stage | | no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
|
ci-stage-pipeline
| | no | no | - DISABLE??
- Disabled on 2018 May 22
|
---|
| ci-staging
| | no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
| ci_test | - uses TIS-REVALIDATION repo
export TIS_ENV=development
export CHROME_DRIVER_HOME=/usr/bin/
cd bdd
mvn verify
- triggers release-tag jenkins job
| no | no | |
---|
| ci-tests-concerns
| - last run Feb 21, 2017 2:42:59 PM
- uses TIS-CONCERNS git repo
- runs "mvn verify"
| no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
|
ci_tests_parallel
| - DISABLED
- last run Sep 27, 2016 8:48:22 AM
- uses TIS-REVALIDATIONS git repo
- watches jenkins job revalidation-dev-deploy which does not exist
| no | no | |
---|
|
ci_tests_tagging
| - DISABLED
- Never run
- uses TIS-REVALIDATIONS git repo
- runs selenium
- triggers non existing git-tag jenkins job
| no | no | |
---|
|
|
|
|
|
|
---|
| db-to-csv-archive
| - DISABLED
- uses db-to-csv git repo
- last run Mar 16, 2017 12:54:04 PM
| no | no | |
---|
| db-to-csv-test-archive
| - DISABLED
- last run Mar 20, 2017 1:51:27 PM
- uses db-to-csv git repo
- runs /tmp/fayaz/TIS-DEVOPS/ansible/tasks/spring-boot-build.yml
| no | no | |
---|
|
dev-api-load-test
| - never run
- uses TIS-JMETER git repo
- watches ci-staging
- runs "./jmeter.sh -n -t load.jmx -l testresults.jtl"
| no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
|
|
|
|
|
|
---|
DOCKER | docker-alpine-java
| - DISABLED
- last run Dec 16, 2017 12:41:00 AM
- uses docker-alpine-java git repo
- runs /home/jenkins/data/devops/bin/docker-build-push.sh
- /home/jenkins/data/devops/bin/docker-build-push.sh runs docker build|push|tag|rmi
| no | | |
---|
| docker-clean-build
| - DISABLED
- last run Sep 26, 2017 12:15:06 PM
Runs regularly to tidy up stray docker artifacts such as "<none>" images, old stopped containers and anonymous volumes
- uses BUILD ansible inventory
- runs ansible/tasks/docker-clean.yml playbook
- ansible/tasks/docker-clean.yml: runs docker system prune -af
| no | | |
---|
|
docker-registryui-cert-renew
| - DISABLED
- last run Jun 11, 2017 6:06:00 AM
- uses ansible DEV inventory
- runs ansible/tasks/docker-registryui-cert-renew.yml ansible playbook
- ansible/tasks/docker-registryui-cert-renew.yml
| no | | |
---|
|
|
|
|
|
|
---|
|
hee-alpine-java-docker
| - watches docker-alpine-java, hee-alpine-jre
- runs ```IMAGE=hee-alpine-java WORKSPACE=~/data/devops/docker/images/hee-alpine-java ~/data/devops/bin/docker-build-push.sh```
- last run Jan 16, 2018 2:00:14 AM
| no | no | - DELETE ??
- ASK AROUND WHAT THIS IS
|
---|
|
hee-alpine-jre
| - NEVER run successfully
- runs ```IMAGE=hee-alpine-jdk WORKSPACE=~/data/devops/docker/images/hee-alpine-jdk ~/data/devops/bin/docker-build-push.sh```
| no | | - DELETE ??
- Disabled on 2018 May 22
|
---|
| inspectlet
| | no | no | - DISABLE ??
- Disabled on 2018 May 22
- ASK AROUND WHAT THIS IS
|
---|
| java-library-base
|
Sample project to clone Java Library projects from.
| yes | no | |
---|
|
|
|
|
|
|
---|
JENKINS | jenkins-cert-renew
| - DISABLED
- runs ansible/tasks/jenkins-cert-renew.yml
- uses BUILD repo
| no | | |
---|
| jenkins-dsl-seed
| - runs DSL code
- buildMonitorView('Production ETLs')
- buildMonitorView('Microservice builds')
| no | no | |
---|
|
|
|
|
|
|
---|
| maven-poms
| | yes | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
| mysql-dev-deploy | - last run Oct 6, 2016 1:20:09 PM
- runs ansible/mysql.yml which does not exit
- uses AZURE inventory which does not exist
| no | no | - DELETE??
- Disabled on 2018 May 22
|
---|
|
|
|
|
|
|
---|
| oriel-etl-dev
| - NEVER run
- runs ansible playbook ansible/tasks/oriel-etl.yml
- uses DEV inventory
- ansible/tasks/oriel-etl.yml deploys repository.tis.nhs.uk:5000/hee/oriel-etl:{{ versions['oriel-etl'] }}
| no | no | - DISABLE??
- Disabled on 2018 May 22
|
---|
|
|
|
|
|
|
---|
| owasp_zap
| | no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
|
|
|
|
|
|
---|
|
piwik-docker
| - last run Dec 8, 2016 4:44:29 PM
- uses docker-piwik git repo
- runs bin/docker-build-push.sh
- bin/docker-build-push.sh which is a wrapper around docker build|push|tag
| no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
|
postgresql-backup-build
| - DISABLED
- last run Sep 23, 2017 2:18:00 AM
Create postgresql backup on build environment postgresql instance
- runs ansbile playbook ansible/tasks/postgres-backup.yml
- uses BUILD inventory
- ansible/tasks/postgres-backup.yml runs "pg_dumpall" and "azure storage blob upload"
| no | | |
---|
|
registry-clone
| - last run Nov 22, 2017 10:29:02 AM
Copies the current docker-registry into azure container registry
- runs /home/jenkins/data/devops/bin/registry-clone.sh
- /home/jenkins/data/devops/bin/registry-clone.sh runs "docker pull|tag|push"
| no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
|
|
|
|
|
|
---|
RELEASE |
release-dev
| - run ONCE only Nov 14, 2017 10:54:23 AM
TIS-Release deployment in blue-green mode
- uses /datadrive/data/fayaz/es/TIS-DEVOPS
- runs various ansible playbooks
| no | no | |
---|
| release-prod
| - DISABLED
- last run Nov 13, 2017 11:15:51 AM
- runs ansible/releases/<RELEASENB>/main.yml
- uses PROD inventory
| no | no | |
---|
|
|
|
|
|
|
---|
SERVICE |
service-docker
| - never run
- takes a repo name and runs bin/docker-build-push.sh
- bin/docker-build-push.sh is a warpper around "docker pull|push|tag"
- triggers service-env-deploy
| no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
| service-final-tag
| - runs a shell script defined in jenkins
- shell script is a wrapper around "docker pull|tag|push|rmi"
- last run Mar 6, 2017 8:24:10 AM
| no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
| service-pipeline-adminsui
| - never run
- testing a new way of using the service-pipeline
- To be DELETED
| no | no | - DELETE
- Deleted on 2018 May 18
|
---|
|
service-pipeline-bkp
| - DISABLED
- pipeline script
- copy and paste of service-pipeline.groovy ????
| no | no | |
---|
|
service-pipeline-ndw-etl
| - DISABLED
- uses a custom pipeline script jenkins/service-pipeline-ndw-etl.groovy
- To be DELETED
| no | no | |
---|
| site-dev3
| - last run Nov 21, 2016 4:00:51 PM
- runs ansible playbook ansible/site.yml
- uses DEV3 ansible inventory
| no | no | - DISABLE
- Disabled on 2018 May 22
|
---|
|
|
|
|
|
|
---|
| sonarqube
| - last run Oct 5, 2016 11:01:42 AM
runs
docker stop sonarqube || true
docker rm sonarqube || true
docker run -d --name sonarqube -p 9000:9000 -p 9092:9092 sonarqube
| no | no | |
---|
| staging-api-load-test
| - last run Dec 14, 2016 4:17:24 PM
- uses TIS-JMETER git repo
- watches ci-staging jenkins job
runs
cd bin
./jmeter.sh -n -t load.jmx -l testresults.jtl
- publishes bin/testresults.jtl;bin/jmeter.log
|
|
| - DISABLE ??
- Disabled on 2018 May 22
|
---|
| terraform-etl
| - runs a pipeline script
- pipeline runs ansible/tasks/terraform-etl.yml with different tags
| no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
| test-intrepid-connection | - DISABLED
runs
/opt/mssql-tools/bin/sqlcmd -S "TCP:212.250.207.206,4589" -U "TRANSFORM SYSTEM" -P "ed0hUbLT" -d "Intrepid.DataRepository" -Q "quit"
|
| - every 15 minutes
- between 0h00 and 8h00
| |
---|
| test-service-pipeline
| - last run Oct 19, 2017 6:54:58 PM
- runs a pipeline script
- pipeline script very similar to service-pipeline.groovy
| no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
|
tis-core-model
| - run twice, last was May 26, 2017 2:15:36 PM
- uses TIS-CORE-MODEL git repo
runs mvn
| yes | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
| tis-core-services
| - last run Apr 1, 2017 12:29:24 PM
tis-core-services including the UI
- uses TIS-CORE-SERVICES git repo
runs mvn then then
export DEVOPS_BASE=/tmp/fayaz/master/TIS-DEVOPS
export UI_PORT=9093
ansible-playbook -i ${DEVOPS_BASE}/ansible/inventory/dev2 /tmp/fayaz/master/TIS-DEVOPS/ansible/tasks/spring-boot-build.yml
- and archives the result in **/target/*.war
| yes | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|
| ubuntu-security-updates
| - DISABLED
- last run Oct 5, 2017 9:10:01 AM
Runs regularly to update ubuntu images
- runs ansible/tasks/ubuntu-security-updates.yml playbook
- uses DEV inventory
| no | no | |
---|
| ui-pipeline
| - run once on Oct 19, 2017 1:08:22 PM
- runs a pipeline script
- pipeline script similar to service-pipeline.groovy
| no | no | - DISABLE ??
- Disabled on 2018 May 22
|
---|