Started by upstream project "pipeline-templates" build number 451 originally caused by: Triggered by Gerrit: https://gerrit.opensdn.io/c/opensdn-io/tf-jenkins/+/1612 Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on slave-openstack-gz1_1 (openstack) in workspace /home/jenkins/workspace/collect-logs-and-cleanup@2 [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Deferred wipeout is disabled by the job configuration... [WS-CLEANUP] Done The recommended git tool is: git No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/opensdn-io/tf-jenkins.git > git init /home/jenkins/workspace/collect-logs-and-cleanup@2/src/opensdn-io/tf-jenkins # timeout=10 Fetching upstream changes from https://github.com/opensdn-io/tf-jenkins.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/opensdn-io/tf-jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/opensdn-io/tf-jenkins.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision d123cf296746e4d7c49b1db909bcef43ae30e239 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f d123cf296746e4d7c49b1db909bcef43ae30e239 # timeout=10 Commit message: "use r24.1 tag for deployer image in ansible case" > git rev-list --no-walk d123cf296746e4d7c49b1db909bcef43ae30e239 # timeout=10 The recommended git tool is: NONE No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/opensdn-io/tf-devstack.git > git init /home/jenkins/workspace/collect-logs-and-cleanup@2/src/opensdn-io/tf-devstack # timeout=10 Fetching upstream changes from https://github.com/opensdn-io/tf-devstack.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/opensdn-io/tf-devstack.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/opensdn-io/tf-devstack.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 Avoid second fetch > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision 2f03a1e26e811ba39d6f10fd1924476f08a26fcf (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 2f03a1e26e811ba39d6f10fd1924476f08a26fcf # timeout=10 Commit message: "fix k8s_manifests" > git rev-list --no-walk 2f03a1e26e811ba39d6f10fd1924476f08a26fcf # timeout=10 Copied 4 artifacts from "pipeline-templates" build number 451 [collect-logs-and-cleanup@2] $ /bin/bash -xe /tmp/jenkins4701865368017573174.sh + source /home/jenkins/workspace/collect-logs-and-cleanup@2/global.env ++ export PIPELINE_BUILD_TAG=jenkins-pipeline-templates-451 ++ PIPELINE_BUILD_TAG=jenkins-pipeline-templates-451 ++ export SLAVE=openstack ++ SLAVE=openstack ++ export SLAVE_REGION=gz1 ++ SLAVE_REGION=gz1 ++ export LOGS_HOST=nexus.gz1.opensdn.io ++ LOGS_HOST=nexus.gz1.opensdn.io ++ export LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/12/1612/3/templates_451 ++ LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/12/1612/3/templates_451 ++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/12/1612/3/templates_451 ++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/12/1612/3/templates_451 ++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG=master-1_6_1_2-3 ++ CONTRAIL_CONTAINER_TAG=master-1_6_1_2-3 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_1_2-3 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_1_2-3 ++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_6_1_2-3 ++ CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_6_1_2-3 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_6_1_2-3 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_6_1_2-3 ++ export GERRIT_PIPELINE=templates ++ GERRIT_PIPELINE=templates ++ export GERRIT_URL=https://gerrit.opensdn.io/ ++ GERRIT_URL=https://gerrit.opensdn.io/ ++ export GERRIT_CHANGE_ID=I3a636acde462e7c4a44ae2cceadf25d96b13d7b9 ++ GERRIT_CHANGE_ID=I3a636acde462e7c4a44ae2cceadf25d96b13d7b9 ++ export GERRIT_BRANCH=master ++ GERRIT_BRANCH=master ++ export GERRIT_PROJECT=opensdn-io/tf-jenkins ++ GERRIT_PROJECT=opensdn-io/tf-jenkins ++ export REPOS_CHANNEL=latest ++ REPOS_CHANNEL=latest + desc='Pipeline: pipeline-templates-451 Random: 54542 Stream: ansible-k8s' + desc+='
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/12/1612/3/templates_451/ansible-k8s' + echo 'DESCRIPTION Pipeline: pipeline-templates-451 Random: 54542 Stream: ansible-k8s
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/12/1612/3/templates_451/ansible-k8s' DESCRIPTION Pipeline: pipeline-templates-451 Random: 54542 Stream: ansible-k8s
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/12/1612/3/templates_451/ansible-k8s [description-setter] Description set: Pipeline: pipeline-templates-451 Random: 54542 Stream: ansible-k8s
Job logs: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/12/1612/3/templates_451/ansible-k8s' [collect-logs-and-cleanup@2] $ /bin/bash -xe /tmp/jenkins13764385858702603238.sh + source /home/jenkins/workspace/collect-logs-and-cleanup@2/global.env ++ export PIPELINE_BUILD_TAG=jenkins-pipeline-templates-451 ++ PIPELINE_BUILD_TAG=jenkins-pipeline-templates-451 ++ export SLAVE=openstack ++ SLAVE=openstack ++ export SLAVE_REGION=gz1 ++ SLAVE_REGION=gz1 ++ export LOGS_HOST=nexus.gz1.opensdn.io ++ LOGS_HOST=nexus.gz1.opensdn.io ++ export LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/12/1612/3/templates_451 ++ LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/12/1612/3/templates_451 ++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/12/1612/3/templates_451 ++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/12/1612/3/templates_451 ++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG=master-1_6_1_2-3 ++ CONTRAIL_CONTAINER_TAG=master-1_6_1_2-3 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_1_2-3 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_1_2-3 ++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_6_1_2-3 ++ CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_6_1_2-3 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_6_1_2-3 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_6_1_2-3 ++ export GERRIT_PIPELINE=templates ++ GERRIT_PIPELINE=templates ++ export GERRIT_URL=https://gerrit.opensdn.io/ ++ GERRIT_URL=https://gerrit.opensdn.io/ ++ export GERRIT_CHANGE_ID=I3a636acde462e7c4a44ae2cceadf25d96b13d7b9 ++ GERRIT_CHANGE_ID=I3a636acde462e7c4a44ae2cceadf25d96b13d7b9 ++ export GERRIT_BRANCH=master ++ GERRIT_BRANCH=master ++ export GERRIT_PROJECT=opensdn-io/tf-jenkins ++ GERRIT_PROJECT=opensdn-io/tf-jenkins ++ export REPOS_CHANNEL=latest ++ REPOS_CHANNEL=latest + ./src/opensdn-io/tf-jenkins/infra/gerrit/apply_patchsets.sh ./src opensdn-io/tf-jenkins ./patchsets-info.json INFO: run 'git fetch https://gerrit.opensdn.io//opensdn-io/tf-jenkins refs/changes/12/1612/3' From https://gerrit.opensdn.io//opensdn-io/tf-jenkins * branch refs/changes/12/1612/3 -> FETCH_HEAD INFO: FETCH_HEAD - d123cf29 use r24.1 tag for deployer image in ansible case [detached HEAD 3c8d4a17] switch to rocky95 Author: Andrey Pavlov Date: Fri Apr 25 15:53:04 2025 +0300 5 files changed, 13 insertions(+), 5 deletions(-) + ./src/opensdn-io/tf-jenkins/infra/gerrit/apply_patchsets.sh ./src opensdn-io/tf-devstack ./patchsets-info.json [collect-logs-and-cleanup@2] $ /bin/bash -xe /tmp/jenkins7312106340685788667.sh + source /home/jenkins/workspace/collect-logs-and-cleanup@2/global.env ++ export PIPELINE_BUILD_TAG=jenkins-pipeline-templates-451 ++ PIPELINE_BUILD_TAG=jenkins-pipeline-templates-451 ++ export SLAVE=openstack ++ SLAVE=openstack ++ export SLAVE_REGION=gz1 ++ SLAVE_REGION=gz1 ++ export LOGS_HOST=nexus.gz1.opensdn.io ++ LOGS_HOST=nexus.gz1.opensdn.io ++ export LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/12/1612/3/templates_451 ++ LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/12/1612/3/templates_451 ++ export LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/12/1612/3/templates_451 ++ LOGS_URL=http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/12/1612/3/templates_451 ++ export SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ SITE_MIRROR=http://nexus.gz1.opensdn.io/repository ++ export CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG=master-1_6_1_2-3 ++ CONTRAIL_CONTAINER_TAG=master-1_6_1_2-3 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_1_2-3 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_1_2-3 ++ export CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ DEPLOYER_CONTAINER_REGISTRY_ORIGINAL=nexus.gz1.opensdn.io:5101 ++ export CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_6_1_2-3 ++ CONTRAIL_CONTAINER_TAG_ORIGINAL=master-1_6_1_2-3 ++ export CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_6_1_2-3 ++ CONTRAIL_DEPLOYER_CONTAINER_TAG_ORIGINAL=master-1_6_1_2-3 ++ export GERRIT_PIPELINE=templates ++ GERRIT_PIPELINE=templates ++ export GERRIT_URL=https://gerrit.opensdn.io/ ++ GERRIT_URL=https://gerrit.opensdn.io/ ++ export GERRIT_CHANGE_ID=I3a636acde462e7c4a44ae2cceadf25d96b13d7b9 ++ GERRIT_CHANGE_ID=I3a636acde462e7c4a44ae2cceadf25d96b13d7b9 ++ export GERRIT_BRANCH=master ++ GERRIT_BRANCH=master ++ export GERRIT_PROJECT=opensdn-io/tf-jenkins ++ GERRIT_PROJECT=opensdn-io/tf-jenkins ++ export REPOS_CHANNEL=latest ++ REPOS_CHANNEL=latest + source /home/jenkins/workspace/collect-logs-and-cleanup@2/deps.collect-logs-and-cleanup.54542.env ++ export PROVIDER=openstack ++ PROVIDER=openstack ++ export ENVIRONMENT_OS=rocky9 ++ ENVIRONMENT_OS=rocky9 ++ export IMAGE=4342c5af-7cec-453c-8480-30a37444aa06 ++ IMAGE=4342c5af-7cec-453c-8480-30a37444aa06 ++ export IMAGE_SSH_USER=rocky ++ IMAGE_SSH_USER=rocky ++ export INSTANCE_IDS=ab1e6066-626f-4f70-8853-cfed426042a6, ++ INSTANCE_IDS=ab1e6066-626f-4f70-8853-cfed426042a6, ++ export instance_ip=10.0.0.38 ++ instance_ip=10.0.0.38 ++ export CONTROLLER_NODES=10.0.0.38, ++ CONTROLLER_NODES=10.0.0.38, ++ export ORCHESTRATOR=kubernetes ++ ORCHESTRATOR=kubernetes ++ export DEPLOYER=ansible ++ DEPLOYER=ansible ++ export JOB_LOGS_PATH=ansible-k8s ++ JOB_LOGS_PATH=ansible-k8s + source /home/jenkins/workspace/collect-logs-and-cleanup@2/vars.collect-logs-and-cleanup.54542.env ++ export MONITORING_DEPLOY_TARGET=AIO ++ MONITORING_DEPLOY_TARGET=AIO ++ export MONITORING_DEPLOYER=ansible ++ MONITORING_DEPLOYER=ansible ++ export MONITORING_ORCHESTRATOR=k8s ++ MONITORING_ORCHESTRATOR=k8s ++ export ENVIRONMENT_OS=rocky9 ++ ENVIRONMENT_OS=rocky9 ++ export CONFIG_API_WORKER_COUNT=3 ++ CONFIG_API_WORKER_COUNT=3 + export FULL_LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/12/1612/3/templates_451/ansible-k8s + FULL_LOGS_PATH=/var/www/logs/jenkins_logs/gerrit/12/1612/3/templates_451/ansible-k8s + [[ -n 10.0.0.38 ]] + /home/jenkins/workspace/collect-logs-and-cleanup@2/src/opensdn-io/tf-jenkins/jobs/devstack/ansible/collect_logs.sh INFO: wait for host Linux cn-jenkins-deploy-platform-ansible-k8s-353-1.novalocal 5.14.0-503.14.1.el9_5.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Nov 15 12:04:32 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux INFO: collect logs INFO: Deploy ansible/logs (collect-logs-and-cleanup) Warning: Permanently added '10.0.0.38' (ECDSA) to the list of known hosts. Warning: Permanently added '10.0.0.38' (ECDSA) to the list of known hosts. INFO: =================== Mon Apr 28 07:53:11 PM UTC 2025 =================== [there is no tf devenv configuration to load] INFO: Applying stages logs INFO: Running stage logs at Mon Apr 28 07:53:11 PM UTC 2025 INFO: collecting logs... cp: cannot stat '/home/rocky/.tf/*.yml': No such file or directory Warning: Permanently added '10.0.0.38' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.38' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.38' (ED25519) to the list of known hosts. Warning: Permanently added '10.0.0.38' (ED25519) to the list of known hosts. INFO: Collecting contrail-status INFO: Collecting system statistics for logs INFO: Collecting docker logs INFO: Collecting TF logs INFO: Collecting tf logs: /etc/cni INFO: Collecting tf logs: save_introspect_info INFO: Collecting core dumps INFO: content of /var/crash /var/crash: total 4 drwxr-xr-x. 2 root root 6 Nov 12 15:50 . drwxr-xr-x. 19 root root 4096 Apr 28 19:33 .. INFO: content of /var/crashes ls: cannot access '/var/crashes': No such file or directory ls: cannot access '/var/crashes': No such file or directory INFO: Collecting statuses from cassandra, zookeeper and rabbitmq services INFO: There are no required containers INFO: Collecting kubernetes logs The connection to the server localhost:8080 was refused - did you specify the right host or port? INFO: kubectl is not configured here INFO: Collecting kubernetes object info The connection to the server localhost:8080 was refused - did you specify the right host or port? INFO: kubectl is not configured here /tmp/ansible-logs/logs /tmp/ansible-logs /tmp/ansible-logs Warning: Permanently added '10.0.0.38' (ED25519) to the list of known hosts. ~/.tf/logs/10.0.0.38 ~ ~ INFO: Stage logs was run successfully Mon Apr 28 07:53:13 PM UTC 2025 [update tf stack configuration] Warning: Permanently added '10.0.0.38' (ED25519) to the list of known hosts. tf setup profile /home/rocky/.tf/stack.env DEPLOYER=ansible CONTRAIL_CONTAINER_TAG=master-1_6_1_2-3 CONTRAIL_DEPLOYER_CONTAINER_TAG=master-1_6_1_2-3 CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 DEPLOYER_CONTAINER_REGISTRY=nexus.gz1.opensdn.io:5101 ORCHESTRATOR=kubernetes OPENSTACK_VERSION="yoga" CONTROLLER_NODES="10.0.0.38 " AGENT_NODES="10.0.0.38" CONTROL_NODES="10.0.0.38 " SSL_ENABLE="false" LEGACY_ANALYTICS_ENABLE="true" HUGE_PAGES_1G= CONTAINER_RUNTIME=docker K8S_CA= DEPLOY_IPA_SERVER= IPA_PASSWORD= AUTH_PASSWORD='contrail123' AUTH_URL='' INFO: Successful deployment Mon Apr 28 07:53:13 PM UTC 2025 DEBUG: kill running child jobs: INFO: Deploy logs finished INFO: Copy logs from host to workspace Warning: Permanently added '10.0.0.38' (ECDSA) to the list of known hosts. ~/workspace/collect-logs-and-cleanup@2 ~/workspace/collect-logs-and-cleanup@2 Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. INFO: Logs collected at http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/12/1612/3/templates_451/ansible-k8s ~/workspace/collect-logs-and-cleanup@2 + /home/jenkins/workspace/collect-logs-and-cleanup@2/src/opensdn-io/tf-jenkins/jobs/devstack/ansible/remove_workers.sh nova CLI is deprecated and will be removed in a future release | locked | False | INFO: do down nodes +-----------------------------+----------------------------------------------------------+ | Field | Value | +-----------------------------+----------------------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | GZ1 | | OS-EXT-STS:power_state | Running | | OS-EXT-STS:task_state | None | | OS-EXT-STS:vm_state | active | | OS-SRV-USG:launched_at | 2025-04-28T19:33:23.000000 | | OS-SRV-USG:terminated_at | None | | accessIPv4 | | | accessIPv6 | | | addresses | management=10.0.0.38 | | config_drive | | | created | 2025-04-28T19:33:08Z | | flavor | STD3-4-16 (b6760da7-d124-45c7-a0a7-64f40acae087) | | hostId | 9f69f79e4c77b1453de3b018a28c0f999d186abee7fe999aebab6d9c | | id | ab1e6066-626f-4f70-8853-cfed426042a6 | | image | N/A (booted from volume) | | key_name | worker | | name | cn_jenkins-deploy-platform-ansible-k8s-353_1 | | progress | 0 | | project_id | **** | | properties | | | status | ACTIVE | | updated | 2025-04-28T19:33:23Z | | user_id | 25d930adb802408885c71e341481886e | | volumes_attached | id='bb80baab-94af-4e27-879c-4acd5991dd9b' | +-----------------------------+----------------------------------------------------------+ Archiving artifacts Finished: SUCCESS