Triggered by Gerrit: https://gerrit.opensdn.io/c/opensdn-io/tf-controller/+/2901 Obtained pipelines/main.groovy from git https://github.com/opensdn-io/tf-jenkins.git [Pipeline] Start of Pipeline [Pipeline] timestamps [Pipeline] { [Pipeline] timeout [2026-07-09T18:00:05.634Z] Timeout set to expire in 8 hr 0 min [Pipeline] { [Pipeline] node [2026-07-09T18:00:05.684Z] Running on slave-openstack-gz1_1 in /home/jenkins/workspace/pipeline-check [Pipeline] { [Pipeline] stage [Pipeline] { (init) [Pipeline] cleanWs [2026-07-09T18:00:05.811Z] [WS-CLEANUP] Deleting project workspace... [2026-07-09T18:00:05.814Z] [WS-CLEANUP] Deferred wipeout is disabled by the job configuration... [2026-07-09T18:00:06.108Z] [WS-CLEANUP] done [Pipeline] checkout [2026-07-09T18:00:06.140Z] The recommended git tool is: git [2026-07-09T18:00:06.147Z] No credentials specified [2026-07-09T18:00:06.149Z] Cloning the remote Git repository [2026-07-09T18:00:06.158Z] Cloning repository https://github.com/opensdn-io/tf-jenkins.git [2026-07-09T18:00:06.189Z] > git init /home/jenkins/workspace/pipeline-check/src/opensdn-io/tf-jenkins # timeout=10 [2026-07-09T18:00:06.206Z] Fetching upstream changes from https://github.com/opensdn-io/tf-jenkins.git [2026-07-09T18:00:06.206Z] > git --version # timeout=10 [2026-07-09T18:00:06.208Z] > git --version # 'git version 2.25.1' [2026-07-09T18:00:06.208Z] > git fetch --tags --force --progress -- https://github.com/opensdn-io/tf-jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 [2026-07-09T18:00:07.547Z] Avoid second fetch [2026-07-09T18:00:07.552Z] Checking out Revision e2fac67fff5a3d411a815ba2849d4891f21d9d21 (refs/remotes/origin/master) [2026-07-09T18:00:07.602Z] Commit message: "do not rebuild R26.1 nightly" [2026-07-09T18:00:07.534Z] > git config remote.origin.url https://github.com/opensdn-io/tf-jenkins.git # timeout=10 [2026-07-09T18:00:07.539Z] > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 [2026-07-09T18:00:07.548Z] > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 [2026-07-09T18:00:07.554Z] > git config core.sparsecheckout # timeout=10 [2026-07-09T18:00:07.556Z] > git checkout -f e2fac67fff5a3d411a815ba2849d4891f21d9d21 # timeout=10 [2026-07-09T18:00:07.604Z] > git rev-list --no-walk 44f115c228687cb42ade4599f6c3223098a00bff # timeout=10 [Pipeline] load [Pipeline] { (/home/jenkins/workspace/pipeline-check/src/opensdn-io/tf-jenkins/pipelines/utils/gerrit.groovy) [Pipeline] } [Pipeline] // load [Pipeline] echo [2026-07-09T18:00:08.058Z] INFO: resolved gerrit URL is https://gerrit.opensdn.io/ [Pipeline] sh [2026-07-09T18:00:08.363Z] + /home/jenkins/workspace/pipeline-check/src/opensdn-io/tf-jenkins/infra/gerrit/resolve_patchsets.py --gerrit https://gerrit.opensdn.io/ --review Ic1483dada871614f40d87e19f7c18eae6e6c391e --branch master --changed_files --output /home/jenkins/workspace/pipeline-check/patchsets-info.json [2026-07-09T18:00:08.363Z] DEBUG: Change: {'id': 'opensdn-io%2Ftf-controller~master~Ic1483dada871614f40d87e19f7c18eae6e6c391e', 'project': 'opensdn-io/tf-controller', 'branch': 'master', 'topic': 'ksync_unittests', 'attention_set': {'1000010': {'account': {'_account_id': 1000010}, 'last_update': '2026-07-06 11:39:38.000000000', 'reason': 'Someone else replied on the change'}}, 'removed_from_attention_set': {'1000001': {'account': {'_account_id': 1000001}, 'last_update': '2026-07-09 18:00:04.000000000', 'reason': 'removed on reply'}}, 'hashtags': [], 'change_id': 'Ic1483dada871614f40d87e19f7c18eae6e6c391e', 'subject': 'ksync: Extend unit tests.', 'status': 'NEW', 'created': '2026-06-26 02:38:59.000000000', 'updated': '2026-07-09 18:00:04.000000000', 'submit_type': 'MERGE_IF_NECESSARY', 'insertions': 1891, 'deletions': 386, 'total_comment_count': 7, 'unresolved_comment_count': 0, 'has_review_started': True, 'meta_rev_id': 'd2203be7d522fef946af749b8c25722dafe4b55a', '_number': 2901, 'owner': {'_account_id': 1000010}, 'labels': {'Code-Review': {'all': [{'value': 0, 'permitted_voting_range': {'min': -2, 'max': 2}, '_account_id': 1000001}], 'values': {'-2': 'This shall not be submitted', '-1': 'I would prefer this is not submitted as is', ' 0': 'No score', '+1': 'Looks good to me, but someone else must approve', '+2': 'Looks good to me, approved'}, 'description': '', 'default_value': 0}, 'Verified': {'all': [{'value': 0, 'permitted_voting_range': {'min': -2, 'max': 2}, '_account_id': 1000001}], 'values': {'-2': 'Fails', '-1': 'Fails', ' 0': 'No score', '+1': 'Verified', '+2': 'Gating'}, 'description': '', 'default_value': 0}}, 'removable_reviewers': [], 'reviewers': {'REVIEWER': [{'_account_id': 1000001}]}, 'pending_reviewers': {}, 'current_revision': 'bc40772d845aa09b7fcd2204a5421d0359bf96f2', 'revisions': {'bc40772d845aa09b7fcd2204a5421d0359bf96f2': {'kind': 'REWORK', '_number': 23, 'created': '2026-07-09 17:59:58.000000000', 'uploader': {'_account_id': 1000010}, 'ref': 'refs/changes/01/2901/23', 'fetch': {'anonymous http': {'url': 'https://gerrit.opensdn.io/opensdn-io/tf-controller', 'ref': 'refs/changes/01/2901/23'}}, 'commit': {'parents': [{'commit': 'af0a7a34aad30deeb9d0946f7d578983c214088d', 'subject': 'vrouter/ksync: fix SYNC_WAIT race on all dependency edges'}], 'author': {'name': 'Mikhail Samoylov', 'email': 'mikhailsamoiloff@gmail.com', 'date': '2026-06-26 02:37:47.000000000', 'tz': 420}, 'committer': {'name': 'Mikhail Samoylov', 'email': 'mikhailsamoiloff@gmail.com', 'date': '2026-07-08 03:20:57.000000000', 'tz': 420}, 'subject': 'ksync: Extend unit tests.', 'message': 'ksync: Extend unit tests.\n\nChange-Id: Ic1483dada871614f40d87e19f7c18eae6e6c391e\nSigned-off-by: Mikhail Samoylov \n'}}}, 'requirements': [], 'submit_records': [{'rule_name': 'gerrit~DefaultSubmitRule', 'status': 'NOT_READY', 'labels': [{'label': 'Code-Review', 'status': 'NEED'}, {'label': 'Verified', 'status': 'NEED'}]}]} [2026-07-09T18:00:08.364Z] DEBUG: Change: {'id': 'opensdn-io%2Ftf-controller~master~Iab8c4a5f7244c3bc4fc7447e8bd551b09a9eeabe', 'project': 'opensdn-io/tf-controller', 'branch': 'master', 'topic': 'fix_ksync', 'attention_set': {}, 'removed_from_attention_set': {'1000003': {'account': {'_account_id': 1000003}, 'last_update': '2026-06-23 05:50:57.000000000', 'reason': ' replied on the change', 'reason_account': {'_account_id': 1000003}}, '1000001': {'account': {'_account_id': 1000001}, 'last_update': '2026-06-22 13:51:41.000000000', 'reason': 'removed on reply'}, '1000010': {'account': {'_account_id': 1000010}, 'last_update': '2026-06-23 08:18:02.000000000', 'reason': 'Change was submitted'}, '1000012': {'account': {'_account_id': 1000012}, 'last_update': '2026-06-19 11:13:27.000000000', 'reason': ' replied on the change', 'reason_account': {'_account_id': 1000012}}}, 'hashtags': [], 'change_id': 'Iab8c4a5f7244c3bc4fc7447e8bd551b09a9eeabe', 'subject': 'vrouter/ksync: fix SYNC_WAIT race on all dependency edges', 'status': 'MERGED', 'created': '2026-06-17 09:22:28.000000000', 'updated': '2026-06-23 08:18:28.000000000', 'submitted': '2026-06-23 08:18:02.000000000', 'submitter': {'_account_id': 1000001}, 'insertions': 249, 'deletions': 11, 'total_comment_count': 6, 'unresolved_comment_count': 0, 'has_review_started': True, 'submission_id': '2862-fix_ksync', 'meta_rev_id': '44c1ee7c106725315358a49b233546544d831b50', '_number': 2862, 'owner': {'_account_id': 1000010}, 'labels': {'Code-Review': {'all': [{'value': 2, 'date': '2026-06-23 05:50:57.000000000', 'permitted_voting_range': {'min': 2, 'max': 2}, '_account_id': 1000003}, {'value': 0, '_account_id': 1000001}, {'value': 1, 'date': '2026-06-22 18:16:00.000000000', 'permitted_voting_range': {'min': 1, 'max': 1}, '_account_id': 1000012}], 'values': {'-2': 'This shall not be submitted', '-1': 'I would prefer this is not submitted as is', ' 0': 'No score', '+1': 'Looks good to me, but someone else must approve', '+2': 'Looks good to me, approved'}, 'description': '', 'default_value': 0}, 'Verified': {'all': [{'value': 0, '_account_id': 1000003}, {'value': 2, 'date': '2026-06-23 08:17:52.000000000', 'permitted_voting_range': {'min': 2, 'max': 2}, '_account_id': 1000001}, {'value': 0, '_account_id': 1000012}], 'values': {'-2': 'Fails', '-1': 'Fails', ' 0': 'No score', '+1': 'Verified', '+2': 'Gating'}, 'description': '', 'default_value': 0}}, 'removable_reviewers': [], 'reviewers': {'REVIEWER': [{'_account_id': 1000001}, {'_account_id': 1000003}, {'_account_id': 1000012}]}, 'pending_reviewers': {}, 'current_revision': 'af0a7a34aad30deeb9d0946f7d578983c214088d', 'revisions': {'af0a7a34aad30deeb9d0946f7d578983c214088d': {'kind': 'REWORK', '_number': 9, 'created': '2026-06-22 14:01:43.000000000', 'uploader': {'_account_id': 1000010}, 'ref': 'refs/changes/62/2862/9', 'fetch': {'anonymous http': {'url': 'https://gerrit.opensdn.io/opensdn-io/tf-controller', 'ref': 'refs/changes/62/2862/9'}}, 'commit': {'parents': [{'commit': '4dd3371690f0cc8c5ba1a476d04ba71f15ce27c2', 'subject': 'Merge "fix: Missing /32 route after VM hard reboot in vxlan-routing topology."'}], 'author': {'name': 'Mikhail Samoylov', 'email': 'mikhailsamoiloff@gmail.com', 'date': '2026-06-17 09:03:09.000000000', 'tz': 420}, 'committer': {'name': 'Mikhail Samoylov', 'email': 'mikhailsamoiloff@gmail.com', 'date': '2026-06-22 14:01:28.000000000', 'tz': 420}, 'subject': 'vrouter/ksync: fix SYNC_WAIT race on all dependency edges', 'message': 'vrouter/ksync: fix SYNC_WAIT race on all dependency edges\n\nProblem\n-------\nKSyncEntry::IsResolved() returns true for SYNC_WAIT (entry sent to\nvRouter, kernel ACK pending) and NEED_SYNC. All UnresolvedReference()\nimplementations gated on IsResolved() alone therefore consider a\ndependency "ready" while it is still in-flight. A dependent object\nsent against an in-flight dependency is rejected by vRouter\n(EINVAL / "Entry not present"); the error ACK is swallowed by\nErrorHandler (log-only), the state machine still promotes the\ndependent to IN_SYNC, and because no back-reference was registered\nthe object is never retried. Result: agent KSync believes the object\nis programmed; vRouter datapath does not have it.\n\nEdges and production impact per edge\n-------------------------------------\nARP/NDP -> interface\n Gateway / neighbour routes disappear when physical interface\n flaps (link-down, firmware update). BGP sessions on that interface\n drop; traffic to other VRFs blackholes until interface recovers.\n\nRECEIVE -> interface\n Local host routes break on vhost interface re-init (agent restart,\n ksync reload). VM-to-host traffic (local LB, DNS stub) drops.\n\nTUNNEL(crypt) -> crypt-interface\n IPSec tunnel NH loses its crypt-interface reference on interface\n re-creation. Encrypted traffic stops or goes unencrypted.\n\nPBB -> child-NH\n Provider Backbone Bridge NH loses child reference on outer link\n flap. All traffic through PBB tunnel drops until recovery.\n\nCOMPOSITE -> component-NH\n ECMP / flood composite NH misses one or more component NHs after\n a component-interface flap. Traffic load-balances only over\n remaining paths; lost paths never recover without config change.\n\nRoute -> NH\n /32 route in bridge-VRF lost when NH is in SYNC_WAIT.\n Fixed in stage 1; refactored here.\n\nRoute -> stitched-MAC bridge-route\n Inet route with stitched MAC loses its bridge-route dependency\n during EVPN MAC-IP reconvergence (BGP path change, NH update).\n VM neighbours unreachable through LR until VIF reconnect.\n\nMPLS -> NH\n MPLS label loses its NH during next-hop failover or BGP\n reconvergence. MPLS LSP breaks; inter-DC traffic over that\n LSP drops until label is reprogrammed by config change.\n\nVrfAssign -> interface/NH\n VLAN sub-interface VRF assignment loses interface or NH reference\n on VLAN config change or interface re-creation. Traffic on that\n VLAN segment goes to wrong VRF or drops entirely.\n\nChange-Id: Iab8c4a5f7244c3bc4fc7447e8bd551b09a9eeabe\nSigned-off-by: Mikhail Samoylov \nCloses-bug: https://github.com/OpenSDN-io/community/issues/121\n'}}}, 'requirements': [], 'submit_records': [{'rule_name': 'gerrit~DefaultSubmitRule', 'status': 'CLOSED', 'labels': [{'label': 'Code-Review', 'status': 'OK', 'applied_by': {'_account_id': 1000003}}, {'label': 'Verified', 'status': 'OK', 'applied_by': {'_account_id': 1000001}}]}]} [2026-07-09T18:00:08.364Z] DEBUG: Change: Ic1483dada871614f40d87e19f7c18eae6e6c391e: depends_on: [] [Pipeline] archiveArtifacts [2026-07-09T18:00:08.429Z] Archiving artifacts [Pipeline] sh [Pipeline] load [Pipeline] { (/home/jenkins/workspace/pipeline-check/src/opensdn-io/tf-jenkins/pipelines/utils/gerrit.groovy) [Pipeline] } [Pipeline] // load [Pipeline] load [Pipeline] { (/home/jenkins/workspace/pipeline-check/src/opensdn-io/tf-jenkins/pipelines/constants.groovy) [Pipeline] } [Pipeline] // load [Pipeline] load [Pipeline] { (/home/jenkins/workspace/pipeline-check/src/opensdn-io/tf-jenkins/pipelines/utils/config.groovy) [Pipeline] } [Pipeline] // load [Pipeline] load [Pipeline] { (/home/jenkins/workspace/pipeline-check/src/opensdn-io/tf-jenkins/pipelines/utils/jobs.groovy) [Pipeline] } [Pipeline] // load [Pipeline] load [Pipeline] { (/home/jenkins/workspace/pipeline-check/src/opensdn-io/tf-jenkins/pipelines/utils/gate.groovy) [Pipeline] } [Pipeline] // load [Pipeline] } [Pipeline] // stage [Pipeline] withCredentials [2026-07-09T18:00:13.642Z] Masking supported pattern matches of $GERRIT_API_PASSWORD [Pipeline] { [Pipeline] echo [2026-07-09T18:00:13.718Z] INFO: resolved gerrit URL is https://gerrit.opensdn.io/ [Pipeline] sh [2026-07-09T18:00:14.041Z] + /home/jenkins/workspace/pipeline-check/src/opensdn-io/tf-jenkins/infra/gerrit/is_merged.py --gerrit https://gerrit.opensdn.io/ --user tf-gerrit --password **** --review Ic1483dada871614f40d87e19f7c18eae6e6c391e --branch master [2026-07-09T18:00:14.075Z] DEBUG: Change: {'id': 'opensdn-io%2Ftf-controller~master~Ic1483dada871614f40d87e19f7c18eae6e6c391e', 'project': 'opensdn-io/tf-controller', 'branch': 'master', 'topic': 'ksync_unittests', 'attention_set': {'1000010': {'account': {'_account_id': 1000010}, 'last_update': '2026-07-06 11:39:38.000000000', 'reason': 'Someone else replied on the change'}}, 'removed_from_attention_set': {'1000001': {'account': {'_account_id': 1000001}, 'last_update': '2026-07-09 18:00:04.000000000', 'reason': 'removed on reply'}}, 'hashtags': [], 'change_id': 'Ic1483dada871614f40d87e19f7c18eae6e6c391e', 'subject': 'ksync: Extend unit tests.', 'status': 'NEW', 'created': '2026-06-26 02:38:59.000000000', 'updated': '2026-07-09 18:00:04.000000000', 'submit_type': 'MERGE_IF_NECESSARY', 'insertions': 1891, 'deletions': 386, 'total_comment_count': 7, 'unresolved_comment_count': 0, 'has_review_started': True, 'meta_rev_id': 'd2203be7d522fef946af749b8c25722dafe4b55a', '_number': 2901, 'owner': {'_account_id': 1000010}, 'labels': {'Code-Review': {'all': [{'value': 0, 'permitted_voting_range': {'min': -2, 'max': 2}, '_account_id': 1000001}], 'values': {'-2': 'This shall not be submitted', '-1': 'I would prefer this is not submitted as is', ' 0': 'No score', '+1': 'Looks good to me, but someone else must approve', '+2': 'Looks good to me, approved'}, 'description': '', 'default_value': 0}, 'Verified': {'all': [{'value': 0, 'permitted_voting_range': {'min': -2, 'max': 2}, '_account_id': 1000001}], 'values': {'-2': 'Fails', '-1': 'Fails', ' 0': 'No score', '+1': 'Verified', '+2': 'Gating'}, 'description': '', 'default_value': 0}}, 'permitted_labels': {'Code-Review': ['-2', '-1', ' 0', '+1', '+2'], 'Verified': ['-2', '-1', ' 0', '+1', '+2']}, 'removable_labels': {}, 'removable_reviewers': [{'_account_id': 1000001}], 'reviewers': {'REVIEWER': [{'_account_id': 1000001}]}, 'pending_reviewers': {}, 'current_revision': 'bc40772d845aa09b7fcd2204a5421d0359bf96f2', 'revisions': {'bc40772d845aa09b7fcd2204a5421d0359bf96f2': {'kind': 'REWORK', '_number': 23, 'created': '2026-07-09 17:59:58.000000000', 'uploader': {'_account_id': 1000010}, 'ref': 'refs/changes/01/2901/23', 'fetch': {'ssh': {'url': 'ssh://tf-gerrit@gerrit.opensdn.io:29418/opensdn-io/tf-controller', 'ref': 'refs/changes/01/2901/23'}, 'anonymous http': {'url': 'https://gerrit.opensdn.io/opensdn-io/tf-controller', 'ref': 'refs/changes/01/2901/23'}, 'http': {'url': 'https://tf-gerrit@gerrit.opensdn.io/a/opensdn-io/tf-controller', 'ref': 'refs/changes/01/2901/23'}}, 'commit': {'parents': [{'commit': 'af0a7a34aad30deeb9d0946f7d578983c214088d', 'subject': 'vrouter/ksync: fix SYNC_WAIT race on all dependency edges'}], 'author': {'name': 'Mikhail Samoylov', 'email': 'mikhailsamoiloff@gmail.com', 'date': '2026-06-26 02:37:47.000000000', 'tz': 420}, 'committer': {'name': 'Mikhail Samoylov', 'email': 'mikhailsamoiloff@gmail.com', 'date': '2026-07-08 03:20:57.000000000', 'tz': 420}, 'subject': 'ksync: Extend unit tests.', 'message': 'ksync: Extend unit tests.\n\nChange-Id: Ic1483dada871614f40d87e19f7c18eae6e6c391e\nSigned-off-by: Mikhail Samoylov \n'}}}, 'requirements': [], 'submit_records': [{'rule_name': 'gerrit~DefaultSubmitRule', 'status': 'NOT_READY', 'labels': [{'label': 'Code-Review', 'status': 'NEED'}, {'label': 'Verified', 'status': 'NEED'}]}]} [Pipeline] echo [2026-07-09T18:00:14.100Z] is_merged.py returns non-zero code. It means that review is not merged for now. [Pipeline] echo [2026-07-09T18:00:14.129Z] script returned exit code 1 [Pipeline] } [Pipeline] // withCredentials [Pipeline] stage [Pipeline] { (Pre-build) [Pipeline] echo [2026-07-09T18:00:14.246Z] Logs URL: http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/01/2901/23/check_4579 [Pipeline] echo [2026-07-09T18:00:14.269Z] terminate_runs_by_review_number: start [Pipeline] echo [2026-07-09T18:00:15.879Z] terminate_runs_by_review_number: terminated builds = [] [Pipeline] echo [2026-07-09T18:00:15.903Z] Search for dependent builds for Ic1483dada871614f40d87e19f7c18eae6e6c391e [Pipeline] echo [2026-07-09T18:00:16.254Z] terminate_runs_by_depends_on_recursive: terminated builds = [] [Pipeline] sh [Pipeline] echo [2026-07-09T18:00:16.584Z] Pipeline to run: check [Pipeline] sh [Pipeline] sh [Pipeline] archiveArtifacts [2026-07-09T18:00:17.212Z] Archiving artifacts [Pipeline] readYaml [Pipeline] readYaml [Pipeline] readYaml [Pipeline] readYaml [Pipeline] readYaml [Pipeline] readYaml [Pipeline] readYaml [Pipeline] readYaml [Pipeline] readYaml [Pipeline] readYaml [Pipeline] readYaml [Pipeline] echo [2026-07-09T18:00:18.369Z] Streams from config: [test-unit:[vars:[LINUX_DISTR:rockylinux, LINUX_DISTR_VER:9], jobs:[test-unit-agent, test-unit-opserver, test-unit-bgp, test-unit-group-one, test-unit-group-two, test-unit-ungrouped, test-code-coverage]], prepare-ut-sandbox:[vars:[LINUX_DISTR:rockylinux, LINUX_DISTR_VER:9], jobs:[prepare-sandbox-ut-sandbox, fetch-sources-ut-sandbox, configure-ut-sandbox, cleanup-worker-ut-sandbox]], ansible-os:[vars:[OPENSTACK_VERSION:2024.2, MONITORING_DEPLOY_TARGET:AIO, MONITORING_DEPLOYER:ansible, MONITORING_ORCHESTRATOR:os, USE_DATAPLANE_NETWORK:true], jobs:[deploy-platform-ansible-os, deploy-tf-ansible-os, test-sanity-ansible-os, collect-logs-and-cleanup-ansible-os]], build-rocky9:[vars:[LINUX_DISTR:rockylinux, LINUX_DISTR_VER:9], jobs:[prepare-sandbox-rocky9, fetch-sources-rocky9, configure-rocky9, package-deployers-rocky9, compile-rocky9, package-rocky9, freeze-rocky9, cleanup-rocky9]]] [Pipeline] echo [2026-07-09T18:00:18.386Z] Jobs from config: [test-unit-agent:[stream:test-unit, depends-on:[[configure-ut-sandbox:[inherit-keys:[DEVENV_TAG, UNITTEST_TARGETS]]]]], test-unit-opserver:[stream:test-unit, depends-on:[[configure-ut-sandbox:[inherit-keys:[DEVENV_TAG, UNITTEST_TARGETS]]]]], test-unit-bgp:[stream:test-unit, depends-on:[[configure-ut-sandbox:[inherit-keys:[DEVENV_TAG, UNITTEST_TARGETS]]]]], test-unit-group-one:[stream:test-unit, depends-on:[[configure-ut-sandbox:[inherit-keys:[DEVENV_TAG, UNITTEST_TARGETS]]]]], test-unit-group-two:[stream:test-unit, depends-on:[[configure-ut-sandbox:[inherit-keys:[DEVENV_TAG, UNITTEST_TARGETS]]]]], test-unit-ungrouped:[stream:test-unit, depends-on:[[configure-ut-sandbox:[inherit-keys:[DEVENV_TAG, UNITTEST_TARGETS]]]]], test-code-coverage:[stream:test-unit, depends-on:[[configure-ut-sandbox:[inherit-keys:[DEVENV_TAG]]], test-unit-agent, test-unit-bgp, test-unit-opserver, test-unit-group-one, test-unit-group-two, test-unit-ungrouped]], prepare-sandbox-ut-sandbox:[job-name:build-prepare-sandbox, stream:prepare-ut-sandbox, vars:[PUBLISH_TYPE:stable, VM_TYPE:small]], fetch-sources-ut-sandbox:[job-name:build-fetch-sources, stream:prepare-ut-sandbox, depends-on:[prepare-sandbox-ut-sandbox]], configure-ut-sandbox:[job-name:build-configure, stream:prepare-ut-sandbox, depends-on:[fetch-sources-ut-sandbox], vars:[PUBLISH_TYPE:build]], cleanup-worker-ut-sandbox:[job-name:build-cleanup, stream:prepare-ut-sandbox, type:post-hook, depends-on:[configure-ut-sandbox]], deploy-platform-ansible-os:[stream:ansible-os, depends-on:[package-rocky9]], deploy-tf-ansible-os:[stream:ansible-os, depends-on:[package-rocky9, deploy-platform-ansible-os]], test-sanity-ansible-os:[job-name:test-sanity, stream:ansible-os, depends-on:[deploy-tf-ansible-os]], collect-logs-and-cleanup-ansible-os:[job-name:collect-logs-and-cleanup, stream:ansible-os, type:post-hook, depends-on:[deploy-platform-ansible-os, deploy-tf-ansible-os, test-sanity-ansible-os]], prepare-sandbox-rocky9:[job-name:build-prepare-sandbox, stream:build-rocky9, vars:[DEVENV_TAG:frozen]], fetch-sources-rocky9:[job-name:build-fetch-sources, stream:build-rocky9, depends-on:[prepare-sandbox-rocky9]], configure-rocky9:[job-name:build-configure, stream:build-rocky9, depends-on:[fetch-sources-rocky9]], package-deployers-rocky9:[job-name:build-package-deployers, stream:build-rocky9, depends-on:[configure-rocky9]], compile-rocky9:[job-name:build-compile, stream:build-rocky9, depends-on:[package-deployers-rocky9]], package-rocky9:[job-name:build-package, stream:build-rocky9, depends-on:[compile-rocky9]], freeze-rocky9:[job-name:build-freeze, stream:build-rocky9, depends-on:[package-rocky9], vars:[PUBLISH_TYPE:frozen]], cleanup-rocky9:[job-name:build-cleanup, stream:build-rocky9, type:post-hook, depends-on:[freeze-rocky9]]] [Pipeline] echo [2026-07-09T18:00:18.402Z] Post Jobs from config: [cleanup-workers:[:]] [Pipeline] echo [2026-07-09T18:00:18.433Z] Notify gerrit verified=0, submit=false, msg= [2026-07-09T18:00:18.433Z] TF CI Build Started (check) https://jenkins.opensdn.io/job/pipeline-check/4579/ [Pipeline] withCredentials [2026-07-09T18:00:18.456Z] Masking supported pattern matches of $GERRIT_API_PASSWORD [Pipeline] { [Pipeline] echo [2026-07-09T18:00:18.559Z] INFO: resolved gerrit URL is https://gerrit.opensdn.io/ [Pipeline] sh [2026-07-09T18:00:18.863Z] + /home/jenkins/workspace/pipeline-check/src/opensdn-io/tf-jenkins/infra/gerrit/notify.py --gerrit https://gerrit.opensdn.io/ --user tf-gerrit --password **** --review Ic1483dada871614f40d87e19f7c18eae6e6c391e --patchset 23 --branch master --labels Verified=0 --message 'TF CI Build Started (check) https://jenkins.opensdn.io/job/pipeline-check/4579/' [2026-07-09T18:00:19.126Z] DEBUG: Change: {'id': 'opensdn-io%2Ftf-controller~master~Ic1483dada871614f40d87e19f7c18eae6e6c391e', 'project': 'opensdn-io/tf-controller', 'branch': 'master', 'topic': 'ksync_unittests', 'attention_set': {'1000010': {'account': {'_account_id': 1000010}, 'last_update': '2026-07-06 11:39:38.000000000', 'reason': 'Someone else replied on the change'}}, 'removed_from_attention_set': {'1000001': {'account': {'_account_id': 1000001}, 'last_update': '2026-07-09 18:00:04.000000000', 'reason': 'removed on reply'}}, 'hashtags': [], 'change_id': 'Ic1483dada871614f40d87e19f7c18eae6e6c391e', 'subject': 'ksync: Extend unit tests.', 'status': 'NEW', 'created': '2026-06-26 02:38:59.000000000', 'updated': '2026-07-09 18:00:04.000000000', 'submit_type': 'MERGE_IF_NECESSARY', 'insertions': 1891, 'deletions': 386, 'total_comment_count': 7, 'unresolved_comment_count': 0, 'has_review_started': True, 'meta_rev_id': 'd2203be7d522fef946af749b8c25722dafe4b55a', '_number': 2901, 'owner': {'_account_id': 1000010}, 'labels': {'Code-Review': {'all': [{'value': 0, 'permitted_voting_range': {'min': -2, 'max': 2}, '_account_id': 1000001}], 'values': {'-2': 'This shall not be submitted', '-1': 'I would prefer this is not submitted as is', ' 0': 'No score', '+1': 'Looks good to me, but someone else must approve', '+2': 'Looks good to me, approved'}, 'description': '', 'default_value': 0}, 'Verified': {'all': [{'value': 0, 'permitted_voting_range': {'min': -2, 'max': 2}, '_account_id': 1000001}], 'values': {'-2': 'Fails', '-1': 'Fails', ' 0': 'No score', '+1': 'Verified', '+2': 'Gating'}, 'description': '', 'default_value': 0}}, 'permitted_labels': {'Code-Review': ['-2', '-1', ' 0', '+1', '+2'], 'Verified': ['-2', '-1', ' 0', '+1', '+2']}, 'removable_labels': {}, 'removable_reviewers': [{'_account_id': 1000001}], 'reviewers': {'REVIEWER': [{'_account_id': 1000001}]}, 'pending_reviewers': {}, 'current_revision': 'bc40772d845aa09b7fcd2204a5421d0359bf96f2', 'revisions': {'bc40772d845aa09b7fcd2204a5421d0359bf96f2': {'kind': 'REWORK', '_number': 23, 'created': '2026-07-09 17:59:58.000000000', 'uploader': {'_account_id': 1000010}, 'ref': 'refs/changes/01/2901/23', 'fetch': {'ssh': {'url': 'ssh://tf-gerrit@gerrit.opensdn.io:29418/opensdn-io/tf-controller', 'ref': 'refs/changes/01/2901/23'}, 'anonymous http': {'url': 'https://gerrit.opensdn.io/opensdn-io/tf-controller', 'ref': 'refs/changes/01/2901/23'}, 'http': {'url': 'https://tf-gerrit@gerrit.opensdn.io/a/opensdn-io/tf-controller', 'ref': 'refs/changes/01/2901/23'}}, 'commit': {'parents': [{'commit': 'af0a7a34aad30deeb9d0946f7d578983c214088d', 'subject': 'vrouter/ksync: fix SYNC_WAIT race on all dependency edges'}], 'author': {'name': 'Mikhail Samoylov', 'email': 'mikhailsamoiloff@gmail.com', 'date': '2026-06-26 02:37:47.000000000', 'tz': 420}, 'committer': {'name': 'Mikhail Samoylov', 'email': 'mikhailsamoiloff@gmail.com', 'date': '2026-07-08 03:20:57.000000000', 'tz': 420}, 'subject': 'ksync: Extend unit tests.', 'message': 'ksync: Extend unit tests.\n\nChange-Id: Ic1483dada871614f40d87e19f7c18eae6e6c391e\nSigned-off-by: Mikhail Samoylov \n'}}}, 'requirements': [], 'submit_records': [{'rule_name': 'gerrit~DefaultSubmitRule', 'status': 'NOT_READY', 'labels': [{'label': 'Code-Review', 'status': 'NEED'}, {'label': 'Verified', 'status': 'NEED'}]}]} [2026-07-09T18:00:19.126Z] DEBUG: push message data: {'labels': {'Verified': '0'}, 'message': 'TF CI Build Started (check) https://jenkins.opensdn.io/job/pipeline-check/4579/'} [Pipeline] } [Pipeline] // withCredentials [Pipeline] echo [2026-07-09T18:00:19.202Z] Notify discord for new job is started [Pipeline] } [Pipeline] // stage [Pipeline] parallel [Pipeline] { (Branch: stream-test-unit) [Pipeline] { (Branch: stream-prepare-ut-sandbox) [Pipeline] { (Branch: stream-ansible-os) [Pipeline] { (Branch: stream-build-rocky9) [Pipeline] parallel [Pipeline] { (Branch: test-unit-agent) [Pipeline] { (Branch: test-unit-opserver) [Pipeline] { (Branch: test-unit-bgp) [Pipeline] { (Branch: test-unit-group-one) [Pipeline] { (Branch: test-unit-group-two) [Pipeline] { (Branch: test-unit-ungrouped) [Pipeline] { (Branch: test-code-coverage) [Pipeline] parallel [Pipeline] { (Branch: prepare-sandbox-ut-sandbox) [Pipeline] { (Branch: fetch-sources-ut-sandbox) [Pipeline] { (Branch: configure-ut-sandbox) [Pipeline] { (Branch: cleanup-worker-ut-sandbox) [Pipeline] parallel [Pipeline] { (Branch: deploy-platform-ansible-os) [Pipeline] { (Branch: deploy-tf-ansible-os) [Pipeline] { (Branch: test-sanity-ansible-os) [Pipeline] { (Branch: collect-logs-and-cleanup-ansible-os) [Pipeline] parallel [Pipeline] { (Branch: prepare-sandbox-rocky9) [Pipeline] { (Branch: fetch-sources-rocky9) [Pipeline] { (Branch: configure-rocky9) [Pipeline] { (Branch: package-deployers-rocky9) [Pipeline] { (Branch: compile-rocky9) [Pipeline] { (Branch: package-rocky9) [Pipeline] { (Branch: freeze-rocky9) [Pipeline] { (Branch: cleanup-rocky9) [Pipeline] stage [Pipeline] { (test-unit-agent) [Pipeline] stage [Pipeline] { (test-unit-opserver) [Pipeline] stage [Pipeline] { (test-unit-bgp) [Pipeline] stage [Pipeline] { (test-unit-group-one) [Pipeline] stage [Pipeline] { (test-unit-group-two) [Pipeline] stage [Pipeline] { (test-unit-ungrouped) [Pipeline] stage [Pipeline] { (test-code-coverage) [Pipeline] stage [Pipeline] { (prepare-sandbox-ut-sandbox) [Pipeline] stage [Pipeline] { (fetch-sources-ut-sandbox) [Pipeline] stage [Pipeline] { (configure-ut-sandbox) [Pipeline] stage [Pipeline] { (cleanup-worker-ut-sandbox) [Pipeline] stage [Pipeline] { (deploy-platform-ansible-os) [Pipeline] stage [Pipeline] { (deploy-tf-ansible-os) [Pipeline] stage [Pipeline] { (test-sanity-ansible-os) [Pipeline] stage [Pipeline] { (collect-logs-and-cleanup-ansible-os) [Pipeline] stage [Pipeline] { (prepare-sandbox-rocky9) [Pipeline] stage [Pipeline] { (fetch-sources-rocky9) [Pipeline] stage [Pipeline] { (configure-rocky9) [Pipeline] stage [Pipeline] { (package-deployers-rocky9) [Pipeline] stage [Pipeline] { (compile-rocky9) [Pipeline] stage [Pipeline] { (package-rocky9) [Pipeline] stage [Pipeline] { (freeze-rocky9) [Pipeline] stage [Pipeline] { (cleanup-rocky9) [Pipeline] echo [2026-07-09T18:00:20.387Z] JOB test-unit-agent: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.428Z] JOB test-unit-opserver: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.468Z] JOB test-unit-bgp: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.504Z] JOB test-unit-group-one: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.551Z] JOB test-unit-group-two: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.591Z] JOB test-unit-ungrouped: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.627Z] JOB test-code-coverage: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.677Z] JOB fetch-sources-ut-sandbox: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.715Z] JOB configure-ut-sandbox: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.752Z] JOB cleanup-worker-ut-sandbox: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.787Z] JOB deploy-platform-ansible-os: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.826Z] JOB deploy-tf-ansible-os: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.862Z] JOB test-sanity-ansible-os: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.899Z] JOB collect-logs-and-cleanup-ansible-os: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.939Z] JOB fetch-sources-rocky9: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:20.976Z] JOB configure-rocky9: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:21.017Z] JOB package-deployers-rocky9: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:21.055Z] JOB compile-rocky9: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:21.088Z] JOB package-rocky9: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:21.127Z] JOB freeze-rocky9: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:21.170Z] JOB cleanup-rocky9: waiting for dependecies [Pipeline] waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:00:21.225Z] JOB prepare-sandbox-ut-sandbox: entering run_job [Pipeline] echo [2026-07-09T18:00:21.253Z] JOB prepare-sandbox-rocky9: entering run_job [Pipeline] echo [2026-07-09T18:00:21.298Z] JOB test-unit-agent: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:21.317Z] JOB test-unit-agent: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.352Z] JOB test-unit-opserver: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:21.370Z] JOB test-unit-opserver: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.397Z] JOB test-unit-bgp: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:21.414Z] JOB test-unit-bgp: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.436Z] JOB test-unit-group-one: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:21.459Z] JOB test-unit-group-one: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.482Z] JOB test-unit-group-two: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:21.499Z] JOB test-unit-group-two: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.533Z] JOB test-unit-ungrouped: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:21.548Z] JOB test-unit-ungrouped: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.570Z] JOB fetch-sources-ut-sandbox: waiting for dependecy [prepare-sandbox-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:21.585Z] JOB fetch-sources-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.606Z] JOB configure-ut-sandbox: waiting for dependecy [fetch-sources-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:21.623Z] JOB configure-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.649Z] JOB cleanup-worker-ut-sandbox: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:21.669Z] JOB cleanup-worker-ut-sandbox: waiting for all = false [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.694Z] JOB deploy-platform-ansible-os: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:00:21.726Z] JOB deploy-platform-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.749Z] JOB test-sanity-ansible-os: waiting for dependecy [deploy-tf-ansible-os:null] [Pipeline] echo [2026-07-09T18:00:21.765Z] JOB test-sanity-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.791Z] JOB fetch-sources-rocky9: waiting for dependecy [prepare-sandbox-rocky9:null] [Pipeline] echo [2026-07-09T18:00:21.814Z] JOB fetch-sources-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.836Z] JOB configure-rocky9: waiting for dependecy [fetch-sources-rocky9:null] [Pipeline] echo [2026-07-09T18:00:21.852Z] JOB configure-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.874Z] JOB package-deployers-rocky9: waiting for dependecy [configure-rocky9:null] [Pipeline] echo [2026-07-09T18:00:21.892Z] JOB package-deployers-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.913Z] JOB compile-rocky9: waiting for dependecy [package-deployers-rocky9:null] [Pipeline] echo [2026-07-09T18:00:21.931Z] JOB compile-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.954Z] JOB package-rocky9: waiting for dependecy [compile-rocky9:null] [Pipeline] echo [2026-07-09T18:00:21.972Z] JOB package-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:21.991Z] JOB freeze-rocky9: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:00:22.009Z] JOB freeze-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:22.037Z] JOB cleanup-rocky9: waiting for dependecy [freeze-rocky9:null] [Pipeline] echo [2026-07-09T18:00:22.052Z] JOB cleanup-rocky9: waiting for all = false [Pipeline] } [Pipeline] echo [2026-07-09T18:00:22.090Z] JOB deploy-tf-ansible-os: waiting for dependecy [package-rocky9:null, deploy-platform-ansible-os:null] [Pipeline] echo [2026-07-09T18:00:22.105Z] JOB deploy-tf-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] writeFile [Pipeline] echo [2026-07-09T18:00:22.158Z] JOB collect-logs-and-cleanup-ansible-os: waiting for dependecy [deploy-platform-ansible-os:null, deploy-tf-ansible-os:null, test-sanity-ansible-os:null] [Pipeline] echo [2026-07-09T18:00:22.174Z] JOB collect-logs-and-cleanup-ansible-os: waiting for all = false [Pipeline] } [Pipeline] writeFile [Pipeline] echo [2026-07-09T18:00:22.241Z] JOB test-code-coverage: waiting for dependecy [configure-ut-sandbox:null, test-unit-agent:null, test-unit-bgp:null, test-unit-opserver:null, test-unit-group-one:null, test-unit-group-two:null, test-unit-ungrouped:null] [Pipeline] echo [2026-07-09T18:00:22.257Z] JOB test-code-coverage: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:00:22.321Z] Will try again after 15 sec [2026-07-09T18:00:22.343Z] Will try again after 15 sec [2026-07-09T18:00:22.362Z] Will try again after 15 sec [2026-07-09T18:00:22.381Z] Will try again after 15 sec [2026-07-09T18:00:22.401Z] Will try again after 15 sec [2026-07-09T18:00:22.420Z] Will try again after 15 sec [2026-07-09T18:00:22.444Z] Will try again after 15 sec [2026-07-09T18:00:22.463Z] Will try again after 15 sec [2026-07-09T18:00:22.484Z] Will try again after 15 sec [2026-07-09T18:00:22.505Z] Will try again after 15 sec [2026-07-09T18:00:22.524Z] Will try again after 15 sec [2026-07-09T18:00:22.546Z] Will try again after 15 sec [2026-07-09T18:00:22.564Z] Will try again after 15 sec [2026-07-09T18:00:22.582Z] Will try again after 15 sec [2026-07-09T18:00:22.603Z] Will try again after 15 sec [2026-07-09T18:00:22.624Z] Will try again after 15 sec [2026-07-09T18:00:22.643Z] Will try again after 15 sec [2026-07-09T18:00:22.660Z] Will try again after 15 sec [2026-07-09T18:00:22.679Z] Will try again after 15 sec [2026-07-09T18:00:22.697Z] Will try again after 15 sec [Pipeline] archiveArtifacts [2026-07-09T18:00:22.722Z] Archiving artifacts [Pipeline] archiveArtifacts [2026-07-09T18:00:22.765Z] Archiving artifacts [2026-07-09T18:00:22.801Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:00:23.097Z] JOB prepare-sandbox-rocky9: Starting job: build-prepare-sandbox rnd: #21590 [Pipeline] timeout [2026-07-09T18:00:23.111Z] Timeout set to expire in 3 hr 0 min [Pipeline] { [Pipeline] echo [2026-07-09T18:00:23.140Z] JOB prepare-sandbox-ut-sandbox: Starting job: build-prepare-sandbox rnd: #91495 [Pipeline] timeout [2026-07-09T18:00:23.155Z] Timeout set to expire in 3 hr 0 min [Pipeline] { [Pipeline] build [2026-07-09T18:00:23.202Z] Scheduling project: build-prepare-sandbox [Pipeline] build [2026-07-09T18:00:23.234Z] Scheduling project: build-prepare-sandbox [2026-07-09T18:00:29.813Z] Starting building: build-prepare-sandbox #15512 [2026-07-09T18:00:34.811Z] Starting building: build-prepare-sandbox #15513 [Pipeline] { [Pipeline] echo [2026-07-09T18:00:37.360Z] JOB test-unit-agent: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:37.383Z] JOB test-unit-agent: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [Pipeline] { [Pipeline] { [2026-07-09T18:00:37.474Z] Will try again after 15 sec [Pipeline] { [Pipeline] { [Pipeline] echo [2026-07-09T18:00:37.522Z] JOB test-unit-opserver: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:37.538Z] JOB test-unit-opserver: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:37.556Z] JOB test-unit-bgp: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:37.572Z] JOB test-unit-bgp: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:37.592Z] JOB test-unit-group-one: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:37.607Z] JOB test-unit-group-one: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:37.629Z] JOB test-unit-group-two: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:37.647Z] JOB test-unit-group-two: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [Pipeline] { [Pipeline] echo [2026-07-09T18:00:37.695Z] JOB test-unit-ungrouped: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:37.711Z] JOB test-unit-ungrouped: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [Pipeline] echo [2026-07-09T18:00:37.750Z] JOB fetch-sources-ut-sandbox: waiting for dependecy [prepare-sandbox-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:37.768Z] JOB fetch-sources-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:37.803Z] JOB configure-ut-sandbox: waiting for dependecy [fetch-sources-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:37.819Z] JOB configure-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:37.842Z] JOB cleanup-worker-ut-sandbox: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:37.858Z] JOB cleanup-worker-ut-sandbox: waiting for all = false [Pipeline] } [Pipeline] { [Pipeline] { [2026-07-09T18:00:37.926Z] Will try again after 15 sec [Pipeline] { [Pipeline] { [2026-07-09T18:00:37.976Z] Will try again after 15 sec [Pipeline] { [Pipeline] { [2026-07-09T18:00:38.022Z] Will try again after 15 sec [Pipeline] { [Pipeline] { [2026-07-09T18:00:38.070Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:00:38.088Z] JOB deploy-platform-ansible-os: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:00:38.105Z] JOB deploy-platform-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:38.446Z] JOB test-sanity-ansible-os: waiting for dependecy [deploy-tf-ansible-os:null] [Pipeline] echo [2026-07-09T18:00:38.463Z] JOB test-sanity-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:38.482Z] JOB fetch-sources-rocky9: waiting for dependecy [prepare-sandbox-rocky9:null] [Pipeline] echo [2026-07-09T18:00:38.498Z] JOB fetch-sources-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:38.519Z] JOB configure-rocky9: waiting for dependecy [fetch-sources-rocky9:null] [Pipeline] echo [2026-07-09T18:00:38.541Z] JOB configure-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:38.564Z] JOB package-deployers-rocky9: waiting for dependecy [configure-rocky9:null] [Pipeline] echo [2026-07-09T18:00:38.581Z] JOB package-deployers-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:38.603Z] JOB compile-rocky9: waiting for dependecy [package-deployers-rocky9:null] [Pipeline] echo [2026-07-09T18:00:38.618Z] JOB compile-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:38.640Z] JOB package-rocky9: waiting for dependecy [compile-rocky9:null] [Pipeline] echo [2026-07-09T18:00:38.656Z] JOB package-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:38.676Z] JOB freeze-rocky9: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:00:38.691Z] JOB freeze-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [Pipeline] { [Pipeline] { [2026-07-09T18:00:38.769Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:00:38.786Z] JOB cleanup-rocky9: waiting for dependecy [freeze-rocky9:null] [Pipeline] echo [2026-07-09T18:00:38.802Z] JOB cleanup-rocky9: waiting for all = false [Pipeline] } [2026-07-09T18:00:38.840Z] Will try again after 15 sec [Pipeline] { [2026-07-09T18:00:38.874Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:00:38.889Z] JOB deploy-tf-ansible-os: waiting for dependecy [package-rocky9:null, deploy-platform-ansible-os:null] [Pipeline] echo [2026-07-09T18:00:38.904Z] JOB deploy-tf-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:00:38.937Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:00:38.954Z] JOB collect-logs-and-cleanup-ansible-os: waiting for dependecy [deploy-platform-ansible-os:null, deploy-tf-ansible-os:null, test-sanity-ansible-os:null] [Pipeline] echo [2026-07-09T18:00:38.969Z] JOB collect-logs-and-cleanup-ansible-os: waiting for all = false [Pipeline] } [Pipeline] echo [2026-07-09T18:00:39.045Z] JOB test-code-coverage: waiting for dependecy [configure-ut-sandbox:null, test-unit-agent:null, test-unit-bgp:null, test-unit-opserver:null, test-unit-group-one:null, test-unit-group-two:null, test-unit-ungrouped:null] [Pipeline] echo [2026-07-09T18:00:39.060Z] JOB test-code-coverage: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:00:39.128Z] Will try again after 15 sec [2026-07-09T18:00:39.152Z] Will try again after 15 sec [2026-07-09T18:00:39.170Z] Will try again after 15 sec [2026-07-09T18:00:39.189Z] Will try again after 15 sec [2026-07-09T18:00:39.208Z] Will try again after 15 sec [2026-07-09T18:00:39.227Z] Will try again after 15 sec [2026-07-09T18:00:39.245Z] Will try again after 15 sec [2026-07-09T18:00:39.263Z] Will try again after 15 sec [2026-07-09T18:00:39.294Z] Will try again after 15 sec [2026-07-09T18:00:39.338Z] Will try again after 15 sec [2026-07-09T18:00:39.367Z] Will try again after 15 sec [2026-07-09T18:00:39.385Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:00:52.509Z] JOB test-unit-agent: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:52.524Z] JOB test-unit-agent: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:00:52.567Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:00:52.960Z] JOB test-unit-opserver: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:52.976Z] JOB test-unit-opserver: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [2026-07-09T18:00:53.033Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:00:53.077Z] JOB test-unit-bgp: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:53.093Z] JOB test-unit-bgp: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:53.115Z] JOB test-unit-group-one: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:53.130Z] JOB test-unit-group-one: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [2026-07-09T18:00:53.181Z] Will try again after 15 sec [2026-07-09T18:00:53.200Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:00:53.229Z] JOB test-unit-group-two: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:53.244Z] JOB test-unit-group-two: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:00:53.304Z] Will try again after 15 sec [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] echo [2026-07-09T18:00:54.502Z] JOB test-unit-ungrouped: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:54.516Z] JOB test-unit-ungrouped: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.536Z] JOB fetch-sources-ut-sandbox: waiting for dependecy [prepare-sandbox-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:54.552Z] JOB fetch-sources-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.572Z] JOB configure-ut-sandbox: waiting for dependecy [fetch-sources-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:54.588Z] JOB configure-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.610Z] JOB cleanup-worker-ut-sandbox: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:00:54.629Z] JOB cleanup-worker-ut-sandbox: waiting for all = false [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.649Z] JOB deploy-platform-ansible-os: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:00:54.664Z] JOB deploy-platform-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.682Z] JOB test-sanity-ansible-os: waiting for dependecy [deploy-tf-ansible-os:null] [Pipeline] echo [2026-07-09T18:00:54.696Z] JOB test-sanity-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.717Z] JOB fetch-sources-rocky9: waiting for dependecy [prepare-sandbox-rocky9:null] [Pipeline] echo [2026-07-09T18:00:54.735Z] JOB fetch-sources-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.753Z] JOB configure-rocky9: waiting for dependecy [fetch-sources-rocky9:null] [Pipeline] echo [2026-07-09T18:00:54.766Z] JOB configure-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.784Z] JOB package-deployers-rocky9: waiting for dependecy [configure-rocky9:null] [Pipeline] echo [2026-07-09T18:00:54.798Z] JOB package-deployers-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.816Z] JOB compile-rocky9: waiting for dependecy [package-deployers-rocky9:null] [Pipeline] echo [2026-07-09T18:00:54.833Z] JOB compile-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.852Z] JOB package-rocky9: waiting for dependecy [compile-rocky9:null] [Pipeline] echo [2026-07-09T18:00:54.866Z] JOB package-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.886Z] JOB freeze-rocky9: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:00:54.901Z] JOB freeze-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.922Z] JOB cleanup-rocky9: waiting for dependecy [freeze-rocky9:null] [Pipeline] echo [2026-07-09T18:00:54.936Z] JOB cleanup-rocky9: waiting for all = false [Pipeline] } [Pipeline] echo [2026-07-09T18:00:54.965Z] JOB deploy-tf-ansible-os: waiting for dependecy [package-rocky9:null, deploy-platform-ansible-os:null] [Pipeline] echo [2026-07-09T18:00:54.979Z] JOB deploy-tf-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:00:55.006Z] JOB collect-logs-and-cleanup-ansible-os: waiting for dependecy [deploy-platform-ansible-os:null, deploy-tf-ansible-os:null, test-sanity-ansible-os:null] [Pipeline] echo [2026-07-09T18:00:55.020Z] JOB collect-logs-and-cleanup-ansible-os: waiting for all = false [Pipeline] } [Pipeline] echo [2026-07-09T18:00:55.056Z] JOB test-code-coverage: waiting for dependecy [configure-ut-sandbox:null, test-unit-agent:null, test-unit-bgp:null, test-unit-opserver:null, test-unit-group-one:null, test-unit-group-two:null, test-unit-ungrouped:null] [Pipeline] echo [2026-07-09T18:00:55.070Z] JOB test-code-coverage: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:00:55.118Z] Will try again after 15 sec [2026-07-09T18:00:55.136Z] Will try again after 15 sec [2026-07-09T18:00:55.154Z] Will try again after 15 sec [2026-07-09T18:00:55.172Z] Will try again after 15 sec [2026-07-09T18:00:55.193Z] Will try again after 15 sec [2026-07-09T18:00:55.214Z] Will try again after 15 sec [2026-07-09T18:00:55.235Z] Will try again after 15 sec [2026-07-09T18:00:55.255Z] Will try again after 15 sec [2026-07-09T18:00:55.276Z] Will try again after 15 sec [2026-07-09T18:00:55.297Z] Will try again after 15 sec [2026-07-09T18:00:55.318Z] Will try again after 15 sec [2026-07-09T18:00:55.340Z] Will try again after 15 sec [2026-07-09T18:00:55.359Z] Will try again after 15 sec [2026-07-09T18:00:55.378Z] Will try again after 15 sec [2026-07-09T18:00:55.398Z] Will try again after 15 sec [2026-07-09T18:00:55.420Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:07.605Z] JOB test-unit-agent: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:07.621Z] JOB test-unit-agent: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:07.669Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:08.071Z] JOB test-unit-opserver: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:08.087Z] JOB test-unit-opserver: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:08.134Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:08.214Z] JOB test-unit-bgp: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:08.230Z] JOB test-unit-bgp: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [2026-07-09T18:01:08.284Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:01:08.317Z] JOB test-unit-group-one: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:08.332Z] JOB test-unit-group-one: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [2026-07-09T18:01:08.381Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:01:08.410Z] JOB test-unit-group-two: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:08.425Z] JOB test-unit-group-two: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:08.469Z] Will try again after 15 sec [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] echo [2026-07-09T18:01:10.415Z] JOB test-unit-ungrouped: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:10.431Z] JOB test-unit-ungrouped: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] echo [2026-07-09T18:01:10.478Z] JOB fetch-sources-ut-sandbox: waiting for dependecy [prepare-sandbox-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:10.493Z] JOB fetch-sources-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:10.513Z] JOB configure-ut-sandbox: waiting for dependecy [fetch-sources-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:10.527Z] JOB configure-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:10.547Z] JOB cleanup-worker-ut-sandbox: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:10.562Z] JOB cleanup-worker-ut-sandbox: waiting for all = false [Pipeline] } [Pipeline] echo [2026-07-09T18:01:10.583Z] JOB deploy-platform-ansible-os: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:01:10.599Z] JOB deploy-platform-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:10.623Z] JOB test-sanity-ansible-os: waiting for dependecy [deploy-tf-ansible-os:null] [Pipeline] echo [2026-07-09T18:01:10.642Z] JOB test-sanity-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:10.669Z] JOB fetch-sources-rocky9: waiting for dependecy [prepare-sandbox-rocky9:null] [Pipeline] echo [2026-07-09T18:01:10.684Z] JOB fetch-sources-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [Pipeline] { [Pipeline] echo [2026-07-09T18:01:10.728Z] JOB configure-rocky9: waiting for dependecy [fetch-sources-rocky9:null] [Pipeline] echo [2026-07-09T18:01:10.744Z] JOB configure-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:10.767Z] JOB package-deployers-rocky9: waiting for dependecy [configure-rocky9:null] [Pipeline] echo [2026-07-09T18:01:10.783Z] JOB package-deployers-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:10.803Z] JOB compile-rocky9: waiting for dependecy [package-deployers-rocky9:null] [Pipeline] echo [2026-07-09T18:01:10.817Z] JOB compile-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:10.836Z] JOB package-rocky9: waiting for dependecy [compile-rocky9:null] [Pipeline] echo [2026-07-09T18:01:10.851Z] JOB package-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [Pipeline] echo [2026-07-09T18:01:10.883Z] JOB freeze-rocky9: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:01:10.897Z] JOB freeze-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:10.916Z] JOB cleanup-rocky9: waiting for dependecy [freeze-rocky9:null] [Pipeline] echo [2026-07-09T18:01:10.930Z] JOB cleanup-rocky9: waiting for all = false [Pipeline] } [Pipeline] { [Pipeline] { [2026-07-09T18:01:10.986Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:01:11.001Z] JOB deploy-tf-ansible-os: waiting for dependecy [package-rocky9:null, deploy-platform-ansible-os:null] [Pipeline] echo [2026-07-09T18:01:11.015Z] JOB deploy-tf-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:11.045Z] JOB collect-logs-and-cleanup-ansible-os: waiting for dependecy [deploy-platform-ansible-os:null, deploy-tf-ansible-os:null, test-sanity-ansible-os:null] [Pipeline] echo [2026-07-09T18:01:11.058Z] JOB collect-logs-and-cleanup-ansible-os: waiting for all = false [Pipeline] } [2026-07-09T18:01:11.095Z] Will try again after 15 sec [2026-07-09T18:01:11.113Z] Will try again after 15 sec [2026-07-09T18:01:11.131Z] Will try again after 15 sec [2026-07-09T18:01:11.150Z] Will try again after 15 sec [2026-07-09T18:01:11.168Z] Will try again after 15 sec [2026-07-09T18:01:11.187Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:01:11.202Z] JOB test-code-coverage: waiting for dependecy [configure-ut-sandbox:null, test-unit-agent:null, test-unit-bgp:null, test-unit-opserver:null, test-unit-group-one:null, test-unit-group-two:null, test-unit-ungrouped:null] [Pipeline] echo [2026-07-09T18:01:11.215Z] JOB test-code-coverage: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:11.260Z] Will try again after 15 sec [2026-07-09T18:01:11.277Z] Will try again after 15 sec [2026-07-09T18:01:11.294Z] Will try again after 15 sec [2026-07-09T18:01:11.312Z] Will try again after 15 sec [2026-07-09T18:01:11.331Z] Will try again after 15 sec [2026-07-09T18:01:11.349Z] Will try again after 15 sec [2026-07-09T18:01:11.381Z] Will try again after 15 sec [2026-07-09T18:01:11.402Z] Will try again after 15 sec [2026-07-09T18:01:11.496Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:22.704Z] JOB test-unit-agent: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:22.720Z] JOB test-unit-agent: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:22.770Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:23.170Z] JOB test-unit-opserver: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:23.187Z] JOB test-unit-opserver: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:23.237Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:23.316Z] JOB test-unit-bgp: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:23.329Z] JOB test-unit-bgp: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:23.374Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:23.418Z] JOB test-unit-group-one: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:23.434Z] JOB test-unit-group-one: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:23.480Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:23.529Z] JOB test-unit-group-two: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:23.545Z] JOB test-unit-group-two: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:23.591Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:26.022Z] JOB test-unit-ungrouped: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:26.037Z] JOB test-unit-ungrouped: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:26.083Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:26.125Z] JOB fetch-sources-ut-sandbox: waiting for dependecy [prepare-sandbox-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:26.139Z] JOB fetch-sources-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [Pipeline] { [2026-07-09T18:01:26.203Z] Will try again after 15 sec [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] echo [2026-07-09T18:01:26.275Z] JOB configure-ut-sandbox: waiting for dependecy [fetch-sources-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:26.291Z] JOB configure-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:26.310Z] JOB cleanup-worker-ut-sandbox: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:26.324Z] JOB cleanup-worker-ut-sandbox: waiting for all = false [Pipeline] } [Pipeline] echo [2026-07-09T18:01:26.343Z] JOB deploy-platform-ansible-os: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:01:26.359Z] JOB deploy-platform-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:26.378Z] JOB test-sanity-ansible-os: waiting for dependecy [deploy-tf-ansible-os:null] [Pipeline] echo [2026-07-09T18:01:26.392Z] JOB test-sanity-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:26.423Z] JOB fetch-sources-rocky9: waiting for dependecy [prepare-sandbox-rocky9:null] [Pipeline] echo [2026-07-09T18:01:26.438Z] JOB fetch-sources-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [Pipeline] { [Pipeline] { [2026-07-09T18:01:26.528Z] Will try again after 15 sec [Pipeline] { [2026-07-09T18:01:26.559Z] Will try again after 15 sec [Pipeline] { [Pipeline] { [2026-07-09T18:01:26.604Z] Will try again after 15 sec [Pipeline] { [2026-07-09T18:01:26.637Z] Will try again after 15 sec [Pipeline] { [2026-07-09T18:01:26.668Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:01:26.682Z] JOB configure-rocky9: waiting for dependecy [fetch-sources-rocky9:null] [Pipeline] echo [2026-07-09T18:01:26.696Z] JOB configure-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:26.718Z] JOB package-deployers-rocky9: waiting for dependecy [configure-rocky9:null] [Pipeline] echo [2026-07-09T18:01:26.733Z] JOB package-deployers-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:26.753Z] JOB compile-rocky9: waiting for dependecy [package-deployers-rocky9:null] [Pipeline] echo [2026-07-09T18:01:26.769Z] JOB compile-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:26.794Z] JOB package-rocky9: waiting for dependecy [compile-rocky9:null] [Pipeline] echo [2026-07-09T18:01:26.810Z] JOB package-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:26.833Z] JOB freeze-rocky9: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:01:26.849Z] JOB freeze-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:26.870Z] JOB cleanup-rocky9: waiting for dependecy [freeze-rocky9:null] [Pipeline] echo [2026-07-09T18:01:26.887Z] JOB cleanup-rocky9: waiting for all = false [Pipeline] } [Pipeline] { [Pipeline] echo [2026-07-09T18:01:26.934Z] JOB deploy-tf-ansible-os: waiting for dependecy [package-rocky9:null, deploy-platform-ansible-os:null] [Pipeline] echo [2026-07-09T18:01:26.948Z] JOB deploy-tf-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:27.038Z] JOB collect-logs-and-cleanup-ansible-os: waiting for dependecy [deploy-platform-ansible-os:null, deploy-tf-ansible-os:null, test-sanity-ansible-os:null] [Pipeline] echo [2026-07-09T18:01:27.055Z] JOB collect-logs-and-cleanup-ansible-os: waiting for all = false [Pipeline] } [2026-07-09T18:01:27.167Z] Will try again after 15 sec [2026-07-09T18:01:27.192Z] Will try again after 15 sec [2026-07-09T18:01:27.218Z] Will try again after 15 sec [2026-07-09T18:01:27.240Z] Will try again after 15 sec [2026-07-09T18:01:27.264Z] Will try again after 15 sec [2026-07-09T18:01:27.287Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:01:27.305Z] JOB test-code-coverage: waiting for dependecy [configure-ut-sandbox:null, test-unit-agent:null, test-unit-bgp:null, test-unit-opserver:null, test-unit-group-one:null, test-unit-group-two:null, test-unit-ungrouped:null] [Pipeline] echo [2026-07-09T18:01:27.322Z] JOB test-code-coverage: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:27.378Z] Will try again after 15 sec [2026-07-09T18:01:27.399Z] Will try again after 15 sec [2026-07-09T18:01:27.513Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:37.872Z] JOB test-unit-agent: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:37.890Z] JOB test-unit-agent: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:37.936Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:38.268Z] JOB test-unit-opserver: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:38.284Z] JOB test-unit-opserver: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:38.347Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:38.408Z] JOB test-unit-bgp: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:38.423Z] JOB test-unit-bgp: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:38.474Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:38.517Z] JOB test-unit-group-one: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:38.533Z] JOB test-unit-group-one: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:38.581Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:38.625Z] JOB test-unit-group-two: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:38.646Z] JOB test-unit-group-two: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:38.690Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:41.116Z] JOB test-unit-ungrouped: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:41.132Z] JOB test-unit-ungrouped: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:41.182Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:41.235Z] JOB fetch-sources-ut-sandbox: waiting for dependecy [prepare-sandbox-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:41.249Z] JOB fetch-sources-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:41.290Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:41.557Z] JOB configure-ut-sandbox: waiting for dependecy [fetch-sources-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:41.574Z] JOB configure-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [2026-07-09T18:01:41.638Z] Will try again after 15 sec [Pipeline] { [Pipeline] { [Pipeline] echo [2026-07-09T18:01:41.695Z] JOB cleanup-worker-ut-sandbox: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:41.709Z] JOB cleanup-worker-ut-sandbox: waiting for all = false [Pipeline] } [Pipeline] echo [2026-07-09T18:01:41.730Z] JOB deploy-platform-ansible-os: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:01:41.747Z] JOB deploy-platform-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [Pipeline] echo [2026-07-09T18:01:41.780Z] JOB test-sanity-ansible-os: waiting for dependecy [deploy-tf-ansible-os:null] [Pipeline] echo [2026-07-09T18:01:41.794Z] JOB test-sanity-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:41.827Z] Will try again after 15 sec [2026-07-09T18:01:41.846Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:01:41.862Z] JOB fetch-sources-rocky9: waiting for dependecy [prepare-sandbox-rocky9:null] [Pipeline] echo [2026-07-09T18:01:41.877Z] JOB fetch-sources-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:41.923Z] Will try again after 15 sec [2026-07-09T18:01:41.967Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:42.201Z] JOB configure-rocky9: waiting for dependecy [fetch-sources-rocky9:null] [Pipeline] echo [2026-07-09T18:01:42.217Z] JOB configure-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [Pipeline] { [2026-07-09T18:01:42.293Z] Will try again after 15 sec [Pipeline] { [Pipeline] { [Pipeline] { [Pipeline] echo [2026-07-09T18:01:42.408Z] JOB package-deployers-rocky9: waiting for dependecy [configure-rocky9:null] [Pipeline] echo [2026-07-09T18:01:42.424Z] JOB package-deployers-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:42.444Z] JOB compile-rocky9: waiting for dependecy [package-deployers-rocky9:null] [Pipeline] echo [2026-07-09T18:01:42.461Z] JOB compile-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:42.485Z] JOB package-rocky9: waiting for dependecy [compile-rocky9:null] [Pipeline] echo [2026-07-09T18:01:42.502Z] JOB package-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:42.522Z] JOB freeze-rocky9: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:01:42.536Z] JOB freeze-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:42.558Z] JOB cleanup-rocky9: waiting for dependecy [freeze-rocky9:null] [Pipeline] echo [2026-07-09T18:01:42.572Z] JOB cleanup-rocky9: waiting for all = false [Pipeline] } [Pipeline] { [Pipeline] { [2026-07-09T18:01:42.641Z] Will try again after 15 sec [2026-07-09T18:01:42.659Z] Will try again after 15 sec [2026-07-09T18:01:42.681Z] Will try again after 15 sec [Pipeline] { [2026-07-09T18:01:42.716Z] Will try again after 15 sec [2026-07-09T18:01:42.734Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:01:42.750Z] JOB deploy-tf-ansible-os: waiting for dependecy [package-rocky9:null, deploy-platform-ansible-os:null] [Pipeline] echo [2026-07-09T18:01:42.766Z] JOB deploy-tf-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:42.824Z] JOB collect-logs-and-cleanup-ansible-os: waiting for dependecy [deploy-platform-ansible-os:null, deploy-tf-ansible-os:null, test-sanity-ansible-os:null] [Pipeline] echo [2026-07-09T18:01:42.837Z] JOB collect-logs-and-cleanup-ansible-os: waiting for all = false [Pipeline] } [2026-07-09T18:01:42.897Z] Will try again after 15 sec [2026-07-09T18:01:42.922Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:01:42.939Z] JOB test-code-coverage: waiting for dependecy [configure-ut-sandbox:null, test-unit-agent:null, test-unit-bgp:null, test-unit-opserver:null, test-unit-group-one:null, test-unit-group-two:null, test-unit-ungrouped:null] [Pipeline] echo [2026-07-09T18:01:42.952Z] JOB test-code-coverage: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:43.021Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:52.970Z] JOB test-unit-agent: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:52.985Z] JOB test-unit-agent: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:53.029Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:53.380Z] JOB test-unit-opserver: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:53.395Z] JOB test-unit-opserver: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:53.445Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:53.506Z] JOB test-unit-bgp: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:53.522Z] JOB test-unit-bgp: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:53.580Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:53.627Z] JOB test-unit-group-one: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:53.642Z] JOB test-unit-group-one: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:53.691Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:53.736Z] JOB test-unit-group-two: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:53.751Z] JOB test-unit-group-two: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:53.798Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:56.219Z] JOB test-unit-ungrouped: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:56.235Z] JOB test-unit-ungrouped: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:56.290Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:56.337Z] JOB fetch-sources-ut-sandbox: waiting for dependecy [prepare-sandbox-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:56.353Z] JOB fetch-sources-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:56.399Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:56.675Z] JOB configure-ut-sandbox: waiting for dependecy [fetch-sources-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:56.691Z] JOB configure-ut-sandbox: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:56.742Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:56.861Z] JOB cleanup-worker-ut-sandbox: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:01:56.877Z] JOB cleanup-worker-ut-sandbox: waiting for all = false [Pipeline] } [Pipeline] { [2026-07-09T18:01:56.928Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:56.973Z] JOB deploy-platform-ansible-os: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:01:56.989Z] JOB deploy-platform-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:57.012Z] JOB test-sanity-ansible-os: waiting for dependecy [deploy-tf-ansible-os:null] [Pipeline] echo [2026-07-09T18:01:57.028Z] JOB test-sanity-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [2026-07-09T18:01:57.078Z] Will try again after 15 sec [2026-07-09T18:01:57.097Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:01:57.127Z] JOB fetch-sources-rocky9: waiting for dependecy [prepare-sandbox-rocky9:null] [Pipeline] echo [2026-07-09T18:01:57.142Z] JOB fetch-sources-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:57.206Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:57.323Z] JOB configure-rocky9: waiting for dependecy [fetch-sources-rocky9:null] [Pipeline] echo [2026-07-09T18:01:57.339Z] JOB configure-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:57.384Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:57.674Z] JOB package-deployers-rocky9: waiting for dependecy [configure-rocky9:null] [Pipeline] echo [2026-07-09T18:01:57.697Z] JOB package-deployers-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] { [Pipeline] { [2026-07-09T18:01:57.791Z] Will try again after 15 sec [2026-07-09T18:01:57.796Z] Build build-prepare-sandbox #15512 completed: FAILURE [Pipeline] { [Pipeline] { [Pipeline] } [Pipeline] echo [2026-07-09T18:01:57.880Z] JOB compile-rocky9: waiting for dependecy [package-deployers-rocky9:null] [Pipeline] echo [2026-07-09T18:01:57.895Z] JOB compile-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:57.914Z] JOB package-rocky9: waiting for dependecy [compile-rocky9:null] [Pipeline] echo [2026-07-09T18:01:57.930Z] JOB package-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:57.952Z] JOB freeze-rocky9: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:01:57.967Z] JOB freeze-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:57.989Z] JOB cleanup-rocky9: waiting for dependecy [freeze-rocky9:null] [Pipeline] echo [2026-07-09T18:01:58.005Z] JOB cleanup-rocky9: waiting for all = false [Pipeline] } [Pipeline] // timeout [Pipeline] { [2026-07-09T18:01:58.126Z] Will try again after 15 sec [Pipeline] { [2026-07-09T18:01:58.169Z] Will try again after 15 sec [2026-07-09T18:01:58.197Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:01:58.214Z] JOB prepare-sandbox-rocky9: Failed [Pipeline] copyArtifacts [2026-07-09T18:01:58.361Z] Copied 0 artifacts from "build-prepare-sandbox" build number 15512 [2026-07-09T18:01:58.370Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:01:58.426Z] JOB deploy-tf-ansible-os: waiting for dependecy [package-rocky9:null, deploy-platform-ansible-os:null] [Pipeline] echo [2026-07-09T18:01:58.441Z] JOB deploy-tf-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:01:58.497Z] JOB collect-logs-and-cleanup-ansible-os: waiting for dependecy [deploy-platform-ansible-os:null, deploy-tf-ansible-os:null, test-sanity-ansible-os:null] [Pipeline] echo [2026-07-09T18:01:58.510Z] JOB collect-logs-and-cleanup-ansible-os: waiting for all = false [Pipeline] } [Pipeline] echo [2026-07-09T18:01:58.556Z] JOB prepare-sandbox-rocky9: Collected artifacts: [Pipeline] sh [2026-07-09T18:01:58.620Z] Will try again after 15 sec [2026-07-09T18:01:58.639Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:01:58.654Z] JOB test-code-coverage: waiting for dependecy [configure-ut-sandbox:null, test-unit-agent:null, test-unit-bgp:null, test-unit-opserver:null, test-unit-group-one:null, test-unit-group-two:null, test-unit-ungrouped:null] [Pipeline] echo [2026-07-09T18:01:58.667Z] JOB test-code-coverage: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:01:58.739Z] Will try again after 15 sec [2026-07-09T18:01:58.844Z] + ls -la build-prepare-sandbox-21590 [2026-07-09T18:01:58.844Z] total 16 [2026-07-09T18:01:58.844Z] drwxr-xr-x 2 jenkins docker 4096 Jul 9 18:01 . [2026-07-09T18:01:58.844Z] drwxr-xr-x 4 jenkins docker 12288 Jul 9 18:01 .. [Pipeline] withCredentials [2026-07-09T18:01:58.971Z] Masking supported pattern matches of $LOGS_HOST_SSH_KEY [Pipeline] { [Pipeline] sh [2026-07-09T18:01:59.283Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [2026-07-09T18:02:00.654Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [2026-07-09T18:02:01.222Z] Build build-prepare-sandbox #15513 completed: FAILURE [Pipeline] sh [Pipeline] } [Pipeline] // timeout [Pipeline] echo [2026-07-09T18:02:01.364Z] JOB prepare-sandbox-ut-sandbox: Failed [Pipeline] copyArtifacts [2026-07-09T18:02:01.440Z] Copied 0 artifacts from "build-prepare-sandbox" build number 15513 [Pipeline] echo [2026-07-09T18:02:01.478Z] JOB prepare-sandbox-ut-sandbox: Collected artifacts: [Pipeline] sh [Pipeline] } [Pipeline] // withCredentials [Pipeline] echo [2026-07-09T18:02:01.609Z] JOB prepare-sandbox-rocky9: error in job!!! [Pipeline] echo [2026-07-09T18:02:01.624Z] JOB prepare-sandbox-rocky9: Err - org.jenkinsci.plugins.workflow.steps.FlowInterruptedException [Pipeline] echo [2026-07-09T18:02:01.639Z] JOB prepare-sandbox-rocky9: Message - null [Pipeline] echo [2026-07-09T18:02:01.654Z] JOB prepare-sandbox-rocky9: Cause - null [Pipeline] echo [2026-07-09T18:02:01.670Z] JOB prepare-sandbox-rocky9: Stacktrace - [PluginClassLoader for pipeline-build-step//org.jenkinsci.plugins.workflow.support.steps.build.BuildTriggerListener.onFinalized(BuildTriggerListener.java:76), hudson.model.listeners.RunListener.lambda$fireFinalized$3(RunListener.java:260), jenkins.util.Listeners.lambda$notify$0(Listeners.java:59), jenkins.util.Listeners.notify(Listeners.java:67), hudson.model.listeners.RunListener.fireFinalized(RunListener.java:258), hudson.model.Run.onEndBuilding(Run.java:2052), hudson.model.Run.execute(Run.java:1959), hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44), hudson.model.ResourceController.execute(ResourceController.java:101), hudson.model.Executor.run(Executor.java:446)] [Pipeline] } [Pipeline] // stage [Pipeline] } [2026-07-09T18:02:01.746Z] Failed in branch prepare-sandbox-rocky9 [2026-07-09T18:02:01.765Z] + ls -la build-prepare-sandbox-91495 [2026-07-09T18:02:01.765Z] total 16 [2026-07-09T18:02:01.765Z] drwxr-xr-x 2 jenkins docker 4096 Jul 9 18:02 . [2026-07-09T18:02:01.765Z] drwxr-xr-x 5 jenkins docker 12288 Jul 9 18:02 .. [Pipeline] withCredentials [2026-07-09T18:02:01.824Z] Masking supported pattern matches of $LOGS_HOST_SSH_KEY [Pipeline] { [Pipeline] sh [2026-07-09T18:02:02.191Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [2026-07-09T18:02:02.757Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [Pipeline] sh [Pipeline] } [Pipeline] // withCredentials [Pipeline] echo [2026-07-09T18:02:03.765Z] JOB prepare-sandbox-ut-sandbox: error in job!!! [Pipeline] echo [2026-07-09T18:02:03.780Z] JOB prepare-sandbox-ut-sandbox: Err - org.jenkinsci.plugins.workflow.steps.FlowInterruptedException [Pipeline] echo [2026-07-09T18:02:03.794Z] JOB prepare-sandbox-ut-sandbox: Message - null [Pipeline] echo [2026-07-09T18:02:03.809Z] JOB prepare-sandbox-ut-sandbox: Cause - null [Pipeline] echo [2026-07-09T18:02:03.826Z] JOB prepare-sandbox-ut-sandbox: Stacktrace - [PluginClassLoader for pipeline-build-step//org.jenkinsci.plugins.workflow.support.steps.build.BuildTriggerListener.onFinalized(BuildTriggerListener.java:76), hudson.model.listeners.RunListener.lambda$fireFinalized$3(RunListener.java:260), jenkins.util.Listeners.lambda$notify$0(Listeners.java:59), jenkins.util.Listeners.notify(Listeners.java:67), hudson.model.listeners.RunListener.fireFinalized(RunListener.java:258), hudson.model.Run.onEndBuilding(Run.java:2052), hudson.model.Run.execute(Run.java:1959), hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44), hudson.model.ResourceController.execute(ResourceController.java:101), hudson.model.Executor.run(Executor.java:446)] [Pipeline] } [Pipeline] // stage [Pipeline] } [2026-07-09T18:02:03.903Z] Failed in branch prepare-sandbox-ut-sandbox [Pipeline] { [Pipeline] echo [2026-07-09T18:02:08.063Z] JOB test-unit-agent: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:02:08.079Z] JOB test-unit-agent: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:02:08.123Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:02:08.475Z] JOB test-unit-opserver: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:02:08.489Z] JOB test-unit-opserver: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:02:08.532Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:02:08.612Z] JOB test-unit-bgp: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:02:08.628Z] JOB test-unit-bgp: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:02:08.671Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:02:08.719Z] JOB test-unit-group-one: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:02:08.733Z] JOB test-unit-group-one: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:02:08.774Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:02:08.830Z] JOB test-unit-group-two: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:02:08.844Z] JOB test-unit-group-two: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:02:08.892Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:02:11.325Z] JOB test-unit-ungrouped: waiting for dependecy [configure-ut-sandbox:null] [Pipeline] echo [2026-07-09T18:02:11.342Z] JOB test-unit-ungrouped: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:02:11.384Z] Will try again after 15 sec [Pipeline] { [Pipeline] echo [2026-07-09T18:02:11.430Z] JOB fetch-sources-ut-sandbox: waiting for dependecy [prepare-sandbox-ut-sandbox:FAILURE] [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:11.498Z] JOB fetch-sources-ut-sandbox: wait finished. overall result = false [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] { [Pipeline] echo [2026-07-09T18:02:11.774Z] JOB configure-ut-sandbox: waiting for dependecy [fetch-sources-ut-sandbox:NOT_BUILT] [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:11.849Z] JOB configure-ut-sandbox: wait finished. overall result = false [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] { [Pipeline] echo [2026-07-09T18:02:11.974Z] JOB cleanup-worker-ut-sandbox: waiting for dependecy [configure-ut-sandbox:NOT_BUILT] [Pipeline] echo [2026-07-09T18:02:11.989Z] JOB cleanup-worker-ut-sandbox: waiting for all = true [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:12.057Z] JOB cleanup-worker-ut-sandbox: wait finished. overall result = true [Pipeline] echo [2026-07-09T18:02:12.083Z] JOB cleanup-worker-ut-sandbox: entering run_job [Pipeline] { [Pipeline] { [Pipeline] writeFile [Pipeline] echo [2026-07-09T18:02:12.151Z] JOB deploy-platform-ansible-os: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:02:12.166Z] JOB deploy-platform-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] echo [2026-07-09T18:02:12.196Z] JOB test-sanity-ansible-os: waiting for dependecy [deploy-tf-ansible-os:null] [Pipeline] echo [2026-07-09T18:02:12.211Z] JOB test-sanity-ansible-os: fails were not found, unfinished jobs are still present [Pipeline] } [2026-07-09T18:02:12.257Z] Will try again after 15 sec [Pipeline] archiveArtifacts [2026-07-09T18:02:12.278Z] Archiving artifacts [Pipeline] { [2026-07-09T18:02:12.331Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:02:12.379Z] JOB cleanup-worker-ut-sandbox / stream prepare-ut-sandbox : deps: [configure-ut-sandbox] [Pipeline] echo [2026-07-09T18:02:12.394Z] JOB fetch-sources-rocky9: waiting for dependecy [prepare-sandbox-rocky9:FAILURE] [Pipeline] } [Pipeline] dir [2026-07-09T18:02:12.416Z] Running in /home/jenkins/workspace/pipeline-check [Pipeline] { [Pipeline] { [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:12.501Z] JOB fetch-sources-rocky9: wait finished. overall result = false [Pipeline] } [Pipeline] findFiles [Pipeline] echo [2026-07-09T18:02:12.549Z] JOB configure-rocky9: waiting for dependecy [fetch-sources-rocky9:NOT_BUILT] [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] echo [2026-07-09T18:02:12.647Z] JOB cleanup-worker-ut-sandbox: files found = 0 [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:12.726Z] JOB configure-rocky9: wait finished. overall result = false [Pipeline] } [Pipeline] // dir [Pipeline] echo [2026-07-09T18:02:12.818Z] JOB cleanup-worker-ut-sandbox: content of deps file is empty [Pipeline] echo [2026-07-09T18:02:12.839Z] JOB cleanup-worker-ut-sandbox: Starting job: build-cleanup rnd: #68377 [Pipeline] timeout [2026-07-09T18:02:12.854Z] Timeout set to expire in 3 hr 0 min [Pipeline] { [Pipeline] // stage [Pipeline] { [Pipeline] } [Pipeline] build [2026-07-09T18:02:12.940Z] Scheduling project: build-cleanup [Pipeline] echo [2026-07-09T18:02:12.970Z] JOB package-deployers-rocky9: waiting for dependecy [configure-rocky9:NOT_BUILT] [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:13.047Z] JOB package-deployers-rocky9: wait finished. overall result = false [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] { [Pipeline] echo [2026-07-09T18:02:13.162Z] JOB compile-rocky9: waiting for dependecy [package-deployers-rocky9:NOT_BUILT] [Pipeline] } [Pipeline] // waitUntil [Pipeline] { [Pipeline] { [Pipeline] echo [2026-07-09T18:02:13.238Z] JOB compile-rocky9: wait finished. overall result = false [Pipeline] } [Pipeline] echo [2026-07-09T18:02:13.267Z] JOB package-rocky9: waiting for dependecy [compile-rocky9:NOT_BUILT] [Pipeline] } [Pipeline] echo [2026-07-09T18:02:13.287Z] JOB freeze-rocky9: waiting for dependecy [package-rocky9:null] [Pipeline] echo [2026-07-09T18:02:13.303Z] JOB freeze-rocky9: fails were not found, unfinished jobs are still present [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // waitUntil [2026-07-09T18:02:13.421Z] Will try again after 15 sec [Pipeline] echo [2026-07-09T18:02:13.439Z] JOB package-rocky9: wait finished. overall result = false [Pipeline] } [Pipeline] { [Pipeline] // stage [Pipeline] } [Pipeline] echo [2026-07-09T18:02:13.552Z] JOB cleanup-rocky9: waiting for dependecy [freeze-rocky9:null] [Pipeline] echo [2026-07-09T18:02:13.569Z] JOB cleanup-rocky9: waiting for all = false [Pipeline] } [2026-07-09T18:02:13.628Z] Will try again after 15 sec [Pipeline] { [Pipeline] { [Pipeline] echo [2026-07-09T18:02:13.690Z] JOB deploy-tf-ansible-os: waiting for dependecy [package-rocky9:NOT_BUILT, deploy-platform-ansible-os:null] [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:13.740Z] JOB deploy-tf-ansible-os: wait finished. overall result = false [Pipeline] } [Pipeline] echo [2026-07-09T18:02:13.760Z] JOB collect-logs-and-cleanup-ansible-os: waiting for dependecy [deploy-platform-ansible-os:null, deploy-tf-ansible-os:null, test-sanity-ansible-os:null] [Pipeline] echo [2026-07-09T18:02:13.774Z] JOB collect-logs-and-cleanup-ansible-os: waiting for all = false [Pipeline] } [Pipeline] { [Pipeline] // stage [2026-07-09T18:02:13.860Z] Will try again after 15 sec [Pipeline] } [Pipeline] echo [2026-07-09T18:02:13.933Z] JOB test-code-coverage: waiting for dependecy [configure-ut-sandbox:NOT_BUILT, test-unit-agent:null, test-unit-bgp:null, test-unit-opserver:null, test-unit-group-one:null, test-unit-group-two:null, test-unit-ungrouped:null] [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:14.006Z] JOB test-code-coverage: wait finished. overall result = false [Pipeline] } [Pipeline] // stage [Pipeline] } [2026-07-09T18:02:19.821Z] Starting building: build-cleanup #13792 [2026-07-09T18:02:22.593Z] Build build-cleanup #13792 completed: SUCCESS [Pipeline] echo [2026-07-09T18:02:22.619Z] JOB cleanup-worker-ut-sandbox: Finished with SUCCESS [Pipeline] } [Pipeline] // timeout [Pipeline] copyArtifacts [2026-07-09T18:02:22.736Z] Copied 0 artifacts from "build-cleanup" build number 13792 [Pipeline] echo [2026-07-09T18:02:22.766Z] JOB cleanup-worker-ut-sandbox: Collected artifacts: [Pipeline] sh [2026-07-09T18:02:23.062Z] + ls -la build-cleanup-68377 [2026-07-09T18:02:23.062Z] total 16 [2026-07-09T18:02:23.062Z] drwxr-xr-x 2 jenkins docker 4096 Jul 9 18:02 . [2026-07-09T18:02:23.062Z] drwxr-xr-x 6 jenkins docker 12288 Jul 9 18:02 .. [Pipeline] withCredentials [2026-07-09T18:02:23.117Z] Masking supported pattern matches of $LOGS_HOST_SSH_KEY [Pipeline] { [Pipeline] { [Pipeline] sh [Pipeline] echo [2026-07-09T18:02:23.226Z] JOB test-unit-agent: waiting for dependecy [configure-ut-sandbox:NOT_BUILT] [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:23.313Z] JOB test-unit-agent: wait finished. overall result = false [Pipeline] } [Pipeline] // stage [Pipeline] } [2026-07-09T18:02:23.455Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [Pipeline] { [Pipeline] echo [2026-07-09T18:02:23.565Z] JOB test-unit-opserver: waiting for dependecy [configure-ut-sandbox:NOT_BUILT] [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:23.640Z] JOB test-unit-opserver: wait finished. overall result = false [Pipeline] } [Pipeline] // stage [Pipeline] { [Pipeline] } [Pipeline] echo [2026-07-09T18:02:23.754Z] JOB test-unit-bgp: waiting for dependecy [configure-ut-sandbox:NOT_BUILT] [Pipeline] } [Pipeline] // waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:02:23.828Z] JOB test-unit-bgp: wait finished. overall result = false [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] echo [2026-07-09T18:02:23.882Z] JOB test-unit-group-one: waiting for dependecy [configure-ut-sandbox:NOT_BUILT] [Pipeline] } [Pipeline] // waitUntil [Pipeline] { [Pipeline] echo [2026-07-09T18:02:23.971Z] JOB test-unit-group-one: wait finished. overall result = false [Pipeline] } [Pipeline] // stage [Pipeline] } [2026-07-09T18:02:24.019Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [Pipeline] echo [2026-07-09T18:02:24.026Z] JOB test-unit-group-two: waiting for dependecy [configure-ut-sandbox:NOT_BUILT] [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:24.176Z] JOB test-unit-group-two: wait finished. overall result = false [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] sh [Pipeline] } [Pipeline] // withCredentials [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // parallel [Pipeline] } [2026-07-09T18:02:25.152Z] Failed in branch stream-prepare-ut-sandbox [Pipeline] { [Pipeline] echo [2026-07-09T18:02:26.417Z] JOB test-unit-ungrouped: waiting for dependecy [configure-ut-sandbox:NOT_BUILT] [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:26.488Z] JOB test-unit-ungrouped: wait finished. overall result = false [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // parallel [Pipeline] } [Pipeline] { [Pipeline] { [Pipeline] echo [2026-07-09T18:02:27.561Z] JOB deploy-platform-ansible-os: waiting for dependecy [package-rocky9:NOT_BUILT] [Pipeline] } [Pipeline] echo [2026-07-09T18:02:27.580Z] JOB test-sanity-ansible-os: waiting for dependecy [deploy-tf-ansible-os:NOT_BUILT] [Pipeline] } [Pipeline] // waitUntil [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:27.672Z] JOB deploy-platform-ansible-os: wait finished. overall result = false [Pipeline] } [Pipeline] echo [2026-07-09T18:02:27.694Z] JOB test-sanity-ansible-os: wait finished. overall result = false [Pipeline] } [Pipeline] // stage [Pipeline] // stage [Pipeline] } [Pipeline] } [Pipeline] { [Pipeline] echo [2026-07-09T18:02:28.451Z] JOB freeze-rocky9: waiting for dependecy [package-rocky9:NOT_BUILT] [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:28.513Z] JOB freeze-rocky9: wait finished. overall result = false [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] { [Pipeline] echo [2026-07-09T18:02:28.660Z] JOB cleanup-rocky9: waiting for dependecy [freeze-rocky9:NOT_BUILT] [Pipeline] echo [2026-07-09T18:02:28.673Z] JOB cleanup-rocky9: waiting for all = true [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:28.734Z] JOB cleanup-rocky9: wait finished. overall result = true [Pipeline] echo [2026-07-09T18:02:28.758Z] JOB cleanup-rocky9: entering run_job [Pipeline] writeFile [Pipeline] archiveArtifacts [2026-07-09T18:02:28.830Z] Archiving artifacts [Pipeline] echo [2026-07-09T18:02:28.867Z] JOB cleanup-rocky9 / stream build-rocky9 : deps: [freeze-rocky9] [Pipeline] { [Pipeline] dir [2026-07-09T18:02:28.903Z] Running in /home/jenkins/workspace/pipeline-check [Pipeline] { [Pipeline] findFiles [Pipeline] echo [2026-07-09T18:02:28.951Z] JOB collect-logs-and-cleanup-ansible-os: waiting for dependecy [deploy-platform-ansible-os:NOT_BUILT, deploy-tf-ansible-os:NOT_BUILT, test-sanity-ansible-os:NOT_BUILT] [Pipeline] echo [2026-07-09T18:02:28.966Z] JOB collect-logs-and-cleanup-ansible-os: waiting for all = true [Pipeline] } [Pipeline] // waitUntil [Pipeline] echo [2026-07-09T18:02:29.029Z] JOB collect-logs-and-cleanup-ansible-os: wait finished. overall result = true [Pipeline] echo [2026-07-09T18:02:29.044Z] JOB cleanup-rocky9: files found = 0 [Pipeline] } [Pipeline] echo [2026-07-09T18:02:29.073Z] JOB collect-logs-and-cleanup-ansible-os: entering run_job [Pipeline] // dir [Pipeline] echo [2026-07-09T18:02:29.116Z] JOB cleanup-rocky9: content of deps file is empty [Pipeline] echo [2026-07-09T18:02:29.137Z] JOB cleanup-rocky9: Starting job: build-cleanup rnd: #12710 [Pipeline] timeout [2026-07-09T18:02:29.153Z] Timeout set to expire in 3 hr 0 min [Pipeline] { [Pipeline] build [2026-07-09T18:02:29.185Z] Scheduling project: build-cleanup [Pipeline] writeFile [Pipeline] archiveArtifacts [2026-07-09T18:02:29.262Z] Archiving artifacts [Pipeline] echo [2026-07-09T18:02:29.299Z] JOB collect-logs-and-cleanup-ansible-os / stream ansible-os : deps: [deploy-platform-ansible-os, deploy-tf-ansible-os, test-sanity-ansible-os] [Pipeline] dir [2026-07-09T18:02:29.326Z] Running in /home/jenkins/workspace/pipeline-check [Pipeline] { [Pipeline] findFiles [Pipeline] echo [2026-07-09T18:02:29.410Z] JOB collect-logs-and-cleanup-ansible-os: files found = 0 [Pipeline] } [Pipeline] // dir [Pipeline] dir [2026-07-09T18:02:29.478Z] Running in /home/jenkins/workspace/pipeline-check [Pipeline] { [Pipeline] findFiles [Pipeline] echo [2026-07-09T18:02:29.553Z] JOB collect-logs-and-cleanup-ansible-os: files found = 0 [Pipeline] } [Pipeline] // dir [Pipeline] dir [2026-07-09T18:02:29.626Z] Running in /home/jenkins/workspace/pipeline-check [Pipeline] { [Pipeline] findFiles [Pipeline] echo [2026-07-09T18:02:29.702Z] JOB collect-logs-and-cleanup-ansible-os: files found = 0 [Pipeline] } [Pipeline] // dir [Pipeline] echo [2026-07-09T18:02:29.767Z] JOB collect-logs-and-cleanup-ansible-os: content of deps file is empty [Pipeline] echo [2026-07-09T18:02:29.784Z] JOB collect-logs-and-cleanup-ansible-os: Starting job: collect-logs-and-cleanup rnd: #62543 [Pipeline] timeout [2026-07-09T18:02:29.798Z] Timeout set to expire in 3 hr 0 min [Pipeline] { [Pipeline] build [2026-07-09T18:02:29.840Z] Scheduling project: collect-logs-and-cleanup [2026-07-09T18:02:34.822Z] Starting building: build-cleanup #13793 [2026-07-09T18:02:37.493Z] Build build-cleanup #13793 completed: SUCCESS [2026-07-09T18:02:37.512Z] Starting building: collect-logs-and-cleanup #11889 [Pipeline] echo [2026-07-09T18:02:37.520Z] JOB cleanup-rocky9: Finished with SUCCESS [Pipeline] } [Pipeline] // timeout [Pipeline] copyArtifacts [2026-07-09T18:02:37.613Z] Copied 0 artifacts from "build-cleanup" build number 13793 [Pipeline] echo [2026-07-09T18:02:37.730Z] JOB cleanup-rocky9: Collected artifacts: [Pipeline] sh [2026-07-09T18:02:38.018Z] + ls -la build-cleanup-12710 [2026-07-09T18:02:38.019Z] total 16 [2026-07-09T18:02:38.019Z] drwxr-xr-x 2 jenkins docker 4096 Jul 9 18:02 . [2026-07-09T18:02:38.019Z] drwxr-xr-x 7 jenkins docker 12288 Jul 9 18:02 .. [Pipeline] withCredentials [2026-07-09T18:02:38.065Z] Masking supported pattern matches of $LOGS_HOST_SSH_KEY [Pipeline] { [Pipeline] sh [2026-07-09T18:02:38.383Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [2026-07-09T18:02:39.315Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [Pipeline] sh [Pipeline] } [Pipeline] // withCredentials [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // parallel [Pipeline] } [2026-07-09T18:02:40.287Z] Failed in branch stream-build-rocky9 [2026-07-09T18:02:40.452Z] Build collect-logs-and-cleanup #11889 completed: SUCCESS [Pipeline] echo [2026-07-09T18:02:40.473Z] JOB collect-logs-and-cleanup-ansible-os: Finished with SUCCESS [Pipeline] } [Pipeline] // timeout [Pipeline] copyArtifacts [2026-07-09T18:02:40.579Z] Copied 0 artifacts from "collect-logs-and-cleanup" build number 11889 [Pipeline] echo [2026-07-09T18:02:40.617Z] JOB collect-logs-and-cleanup-ansible-os: Collected artifacts: [Pipeline] sh [2026-07-09T18:02:40.925Z] + ls -la collect-logs-and-cleanup-62543 [2026-07-09T18:02:40.925Z] total 16 [2026-07-09T18:02:40.925Z] drwxr-xr-x 2 jenkins docker 4096 Jul 9 18:02 . [2026-07-09T18:02:40.925Z] drwxr-xr-x 8 jenkins docker 12288 Jul 9 18:02 .. [Pipeline] withCredentials [2026-07-09T18:02:40.995Z] Masking supported pattern matches of $LOGS_HOST_SSH_KEY [Pipeline] { [Pipeline] sh [2026-07-09T18:02:41.330Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [2026-07-09T18:02:41.901Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [Pipeline] sh [Pipeline] } [Pipeline] // withCredentials [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // parallel [Pipeline] } [Pipeline] // parallel [Pipeline] echo [2026-07-09T18:02:43.069Z] ERROR: Failed to run null [Pipeline] echo [2026-07-09T18:02:43.082Z] Stacktrace - [PluginClassLoader for pipeline-build-step//org.jenkinsci.plugins.workflow.support.steps.build.BuildTriggerListener.onFinalized(BuildTriggerListener.java:76), hudson.model.listeners.RunListener.lambda$fireFinalized$3(RunListener.java:260), jenkins.util.Listeners.lambda$notify$0(Listeners.java:59), jenkins.util.Listeners.notify(Listeners.java:67), hudson.model.listeners.RunListener.fireFinalized(RunListener.java:258), hudson.model.Run.onEndBuilding(Run.java:2052), hudson.model.Run.execute(Run.java:1959), hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44), hudson.model.ResourceController.execute(ResourceController.java:101), hudson.model.Executor.run(Executor.java:446)] [Pipeline] echo [2026-07-09T18:02:43.095Z] Jobs results: [test-unit-agent:[job-rnd:29327, number:-1, duration:0, result:NOT_BUILT], test-unit-opserver:[job-rnd:46731, number:-1, duration:0, result:NOT_BUILT], test-unit-bgp:[job-rnd:77922, number:-1, duration:0, result:NOT_BUILT], test-unit-group-one:[job-rnd:5763, number:-1, duration:0, result:NOT_BUILT], test-unit-group-two:[job-rnd:12036, number:-1, duration:0, result:NOT_BUILT], test-unit-ungrouped:[job-rnd:11711, number:-1, duration:0, result:NOT_BUILT], test-code-coverage:[job-rnd:20118, number:-1, duration:0, result:NOT_BUILT], prepare-sandbox-ut-sandbox:[job-rnd:91495, result:FAILURE, number:15513, started:1783620034810, duration:86376], fetch-sources-ut-sandbox:[job-rnd:25177, number:-1, duration:0, result:NOT_BUILT], configure-ut-sandbox:[job-rnd:12751, number:-1, duration:0, result:NOT_BUILT], cleanup-worker-ut-sandbox:[job-rnd:68377, number:13792, started:1783620139819, duration:2729, result:SUCCESS], deploy-platform-ansible-os:[job-rnd:33177, number:-1, duration:0, result:NOT_BUILT], deploy-tf-ansible-os:[job-rnd:33771, number:-1, duration:0, result:NOT_BUILT], test-sanity-ansible-os:[job-rnd:84275, number:-1, duration:0, result:NOT_BUILT], collect-logs-and-cleanup-ansible-os:[job-rnd:62543, number:11889, started:1783620157511, duration:2887, result:SUCCESS], prepare-sandbox-rocky9:[job-rnd:21590, result:FAILURE, number:15512, started:1783620029808, duration:87909], fetch-sources-rocky9:[job-rnd:49266, number:-1, duration:0, result:NOT_BUILT], configure-rocky9:[job-rnd:76452, number:-1, duration:0, result:NOT_BUILT], package-deployers-rocky9:[job-rnd:30442, number:-1, duration:0, result:NOT_BUILT], compile-rocky9:[job-rnd:42669, number:-1, duration:0, result:NOT_BUILT], package-rocky9:[job-rnd:83737, number:-1, duration:0, result:NOT_BUILT], freeze-rocky9:[job-rnd:17669, number:-1, duration:0, result:NOT_BUILT], cleanup-rocky9:[job-rnd:12710, number:13793, started:1783620154821, duration:2632, result:SUCCESS]] [Pipeline] stage [Pipeline] { (gerrit vote) [Pipeline] echo [2026-07-09T18:02:43.219Z] Evaluated results for test-unit = [results:[NOT_BUILT, NOT_BUILT, NOT_BUILT, NOT_BUILT, NOT_BUILT, NOT_BUILT, NOT_BUILT], duration:0] [Pipeline] echo [2026-07-09T18:02:43.244Z] Evaluated results for prepare-ut-sandbox = [results:[FAILURE, NOT_BUILT, NOT_BUILT, SUCCESS], duration:89105] [Pipeline] echo [2026-07-09T18:02:43.273Z] Evaluated results for ansible-os = [results:[NOT_BUILT, NOT_BUILT, NOT_BUILT, SUCCESS], duration:2887] [Pipeline] echo [2026-07-09T18:02:43.300Z] Evaluated results for build-rocky9 = [results:[FAILURE, NOT_BUILT, NOT_BUILT, NOT_BUILT, NOT_BUILT, NOT_BUILT, NOT_BUILT, SUCCESS], duration:90541] [Pipeline] echo [2026-07-09T18:02:43.330Z] Notify gerrit verified=-1, submit=false, msg= [2026-07-09T18:02:43.330Z] TF CI Build Failed (check) in 0h 2m 29s [2026-07-09T18:02:43.330Z] [2026-07-09T18:02:43.330Z] Failed checks: [2026-07-09T18:02:43.330Z] - test-unit : NOT_BUILT [2026-07-09T18:02:43.330Z] - prepare-ut-sandbox http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/01/2901/23/check_4579/prepare-ut-sandbox : FAILURE in 0h 1m 29s [2026-07-09T18:02:43.330Z] - ansible-os http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/01/2901/23/check_4579/ansible-os : FAILURE in 0h 0m 2s [2026-07-09T18:02:43.330Z] - build-rocky9 http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/01/2901/23/check_4579/build-rocky9 : FAILURE in 0h 1m 30s [2026-07-09T18:02:43.330Z] [2026-07-09T18:02:43.330Z] Succeeded checks: [Pipeline] withCredentials [2026-07-09T18:02:43.353Z] Masking supported pattern matches of $GERRIT_API_PASSWORD [Pipeline] { [Pipeline] echo [2026-07-09T18:02:43.434Z] INFO: resolved gerrit URL is https://gerrit.opensdn.io/ [Pipeline] sh [2026-07-09T18:02:43.724Z] + /home/jenkins/workspace/pipeline-check/src/opensdn-io/tf-jenkins/infra/gerrit/notify.py --gerrit https://gerrit.opensdn.io/ --user tf-gerrit --password **** --review Ic1483dada871614f40d87e19f7c18eae6e6c391e --patchset 23 --branch master --labels Verified=-1 --message 'TF CI Build Failed (check) in 0h 2m 29s [2026-07-09T18:02:43.724Z] [2026-07-09T18:02:43.724Z] Failed checks: [2026-07-09T18:02:43.724Z] - test-unit : NOT_BUILT [2026-07-09T18:02:43.724Z] - prepare-ut-sandbox http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/01/2901/23/check_4579/prepare-ut-sandbox : FAILURE in 0h 1m 29s [2026-07-09T18:02:43.724Z] - ansible-os http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/01/2901/23/check_4579/ansible-os : FAILURE in 0h 0m 2s [2026-07-09T18:02:43.724Z] - build-rocky9 http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/01/2901/23/check_4579/build-rocky9 : FAILURE in 0h 1m 30s [2026-07-09T18:02:43.724Z] [2026-07-09T18:02:43.724Z] Succeeded checks:' [2026-07-09T18:02:43.724Z] DEBUG: Change: {'id': 'opensdn-io%2Ftf-controller~master~Ic1483dada871614f40d87e19f7c18eae6e6c391e', 'project': 'opensdn-io/tf-controller', 'branch': 'master', 'topic': 'ksync_unittests', 'attention_set': {'1000010': {'account': {'_account_id': 1000010}, 'last_update': '2026-07-06 11:39:38.000000000', 'reason': 'Someone else replied on the change'}}, 'removed_from_attention_set': {'1000001': {'account': {'_account_id': 1000001}, 'last_update': '2026-07-09 18:00:04.000000000', 'reason': 'removed on reply'}}, 'hashtags': [], 'change_id': 'Ic1483dada871614f40d87e19f7c18eae6e6c391e', 'subject': 'ksync: Extend unit tests.', 'status': 'NEW', 'created': '2026-06-26 02:38:59.000000000', 'updated': '2026-07-09 18:00:18.000000000', 'submit_type': 'MERGE_IF_NECESSARY', 'insertions': 1891, 'deletions': 386, 'total_comment_count': 7, 'unresolved_comment_count': 0, 'has_review_started': True, 'meta_rev_id': 'f156c77d7730d8fe65f141bb522dd13fbc62707d', '_number': 2901, 'owner': {'_account_id': 1000010}, 'labels': {'Code-Review': {'all': [{'value': 0, 'permitted_voting_range': {'min': -2, 'max': 2}, '_account_id': 1000001}], 'values': {'-2': 'This shall not be submitted', '-1': 'I would prefer this is not submitted as is', ' 0': 'No score', '+1': 'Looks good to me, but someone else must approve', '+2': 'Looks good to me, approved'}, 'description': '', 'default_value': 0}, 'Verified': {'all': [{'value': 0, 'permitted_voting_range': {'min': -2, 'max': 2}, '_account_id': 1000001}], 'values': {'-2': 'Fails', '-1': 'Fails', ' 0': 'No score', '+1': 'Verified', '+2': 'Gating'}, 'description': '', 'default_value': 0}}, 'permitted_labels': {'Code-Review': ['-2', '-1', ' 0', '+1', '+2'], 'Verified': ['-2', '-1', ' 0', '+1', '+2']}, 'removable_labels': {}, 'removable_reviewers': [{'_account_id': 1000001}], 'reviewers': {'REVIEWER': [{'_account_id': 1000001}]}, 'pending_reviewers': {}, 'current_revision': 'bc40772d845aa09b7fcd2204a5421d0359bf96f2', 'revisions': {'bc40772d845aa09b7fcd2204a5421d0359bf96f2': {'kind': 'REWORK', '_number': 23, 'created': '2026-07-09 17:59:58.000000000', 'uploader': {'_account_id': 1000010}, 'ref': 'refs/changes/01/2901/23', 'fetch': {'ssh': {'url': 'ssh://tf-gerrit@gerrit.opensdn.io:29418/opensdn-io/tf-controller', 'ref': 'refs/changes/01/2901/23'}, 'anonymous http': {'url': 'https://gerrit.opensdn.io/opensdn-io/tf-controller', 'ref': 'refs/changes/01/2901/23'}, 'http': {'url': 'https://tf-gerrit@gerrit.opensdn.io/a/opensdn-io/tf-controller', 'ref': 'refs/changes/01/2901/23'}}, 'commit': {'parents': [{'commit': 'af0a7a34aad30deeb9d0946f7d578983c214088d', 'subject': 'vrouter/ksync: fix SYNC_WAIT race on all dependency edges'}], 'author': {'name': 'Mikhail Samoylov', 'email': 'mikhailsamoiloff@gmail.com', 'date': '2026-06-26 02:37:47.000000000', 'tz': 420}, 'committer': {'name': 'Mikhail Samoylov', 'email': 'mikhailsamoiloff@gmail.com', 'date': '2026-07-08 03:20:57.000000000', 'tz': 420}, 'subject': 'ksync: Extend unit tests.', 'message': 'ksync: Extend unit tests.\n\nChange-Id: Ic1483dada871614f40d87e19f7c18eae6e6c391e\nSigned-off-by: Mikhail Samoylov \n'}}}, 'requirements': [], 'submit_records': [{'rule_name': 'gerrit~DefaultSubmitRule', 'status': 'NOT_READY', 'labels': [{'label': 'Code-Review', 'status': 'NEED'}, {'label': 'Verified', 'status': 'NEED'}]}]} [2026-07-09T18:02:43.724Z] DEBUG: push message data: {'labels': {'Verified': '-1'}, 'message': 'TF CI Build Failed (check) in 0h 2m 29s\n\nFailed checks:\n- test-unit : NOT_BUILT\n- prepare-ut-sandbox http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/01/2901/23/check_4579/prepare-ut-sandbox : FAILURE in 0h 1m 29s\n- ansible-os http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/01/2901/23/check_4579/ansible-os : FAILURE in 0h 0m 2s\n- build-rocky9 http://nexus.gz1.opensdn.io:8082/jenkins_logs/gerrit/01/2901/23/check_4579/build-rocky9 : FAILURE in 0h 1m 30s\n\nSucceeded checks:'} [Pipeline] } [Pipeline] // withCredentials [Pipeline] sh [Pipeline] archiveArtifacts [2026-07-09T18:02:44.350Z] Archiving artifacts [Pipeline] withCredentials [2026-07-09T18:02:44.544Z] Masking supported pattern matches of $LOGS_HOST_SSH_KEY [Pipeline] { [Pipeline] writeFile [Pipeline] sh [2026-07-09T18:02:44.909Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [2026-07-09T18:02:45.472Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [Pipeline] } [Pipeline] // withCredentials [Pipeline] } [Pipeline] // stage [Pipeline] parallel [Pipeline] { (Branch: job-cleanup-workers) [Pipeline] stage [Pipeline] { (cleanup-workers) [Pipeline] echo [2026-07-09T18:02:46.255Z] JOB cleanup-workers: entering run_job [Pipeline] echo [2026-07-09T18:02:46.280Z] JOB cleanup-workers: vars empty. do not store vars file. [Pipeline] echo [2026-07-09T18:02:46.311Z] JOB cleanup-workers: Starting job: cleanup-workers rnd: #45565 [Pipeline] timeout [2026-07-09T18:02:46.326Z] Timeout set to expire in 3 hr 0 min [Pipeline] { [Pipeline] build [2026-07-09T18:02:46.370Z] Scheduling project: cleanup-workers [2026-07-09T18:02:54.832Z] Starting building: cleanup-workers #7238 [2026-07-09T18:03:49.546Z] Build cleanup-workers #7238 completed: FAILURE [Pipeline] } [Pipeline] // timeout [Pipeline] echo [2026-07-09T18:03:49.634Z] JOB cleanup-workers: Failed [Pipeline] copyArtifacts [Pipeline] echo [2026-07-09T18:03:49.702Z] JOB cleanup-workers: Collected artifacts: [Pipeline] sh [2026-07-09T18:03:49.988Z] + ls -la cleanup-workers-45565 [2026-07-09T18:03:49.988Z] ls: cannot access 'cleanup-workers-45565': No such file or directory [2026-07-09T18:03:49.988Z] + /bin/true [Pipeline] withCredentials [2026-07-09T18:03:50.043Z] Masking supported pattern matches of $LOGS_HOST_SSH_KEY [Pipeline] { [Pipeline] sh [2026-07-09T18:03:50.353Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [2026-07-09T18:03:50.916Z] Warning: Permanently added 'nexus.gz1.opensdn.io,212.233.90.199' (ECDSA) to the list of known hosts. [Pipeline] sh [Pipeline] } [Pipeline] // withCredentials [Pipeline] echo [2026-07-09T18:03:51.843Z] JOB cleanup-workers: error in job!!! [Pipeline] echo [2026-07-09T18:03:51.857Z] JOB cleanup-workers: Err - org.jenkinsci.plugins.workflow.steps.FlowInterruptedException [Pipeline] echo [2026-07-09T18:03:51.872Z] JOB cleanup-workers: Message - null [Pipeline] echo [2026-07-09T18:03:51.886Z] JOB cleanup-workers: Cause - null [Pipeline] echo [2026-07-09T18:03:51.900Z] JOB cleanup-workers: Stacktrace - [PluginClassLoader for pipeline-build-step//org.jenkinsci.plugins.workflow.support.steps.build.BuildTriggerListener.onFinalized(BuildTriggerListener.java:76), hudson.model.listeners.RunListener.lambda$fireFinalized$3(RunListener.java:260), jenkins.util.Listeners.lambda$notify$0(Listeners.java:59), jenkins.util.Listeners.notify(Listeners.java:67), hudson.model.listeners.RunListener.fireFinalized(RunListener.java:258), hudson.model.Run.onEndBuilding(Run.java:2052), hudson.model.Run.execute(Run.java:1959), hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44), hudson.model.ResourceController.execute(ResourceController.java:101), hudson.model.Executor.run(Executor.java:446)] [Pipeline] } [Pipeline] // stage [Pipeline] } [2026-07-09T18:03:51.966Z] Failed in branch job-cleanup-workers [Pipeline] // parallel [Pipeline] echo [2026-07-09T18:03:52.026Z] URL of console output = https://jenkins.opensdn.io/job/pipeline-check/4579/consoleText [Pipeline] withCredentials [2026-07-09T18:03:52.054Z] Masking supported pattern matches of $LOGS_HOST_SSH_KEY [Pipeline] { [Pipeline] sh