2025-08-07 02:21:36,098 - INFO - Using existing project ['default-domain', 'admin'](db90afc9-ebb9-4864-97c2-f05b9e92842e) 2025-08-07 02:21:36,109 - INFO - ================================================================================ 2025-08-07 02:21:36,109 - INFO - STARTING TEST : test_db_nodemgr_status 2025-08-07 02:21:36,109 - INFO - TEST DESCRIPTION : Test to verify db nodemgr status 2025-08-07 02:21:36,775 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-08-07 02:21:36,775 - INFO - Initial checks done. Running the testcase now 2025-08-07 02:21:36,775 - INFO - 2025-08-07 02:21:36,775 - DEBUG - Verifying if db node_mgr running... 2025-08-07 02:21:36,775 - INFO - Verifying through collector 10.0.0.249 for db node cn-jenkins-deploy-platform-ansible-os-3767-1. 2025-08-07 02:21:36,775 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3767-1.?flat 2025-08-07 02:21:37,081 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3767-1.?flat 2025-08-07 02:21:37,177 - INFO - Verifying through collector 10.0.0.249 for db node cn-jenkins-deploy-platform-ansible-os-3767-2. 2025-08-07 02:21:37,178 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3767-2.?flat 2025-08-07 02:21:37,249 - INFO - Verifying through collector 10.0.0.249 for db node cn-jenkins-deploy-platform-ansible-os-3767-3. 2025-08-07 02:21:37,249 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/database-node/cn-jenkins-deploy-platform-ansible-os-3767-3.?flat 2025-08-07 02:21:38,015 - DEBUG - No XMPP flaps were noticed during the test 2025-08-07 02:21:38,015 - INFO - END TEST : test_db_nodemgr_status : PASSED[0:00:02] 2025-08-07 02:21:38,015 - INFO - -------------------------------------------------------------------------------- 2025-08-07 02:21:38,019 - INFO - ================================================================================ 2025-08-07 02:21:38,019 - INFO - STARTING TEST : test_verify_generator_collector_connections 2025-08-07 02:21:38,019 - INFO - TEST DESCRIPTION : Description: Verify generator:module connections to collector 1.Verify all generators connected to collector - fails otherwise 2.Get the xmpp peers in vrouter uve and get the active xmpp peer out of it 3.Verify from agent introspect that active xmpp matches with step 2 - fails otherwise 4.Get bgp peers from bgp-peer uve and verify from control node introspect that that matches - fails otherwise Maintainer: sandipd@juniper.net 2025-08-07 02:21:38,691 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-08-07 02:21:38,691 - INFO - Initial checks done. Running the testcase now 2025-08-07 02:21:38,691 - INFO - 2025-08-07 02:21:38,698 - INFO - IP 10.0.0.56 port 8083 connected to collector 10.0.0.249 2025-08-07 02:21:38,704 - INFO - IP 10.0.0.130 port 8083 connected to collector 10.0.0.249 2025-08-07 02:21:38,711 - INFO - IP 10.0.0.249 port 8083 connected to collector 10.0.0.249 2025-08-07 02:21:38,716 - INFO - IP 10.0.0.56 port 8084 connected to collector 10.0.0.130 2025-08-07 02:21:38,721 - INFO - IP 10.0.0.130 port 8084 connected to collector 10.0.0.130 2025-08-07 02:21:38,725 - INFO - IP 10.0.0.249 port 8084 connected to collector 10.0.0.249 2025-08-07 02:21:38,729 - INFO - IP 10.0.0.56 port 8087 connected to collector 10.0.0.130 2025-08-07 02:21:38,732 - INFO - IP 10.0.0.56 port 8088 connected to collector 10.0.0.56 2025-08-07 02:21:38,737 - INFO - IP 10.0.0.56 port 8090 connected to collector 10.0.0.130 2025-08-07 02:21:38,742 - INFO - IP 10.0.0.130 port 8090 connected to collector 10.0.0.56 2025-08-07 02:21:38,746 - INFO - IP 10.0.0.249 port 8090 connected to collector 10.0.0.56 2025-08-07 02:21:38,754 - INFO - IP 10.0.0.56 port 8091 connected to collector 10.0.0.249 2025-08-07 02:21:38,762 - INFO - IP 10.0.0.130 port 8091 connected to collector 10.0.0.249 2025-08-07 02:21:38,769 - INFO - IP 10.0.0.249 port 8091 connected to collector 10.0.0.249 2025-08-07 02:21:38,769 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:38,877 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1:Control:contrail-control:0 is connected to collector 10.0.0.56 2025-08-07 02:21:38,877 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:38,970 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1:Control:contrail-dns:0 is connected to collector 10.0.0.56 2025-08-07 02:21:38,970 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,029 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2:Control:contrail-control:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,029 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,064 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2:Control:contrail-dns:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,065 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,113 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3:Control:contrail-control:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,113 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,151 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3:Control:contrail-dns:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,151 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,196 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3767-1:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,196 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,250 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3767-2:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,250 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,275 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Config:contrail-schema:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,275 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,303 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Config:contrail-svc-monitor:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,334 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,360 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Config:contrail-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,360 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,389 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2.:Config:contrail-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,389 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,423 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3.:Config:contrail-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,446 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,472 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,473 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,496 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,496 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,520 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,520 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,546 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,546 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,567 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,567 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,591 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,591 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,615 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,616 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,639 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,640 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,669 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,669 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,708 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Analytics:contrail-collector:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,708 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,737 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Database:contrail-query-engine:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,738 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,774 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2.:Analytics:contrail-collector:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,774 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,803 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2.:Database:contrail-query-engine:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,803 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,835 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3.:Analytics:contrail-collector:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,836 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:39,864 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3.:Database:contrail-query-engine:0 is connected to collector 10.0.0.56 2025-08-07 02:21:39,916 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3767-1?flat 2025-08-07 02:21:40,218 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3767-1?flat 2025-08-07 02:21:40,302 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3767-1 vrouter uve is 10.20.0.17 2025-08-07 02:21:40,329 - DEBUG - Requesting: http://10.20.0.192:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 02:21:40,345 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3767-1 agent introspect is 10.20.0.17 2025-08-07 02:21:40,392 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3767-2?flat 2025-08-07 02:21:40,481 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3767-2 vrouter uve is 10.20.0.25 2025-08-07 02:21:40,506 - DEBUG - Requesting: http://10.20.0.201:8085/Snh_AgentXmppConnectionStatusReq? 2025-08-07 02:21:40,521 - INFO - Active xmpp peer in an-jenkins-deploy-platform-ansible-os-3767-2 agent introspect is 10.20.0.25 2025-08-07 02:21:40,565 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3767-1?flat 2025-08-07 02:21:40,654 - INFO - Vrouter an-jenkins-deploy-platform-ansible-os-3767-1 connected to {'10.20.0.17', '10.20.0.25'} xmpp peers out of {'10.20.0.129', '10.20.0.17', '10.20.0.25'} 2025-08-07 02:21:40,654 - INFO - xmpp peer correctly displayed as ['10.20.0.17', '10.20.0.25'] for vrouter an-jenkins-deploy-platform-ansible-os-3767-1 2025-08-07 02:21:40,697 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-3767-2?flat 2025-08-07 02:21:40,745 - INFO - Vrouter an-jenkins-deploy-platform-ansible-os-3767-2 connected to {'10.20.0.17', '10.20.0.25'} xmpp peers out of {'10.20.0.129', '10.20.0.17', '10.20.0.25'} 2025-08-07 02:21:40,745 - INFO - xmpp peer correctly displayed as ['10.20.0.17', '10.20.0.25'] for vrouter an-jenkins-deploy-platform-ansible-os-3767-2 2025-08-07 02:21:40,746 - INFO - Verifying through opserver in 10.0.0.249 2025-08-07 02:21:40,746 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3767-1?flat 2025-08-07 02:21:40,775 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3767-2?flat 2025-08-07 02:21:40,800 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3767-3?flat 2025-08-07 02:21:40,829 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3767-1?flat 2025-08-07 02:21:40,854 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3767-2?flat 2025-08-07 02:21:40,878 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/control-node/cn-jenkins-deploy-platform-ansible-os-3767-3?flat 2025-08-07 02:21:40,906 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3767-1 bgp-router uve 2025-08-07 02:21:40,906 - INFO - Bgp peers = 2 2025-08-07 02:21:40,907 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3767-2 bgp-router uve 2025-08-07 02:21:40,907 - INFO - Bgp peers = 2 2025-08-07 02:21:40,907 - DEBUG - Verifying for cn-jenkins-deploy-platform-ansible-os-3767-3 bgp-router uve 2025-08-07 02:21:40,907 - INFO - Bgp peers = 2 2025-08-07 02:21:40,907 - INFO - Total xmpp peer connections found = 4 2025-08-07 02:21:41,547 - DEBUG - No XMPP flaps were noticed during the test 2025-08-07 02:21:41,547 - INFO - END TEST : test_verify_generator_collector_connections : PASSED[0:00:03] 2025-08-07 02:21:41,548 - INFO - -------------------------------------------------------------------------------- 2025-08-07 02:21:41,554 - INFO - ================================================================================ 2025-08-07 02:21:41,554 - INFO - STARTING TEST : test_verify_generator_connections_to_collector_node 2025-08-07 02:21:41,554 - INFO - TEST DESCRIPTION : Test to validate generator connections 2025-08-07 02:21:42,190 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-08-07 02:21:42,190 - INFO - Initial checks done. Running the testcase now 2025-08-07 02:21:42,191 - INFO - 2025-08-07 02:21:42,191 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,237 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3767-1:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,237 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,261 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3767-1:Compute:contrail-vrouter-nodemgr:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,261 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,301 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3767-2:Compute:contrail-vrouter-agent:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,301 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,322 - INFO - Validated that an-jenkins-deploy-platform-ansible-os-3767-2:Compute:contrail-vrouter-nodemgr:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,323 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,353 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,353 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,399 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Analytics:contrail-collector:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,399 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,423 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,423 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,446 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,446 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,489 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2.:Analytics:contrail-collector:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,489 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,514 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,514 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,535 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3.:Analytics:contrail-analytics-nodemgr:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,535 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,577 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3.:Analytics:contrail-collector:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,578 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,605 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3.:Analytics:contrail-analytics-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,606 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,639 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Database:contrail-query-engine:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,639 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,669 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,670 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,702 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2.:Database:contrail-query-engine:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,702 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,725 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,725 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,756 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3.:Database:contrail-query-engine:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,757 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,786 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3.:Database:contrail-database-nodemgr:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,787 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,814 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1.:Config:contrail-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,814 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,838 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2.:Config:contrail-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,839 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,862 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3.:Config:contrail-api:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,863 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,931 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1:Control:contrail-control:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,931 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,955 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,955 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:42,993 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-1:Control:contrail-dns:0 is connected to collector 10.0.0.56 2025-08-07 02:21:42,993 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:43,052 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2:Control:contrail-control:0 is connected to collector 10.0.0.56 2025-08-07 02:21:43,052 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:43,079 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.56 2025-08-07 02:21:43,079 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:43,127 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-2:Control:contrail-dns:0 is connected to collector 10.0.0.56 2025-08-07 02:21:43,128 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:43,185 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3:Control:contrail-control:0 is connected to collector 10.0.0.56 2025-08-07 02:21:43,185 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:43,208 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3:Control:contrail-control-nodemgr:0 is connected to collector 10.0.0.56 2025-08-07 02:21:43,208 - DEBUG - Verifying through opserver in 10.0.0.56 2025-08-07 02:21:43,243 - INFO - Validated that cn-jenkins-deploy-platform-ansible-os-3767-3:Control:contrail-dns:0 is connected to collector 10.0.0.56 2025-08-07 02:21:43,895 - DEBUG - No XMPP flaps were noticed during the test 2025-08-07 02:21:43,895 - INFO - END TEST : test_verify_generator_connections_to_collector_node : PASSED[0:00:02] 2025-08-07 02:21:43,895 - INFO - -------------------------------------------------------------------------------- 2025-08-07 02:21:43,900 - INFO - ================================================================================ 2025-08-07 02:21:43,900 - INFO - STARTING TEST : test_verify_process_status_agent 2025-08-07 02:21:43,900 - INFO - TEST DESCRIPTION : Test to validate process_status 2025-08-07 02:21:44,545 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-08-07 02:21:44,545 - INFO - Initial checks done. Running the testcase now 2025-08-07 02:21:44,545 - INFO - 2025-08-07 02:21:44,586 - INFO - an-jenkins-deploy-platform-ansible-os-3767-1:contrail-vrouter-agent module connection to ['10.20.0.17:5269'] servers UP 2025-08-07 02:21:44,586 - INFO - an-jenkins-deploy-platform-ansible-os-3767-1 connected to xmpp 10.20.0.17 2025-08-07 02:21:44,586 - INFO - an-jenkins-deploy-platform-ansible-os-3767-1:contrail-vrouter-agent module connection to ['10.20.0.25:5269'] servers UP 2025-08-07 02:21:44,586 - INFO - an-jenkins-deploy-platform-ansible-os-3767-1 connected to xmpp 10.20.0.25 2025-08-07 02:21:44,587 - WARNING - an-jenkins-deploy-platform-ansible-os-3767-1:contrail-vrouter-agent module connection to ['10.20.0.129:5269'] servers NOT UP 2025-08-07 02:21:44,587 - INFO - an-jenkins-deploy-platform-ansible-os-3767-1:contrail-vrouter-agent module connection to ['10.20.0.17:53'] servers UP 2025-08-07 02:21:44,587 - INFO - an-jenkins-deploy-platform-ansible-os-3767-1 connected to dns 10.20.0.17 2025-08-07 02:21:44,587 - INFO - an-jenkins-deploy-platform-ansible-os-3767-1:contrail-vrouter-agent module connection to ['10.20.0.25:53'] servers UP 2025-08-07 02:21:44,587 - INFO - an-jenkins-deploy-platform-ansible-os-3767-1 connected to dns 10.20.0.25 2025-08-07 02:21:44,587 - WARNING - an-jenkins-deploy-platform-ansible-os-3767-1:contrail-vrouter-agent module connection to ['10.20.0.129:53'] servers NOT UP 2025-08-07 02:21:44,587 - WARNING - an-jenkins-deploy-platform-ansible-os-3767-1:contrail-vrouter-agent module connection to ['10.0.0.56:8086'] servers NOT UP 2025-08-07 02:21:44,587 - INFO - an-jenkins-deploy-platform-ansible-os-3767-1:contrail-vrouter-agent module connection to ['10.0.0.130:8086'] servers UP 2025-08-07 02:21:44,587 - INFO - an-jenkins-deploy-platform-ansible-os-3767-1 connected to collector 10.0.0.130 2025-08-07 02:21:44,587 - WARNING - an-jenkins-deploy-platform-ansible-os-3767-1:contrail-vrouter-agent module connection to ['10.0.0.249:8086'] servers NOT UP 2025-08-07 02:21:45,247 - DEBUG - No XMPP flaps were noticed during the test 2025-08-07 02:21:45,247 - INFO - END TEST : test_verify_process_status_agent : PASSED[0:00:02] 2025-08-07 02:21:45,247 - INFO - -------------------------------------------------------------------------------- 2025-08-07 02:21:45,253 - INFO - ================================================================================ 2025-08-07 02:21:45,253 - INFO - STARTING TEST : test_verify_process_status_analytics_node 2025-08-07 02:21:45,253 - INFO - TEST DESCRIPTION : Test to validate process_status-Analytics-Node 2025-08-07 02:21:45,890 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-08-07 02:21:45,890 - INFO - Initial checks done. Running the testcase now 2025-08-07 02:21:45,890 - INFO - 2025-08-07 02:21:46,123 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-collector module connection to ['10.0.0.56:8086'] servers UP 2025-08-07 02:21:46,123 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-collector module connection to ['10.0.0.56:6379'] servers NOT UP 2025-08-07 02:21:46,123 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-collector module connection to ['10.0.0.130:6379'] servers NOT UP 2025-08-07 02:21:46,123 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-collector module connection to ['10.0.0.249:6379'] servers NOT UP 2025-08-07 02:21:46,123 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP 2025-08-07 02:21:46,124 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-collector module connection to ['10.0.0.56:9042'] servers UP 2025-08-07 02:21:46,165 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-2.:contrail-collector module connection to ['10.0.0.56:8086'] servers NOT UP 2025-08-07 02:21:46,165 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-2.:contrail-collector module connection to ['10.0.0.130:8086'] servers UP 2025-08-07 02:21:46,165 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-2.:contrail-collector module connection to ['10.0.0.56:6379'] servers NOT UP 2025-08-07 02:21:46,165 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-2.:contrail-collector module connection to ['10.0.0.130:6379'] servers NOT UP 2025-08-07 02:21:46,165 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-2.:contrail-collector module connection to ['10.0.0.249:6379'] servers NOT UP 2025-08-07 02:21:46,166 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-2.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP 2025-08-07 02:21:46,166 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-2.:contrail-collector module connection to ['10.0.0.56:9042'] servers UP 2025-08-07 02:21:46,210 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-3.:contrail-collector module connection to ['10.0.0.56:8086'] servers NOT UP 2025-08-07 02:21:46,210 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-3.:contrail-collector module connection to ['10.0.0.130:8086'] servers NOT UP 2025-08-07 02:21:46,210 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-3.:contrail-collector module connection to ['10.0.0.249:8086'] servers UP 2025-08-07 02:21:46,210 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-3.:contrail-collector module connection to ['10.0.0.56:6379'] servers NOT UP 2025-08-07 02:21:46,211 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-3.:contrail-collector module connection to ['10.0.0.130:6379'] servers NOT UP 2025-08-07 02:21:46,211 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-3.:contrail-collector module connection to ['10.0.0.249:6379'] servers NOT UP 2025-08-07 02:21:46,211 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-3.:contrail-collector module connection to ['127.0.0.1:6379'] servers UP 2025-08-07 02:21:46,211 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-3.:contrail-collector module connection to ['10.0.0.56:9042'] servers UP 2025-08-07 02:21:46,250 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-analytics-api module connection to ['10.0.0.56:8086'] servers NOT UP 2025-08-07 02:21:46,251 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-analytics-api module connection to ['10.0.0.130:8086'] servers UP 2025-08-07 02:21:46,293 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-2.:contrail-analytics-api module connection to ['10.0.0.56:8086'] servers UP 2025-08-07 02:21:46,338 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-3.:contrail-analytics-api module connection to ['10.0.0.56:8086'] servers UP 2025-08-07 02:21:46,380 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-analytics-nodemgr module connection to ['10.0.0.56:8086'] servers UP 2025-08-07 02:21:46,426 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-2.:contrail-analytics-nodemgr module connection to ['10.0.0.56:8086'] servers UP 2025-08-07 02:21:46,469 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-3.:contrail-analytics-nodemgr module connection to ['10.0.0.56:8086'] servers NOT UP 2025-08-07 02:21:46,469 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-3.:contrail-analytics-nodemgr module connection to ['10.0.0.130:8086'] servers NOT UP 2025-08-07 02:21:46,469 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-3.:contrail-analytics-nodemgr module connection to ['10.0.0.249:8086'] servers UP 2025-08-07 02:21:47,133 - DEBUG - No XMPP flaps were noticed during the test 2025-08-07 02:21:47,133 - INFO - END TEST : test_verify_process_status_analytics_node : PASSED[0:00:02] 2025-08-07 02:21:47,133 - INFO - -------------------------------------------------------------------------------- 2025-08-07 02:21:47,138 - INFO - ================================================================================ 2025-08-07 02:21:47,138 - INFO - STARTING TEST : test_verify_process_status_config 2025-08-07 02:21:47,138 - INFO - TEST DESCRIPTION : Test to validate process_status-Config 2025-08-07 02:21:47,811 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-08-07 02:21:47,811 - INFO - Initial checks done. Running the testcase now 2025-08-07 02:21:47,811 - INFO - 2025-08-07 02:21:47,872 - WARNING - No object found for module contrail-device-manager 2025-08-07 02:21:47,902 - WARNING - No object found for module contrail-device-manager 2025-08-07 02:21:47,931 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-api module connection to 10.0.0.56:8086 servers NOT UP 2025-08-07 02:21:47,931 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-api module connection to 10.0.0.130:8086 servers UP 2025-08-07 02:21:47,932 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-api module connection to 10.0.0.56:2181 servers UP 2025-08-07 02:21:47,932 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-api module connection to 10.0.0.56:9161 servers NOT UP 2025-08-07 02:21:47,932 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-api module connection to 10.0.0.130:9161 servers NOT UP 2025-08-07 02:21:47,932 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-api module connection to 10.0.0.249:9161 servers NOT UP 2025-08-07 02:21:47,933 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3767-1.*:9161 servers NOT UP 2025-08-07 02:21:47,934 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3767-2.*:9161 servers NOT UP 2025-08-07 02:21:47,934 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1.:contrail-api module connection to cn-jenkins-deploy-platform-ansible-os-3767-3.*:9161 servers NOT UP 2025-08-07 02:21:48,570 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Thu Aug 7 02:21:47 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/analytics/test_analytics.py in test_verify_process_status_config(self=) 333 334 ''' 335 self.analytics_obj.verify_process_and_connection_infos_config() 336 337 @test.attr(type=['cb_sanity', 'sanity', 'dev_sanity_dpdk']) self = self.analytics_obj = self.analytics_obj.verify_process_and_connection_infos_config = > /contrail-test/tcutils/collector/analytics_tests.py in verify_process_and_connection_infos_config(self=) 4218 'contrail-api',\ 4219 server,node = cfgm) 4220 assert result 4221 result = False 4222 result = False AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/analytics/test_analytics.py", line 335, in test_verify_process_status_config self.analytics_obj.verify_process_and_connection_infos_config() File "/contrail-test/tcutils/collector/analytics_tests.py", line 4220, in verify_process_and_connection_infos_config assert result AssertionError 2025-08-07 02:21:48,589 - DEBUG - No XMPP flaps were noticed during the test 2025-08-07 02:21:48,589 - INFO - 2025-08-07 02:21:48,589 - INFO - END TEST : test_verify_process_status_config : FAILED[0:00:01] 2025-08-07 02:21:48,589 - INFO - -------------------------------------------------------------------------------- 2025-08-07 02:21:48,592 - INFO - ================================================================================ 2025-08-07 02:21:48,593 - INFO - STARTING TEST : test_verify_process_status_control_node 2025-08-07 02:21:48,593 - INFO - TEST DESCRIPTION : Test to validate process_status-Control-Node 2025-08-07 02:21:49,234 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-08-07 02:21:49,234 - INFO - Initial checks done. Running the testcase now 2025-08-07 02:21:49,234 - INFO - 2025-08-07 02:21:49,269 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-1:contrail-control module connection to 10.0.0.56:9041 servers UP 2025-08-07 02:21:49,270 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-1:contrail-control module connection to 10.0.0.56:5673 servers UP 2025-08-07 02:21:49,270 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1:contrail-control module connection to ['10.0.0.56:8086'] servers NOT UP 2025-08-07 02:21:49,270 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-1:contrail-control module connection to ['10.0.0.130:8086'] servers NOT UP 2025-08-07 02:21:49,271 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-1:contrail-control module connection to ['10.0.0.249:8086'] servers UP 2025-08-07 02:21:49,303 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-2:contrail-control module connection to 10.0.0.56:9041 servers UP 2025-08-07 02:21:49,303 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-2:contrail-control module connection to 10.0.0.56:5673 servers UP 2025-08-07 02:21:49,303 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-2:contrail-control module connection to ['10.0.0.56:8086'] servers NOT UP 2025-08-07 02:21:49,303 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-2:contrail-control module connection to ['10.0.0.130:8086'] servers NOT UP 2025-08-07 02:21:49,304 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-2:contrail-control module connection to ['10.0.0.249:8086'] servers UP 2025-08-07 02:21:49,342 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-3:contrail-control module connection to 10.0.0.56:9041 servers UP 2025-08-07 02:21:49,342 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-3:contrail-control module connection to 10.0.0.56:5673 servers UP 2025-08-07 02:21:49,349 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-3:contrail-control module connection to ['10.0.0.56:8086'] servers NOT UP 2025-08-07 02:21:49,350 - WARNING - cn-jenkins-deploy-platform-ansible-os-3767-3:contrail-control module connection to ['10.0.0.130:8086'] servers NOT UP 2025-08-07 02:21:49,350 - INFO - cn-jenkins-deploy-platform-ansible-os-3767-3:contrail-control module connection to ['10.0.0.249:8086'] servers UP 2025-08-07 02:21:50,003 - DEBUG - No XMPP flaps were noticed during the test 2025-08-07 02:21:50,003 - INFO - END TEST : test_verify_process_status_control_node : PASSED[0:00:02] 2025-08-07 02:21:50,003 - INFO - --------------------------------------------------------------------------------