2025-10-06 02:45:22,271 - INFO - Domain Default found not creating 2025-10-06 02:45:22,411 - INFO - Project ctest-TestSVCV2Mirror-61993685 not found, creating it 2025-10-06 02:45:22,917 - INFO - Created Project:ctest-TestSVCV2Mirror-61993685, ID : 7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:45:24,353 - INFO - ================================================================================ 2025-10-06 02:45:24,353 - INFO - STARTING TEST : test_svc_v2_mirroring 2025-10-06 02:45:24,353 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2025-10-06 02:45:25,634 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.193': '0', '10.20.0.25': '0'}, '10.0.0.19': {'10.20.0.25': '0', '10.20.0.17': '0'}} with 2025-10-06 02:45:25,635 - INFO - Initial checks done. Running the testcase now 2025-10-06 02:45:25,635 - INFO - 2025-10-06 02:45:26,262 - DEBUG - Response for create_network : {'network': {'id': '7e0d9e24-37dd-415a-b576-627f29ea331a', 'name': 'ctest-left-42980037', 'tenant_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'project_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-61993685', 'ctest-left-42980037'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:45:26,572 - DEBUG - Response for create_subnet : {'subnet': {'id': '33dff360-c58a-487b-b687-32b5219a9fc7', 'name': '', 'tenant_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'network_id': '7e0d9e24-37dd-415a-b576-627f29ea331a', 'ip_version': 4, 'cidr': '89.207.12.192/26', 'allocation_pools': [{'start': '89.207.12.194', 'end': '89.207.12.254'}], 'gateway_ip': '89.207.12.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '89.207.12.194', 'tags': [], 'project_id': '7c58c5ec220a4d1696aee1d84b939fa9'}} 2025-10-06 02:45:26,595 - INFO - Created VN ctest-left-42980037 2025-10-06 02:45:26,609 - DEBUG - VN ctest-left-42980037 UUID is 7e0d9e24-37dd-415a-b576-627f29ea331a 2025-10-06 02:45:26,677 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:26,983 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:27,022 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:27,037 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:45:27,136 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/7e0d9e24-37dd-415a-b576-627f29ea331a 2025-10-06 02:45:27,151 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/7e0d9e24-37dd-415a-b576-627f29ea331a 2025-10-06 02:45:27,159 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/77e784a2-718d-483d-832f-78aed20735b7 2025-10-06 02:45:27,166 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/77e784a2-718d-483d-832f-78aed20735b7 2025-10-06 02:45:27,172 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/11e24193-de30-470a-a39d-f8f82695fc97 2025-10-06 02:45:27,178 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-06 02:45:27,178 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/7e0d9e24-37dd-415a-b576-627f29ea331a 2025-10-06 02:45:27,186 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/77e784a2-718d-483d-832f-78aed20735b7 2025-10-06 02:45:27,200 - INFO - Verified VN network id 10 for VN 7e0d9e24-37dd-415a-b576-627f29ea331a 2025-10-06 02:45:27,200 - INFO - Verifications in API Server for VN ctest-left-42980037 passed 2025-10-06 02:45:27,200 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/7e0d9e24-37dd-415a-b576-627f29ea331a 2025-10-06 02:45:27,208 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/77e784a2-718d-483d-832f-78aed20735b7 2025-10-06 02:45:27,214 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/77e784a2-718d-483d-832f-78aed20735b7 2025-10-06 02:45:27,221 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/11e24193-de30-470a-a39d-f8f82695fc97 2025-10-06 02:45:27,231 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9083089901869416794', 'uuid-lslong': '13075746866420396826'}, 'enable': 'true', 'created': '2025-10-06T02:45:26', 'last-modified': '2025-10-06T02:45:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.710508'} 2025-10-06 02:45:27,236 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-06 02:45:27,243 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9083089901869416794', 'uuid-lslong': '13075746866420396826'}, 'enable': 'true', 'created': '2025-10-06T02:45:26', 'last-modified': '2025-10-06T02:45:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.717317'} 2025-10-06 02:45:27,249 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-06 02:45:27,254 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9083089901869416794', 'uuid-lslong': '13075746866420396826'}, 'enable': 'true', 'created': '2025-10-06T02:45:26', 'last-modified': '2025-10-06T02:45:26', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.733157'} 2025-10-06 02:45:27,259 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-06 02:45:27,260 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-42980037 passed 2025-10-06 02:45:27,260 - DEBUG - ====Verifying policy data for ctest-left-42980037 in API_Server ====== 2025-10-06 02:45:27,260 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:27,267 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:27,280 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:45:27,367 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/7e0d9e24-37dd-415a-b576-627f29ea331a 2025-10-06 02:45:27,377 - DEBUG - =>VN ctest-left-42980037 has no policy to be verified 2025-10-06 02:45:27,377 - DEBUG - Verifying the vn in opserver 2025-10-06 02:45:27,377 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037 virtual network link through opserver 10.0.0.33 2025-10-06 02:45:27,377 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:45:27,674 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:45:27,729 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037?flat'} 2025-10-06 02:45:27,729 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037 virtual network link through opserver 10.0.0.38 2025-10-06 02:45:27,730 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:45:28,020 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:45:28,072 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037?flat'} 2025-10-06 02:45:28,072 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037 virtual network link through opserver 10.0.0.249 2025-10-06 02:45:28,072 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:45:28,361 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:45:28,410 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037?flat'} 2025-10-06 02:45:28,410 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037 is found in opserver 2025-10-06 02:45:28,428 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:45:28,436 - DEBUG - VRF ids for VN ctest-left-42980037: {} 2025-10-06 02:45:28,693 - DEBUG - Response for create_network : {'network': {'id': 'f6566bcd-e861-4bd7-8a0d-1a27fd7bb1ae', 'name': 'ctest-right-84727568', 'tenant_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'project_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-61993685', 'ctest-right-84727568'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:45:28,921 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bd8a3719-e8f5-4675-8c7f-212ae1862680', 'name': '', 'tenant_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'network_id': 'f6566bcd-e861-4bd7-8a0d-1a27fd7bb1ae', 'ip_version': 4, 'cidr': '133.195.45.64/26', 'allocation_pools': [{'start': '133.195.45.66', 'end': '133.195.45.126'}], 'gateway_ip': '133.195.45.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '133.195.45.66', 'tags': [], 'project_id': '7c58c5ec220a4d1696aee1d84b939fa9'}} 2025-10-06 02:45:28,944 - INFO - Created VN ctest-right-84727568 2025-10-06 02:45:28,956 - DEBUG - VN ctest-right-84727568 UUID is f6566bcd-e861-4bd7-8a0d-1a27fd7bb1ae 2025-10-06 02:45:29,030 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:29,037 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:29,048 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:45:29,137 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/f6566bcd-e861-4bd7-8a0d-1a27fd7bb1ae 2025-10-06 02:45:29,147 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/f6566bcd-e861-4bd7-8a0d-1a27fd7bb1ae 2025-10-06 02:45:29,155 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/d35376db-c0c0-415f-906f-2b8de5cb896a 2025-10-06 02:45:29,163 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/d35376db-c0c0-415f-906f-2b8de5cb896a 2025-10-06 02:45:29,169 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/2b7121d3-3f5b-43de-9611-4cd91ee202db 2025-10-06 02:45:29,176 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-06 02:45:29,176 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/f6566bcd-e861-4bd7-8a0d-1a27fd7bb1ae 2025-10-06 02:45:29,186 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/d35376db-c0c0-415f-906f-2b8de5cb896a 2025-10-06 02:45:29,202 - INFO - Verified VN network id 11 for VN f6566bcd-e861-4bd7-8a0d-1a27fd7bb1ae 2025-10-06 02:45:29,202 - INFO - Verifications in API Server for VN ctest-right-84727568 passed 2025-10-06 02:45:29,202 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/f6566bcd-e861-4bd7-8a0d-1a27fd7bb1ae 2025-10-06 02:45:29,211 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/d35376db-c0c0-415f-906f-2b8de5cb896a 2025-10-06 02:45:29,235 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/d35376db-c0c0-415f-906f-2b8de5cb896a 2025-10-06 02:45:29,244 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/2b7121d3-3f5b-43de-9611-4cd91ee202db 2025-10-06 02:45:29,263 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17750493513438546903', 'uuid-lslong': '9947635910990082478'}, 'enable': 'true', 'created': '2025-10-06T02:45:28', 'last-modified': '2025-10-06T02:45:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.390429'} 2025-10-06 02:45:29,269 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-06 02:45:29,274 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17750493513438546903', 'uuid-lslong': '9947635910990082478'}, 'enable': 'true', 'created': '2025-10-06T02:45:28', 'last-modified': '2025-10-06T02:45:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.400067'} 2025-10-06 02:45:29,279 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-06 02:45:29,284 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '17750493513438546903', 'uuid-lslong': '9947635910990082478'}, 'enable': 'true', 'created': '2025-10-06T02:45:28', 'last-modified': '2025-10-06T02:45:28', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.412202'} 2025-10-06 02:45:29,289 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-06 02:45:29,289 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-84727568 passed 2025-10-06 02:45:29,289 - DEBUG - ====Verifying policy data for ctest-right-84727568 in API_Server ====== 2025-10-06 02:45:29,289 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:29,295 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:29,305 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:45:29,398 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/f6566bcd-e861-4bd7-8a0d-1a27fd7bb1ae 2025-10-06 02:45:29,406 - DEBUG - =>VN ctest-right-84727568 has no policy to be verified 2025-10-06 02:45:29,406 - DEBUG - Verifying the vn in opserver 2025-10-06 02:45:29,406 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568 virtual network link through opserver 10.0.0.33 2025-10-06 02:45:29,406 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:45:29,463 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568?flat'} 2025-10-06 02:45:29,463 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568 virtual network link through opserver 10.0.0.38 2025-10-06 02:45:29,463 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:45:29,513 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568?flat'} 2025-10-06 02:45:29,513 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568 virtual network link through opserver 10.0.0.249 2025-10-06 02:45:29,513 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:45:29,568 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568?flat'} 2025-10-06 02:45:29,568 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568 is found in opserver 2025-10-06 02:45:29,587 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:45:29,596 - DEBUG - VRF ids for VN ctest-right-84727568: {} 2025-10-06 02:45:29,846 - DEBUG - Response for create_network : {'network': {'id': '8a683bc5-e97c-4d46-870e-c9b2c4fdeb54', 'name': 'ctest-mgmt_vn-02162339', 'tenant_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'project_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-61993685', 'ctest-mgmt_vn-02162339'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:45:30,057 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f4c87341-1c36-445a-bc1b-1bcc2b3f0c41', 'name': '', 'tenant_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'network_id': '8a683bc5-e97c-4d46-870e-c9b2c4fdeb54', 'ip_version': 4, 'cidr': '186.72.149.128/26', 'allocation_pools': [{'start': '186.72.149.130', 'end': '186.72.149.190'}], 'gateway_ip': '186.72.149.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '186.72.149.130', 'tags': [], 'project_id': '7c58c5ec220a4d1696aee1d84b939fa9'}} 2025-10-06 02:45:30,080 - INFO - Created VN ctest-mgmt_vn-02162339 2025-10-06 02:45:30,091 - DEBUG - VN ctest-mgmt_vn-02162339 UUID is 8a683bc5-e97c-4d46-870e-c9b2c4fdeb54 2025-10-06 02:45:30,172 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:30,178 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:30,193 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:45:30,286 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/8a683bc5-e97c-4d46-870e-c9b2c4fdeb54 2025-10-06 02:45:30,298 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/8a683bc5-e97c-4d46-870e-c9b2c4fdeb54 2025-10-06 02:45:30,308 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/f7666a04-a9a0-48dc-95bc-fbf7d2dffe02 2025-10-06 02:45:30,317 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/f7666a04-a9a0-48dc-95bc-fbf7d2dffe02 2025-10-06 02:45:30,324 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/c3bee91a-c931-41f8-b50d-d224398bf2c8 2025-10-06 02:45:30,331 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-06 02:45:30,331 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/8a683bc5-e97c-4d46-870e-c9b2c4fdeb54 2025-10-06 02:45:30,340 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/f7666a04-a9a0-48dc-95bc-fbf7d2dffe02 2025-10-06 02:45:30,356 - INFO - Verified VN network id 12 for VN 8a683bc5-e97c-4d46-870e-c9b2c4fdeb54 2025-10-06 02:45:30,356 - INFO - Verifications in API Server for VN ctest-mgmt_vn-02162339 passed 2025-10-06 02:45:30,356 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/8a683bc5-e97c-4d46-870e-c9b2c4fdeb54 2025-10-06 02:45:30,364 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/f7666a04-a9a0-48dc-95bc-fbf7d2dffe02 2025-10-06 02:45:30,371 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/f7666a04-a9a0-48dc-95bc-fbf7d2dffe02 2025-10-06 02:45:30,377 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/c3bee91a-c931-41f8-b50d-d224398bf2c8 2025-10-06 02:45:30,389 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9973287096023797062', 'uuid-lslong': '9731937614440557396'}, 'enable': 'true', 'created': '2025-10-06T02:45:29', 'last-modified': '2025-10-06T02:45:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.387259'} 2025-10-06 02:45:30,395 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-06 02:45:30,400 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9973287096023797062', 'uuid-lslong': '9731937614440557396'}, 'enable': 'true', 'created': '2025-10-06T02:45:29', 'last-modified': '2025-10-06T02:45:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.401238'} 2025-10-06 02:45:30,405 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-06 02:45:30,410 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9973287096023797062', 'uuid-lslong': '9731937614440557396'}, 'enable': 'true', 'created': '2025-10-06T02:45:29', 'last-modified': '2025-10-06T02:45:29', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.407877'} 2025-10-06 02:45:30,415 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-06 02:45:30,415 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-02162339 passed 2025-10-06 02:45:30,415 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-02162339 in API_Server ====== 2025-10-06 02:45:30,415 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:30,421 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:30,430 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:45:30,516 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/8a683bc5-e97c-4d46-870e-c9b2c4fdeb54 2025-10-06 02:45:30,526 - DEBUG - =>VN ctest-mgmt_vn-02162339 has no policy to be verified 2025-10-06 02:45:30,526 - DEBUG - Verifying the vn in opserver 2025-10-06 02:45:30,526 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339 virtual network link through opserver 10.0.0.33 2025-10-06 02:45:30,526 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:45:30,575 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339?flat'} 2025-10-06 02:45:30,576 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339 virtual network link through opserver 10.0.0.38 2025-10-06 02:45:30,576 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:45:30,625 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339?flat'} 2025-10-06 02:45:30,625 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339 virtual network link through opserver 10.0.0.249 2025-10-06 02:45:30,625 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:45:30,671 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339?flat'} 2025-10-06 02:45:30,671 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-61993685:ctest-mgmt_vn-02162339 is found in opserver 2025-10-06 02:45:30,690 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:45:30,698 - DEBUG - VRF ids for VN ctest-mgmt_vn-02162339: {} 2025-10-06 02:45:30,982 - DEBUG - Response for create_network : {'network': {'id': 'c3f7e2a4-c4aa-417c-8626-2f97b38a964b', 'name': 'ctest-trans_left_vn-04339803', 'tenant_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'project_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-61993685', 'ctest-trans_left_vn-04339803'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:45:31,189 - DEBUG - Response for create_subnet : {'subnet': {'id': '5f059c5c-a7a8-4277-ab8c-3e2b34ea8fc7', 'name': '', 'tenant_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'network_id': 'c3f7e2a4-c4aa-417c-8626-2f97b38a964b', 'ip_version': 4, 'cidr': '196.169.135.0/26', 'allocation_pools': [{'start': '196.169.135.2', 'end': '196.169.135.62'}], 'gateway_ip': '196.169.135.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '196.169.135.2', 'tags': [], 'project_id': '7c58c5ec220a4d1696aee1d84b939fa9'}} 2025-10-06 02:45:31,213 - INFO - Created VN ctest-trans_left_vn-04339803 2025-10-06 02:45:31,226 - DEBUG - VN ctest-trans_left_vn-04339803 UUID is c3f7e2a4-c4aa-417c-8626-2f97b38a964b 2025-10-06 02:45:31,292 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:31,299 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:31,312 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:45:31,399 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c3f7e2a4-c4aa-417c-8626-2f97b38a964b 2025-10-06 02:45:31,412 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c3f7e2a4-c4aa-417c-8626-2f97b38a964b 2025-10-06 02:45:31,420 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7349ee72-f178-4c13-a1c8-ecb3080c5a6f 2025-10-06 02:45:31,429 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7349ee72-f178-4c13-a1c8-ecb3080c5a6f 2025-10-06 02:45:31,436 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/f0dddcbd-03fa-4af0-8c01-596958bf1e99 2025-10-06 02:45:31,442 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-06 02:45:31,442 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c3f7e2a4-c4aa-417c-8626-2f97b38a964b 2025-10-06 02:45:31,450 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7349ee72-f178-4c13-a1c8-ecb3080c5a6f 2025-10-06 02:45:31,465 - INFO - Verified VN network id 13 for VN c3f7e2a4-c4aa-417c-8626-2f97b38a964b 2025-10-06 02:45:31,465 - INFO - Verifications in API Server for VN ctest-trans_left_vn-04339803 passed 2025-10-06 02:45:31,465 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c3f7e2a4-c4aa-417c-8626-2f97b38a964b 2025-10-06 02:45:31,473 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7349ee72-f178-4c13-a1c8-ecb3080c5a6f 2025-10-06 02:45:31,479 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7349ee72-f178-4c13-a1c8-ecb3080c5a6f 2025-10-06 02:45:31,485 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/f0dddcbd-03fa-4af0-8c01-596958bf1e99 2025-10-06 02:45:31,495 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14121004353945485692', 'uuid-lslong': '9666465978796119627'}, 'enable': 'true', 'created': '2025-10-06T02:45:30', 'last-modified': '2025-10-06T02:45:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.347375'} 2025-10-06 02:45:31,501 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-06 02:45:31,506 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14121004353945485692', 'uuid-lslong': '9666465978796119627'}, 'enable': 'true', 'created': '2025-10-06T02:45:30', 'last-modified': '2025-10-06T02:45:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.355071'} 2025-10-06 02:45:31,511 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-06 02:45:31,516 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14121004353945485692', 'uuid-lslong': '9666465978796119627'}, 'enable': 'true', 'created': '2025-10-06T02:45:30', 'last-modified': '2025-10-06T02:45:31', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.371301'} 2025-10-06 02:45:31,521 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-06 02:45:31,521 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-04339803 passed 2025-10-06 02:45:31,521 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-04339803 in API_Server ====== 2025-10-06 02:45:31,521 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:31,527 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:31,536 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:45:31,622 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/c3f7e2a4-c4aa-417c-8626-2f97b38a964b 2025-10-06 02:45:31,632 - DEBUG - =>VN ctest-trans_left_vn-04339803 has no policy to be verified 2025-10-06 02:45:31,632 - DEBUG - Verifying the vn in opserver 2025-10-06 02:45:31,632 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 virtual network link through opserver 10.0.0.33 2025-10-06 02:45:31,632 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:45:31,643 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803?flat'} 2025-10-06 02:45:31,643 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 virtual network link through opserver 10.0.0.38 2025-10-06 02:45:31,644 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:45:31,654 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803?flat'} 2025-10-06 02:45:31,654 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 virtual network link through opserver 10.0.0.249 2025-10-06 02:45:31,654 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:45:31,667 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803?flat'} 2025-10-06 02:45:31,667 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is found in opserver 2025-10-06 02:45:31,686 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:45:31,694 - DEBUG - VRF ids for VN ctest-trans_left_vn-04339803: {} 2025-10-06 02:45:31,960 - DEBUG - Response for create_network : {'network': {'id': '54ce5c72-d235-4710-a4de-4f0909b155ad', 'name': 'ctest-trans_right_vn-28747911', 'tenant_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'project_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-61993685', 'ctest-trans_right_vn-28747911'], 'port_security_enabled': True, 'description': ''}} 2025-10-06 02:45:32,192 - DEBUG - Response for create_subnet : {'subnet': {'id': '32939cc7-1eb3-4a5c-a08c-a68ab1136708', 'name': '', 'tenant_id': '7c58c5ec220a4d1696aee1d84b939fa9', 'network_id': '54ce5c72-d235-4710-a4de-4f0909b155ad', 'ip_version': 4, 'cidr': '41.40.141.0/26', 'allocation_pools': [{'start': '41.40.141.2', 'end': '41.40.141.62'}], 'gateway_ip': '41.40.141.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '41.40.141.2', 'tags': [], 'project_id': '7c58c5ec220a4d1696aee1d84b939fa9'}} 2025-10-06 02:45:32,214 - INFO - Created VN ctest-trans_right_vn-28747911 2025-10-06 02:45:32,224 - DEBUG - VN ctest-trans_right_vn-28747911 UUID is 54ce5c72-d235-4710-a4de-4f0909b155ad 2025-10-06 02:45:32,306 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:32,314 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:32,325 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:45:32,408 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/54ce5c72-d235-4710-a4de-4f0909b155ad 2025-10-06 02:45:32,423 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/54ce5c72-d235-4710-a4de-4f0909b155ad 2025-10-06 02:45:32,432 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/4ad1e988-a5bb-4fef-833c-7b0278934eee 2025-10-06 02:45:32,439 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/4ad1e988-a5bb-4fef-833c-7b0278934eee 2025-10-06 02:45:32,447 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/881b465d-551f-4180-a0ee-b74aade463a3 2025-10-06 02:45:32,453 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-06 02:45:32,453 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/54ce5c72-d235-4710-a4de-4f0909b155ad 2025-10-06 02:45:32,461 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/4ad1e988-a5bb-4fef-833c-7b0278934eee 2025-10-06 02:45:32,477 - INFO - Verified VN network id 14 for VN 54ce5c72-d235-4710-a4de-4f0909b155ad 2025-10-06 02:45:32,477 - INFO - Verifications in API Server for VN ctest-trans_right_vn-28747911 passed 2025-10-06 02:45:32,477 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/54ce5c72-d235-4710-a4de-4f0909b155ad 2025-10-06 02:45:32,486 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/4ad1e988-a5bb-4fef-833c-7b0278934eee 2025-10-06 02:45:32,492 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/4ad1e988-a5bb-4fef-833c-7b0278934eee 2025-10-06 02:45:32,499 - DEBUG - Requesting: http://10.0.0.33:8082/route-target/881b465d-551f-4180-a0ee-b74aade463a3 2025-10-06 02:45:32,510 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6110923392611075856', 'uuid-lslong': '11880019767285863853'}, 'enable': 'true', 'created': '2025-10-06T02:45:31', 'last-modified': '2025-10-06T02:45:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.363964'} 2025-10-06 02:45:32,515 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-06 02:45:32,519 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6110923392611075856', 'uuid-lslong': '11880019767285863853'}, 'enable': 'true', 'created': '2025-10-06T02:45:31', 'last-modified': '2025-10-06T02:45:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.369078'} 2025-10-06 02:45:32,523 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-06 02:45:32,528 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-61993685', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6110923392611075856', 'uuid-lslong': '11880019767285863853'}, 'enable': 'true', 'created': '2025-10-06T02:45:31', 'last-modified': '2025-10-06T02:45:32', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.386235'} 2025-10-06 02:45:32,534 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-06 02:45:32,534 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-28747911 passed 2025-10-06 02:45:32,534 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-28747911 in API_Server ====== 2025-10-06 02:45:32,534 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:45:32,539 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:45:32,549 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:45:32,638 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-network/54ce5c72-d235-4710-a4de-4f0909b155ad 2025-10-06 02:45:32,647 - DEBUG - =>VN ctest-trans_right_vn-28747911 has no policy to be verified 2025-10-06 02:45:32,648 - DEBUG - Verifying the vn in opserver 2025-10-06 02:45:32,648 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911 virtual network link through opserver 10.0.0.33 2025-10-06 02:45:32,648 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2025-10-06 02:45:32,658 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911?flat'} 2025-10-06 02:45:32,658 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911 virtual network link through opserver 10.0.0.38 2025-10-06 02:45:32,658 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-10-06 02:45:32,670 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911?flat'} 2025-10-06 02:45:32,670 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911 virtual network link through opserver 10.0.0.249 2025-10-06 02:45:32,670 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2025-10-06 02:45:32,682 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911?flat'} 2025-10-06 02:45:32,682 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_right_vn-28747911 is found in opserver 2025-10-06 02:45:32,699 - DEBUG - Do not have enough data to verify VN in agent 2025-10-06 02:45:32,707 - DEBUG - VRF ids for VN ctest-trans_right_vn-28747911: {} 2025-10-06 02:45:32,758 - DEBUG - Services list from nova: [, , , ] 2025-10-06 02:45:33,778 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4219-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4219-1) 2025-10-06 02:45:34,935 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4219-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4219-2) 2025-10-06 02:45:34,935 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-52363424'] 2025-10-06 02:45:35,220 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-52363424'] created succesfully 2025-10-06 02:45:36,676 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4219-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4219-1) 2025-10-06 02:45:36,677 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/0d709b85-ed72-4d0b-bc69-f39290c6cc93 2025-10-06 02:45:36,979 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/0d709b85-ed72-4d0b-bc69-f39290c6cc93 2025-10-06 02:45:37,005 - DEBUG - Response Code: 404 2025-10-06 02:45:39,006 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/0d709b85-ed72-4d0b-bc69-f39290c6cc93 2025-10-06 02:45:39,018 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/853b635a-5244-46f8-82b1-6a4581b1f5a3 2025-10-06 02:45:39,097 - INFO - Waiting for VM ctest-pt_svm0-53325056 to be up.. 2025-10-06 02:45:39,205 - DEBUG - VM is in ACTIVE state now 2025-10-06 02:45:39,205 - INFO - VM name : ctest-pt_svm0-53325056 2025-10-06 02:45:39,301 - DEBUG - VM ctest-pt_svm0-53325056 ID is 0d709b85-ed72-4d0b-bc69-f39290c6cc93 2025-10-06 02:45:39,344 - DEBUG - VM ctest-pt_svm0-53325056 launched on Node an-jenkins-deploy-platform-ansible-os-4219-1 2025-10-06 02:45:39,445 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/0d709b85-ed72-4d0b-bc69-f39290c6cc93 2025-10-06 02:45:39,454 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/853b635a-5244-46f8-82b1-6a4581b1f5a3 2025-10-06 02:45:42,633 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-10-06 02:45:42,633 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-53325056 failed! 2025-10-06 02:45:42,646 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is 196.169.135.1 and allocation pool is NOT set 2025-10-06 02:45:46,735 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-10-06 02:45:46,735 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-53325056 failed! 2025-10-06 02:45:46,749 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is 196.169.135.1 and allocation pool is NOT set 2025-10-06 02:45:50,826 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-06 02:45:50,826 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-53325056 failed! 2025-10-06 02:45:50,842 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is 196.169.135.1 and allocation pool is NOT set 2025-10-06 02:45:54,924 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-06 02:45:54,924 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-53325056 failed! 2025-10-06 02:45:54,940 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is 196.169.135.1 and allocation pool is NOT set 2025-10-06 02:45:59,023 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-06 02:45:59,023 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-53325056 failed! 2025-10-06 02:45:59,042 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is 196.169.135.1 and allocation pool is NOT set 2025-10-06 02:46:03,119 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-06 02:46:03,119 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-53325056 failed! 2025-10-06 02:46:03,134 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is 196.169.135.1 and allocation pool is NOT set 2025-10-06 02:46:07,215 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-06 02:46:07,215 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-53325056 failed! 2025-10-06 02:46:07,232 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is 196.169.135.1 and allocation pool is NOT set 2025-10-06 02:46:11,302 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-10-06 02:46:11,302 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-53325056 failed! 2025-10-06 02:46:11,316 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is 196.169.135.1 and allocation pool is NOT set 2025-10-06 02:46:15,407 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1021ms') 2025-10-06 02:46:15,407 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-53325056 failed! 2025-10-06 02:46:15,421 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is 196.169.135.1 and allocation pool is NOT set 2025-10-06 02:46:19,497 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-06 02:46:19,497 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-53325056 failed! 2025-10-06 02:46:19,515 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is 196.169.135.1 and allocation pool is NOT set 2025-10-06 02:46:21,580 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=5.86 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=0.487 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.487/3.172/5.857/2.685 ms') 2025-10-06 02:46:21,580 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-53325056 passed 2025-10-06 02:46:21,654 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-06 02:46:21,654 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-53325056, IP 196.169.135.3, Port 22 2025-10-06 02:46:21,718 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-06 02:46:21,843 - DEBUG - VM ctest-pt_svm0-53325056 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-06 02:46:26,844 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-06 02:46:26,844 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-53325056, IP 196.169.135.3, Port 22 2025-10-06 02:46:26,900 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-06 02:46:27,010 - DEBUG - VM ctest-pt_svm0-53325056 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-06 02:46:32,011 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-06 02:46:32,011 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-53325056, IP 196.169.135.3, Port 22 2025-10-06 02:46:32,079 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-06 02:46:32,160 - DEBUG - VM ctest-pt_svm0-53325056 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-06 02:46:37,161 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-06 02:46:37,162 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-53325056, IP 196.169.135.3, Port 22 2025-10-06 02:46:37,226 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-06 02:46:37,302 - DEBUG - VM ctest-pt_svm0-53325056 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-06 02:46:42,303 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-06 02:46:42,303 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-53325056, IP 196.169.135.3, Port 22 2025-10-06 02:46:42,468 - DEBUG - VM ctest-pt_svm0-53325056 is ready for SSH connections 2025-10-06 02:46:42,474 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSVCV2Mirror-61993685', 'ctest-si-85585653'] 2025-10-06 02:46:42,965 - INFO - Waiting for VM ctest-left_vm-57098605 to be up.. 2025-10-06 02:46:43,102 - DEBUG - VM is in ACTIVE state now 2025-10-06 02:46:43,103 - INFO - VM name : ctest-left_vm-57098605 2025-10-06 02:46:43,207 - DEBUG - VM ctest-left_vm-57098605 ID is 97647995-28d5-4447-ac43-4089dcc3612e 2025-10-06 02:46:43,208 - DEBUG - VM ctest-left_vm-57098605 launched on Node an-jenkins-deploy-platform-ansible-os-4219-1 2025-10-06 02:46:43,330 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/97647995-28d5-4447-ac43-4089dcc3612e 2025-10-06 02:46:43,341 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/f592b164-cb36-45f5-a542-5c66d4995381 2025-10-06 02:46:44,503 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=2.93 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=2.77 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.770/2.852/2.934/0.082 ms') 2025-10-06 02:46:44,503 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-57098605 passed 2025-10-06 02:46:44,579 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-06 02:46:44,580 - DEBUG - Waiting to SSH to VM ctest-left_vm-57098605, IP 89.207.12.195, Port 22 2025-10-06 02:46:44,744 - DEBUG - VM ctest-left_vm-57098605 is ready for SSH connections 2025-10-06 02:46:44,744 - INFO - Waiting for VM ctest-right_vm-58370801 to be up.. 2025-10-06 02:46:44,820 - DEBUG - VM is in ACTIVE state now 2025-10-06 02:46:44,820 - INFO - VM name : ctest-right_vm-58370801 2025-10-06 02:46:44,894 - DEBUG - VM ctest-right_vm-58370801 ID is c247d0e6-053b-4385-8244-4fe45af09765 2025-10-06 02:46:44,895 - DEBUG - VM ctest-right_vm-58370801 launched on Node an-jenkins-deploy-platform-ansible-os-4219-2 2025-10-06 02:46:44,965 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/c247d0e6-053b-4385-8244-4fe45af09765 2025-10-06 02:46:44,974 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/17377b42-1382-466a-a859-c4a4b888766c 2025-10-06 02:46:46,124 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.04 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.14 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.139/2.088/3.038/0.949 ms') 2025-10-06 02:46:46,125 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-right_vm-58370801 passed 2025-10-06 02:46:46,194 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-06 02:46:46,195 - DEBUG - Waiting to SSH to VM ctest-right_vm-58370801, IP 133.195.45.67, Port 22 2025-10-06 02:46:46,361 - DEBUG - VM ctest-right_vm-58370801 is ready for SSH connections 2025-10-06 02:46:46,370 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-61993685:ctest-si-85585653, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-06 02:46:46,692 - INFO - Attaching policy ctest-policy-30915868 to vn ctest-left-42980037 2025-10-06 02:46:47,048 - INFO - Attaching policy ctest-policy-30915868 to vn ctest-right-84727568 2025-10-06 02:46:47,365 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-52363424'] created succesfully 2025-10-06 02:46:47,562 - DEBUG - Service instance: ['default-domain', 'ctest-TestSVCV2Mirror-61993685', 'ctest-si-85585653'] created succesfully 2025-10-06 02:46:47,562 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:46:47,568 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:46:47,580 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:46:47,665 - DEBUG - Requesting: http://10.0.0.33:8082/service-instance/3624d17e-e35e-495d-903d-3c8987cf6c03 2025-10-06 02:46:47,674 - DEBUG - SI 'ctest-si-85585653' has service template ref to ctest-service_template_1-52363424 2025-10-06 02:46:47,675 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:46:47,681 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:46:47,691 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:46:47,784 - DEBUG - Requesting: http://10.0.0.33:8082/service-instance/3624d17e-e35e-495d-903d-3c8987cf6c03 2025-10-06 02:46:47,798 - DEBUG - Requesting: http://10.0.0.33:8082/port-tuple/14257531-22c1-44ae-9806-b50f34c9b51d 2025-10-06 02:46:47,805 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/853b635a-5244-46f8-82b1-6a4581b1f5a3 2025-10-06 02:46:47,996 - DEBUG - VM is in ACTIVE state now 2025-10-06 02:46:48,232 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/0d709b85-ed72-4d0b-bc69-f39290c6cc93 2025-10-06 02:46:48,249 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/853b635a-5244-46f8-82b1-6a4581b1f5a3 2025-10-06 02:46:48,264 - DEBUG - Requesting: http://10.0.0.249:8082/instance-ip/18d64dbd-6ea8-41ff-9ee6-2deda7227434 2025-10-06 02:46:48,275 - DEBUG - Requesting: http://10.0.0.249:8082/instance-ip/ab497fda-cff6-4a7a-8cb0-28692bfe9e19 2025-10-06 02:46:48,284 - DEBUG - Requesting: http://10.0.0.249:8082/instance-ip/f4ca64d7-c15e-49c8-955d-9ea67f038d3a 2025-10-06 02:46:48,449 - DEBUG - VM is in ACTIVE state now 2025-10-06 02:46:48,450 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine/0d709b85-ed72-4d0b-bc69-f39290c6cc93 2025-10-06 02:46:48,459 - DEBUG - Requesting: http://10.0.0.249:8082/virtual-machine-interface/853b635a-5244-46f8-82b1-6a4581b1f5a3 2025-10-06 02:46:49,602 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=3.20 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=1.84 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.843/2.519/3.195/0.676 ms') 2025-10-06 02:46:49,602 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-53325056 passed 2025-10-06 02:46:49,633 - DEBUG - VM ctest-pt_svm0-53325056 Tap interface: {'index': '4', 'name': 'tap853b635a-52', 'uuid': '853b635a-5244-46f8-82b1-6a4581b1f5a3', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803:ctest-trans_left_vn-04339803', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803', 'vm_uuid': '0d709b85-ed72-4d0b-bc69-f39290c6cc93', 'vm_name': 'ctest-pt_svm0-53325056', 'ip_addr': '196.169.135.3', 'mac_addr': '02:85:3b:63:5a:52', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-61993685:853b635a-5244-46f8-82b1-6a4581b1f5a3', 'sg_uuid_list': ['40259019-e4b2-4230-8444-bd90b8e264a2'], 'static_route_list': None, 'vm_project_uuid': '7c58c5ec-220a-4d16-96ae-e1d84b939fa9', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-06 02:46:49,633 - DEBUG - Agent 10.0.0.49 vrf name: default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803:ctest-trans_left_vn-04339803 2025-10-06 02:46:49,639 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803:ctest-trans_left_vn-04339803', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803', 'table_label': '-1', 'vxlan_id': '13', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.18:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-06 02:46:49,718 - DEBUG - VM ctest-pt_svm0-53325056 : Tap interface tap853b635a-52 is set to Active 2025-10-06 02:46:49,719 - DEBUG - Tap interface tap853b635a-52 detail : {'index': '4', 'name': 'tap853b635a-52', 'uuid': '853b635a-5244-46f8-82b1-6a4581b1f5a3', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803:ctest-trans_left_vn-04339803', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '13', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803', 'vm_uuid': '0d709b85-ed72-4d0b-bc69-f39290c6cc93', 'vm_name': 'ctest-pt_svm0-53325056', 'ip_addr': '196.169.135.3', 'mac_addr': '02:85:3b:63:5a:52', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-61993685:853b635a-5244-46f8-82b1-6a4581b1f5a3', 'sg_uuid_list': ['40259019-e4b2-4230-8444-bd90b8e264a2'], 'static_route_list': None, 'vm_project_uuid': '7c58c5ec-220a-4d16-96ae-e1d84b939fa9', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-06 02:46:49,825 - DEBUG - Starting Layer 2 verification in Agent 2025-10-06 02:46:49,836 - DEBUG - Layer 2 path is seen for VM MAC 02:85:3b:63:5a:52 in agent 10.0.0.49 2025-10-06 02:46:49,836 - DEBUG - Active layer 2 route in agent is present for VMI tap853b635a-52 2025-10-06 02:46:49,836 - DEBUG - L2 label(35) matches bw route table and interface table 2025-10-06 02:46:49,845 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is found in Agent of node 10.0.0.49 2025-10-06 02:46:49,970 - DEBUG - VRF IDs of VN default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 is consistent in agent 10.0.0.49 2025-10-06 02:46:49,970 - DEBUG - Route for VM IP ['196.169.135.3'] is consistent in agent 10.0.0.49 2025-10-06 02:46:49,970 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-61993685:ctest-trans_left_vn-04339803 verification for VM ctest-pt_svm0-53325056 in Agent 10.0.0.49 passed 2025-10-06 02:46:50,095 - DEBUG - Starting all layer 2 verification in agent 10.0.0.49 2025-10-06 02:46:50,106 - DEBUG - Route for VM MAC 02:85:3b:63:5a:52 is consistent in agent 10.0.0.49 2025-10-06 02:46:50,110 - INFO - VM ctest-pt_svm0-53325056 verifications in Compute nodes passed 2025-10-06 02:46:50,110 - DEBUG - The SVMs in the SI are : [] 2025-10-06 02:46:50,110 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/0d709b85-ed72-4d0b-bc69-f39290c6cc93 2025-10-06 02:46:50,119 - DEBUG - Service VM for SI 'ctest-si-85585653' is launched 2025-10-06 02:46:50,119 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:46:50,123 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:46:50,132 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:46:50,218 - DEBUG - Requesting: http://10.0.0.33:8082/service-instance/3624d17e-e35e-495d-903d-3c8987cf6c03 2025-10-06 02:46:50,225 - DEBUG - SI ctest-si-85585653 has Port Tuple: ['ctest-port_tuple-41447908'] 2025-10-06 02:46:50,285 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037 2025-10-06 02:46:50,352 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568 2025-10-06 02:46:50,352 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-06 02:46:50,352 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-06 02:46:50,352 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 133.195.45.67, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-10-06 02:46:50,352 - DEBUG - ping -s 56 -c 3 -W 1 133.195.45.67 2025-10-06 02:47:39,454 - DEBUG - PING 133.195.45.67 (133.195.45.67) 56(84) bytes of data. 64 bytes from 133.195.45.67: icmp_req=1 ttl=63 time=9.65 ms 64 bytes from 133.195.45.67: icmp_req=2 ttl=63 time=1.20 ms 64 bytes from 133.195.45.67: icmp_req=3 ttl=63 time=1.10 ms --- 133.195.45.67 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.104/3.987/9.652/4.006 ms 2025-10-06 02:47:39,454 - INFO - Ping to IP 133.195.45.67 from VM ctest-left_vm-57098605 passed 2025-10-06 02:47:39,461 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-61993685:ctest-si-85585653, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-61993685:ctest-left-42980037, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-61993685:ctest-right-84727568, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-61993685:ctest-si-85585653, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-06 02:47:39,524 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-06 02:47:39,524 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:47:39,530 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:47:39,541 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:47:39,639 - DEBUG - Requesting: http://10.0.0.33:8082/service-instance/3624d17e-e35e-495d-903d-3c8987cf6c03 2025-10-06 02:47:39,654 - DEBUG - Requesting: http://10.0.0.33:8082/port-tuple/14257531-22c1-44ae-9806-b50f34c9b51d 2025-10-06 02:47:39,660 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/853b635a-5244-46f8-82b1-6a4581b1f5a3 2025-10-06 02:47:39,832 - DEBUG - Executing command: rm -f /tmp/mirror-tap853b635a-52_ctest-random-00650660.pcap 2025-10-06 02:47:50,230 - INFO - Starting tcpdump to capture the mirrored packets. 2025-10-06 02:47:50,231 - DEBUG - Executing command: sudo tcpdump -ni tap853b635a-52 -U udp port 8099 -w /tmp/mirror-tap853b635a-52_ctest-random-00650660.pcap 2025-10-06 02:48:00,264 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 133.195.45.67, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123 2025-10-06 02:48:00,264 - DEBUG - ping -s 56 -c 3 -W 1 133.195.45.67 2025-10-06 02:48:02,721 - DEBUG - PING 133.195.45.67 (133.195.45.67) 56(84) bytes of data. 64 bytes from 133.195.45.67: icmp_req=1 ttl=63 time=2.75 ms 64 bytes from 133.195.45.67: icmp_req=2 ttl=63 time=1.00 ms 64 bytes from 133.195.45.67: icmp_req=3 ttl=63 time=0.997 ms --- 133.195.45.67 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 0.997/1.584/2.754/0.828 ms 2025-10-06 02:48:02,721 - INFO - Ping to IP 133.195.45.67 from VM ctest-left_vm-57098605 passed 2025-10-06 02:48:02,721 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:48:02,729 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:48:02,762 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:48:02,854 - DEBUG - Requesting: http://10.0.0.33:8082/service-instance/3624d17e-e35e-495d-903d-3c8987cf6c03 2025-10-06 02:48:02,863 - DEBUG - Requesting: http://10.0.0.33:8082/port-tuple/14257531-22c1-44ae-9806-b50f34c9b51d 2025-10-06 02:48:02,870 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/853b635a-5244-46f8-82b1-6a4581b1f5a3 2025-10-06 02:48:02,959 - DEBUG - Waiting for the tcpdump write to complete. 2025-10-06 02:48:04,960 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tap853b635a-52_ctest-random-00650660.pcap| awk '{print $2}') 2025-10-06 02:48:04,962 - DEBUG - Executing command: sync 2025-10-06 02:48:07,984 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap853b635a-52_ctest-random-00650660.pcap | wc -l 2025-10-06 02:48:07,997 - DEBUG - STDOUT: 12 2025-10-06 02:48:07,997 - DEBUG - STDERR: reading from file /tmp/mirror-tap853b635a-52_ctest-random-00650660.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-10-06 02:48:07,997 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tap853b635a-52_ctest-random-00650660.pcap 2025-10-06 02:48:08,041 - INFO - 12 ICMP packets are mirrored to the analyzer service VM 'ctest-pt_svm0-53325056' 2025-10-06 02:48:08,042 - INFO - Dettaching policy ctest-policy-30915868 from vn ctest-right-84727568 2025-10-06 02:48:08,225 - INFO - Dettaching policy ctest-policy-30915868 from vn ctest-left-42980037 2025-10-06 02:48:08,450 - INFO - Deleted policy ctest-policy-30915868 2025-10-06 02:48:08,450 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSVCV2Mirror-61993685', 'ctest-si-85585653'] 2025-10-06 02:48:08,545 - INFO - Deleted SI ['default-domain', 'ctest-TestSVCV2Mirror-61993685', 'ctest-si-85585653'] 2025-10-06 02:48:08,546 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:48:08,555 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:48:08,565 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:48:08,649 - DEBUG - Service instance ctest-si-85585653 removed from api server 2025-10-06 02:48:08,650 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/0d709b85-ed72-4d0b-bc69-f39290c6cc93 2025-10-06 02:48:08,660 - DEBUG - All Service VMs unlinked from SI ctest-si-85585653 2025-10-06 02:48:08,665 - DEBUG - 0 svc intances found in all projects. They are [] 2025-10-06 02:48:08,665 - DEBUG - 0 svc intances found in current project. They are [] 2025-10-06 02:48:08,717 - DEBUG - 0 svc intances found in all projects. They are [] 2025-10-06 02:48:08,717 - DEBUG - 0 svc intances found in current project. They are [] 2025-10-06 02:48:08,717 - INFO - Deleting VM ctest-pt_svm0-53325056 2025-10-06 02:48:08,830 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-52363424'] 2025-10-06 02:48:08,937 - INFO - Service template: ['default-domain', 'ctest-service_template_1-52363424'] deleted successfully. 2025-10-06 02:48:08,937 - INFO - Deleting VM ctest-right_vm-58370801 2025-10-06 02:48:09,034 - INFO - Deleting VM ctest-left_vm-57098605 2025-10-06 02:48:09,146 - INFO - Deleting VN ctest-trans_right_vn-28747911 2025-10-06 02:48:09,287 - DEBUG - Response for deleting network () 2025-10-06 02:48:09,287 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/4ad1e988-a5bb-4fef-833c-7b0278934eee 2025-10-06 02:48:09,297 - DEBUG - Response Code: 404 2025-10-06 02:48:09,297 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:48:09,306 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:48:09,320 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:48:09,411 - INFO - Validated that VN ctest-trans_right_vn-28747911 is not found in API Server 2025-10-06 02:48:09,423 - DEBUG - VN ctest-trans_right_vn-28747911 is not present in Agent 10.0.0.49 2025-10-06 02:48:09,434 - DEBUG - VN ctest-trans_right_vn-28747911 is not present in Agent 10.0.0.19 2025-10-06 02:48:09,434 - INFO - Validated that VN ctest-trans_right_vn-28747911 is not in any agent 2025-10-06 02:48:09,474 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-28747911 info 2025-10-06 02:48:09,475 - INFO - Deleting VN ctest-trans_left_vn-04339803 2025-10-06 02:48:09,529 - DEBUG - VN c3f7e2a4-c4aa-417c-8626-2f97b38a964b still in use: Unable to complete operation on network c3f7e2a4-c4aa-417c-8626-2f97b38a964b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-befad8a4-e204-4e9e-b196-a728f4852b9a'] 2025-10-06 02:48:09,529 - WARNING - Deleting VN ctest-trans_left_vn-04339803 failed..Will retry 2025-10-06 02:48:11,741 - DEBUG - Response for deleting network () 2025-10-06 02:48:11,741 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/7349ee72-f178-4c13-a1c8-ecb3080c5a6f 2025-10-06 02:48:11,753 - DEBUG - Response Code: 404 2025-10-06 02:48:11,753 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:48:11,759 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:48:11,810 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:48:11,901 - INFO - Validated that VN ctest-trans_left_vn-04339803 is not found in API Server 2025-10-06 02:48:11,909 - DEBUG - VN ctest-trans_left_vn-04339803 is not present in Agent 10.0.0.49 2025-10-06 02:48:11,917 - DEBUG - VN ctest-trans_left_vn-04339803 is not present in Agent 10.0.0.19 2025-10-06 02:48:11,917 - INFO - Validated that VN ctest-trans_left_vn-04339803 is not in any agent 2025-10-06 02:48:11,942 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-04339803 info 2025-10-06 02:48:11,942 - INFO - Deleting VN ctest-mgmt_vn-02162339 2025-10-06 02:48:12,105 - DEBUG - Response for deleting network () 2025-10-06 02:48:12,105 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/f7666a04-a9a0-48dc-95bc-fbf7d2dffe02 2025-10-06 02:48:12,113 - DEBUG - Response Code: 404 2025-10-06 02:48:12,113 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:48:12,119 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:48:12,132 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:48:12,229 - INFO - Validated that VN ctest-mgmt_vn-02162339 is not found in API Server 2025-10-06 02:48:12,238 - DEBUG - VN ctest-mgmt_vn-02162339 is not present in Agent 10.0.0.49 2025-10-06 02:48:12,248 - DEBUG - VN ctest-mgmt_vn-02162339 is not present in Agent 10.0.0.19 2025-10-06 02:48:12,248 - INFO - Validated that VN ctest-mgmt_vn-02162339 is not in any agent 2025-10-06 02:48:12,278 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-02162339 info 2025-10-06 02:48:12,278 - INFO - Deleting VN ctest-right-84727568 2025-10-06 02:48:12,516 - DEBUG - Response for deleting network () 2025-10-06 02:48:12,516 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/d35376db-c0c0-415f-906f-2b8de5cb896a 2025-10-06 02:48:12,521 - DEBUG - Response Code: 404 2025-10-06 02:48:12,521 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:48:12,527 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:48:12,537 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:48:12,640 - INFO - Validated that VN ctest-right-84727568 is not found in API Server 2025-10-06 02:48:12,651 - DEBUG - VN ctest-right-84727568 is not present in Agent 10.0.0.49 2025-10-06 02:48:12,662 - DEBUG - VN ctest-right-84727568 is not present in Agent 10.0.0.19 2025-10-06 02:48:12,662 - INFO - Validated that VN ctest-right-84727568 is not in any agent 2025-10-06 02:48:12,698 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-84727568 info 2025-10-06 02:48:12,698 - INFO - Deleting VN ctest-left-42980037 2025-10-06 02:48:12,901 - DEBUG - Response for deleting network () 2025-10-06 02:48:12,901 - DEBUG - Requesting: http://10.0.0.33:8082/routing-instance/77e784a2-718d-483d-832f-78aed20735b7 2025-10-06 02:48:12,906 - DEBUG - Response Code: 404 2025-10-06 02:48:12,906 - DEBUG - Requesting: http://10.0.0.33:8082/domains 2025-10-06 02:48:12,912 - DEBUG - Requesting: http://10.0.0.33:8082/domain/8177ca4a-5181-4745-ae27-f33c0972392c 2025-10-06 02:48:12,966 - DEBUG - Requesting: http://10.0.0.33:8082/project/7c58c5ec-220a-4d16-96ae-e1d84b939fa9 2025-10-06 02:48:13,059 - INFO - Validated that VN ctest-left-42980037 is not found in API Server 2025-10-06 02:48:13,069 - DEBUG - VN ctest-left-42980037 is not present in Agent 10.0.0.49 2025-10-06 02:48:13,078 - DEBUG - VN ctest-left-42980037 is not present in Agent 10.0.0.19 2025-10-06 02:48:13,078 - INFO - Validated that VN ctest-left-42980037 is not in any agent 2025-10-06 02:48:13,121 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-42980037 info 2025-10-06 02:48:14,393 - DEBUG - No XMPP flaps were noticed during the test 2025-10-06 02:48:14,393 - INFO -

2025-10-06 02:48:14,393 - INFO - END TEST : test_svc_v2_mirroring : PASSED[0:02:50]

2025-10-06 02:48:14,393 - INFO - -------------------------------------------------------------------------------- 2025-10-06 02:48:15,139 - INFO - Deleted project: ctest-TestSVCV2Mirror-61993685, ID : 7c58c5ec-220a-4d16-96ae-e1d84b939fa9