2025-10-13 03:07:12,818 - INFO - Domain Default found not creating 2025-10-13 03:07:12,969 - INFO - Project ctest-TestSVCV2Mirror-19665451 not found, creating it 2025-10-13 03:07:13,475 - INFO - Created Project:ctest-TestSVCV2Mirror-19665451, ID : 2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:07:14,910 - INFO - ================================================================================ 2025-10-13 03:07:14,910 - INFO - STARTING TEST : test_svc_v2_mirroring 2025-10-13 03:07:14,910 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2025-10-13 03:07:16,183 - DEBUG - Nothing to compare xmpp stats {'10.0.0.249': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.27': {'10.20.0.18': '0', '10.20.0.129': '0'}} with 2025-10-13 03:07:16,183 - INFO - Initial checks done. Running the testcase now 2025-10-13 03:07:16,183 - INFO - 2025-10-13 03:07:16,828 - DEBUG - Response for create_network : {'network': {'id': '719ed6be-ff9e-4466-a568-fa9e9e1dcb46', 'name': 'ctest-left-85139265', 'tenant_id': '2c0c3edad42a49d5b8d744459ce1f511', 'project_id': '2c0c3edad42a49d5b8d744459ce1f511', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-19665451', 'ctest-left-85139265'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:07:17,062 - DEBUG - Response for create_subnet : {'subnet': {'id': '0dd2b563-f378-417e-853e-a697e6262cd7', 'name': '', 'tenant_id': '2c0c3edad42a49d5b8d744459ce1f511', 'network_id': '719ed6be-ff9e-4466-a568-fa9e9e1dcb46', 'ip_version': 4, 'cidr': '178.209.236.64/26', 'allocation_pools': [{'start': '178.209.236.66', 'end': '178.209.236.126'}], 'gateway_ip': '178.209.236.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '178.209.236.66', 'tags': [], 'project_id': '2c0c3edad42a49d5b8d744459ce1f511'}} 2025-10-13 03:07:17,084 - INFO - Created VN ctest-left-85139265 2025-10-13 03:07:17,097 - DEBUG - VN ctest-left-85139265 UUID is 719ed6be-ff9e-4466-a568-fa9e9e1dcb46 2025-10-13 03:07:17,174 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:17,487 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:17,519 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:17,536 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:07:17,639 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/719ed6be-ff9e-4466-a568-fa9e9e1dcb46 2025-10-13 03:07:17,651 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/719ed6be-ff9e-4466-a568-fa9e9e1dcb46 2025-10-13 03:07:17,660 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/714720df-a5ff-44ac-9ef1-7475104a2c71 2025-10-13 03:07:17,668 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/714720df-a5ff-44ac-9ef1-7475104a2c71 2025-10-13 03:07:17,676 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/11ebe107-2656-4bbd-8ae3-25be9ddaa990 2025-10-13 03:07:17,683 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-13 03:07:17,683 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/719ed6be-ff9e-4466-a568-fa9e9e1dcb46 2025-10-13 03:07:17,692 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/714720df-a5ff-44ac-9ef1-7475104a2c71 2025-10-13 03:07:17,716 - INFO - Verified VN network id 13 for VN 719ed6be-ff9e-4466-a568-fa9e9e1dcb46 2025-10-13 03:07:17,716 - INFO - Verifications in API Server for VN ctest-left-85139265 passed 2025-10-13 03:07:17,716 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/719ed6be-ff9e-4466-a568-fa9e9e1dcb46 2025-10-13 03:07:17,727 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/714720df-a5ff-44ac-9ef1-7475104a2c71 2025-10-13 03:07:17,735 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/714720df-a5ff-44ac-9ef1-7475104a2c71 2025-10-13 03:07:17,743 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/11ebe107-2656-4bbd-8ae3-25be9ddaa990 2025-10-13 03:07:17,756 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8187217288426832998', 'uuid-lslong': '11919051973000547142'}, 'enable': 'true', 'created': '2025-10-13T03:07:16', 'last-modified': '2025-10-13T03:07:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.743707'} 2025-10-13 03:07:17,761 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-13 03:07:17,767 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8187217288426832998', 'uuid-lslong': '11919051973000547142'}, 'enable': 'true', 'created': '2025-10-13T03:07:16', 'last-modified': '2025-10-13T03:07:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.755145'} 2025-10-13 03:07:17,772 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-13 03:07:17,777 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '8187217288426832998', 'uuid-lslong': '11919051973000547142'}, 'enable': 'true', 'created': '2025-10-13T03:07:16', 'last-modified': '2025-10-13T03:07:16', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.762130'} 2025-10-13 03:07:17,783 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-13 03:07:17,784 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-85139265 passed 2025-10-13 03:07:17,784 - DEBUG - ====Verifying policy data for ctest-left-85139265 in API_Server ====== 2025-10-13 03:07:17,784 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:17,791 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:17,802 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:07:17,881 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/719ed6be-ff9e-4466-a568-fa9e9e1dcb46 2025-10-13 03:07:17,893 - DEBUG - =>VN ctest-left-85139265 has no policy to be verified 2025-10-13 03:07:17,893 - DEBUG - Verifying the vn in opserver 2025-10-13 03:07:17,893 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265 virtual network link through opserver 10.0.0.22 2025-10-13 03:07:17,893 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:07:18,192 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:07:18,260 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265?flat'} 2025-10-13 03:07:18,261 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265 virtual network link through opserver 10.0.0.19 2025-10-13 03:07:18,261 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:07:18,550 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:07:18,605 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265?flat'} 2025-10-13 03:07:18,605 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265 virtual network link through opserver 10.0.0.41 2025-10-13 03:07:18,605 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:07:18,898 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:07:18,960 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265?flat'} 2025-10-13 03:07:18,960 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265 is found in opserver 2025-10-13 03:07:18,981 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:07:18,993 - DEBUG - VRF ids for VN ctest-left-85139265: {} 2025-10-13 03:07:19,229 - DEBUG - Response for create_network : {'network': {'id': '291c2d67-0a30-425e-ad01-4163b306e8ac', 'name': 'ctest-right-50731278', 'tenant_id': '2c0c3edad42a49d5b8d744459ce1f511', 'project_id': '2c0c3edad42a49d5b8d744459ce1f511', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-19665451', 'ctest-right-50731278'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:07:19,439 - DEBUG - Response for create_subnet : {'subnet': {'id': '03ee2a32-4bcc-4f21-b846-fca690c11e52', 'name': '', 'tenant_id': '2c0c3edad42a49d5b8d744459ce1f511', 'network_id': '291c2d67-0a30-425e-ad01-4163b306e8ac', 'ip_version': 4, 'cidr': '100.133.49.64/26', 'allocation_pools': [{'start': '100.133.49.66', 'end': '100.133.49.126'}], 'gateway_ip': '100.133.49.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '100.133.49.66', 'tags': [], 'project_id': '2c0c3edad42a49d5b8d744459ce1f511'}} 2025-10-13 03:07:19,463 - INFO - Created VN ctest-right-50731278 2025-10-13 03:07:19,474 - DEBUG - VN ctest-right-50731278 UUID is 291c2d67-0a30-425e-ad01-4163b306e8ac 2025-10-13 03:07:19,546 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:19,552 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:19,562 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:07:19,655 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/291c2d67-0a30-425e-ad01-4163b306e8ac 2025-10-13 03:07:19,665 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/291c2d67-0a30-425e-ad01-4163b306e8ac 2025-10-13 03:07:19,674 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/4bbf3f59-9ad8-4273-bff1-fa9670792182 2025-10-13 03:07:19,683 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/4bbf3f59-9ad8-4273-bff1-fa9670792182 2025-10-13 03:07:19,689 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/d9b06ce3-3bb3-4360-933e-ac1795da8a13 2025-10-13 03:07:19,695 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-13 03:07:19,695 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/291c2d67-0a30-425e-ad01-4163b306e8ac 2025-10-13 03:07:19,703 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/4bbf3f59-9ad8-4273-bff1-fa9670792182 2025-10-13 03:07:19,717 - INFO - Verified VN network id 14 for VN 291c2d67-0a30-425e-ad01-4163b306e8ac 2025-10-13 03:07:19,717 - INFO - Verifications in API Server for VN ctest-right-50731278 passed 2025-10-13 03:07:19,717 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/291c2d67-0a30-425e-ad01-4163b306e8ac 2025-10-13 03:07:19,726 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/4bbf3f59-9ad8-4273-bff1-fa9670792182 2025-10-13 03:07:19,732 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/4bbf3f59-9ad8-4273-bff1-fa9670792182 2025-10-13 03:07:19,741 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/d9b06ce3-3bb3-4360-933e-ac1795da8a13 2025-10-13 03:07:19,752 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2962292575478760030', 'uuid-lslong': '12466317139999385772'}, 'enable': 'true', 'created': '2025-10-13T03:07:19', 'last-modified': '2025-10-13T03:07:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.359352'} 2025-10-13 03:07:19,757 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-13 03:07:19,762 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2962292575478760030', 'uuid-lslong': '12466317139999385772'}, 'enable': 'true', 'created': '2025-10-13T03:07:19', 'last-modified': '2025-10-13T03:07:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.374477'} 2025-10-13 03:07:19,767 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-13 03:07:19,772 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '2962292575478760030', 'uuid-lslong': '12466317139999385772'}, 'enable': 'true', 'created': '2025-10-13T03:07:19', 'last-modified': '2025-10-13T03:07:19', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.386166'} 2025-10-13 03:07:19,778 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-10-13 03:07:19,778 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-50731278 passed 2025-10-13 03:07:19,778 - DEBUG - ====Verifying policy data for ctest-right-50731278 in API_Server ====== 2025-10-13 03:07:19,778 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:19,783 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:19,793 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:07:19,880 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/291c2d67-0a30-425e-ad01-4163b306e8ac 2025-10-13 03:07:19,891 - DEBUG - =>VN ctest-right-50731278 has no policy to be verified 2025-10-13 03:07:19,891 - DEBUG - Verifying the vn in opserver 2025-10-13 03:07:19,891 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278 virtual network link through opserver 10.0.0.22 2025-10-13 03:07:19,891 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:07:19,948 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278?flat'} 2025-10-13 03:07:19,948 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278 virtual network link through opserver 10.0.0.19 2025-10-13 03:07:19,948 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:07:20,001 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278?flat'} 2025-10-13 03:07:20,001 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278 virtual network link through opserver 10.0.0.41 2025-10-13 03:07:20,001 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:07:20,054 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278?flat'} 2025-10-13 03:07:20,054 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278 is found in opserver 2025-10-13 03:07:20,075 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:07:20,086 - DEBUG - VRF ids for VN ctest-right-50731278: {} 2025-10-13 03:07:20,355 - DEBUG - Response for create_network : {'network': {'id': '699100d7-a45c-4121-8ae5-9f341a240aa3', 'name': 'ctest-mgmt_vn-57657866', 'tenant_id': '2c0c3edad42a49d5b8d744459ce1f511', 'project_id': '2c0c3edad42a49d5b8d744459ce1f511', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-19665451', 'ctest-mgmt_vn-57657866'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:07:20,581 - DEBUG - Response for create_subnet : {'subnet': {'id': '2576e26d-eafe-4930-81dd-3c9cf5ddf500', 'name': '', 'tenant_id': '2c0c3edad42a49d5b8d744459ce1f511', 'network_id': '699100d7-a45c-4121-8ae5-9f341a240aa3', 'ip_version': 4, 'cidr': '15.43.162.192/26', 'allocation_pools': [{'start': '15.43.162.194', 'end': '15.43.162.254'}], 'gateway_ip': '15.43.162.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '15.43.162.194', 'tags': [], 'project_id': '2c0c3edad42a49d5b8d744459ce1f511'}} 2025-10-13 03:07:20,603 - INFO - Created VN ctest-mgmt_vn-57657866 2025-10-13 03:07:20,617 - DEBUG - VN ctest-mgmt_vn-57657866 UUID is 699100d7-a45c-4121-8ae5-9f341a240aa3 2025-10-13 03:07:20,685 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:20,691 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:20,702 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:07:20,785 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/699100d7-a45c-4121-8ae5-9f341a240aa3 2025-10-13 03:07:20,798 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/699100d7-a45c-4121-8ae5-9f341a240aa3 2025-10-13 03:07:20,806 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/82aa3c52-f110-4183-a7a6-202bfad328b7 2025-10-13 03:07:20,813 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/82aa3c52-f110-4183-a7a6-202bfad328b7 2025-10-13 03:07:20,819 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/24e51162-d013-4990-9bd4-1ac4b16f8571 2025-10-13 03:07:20,824 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-13 03:07:20,824 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/699100d7-a45c-4121-8ae5-9f341a240aa3 2025-10-13 03:07:20,832 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/82aa3c52-f110-4183-a7a6-202bfad328b7 2025-10-13 03:07:20,845 - INFO - Verified VN network id 15 for VN 699100d7-a45c-4121-8ae5-9f341a240aa3 2025-10-13 03:07:20,845 - INFO - Verifications in API Server for VN ctest-mgmt_vn-57657866 passed 2025-10-13 03:07:20,845 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/699100d7-a45c-4121-8ae5-9f341a240aa3 2025-10-13 03:07:20,855 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/82aa3c52-f110-4183-a7a6-202bfad328b7 2025-10-13 03:07:20,863 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/82aa3c52-f110-4183-a7a6-202bfad328b7 2025-10-13 03:07:20,870 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/24e51162-d013-4990-9bd4-1ac4b16f8571 2025-10-13 03:07:20,882 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7606862171780956449', 'uuid-lslong': '10008580793026480803'}, 'enable': 'true', 'created': '2025-10-13T03:07:20', 'last-modified': '2025-10-13T03:07:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.364589'} 2025-10-13 03:07:20,887 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-13 03:07:20,893 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7606862171780956449', 'uuid-lslong': '10008580793026480803'}, 'enable': 'true', 'created': '2025-10-13T03:07:20', 'last-modified': '2025-10-13T03:07:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.381556'} 2025-10-13 03:07:20,898 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-13 03:07:20,905 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '7606862171780956449', 'uuid-lslong': '10008580793026480803'}, 'enable': 'true', 'created': '2025-10-13T03:07:20', 'last-modified': '2025-10-13T03:07:20', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.387551'} 2025-10-13 03:07:20,910 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-13 03:07:20,910 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-57657866 passed 2025-10-13 03:07:20,910 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-57657866 in API_Server ====== 2025-10-13 03:07:20,910 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:20,916 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:20,929 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:07:21,018 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/699100d7-a45c-4121-8ae5-9f341a240aa3 2025-10-13 03:07:21,027 - DEBUG - =>VN ctest-mgmt_vn-57657866 has no policy to be verified 2025-10-13 03:07:21,027 - DEBUG - Verifying the vn in opserver 2025-10-13 03:07:21,027 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866 virtual network link through opserver 10.0.0.22 2025-10-13 03:07:21,027 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:07:21,076 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866?flat'} 2025-10-13 03:07:21,076 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866 virtual network link through opserver 10.0.0.19 2025-10-13 03:07:21,076 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:07:21,130 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866?flat'} 2025-10-13 03:07:21,130 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866 virtual network link through opserver 10.0.0.41 2025-10-13 03:07:21,130 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:07:21,188 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866?flat'} 2025-10-13 03:07:21,188 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-19665451:ctest-mgmt_vn-57657866 is found in opserver 2025-10-13 03:07:21,206 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:07:21,214 - DEBUG - VRF ids for VN ctest-mgmt_vn-57657866: {} 2025-10-13 03:07:21,470 - DEBUG - Response for create_network : {'network': {'id': '2f115278-6492-4c33-88f8-ff5143bd57d6', 'name': 'ctest-trans_left_vn-84621152', 'tenant_id': '2c0c3edad42a49d5b8d744459ce1f511', 'project_id': '2c0c3edad42a49d5b8d744459ce1f511', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-19665451', 'ctest-trans_left_vn-84621152'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:07:21,686 - DEBUG - Response for create_subnet : {'subnet': {'id': '01390e0b-afa9-4a1f-ae94-ab663ab50723', 'name': '', 'tenant_id': '2c0c3edad42a49d5b8d744459ce1f511', 'network_id': '2f115278-6492-4c33-88f8-ff5143bd57d6', 'ip_version': 4, 'cidr': '11.75.121.64/26', 'allocation_pools': [{'start': '11.75.121.66', 'end': '11.75.121.126'}], 'gateway_ip': '11.75.121.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '11.75.121.66', 'tags': [], 'project_id': '2c0c3edad42a49d5b8d744459ce1f511'}} 2025-10-13 03:07:21,709 - INFO - Created VN ctest-trans_left_vn-84621152 2025-10-13 03:07:21,719 - DEBUG - VN ctest-trans_left_vn-84621152 UUID is 2f115278-6492-4c33-88f8-ff5143bd57d6 2025-10-13 03:07:21,800 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:21,806 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:21,816 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:07:21,904 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/2f115278-6492-4c33-88f8-ff5143bd57d6 2025-10-13 03:07:21,915 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/2f115278-6492-4c33-88f8-ff5143bd57d6 2025-10-13 03:07:21,923 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/e16a7c04-ea5c-413f-ae1c-1930c3237ef9 2025-10-13 03:07:21,929 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/e16a7c04-ea5c-413f-ae1c-1930c3237ef9 2025-10-13 03:07:21,935 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/3655d37a-20e1-45b3-a80f-0f9d43bf2e70 2025-10-13 03:07:21,940 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-13 03:07:21,940 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/2f115278-6492-4c33-88f8-ff5143bd57d6 2025-10-13 03:07:21,951 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/e16a7c04-ea5c-413f-ae1c-1930c3237ef9 2025-10-13 03:07:21,964 - INFO - Verified VN network id 16 for VN 2f115278-6492-4c33-88f8-ff5143bd57d6 2025-10-13 03:07:21,964 - INFO - Verifications in API Server for VN ctest-trans_left_vn-84621152 passed 2025-10-13 03:07:21,964 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/2f115278-6492-4c33-88f8-ff5143bd57d6 2025-10-13 03:07:21,973 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/e16a7c04-ea5c-413f-ae1c-1930c3237ef9 2025-10-13 03:07:21,979 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/e16a7c04-ea5c-413f-ae1c-1930c3237ef9 2025-10-13 03:07:21,984 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/3655d37a-20e1-45b3-a80f-0f9d43bf2e70 2025-10-13 03:07:21,995 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3391582671423556659', 'uuid-lslong': '9869919307876358102'}, 'enable': 'true', 'created': '2025-10-13T03:07:21', 'last-modified': '2025-10-13T03:07:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.336888'} 2025-10-13 03:07:22,001 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-13 03:07:22,007 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3391582671423556659', 'uuid-lslong': '9869919307876358102'}, 'enable': 'true', 'created': '2025-10-13T03:07:21', 'last-modified': '2025-10-13T03:07:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.366524'} 2025-10-13 03:07:22,012 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-13 03:07:22,017 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '3391582671423556659', 'uuid-lslong': '9869919307876358102'}, 'enable': 'true', 'created': '2025-10-13T03:07:21', 'last-modified': '2025-10-13T03:07:21', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.376664'} 2025-10-13 03:07:22,023 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-13 03:07:22,023 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-84621152 passed 2025-10-13 03:07:22,023 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-84621152 in API_Server ====== 2025-10-13 03:07:22,023 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:22,029 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:22,039 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:07:22,136 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/2f115278-6492-4c33-88f8-ff5143bd57d6 2025-10-13 03:07:22,147 - DEBUG - =>VN ctest-trans_left_vn-84621152 has no policy to be verified 2025-10-13 03:07:22,147 - DEBUG - Verifying the vn in opserver 2025-10-13 03:07:22,147 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 virtual network link through opserver 10.0.0.22 2025-10-13 03:07:22,147 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:07:22,158 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152?flat'} 2025-10-13 03:07:22,158 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 virtual network link through opserver 10.0.0.19 2025-10-13 03:07:22,158 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:07:22,169 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152?flat'} 2025-10-13 03:07:22,170 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 virtual network link through opserver 10.0.0.41 2025-10-13 03:07:22,170 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:07:22,181 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152?flat'} 2025-10-13 03:07:22,181 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is found in opserver 2025-10-13 03:07:22,201 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:07:22,210 - DEBUG - VRF ids for VN ctest-trans_left_vn-84621152: {} 2025-10-13 03:07:22,472 - DEBUG - Response for create_network : {'network': {'id': '9d88b2bd-4dc0-4aa9-b46d-0834899732ce', 'name': 'ctest-trans_right_vn-13525380', 'tenant_id': '2c0c3edad42a49d5b8d744459ce1f511', 'project_id': '2c0c3edad42a49d5b8d744459ce1f511', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-19665451', 'ctest-trans_right_vn-13525380'], 'port_security_enabled': True, 'description': ''}} 2025-10-13 03:07:22,736 - DEBUG - Response for create_subnet : {'subnet': {'id': '10df15df-7f58-4c54-90fd-463282a88239', 'name': '', 'tenant_id': '2c0c3edad42a49d5b8d744459ce1f511', 'network_id': '9d88b2bd-4dc0-4aa9-b46d-0834899732ce', 'ip_version': 4, 'cidr': '129.148.121.0/26', 'allocation_pools': [{'start': '129.148.121.2', 'end': '129.148.121.62'}], 'gateway_ip': '129.148.121.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '129.148.121.2', 'tags': [], 'project_id': '2c0c3edad42a49d5b8d744459ce1f511'}} 2025-10-13 03:07:22,756 - INFO - Created VN ctest-trans_right_vn-13525380 2025-10-13 03:07:22,768 - DEBUG - VN ctest-trans_right_vn-13525380 UUID is 9d88b2bd-4dc0-4aa9-b46d-0834899732ce 2025-10-13 03:07:22,839 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:22,845 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:22,854 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:07:22,937 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/9d88b2bd-4dc0-4aa9-b46d-0834899732ce 2025-10-13 03:07:22,950 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/9d88b2bd-4dc0-4aa9-b46d-0834899732ce 2025-10-13 03:07:22,958 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b339ac11-9e09-4e17-b002-527bc0fab545 2025-10-13 03:07:22,967 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b339ac11-9e09-4e17-b002-527bc0fab545 2025-10-13 03:07:22,973 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/3c6f1599-4855-44a9-9b87-9dab00a32d2e 2025-10-13 03:07:22,979 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-13 03:07:22,979 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/9d88b2bd-4dc0-4aa9-b46d-0834899732ce 2025-10-13 03:07:22,988 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b339ac11-9e09-4e17-b002-527bc0fab545 2025-10-13 03:07:23,004 - INFO - Verified VN network id 17 for VN 9d88b2bd-4dc0-4aa9-b46d-0834899732ce 2025-10-13 03:07:23,004 - INFO - Verifications in API Server for VN ctest-trans_right_vn-13525380 passed 2025-10-13 03:07:23,004 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/9d88b2bd-4dc0-4aa9-b46d-0834899732ce 2025-10-13 03:07:23,016 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b339ac11-9e09-4e17-b002-527bc0fab545 2025-10-13 03:07:23,031 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b339ac11-9e09-4e17-b002-527bc0fab545 2025-10-13 03:07:23,038 - DEBUG - Requesting: http://10.0.0.22:8082/route-target/3c6f1599-4855-44a9-9b87-9dab00a32d2e 2025-10-13 03:07:23,051 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11351519386910345897', 'uuid-lslong': '13001056721028199118'}, 'enable': 'true', 'created': '2025-10-13T03:07:22', 'last-modified': '2025-10-13T03:07:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.378313'} 2025-10-13 03:07:23,057 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-13 03:07:23,061 - DEBUG - Control-node 10.0.0.19 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11351519386910345897', 'uuid-lslong': '13001056721028199118'}, 'enable': 'true', 'created': '2025-10-13T03:07:22', 'last-modified': '2025-10-13T03:07:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.384153'} 2025-10-13 03:07:23,068 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-13 03:07:23,076 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-19665451', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11351519386910345897', 'uuid-lslong': '13001056721028199118'}, 'enable': 'true', 'created': '2025-10-13T03:07:22', 'last-modified': '2025-10-13T03:07:22', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.403112'} 2025-10-13 03:07:23,083 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-13 03:07:23,083 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-13525380 passed 2025-10-13 03:07:23,083 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-13525380 in API_Server ====== 2025-10-13 03:07:23,083 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:07:23,089 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:07:23,100 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:07:23,191 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-network/9d88b2bd-4dc0-4aa9-b46d-0834899732ce 2025-10-13 03:07:23,200 - DEBUG - =>VN ctest-trans_right_vn-13525380 has no policy to be verified 2025-10-13 03:07:23,200 - DEBUG - Verifying the vn in opserver 2025-10-13 03:07:23,200 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380 virtual network link through opserver 10.0.0.22 2025-10-13 03:07:23,200 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-10-13 03:07:23,212 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380?flat'} 2025-10-13 03:07:23,212 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380 virtual network link through opserver 10.0.0.19 2025-10-13 03:07:23,212 - DEBUG - Requesting: http://10.0.0.19:8081/analytics/uves/virtual-networks 2025-10-13 03:07:23,225 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380', 'href': 'http://10.0.0.19:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380?flat'} 2025-10-13 03:07:23,225 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380 virtual network link through opserver 10.0.0.41 2025-10-13 03:07:23,225 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-10-13 03:07:23,238 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380?flat'} 2025-10-13 03:07:23,238 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_right_vn-13525380 is found in opserver 2025-10-13 03:07:23,260 - DEBUG - Do not have enough data to verify VN in agent 2025-10-13 03:07:23,269 - DEBUG - VRF ids for VN ctest-trans_right_vn-13525380: {} 2025-10-13 03:07:23,324 - DEBUG - Services list from nova: [, , , ] 2025-10-13 03:07:24,348 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4296-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4296-1) 2025-10-13 03:07:25,633 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4296-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4296-2) 2025-10-13 03:07:25,634 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-72125971'] 2025-10-13 03:07:25,929 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-72125971'] created succesfully 2025-10-13 03:07:27,396 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4296-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4296-1) 2025-10-13 03:07:27,397 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/627bb881-61b4-4e77-b478-8a3f5e259383 2025-10-13 03:07:27,714 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/627bb881-61b4-4e77-b478-8a3f5e259383 2025-10-13 03:07:27,742 - DEBUG - Response Code: 404 2025-10-13 03:07:29,743 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/627bb881-61b4-4e77-b478-8a3f5e259383 2025-10-13 03:07:29,752 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/eaafc4a4-c179-422f-a117-22b3b692462d 2025-10-13 03:07:29,828 - INFO - Waiting for VM ctest-pt_svm0-43859799 to be up.. 2025-10-13 03:07:29,910 - DEBUG - VM is in ACTIVE state now 2025-10-13 03:07:29,910 - INFO - VM name : ctest-pt_svm0-43859799 2025-10-13 03:07:29,994 - DEBUG - VM ctest-pt_svm0-43859799 ID is 627bb881-61b4-4e77-b478-8a3f5e259383 2025-10-13 03:07:30,024 - DEBUG - VM ctest-pt_svm0-43859799 launched on Node an-jenkins-deploy-platform-ansible-os-4296-1 2025-10-13 03:07:30,114 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/627bb881-61b4-4e77-b478-8a3f5e259383 2025-10-13 03:07:30,122 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/eaafc4a4-c179-422f-a117-22b3b692462d 2025-10-13 03:07:33,274 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-10-13 03:07:33,274 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-43859799 failed! 2025-10-13 03:07:33,288 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is 11.75.121.65 and allocation pool is NOT set 2025-10-13 03:07:37,373 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-10-13 03:07:37,373 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-43859799 failed! 2025-10-13 03:07:37,385 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is 11.75.121.65 and allocation pool is NOT set 2025-10-13 03:07:41,468 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-10-13 03:07:41,469 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-43859799 failed! 2025-10-13 03:07:41,485 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is 11.75.121.65 and allocation pool is NOT set 2025-10-13 03:07:45,571 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-10-13 03:07:45,571 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-43859799 failed! 2025-10-13 03:07:45,585 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is 11.75.121.65 and allocation pool is NOT set 2025-10-13 03:07:49,660 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-13 03:07:49,660 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-43859799 failed! 2025-10-13 03:07:49,677 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is 11.75.121.65 and allocation pool is NOT set 2025-10-13 03:07:53,753 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1020ms') 2025-10-13 03:07:53,753 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-43859799 failed! 2025-10-13 03:07:53,773 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is 11.75.121.65 and allocation pool is NOT set 2025-10-13 03:07:57,858 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms') 2025-10-13 03:07:57,858 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-43859799 failed! 2025-10-13 03:07:57,873 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is 11.75.121.65 and allocation pool is NOT set 2025-10-13 03:08:01,949 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-10-13 03:08:01,949 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-43859799 failed! 2025-10-13 03:08:01,964 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is 11.75.121.65 and allocation pool is NOT set 2025-10-13 03:08:06,050 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms') 2025-10-13 03:08:06,050 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-43859799 failed! 2025-10-13 03:08:06,065 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is 11.75.121.65 and allocation pool is NOT set 2025-10-13 03:08:10,146 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-13 03:08:10,146 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-43859799 failed! 2025-10-13 03:08:10,161 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is 11.75.121.65 and allocation pool is NOT set 2025-10-13 03:08:14,234 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=12.7 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1010ms\r\nrtt min/avg/max/mdev = 12.742/12.742/12.742/0.000 ms') 2025-10-13 03:08:14,234 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-43859799 passed 2025-10-13 03:08:14,305 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-13 03:08:14,305 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-43859799, IP 11.75.121.67, Port 22 2025-10-13 03:08:14,374 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-13 03:08:14,455 - DEBUG - VM ctest-pt_svm0-43859799 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-13 03:08:19,456 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-13 03:08:19,456 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-43859799, IP 11.75.121.67, Port 22 2025-10-13 03:08:19,522 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-13 03:08:19,605 - DEBUG - VM ctest-pt_svm0-43859799 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-13 03:08:24,605 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-13 03:08:24,606 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-43859799, IP 11.75.121.67, Port 22 2025-10-13 03:08:24,674 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-13 03:08:24,753 - DEBUG - VM ctest-pt_svm0-43859799 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-13 03:08:29,754 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-13 03:08:29,754 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-43859799, IP 11.75.121.67, Port 22 2025-10-13 03:08:29,821 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-13 03:08:29,905 - DEBUG - VM ctest-pt_svm0-43859799 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-13 03:08:34,906 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-13 03:08:34,906 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-43859799, IP 11.75.121.67, Port 22 2025-10-13 03:08:35,063 - DEBUG - VM ctest-pt_svm0-43859799 is ready for SSH connections 2025-10-13 03:08:35,070 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSVCV2Mirror-19665451', 'ctest-si-78330120'] 2025-10-13 03:08:35,576 - INFO - Waiting for VM ctest-left_vm-43348307 to be up.. 2025-10-13 03:08:35,702 - DEBUG - VM is in ACTIVE state now 2025-10-13 03:08:35,703 - INFO - VM name : ctest-left_vm-43348307 2025-10-13 03:08:35,820 - DEBUG - VM ctest-left_vm-43348307 ID is a0fa3788-ad72-4595-a9fd-2d586d9932dd 2025-10-13 03:08:35,821 - DEBUG - VM ctest-left_vm-43348307 launched on Node an-jenkins-deploy-platform-ansible-os-4296-1 2025-10-13 03:08:35,915 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/a0fa3788-ad72-4595-a9fd-2d586d9932dd 2025-10-13 03:08:35,925 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/4400a177-5265-4eca-b7e0-e94f12471024 2025-10-13 03:08:37,089 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.96 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.03 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 3.026/4.494/5.962/1.468 ms') 2025-10-13 03:08:37,089 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-43348307 passed 2025-10-13 03:08:37,157 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-13 03:08:37,158 - DEBUG - Waiting to SSH to VM ctest-left_vm-43348307, IP 178.209.236.67, Port 22 2025-10-13 03:08:37,330 - DEBUG - VM ctest-left_vm-43348307 is ready for SSH connections 2025-10-13 03:08:37,330 - INFO - Waiting for VM ctest-right_vm-69431828 to be up.. 2025-10-13 03:08:37,404 - DEBUG - VM is in ACTIVE state now 2025-10-13 03:08:37,404 - INFO - VM name : ctest-right_vm-69431828 2025-10-13 03:08:37,488 - DEBUG - VM ctest-right_vm-69431828 ID is fa52c9f9-a7e9-43cf-b067-cf36fc37b307 2025-10-13 03:08:37,489 - DEBUG - VM ctest-right_vm-69431828 launched on Node an-jenkins-deploy-platform-ansible-os-4296-2 2025-10-13 03:08:37,569 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/fa52c9f9-a7e9-43cf-b067-cf36fc37b307 2025-10-13 03:08:37,579 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/64ceb4f3-38ee-44c6-8ec0-59ad5f5d4068 2025-10-13 03:08:38,736 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.03 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.473 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1000ms\r\nrtt min/avg/max/mdev = 0.473/1.752/3.032/1.279 ms') 2025-10-13 03:08:38,736 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-right_vm-69431828 passed 2025-10-13 03:08:38,806 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-13 03:08:38,806 - DEBUG - Waiting to SSH to VM ctest-right_vm-69431828, IP 100.133.49.67, Port 22 2025-10-13 03:08:38,975 - DEBUG - VM ctest-right_vm-69431828 is ready for SSH connections 2025-10-13 03:08:38,982 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-19665451:ctest-si-78330120, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-13 03:08:39,316 - INFO - Attaching policy ctest-policy-48089639 to vn ctest-left-85139265 2025-10-13 03:08:39,747 - INFO - Attaching policy ctest-policy-48089639 to vn ctest-right-50731278 2025-10-13 03:08:40,077 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-72125971'] created succesfully 2025-10-13 03:08:40,276 - DEBUG - Service instance: ['default-domain', 'ctest-TestSVCV2Mirror-19665451', 'ctest-si-78330120'] created succesfully 2025-10-13 03:08:40,276 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:08:40,283 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:08:40,296 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:08:40,396 - DEBUG - Requesting: http://10.0.0.22:8082/service-instance/42f5aa34-1c06-4cf5-923d-72ee44147044 2025-10-13 03:08:40,406 - DEBUG - SI 'ctest-si-78330120' has service template ref to ctest-service_template_1-72125971 2025-10-13 03:08:40,406 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:08:40,411 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:08:40,424 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:08:40,527 - DEBUG - Requesting: http://10.0.0.22:8082/service-instance/42f5aa34-1c06-4cf5-923d-72ee44147044 2025-10-13 03:08:40,538 - DEBUG - Requesting: http://10.0.0.22:8082/port-tuple/f53f3ed2-f30a-47ed-8106-714632f9be19 2025-10-13 03:08:40,546 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/eaafc4a4-c179-422f-a117-22b3b692462d 2025-10-13 03:08:40,759 - DEBUG - VM is in ACTIVE state now 2025-10-13 03:08:41,001 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/627bb881-61b4-4e77-b478-8a3f5e259383 2025-10-13 03:08:41,010 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/eaafc4a4-c179-422f-a117-22b3b692462d 2025-10-13 03:08:41,019 - DEBUG - Requesting: http://10.0.0.41:8082/instance-ip/03d20524-f237-4126-a0a5-b0cb15bfeb37 2025-10-13 03:08:41,027 - DEBUG - Requesting: http://10.0.0.41:8082/instance-ip/9cde6101-254b-4bfc-ada9-62b95068f19a 2025-10-13 03:08:41,037 - DEBUG - Requesting: http://10.0.0.41:8082/instance-ip/f103b30f-3265-4e55-b449-20b334f04513 2025-10-13 03:08:41,211 - DEBUG - VM is in ACTIVE state now 2025-10-13 03:08:41,211 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/627bb881-61b4-4e77-b478-8a3f5e259383 2025-10-13 03:08:41,219 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/eaafc4a4-c179-422f-a117-22b3b692462d 2025-10-13 03:08:42,366 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=4.29 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=0.359 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.359/2.325/4.291/1.966 ms') 2025-10-13 03:08:42,366 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-43859799 passed 2025-10-13 03:08:42,405 - DEBUG - VM ctest-pt_svm0-43859799 Tap interface: {'index': '4', 'name': 'tapeaafc4a4-c1', 'uuid': 'eaafc4a4-c179-422f-a117-22b3b692462d', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152:ctest-trans_left_vn-84621152', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '16', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152', 'vm_uuid': '627bb881-61b4-4e77-b478-8a3f5e259383', 'vm_name': 'ctest-pt_svm0-43859799', 'ip_addr': '11.75.121.67', 'mac_addr': '02:ea:af:c4:a4:c1', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-19665451:eaafc4a4-c179-422f-a117-22b3b692462d', 'sg_uuid_list': ['22bc1fb9-1ac3-4bfd-afa1-2d8f34f60d09'], 'static_route_list': None, 'vm_project_uuid': '2c0c3eda-d42a-49d5-b8d7-44459ce1f511', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-13 03:08:42,405 - DEBUG - Agent 10.0.0.249 vrf name: default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152:ctest-trans_left_vn-84621152 2025-10-13 03:08:42,409 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152:ctest-trans_left_vn-84621152', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152', 'table_label': '-1', 'vxlan_id': '16', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.192:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-13 03:08:42,489 - DEBUG - VM ctest-pt_svm0-43859799 : Tap interface tapeaafc4a4-c1 is set to Active 2025-10-13 03:08:42,489 - DEBUG - Tap interface tapeaafc4a4-c1 detail : {'index': '4', 'name': 'tapeaafc4a4-c1', 'uuid': 'eaafc4a4-c179-422f-a117-22b3b692462d', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152:ctest-trans_left_vn-84621152', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '16', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152', 'vm_uuid': '627bb881-61b4-4e77-b478-8a3f5e259383', 'vm_name': 'ctest-pt_svm0-43859799', 'ip_addr': '11.75.121.67', 'mac_addr': '02:ea:af:c4:a4:c1', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-19665451:eaafc4a4-c179-422f-a117-22b3b692462d', 'sg_uuid_list': ['22bc1fb9-1ac3-4bfd-afa1-2d8f34f60d09'], 'static_route_list': None, 'vm_project_uuid': '2c0c3eda-d42a-49d5-b8d7-44459ce1f511', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-13 03:08:42,608 - DEBUG - Starting Layer 2 verification in Agent 2025-10-13 03:08:42,618 - DEBUG - Layer 2 path is seen for VM MAC 02:ea:af:c4:a4:c1 in agent 10.0.0.249 2025-10-13 03:08:42,618 - DEBUG - Active layer 2 route in agent is present for VMI tapeaafc4a4-c1 2025-10-13 03:08:42,618 - DEBUG - L2 label(35) matches bw route table and interface table 2025-10-13 03:08:42,624 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is found in Agent of node 10.0.0.249 2025-10-13 03:08:42,759 - DEBUG - VRF IDs of VN default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 is consistent in agent 10.0.0.249 2025-10-13 03:08:42,759 - DEBUG - Route for VM IP ['11.75.121.67'] is consistent in agent 10.0.0.249 2025-10-13 03:08:42,760 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-19665451:ctest-trans_left_vn-84621152 verification for VM ctest-pt_svm0-43859799 in Agent 10.0.0.249 passed 2025-10-13 03:08:42,875 - DEBUG - Starting all layer 2 verification in agent 10.0.0.249 2025-10-13 03:08:42,886 - DEBUG - Route for VM MAC 02:ea:af:c4:a4:c1 is consistent in agent 10.0.0.249 2025-10-13 03:08:42,892 - INFO - VM ctest-pt_svm0-43859799 verifications in Compute nodes passed 2025-10-13 03:08:42,893 - DEBUG - The SVMs in the SI are : [] 2025-10-13 03:08:42,893 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/627bb881-61b4-4e77-b478-8a3f5e259383 2025-10-13 03:08:42,903 - DEBUG - Service VM for SI 'ctest-si-78330120' is launched 2025-10-13 03:08:42,903 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:08:42,909 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:08:42,921 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:08:43,013 - DEBUG - Requesting: http://10.0.0.22:8082/service-instance/42f5aa34-1c06-4cf5-923d-72ee44147044 2025-10-13 03:08:43,025 - DEBUG - SI ctest-si-78330120 has Port Tuple: ['ctest-port_tuple-57014077'] 2025-10-13 03:08:43,093 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265 2025-10-13 03:08:43,200 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278 2025-10-13 03:08:43,200 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-13 03:08:43,201 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-13 03:08:43,201 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 100.133.49.67, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.249, gateway password: c0ntrail123 2025-10-13 03:08:43,201 - DEBUG - ping -s 56 -c 3 -W 1 100.133.49.67 2025-10-13 03:09:26,105 - DEBUG - PING 100.133.49.67 (100.133.49.67) 56(84) bytes of data. 64 bytes from 100.133.49.67: icmp_req=1 ttl=63 time=8.58 ms 64 bytes from 100.133.49.67: icmp_req=2 ttl=63 time=1.10 ms 64 bytes from 100.133.49.67: icmp_req=3 ttl=63 time=1.80 ms --- 100.133.49.67 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.103/3.830/8.583/3.373 ms 2025-10-13 03:09:26,105 - INFO - Ping to IP 100.133.49.67 from VM ctest-left_vm-43348307 passed 2025-10-13 03:09:26,113 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-19665451:ctest-si-78330120, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-19665451:ctest-left-85139265, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-19665451:ctest-right-50731278, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-19665451:ctest-si-78330120, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-13 03:09:26,179 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-13 03:09:26,180 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:09:26,186 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:09:26,201 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:09:26,311 - DEBUG - Requesting: http://10.0.0.22:8082/service-instance/42f5aa34-1c06-4cf5-923d-72ee44147044 2025-10-13 03:09:26,319 - DEBUG - Requesting: http://10.0.0.22:8082/port-tuple/f53f3ed2-f30a-47ed-8106-714632f9be19 2025-10-13 03:09:26,326 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/eaafc4a4-c179-422f-a117-22b3b692462d 2025-10-13 03:09:26,496 - DEBUG - Executing command: rm -f /tmp/mirror-tapeaafc4a4-c1_ctest-random-56151255.pcap 2025-10-13 03:09:36,629 - INFO - Starting tcpdump to capture the mirrored packets. 2025-10-13 03:09:36,629 - DEBUG - Executing command: sudo tcpdump -ni tapeaafc4a4-c1 -U udp port 8099 -w /tmp/mirror-tapeaafc4a4-c1_ctest-random-56151255.pcap 2025-10-13 03:09:46,665 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 100.133.49.67, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.249, gateway password: c0ntrail123 2025-10-13 03:09:46,666 - DEBUG - ping -s 56 -c 3 -W 1 100.133.49.67 2025-10-13 03:09:49,149 - DEBUG - PING 100.133.49.67 (100.133.49.67) 56(84) bytes of data. 64 bytes from 100.133.49.67: icmp_req=1 ttl=63 time=5.39 ms 64 bytes from 100.133.49.67: icmp_req=2 ttl=63 time=1.41 ms 64 bytes from 100.133.49.67: icmp_req=3 ttl=63 time=1.34 ms --- 100.133.49.67 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.344/2.718/5.395/1.893 ms 2025-10-13 03:09:49,149 - INFO - Ping to IP 100.133.49.67 from VM ctest-left_vm-43348307 passed 2025-10-13 03:09:49,150 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:09:49,159 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:09:49,171 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:09:49,268 - DEBUG - Requesting: http://10.0.0.22:8082/service-instance/42f5aa34-1c06-4cf5-923d-72ee44147044 2025-10-13 03:09:49,277 - DEBUG - Requesting: http://10.0.0.22:8082/port-tuple/f53f3ed2-f30a-47ed-8106-714632f9be19 2025-10-13 03:09:49,284 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine-interface/eaafc4a4-c179-422f-a117-22b3b692462d 2025-10-13 03:09:49,386 - DEBUG - Waiting for the tcpdump write to complete. 2025-10-13 03:09:51,386 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tapeaafc4a4-c1_ctest-random-56151255.pcap| awk '{print $2}') 2025-10-13 03:09:51,388 - DEBUG - Executing command: sync 2025-10-13 03:09:54,450 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tapeaafc4a4-c1_ctest-random-56151255.pcap | wc -l 2025-10-13 03:09:54,465 - DEBUG - STDOUT: 12 2025-10-13 03:09:54,466 - DEBUG - STDERR: reading from file /tmp/mirror-tapeaafc4a4-c1_ctest-random-56151255.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-10-13 03:09:54,466 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tapeaafc4a4-c1_ctest-random-56151255.pcap 2025-10-13 03:09:54,509 - INFO - 12 ICMP packets are mirrored to the analyzer service VM 'ctest-pt_svm0-43859799' 2025-10-13 03:09:54,509 - INFO - Dettaching policy ctest-policy-48089639 from vn ctest-right-50731278 2025-10-13 03:09:54,667 - INFO - Dettaching policy ctest-policy-48089639 from vn ctest-left-85139265 2025-10-13 03:09:54,897 - INFO - Deleted policy ctest-policy-48089639 2025-10-13 03:09:54,897 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSVCV2Mirror-19665451', 'ctest-si-78330120'] 2025-10-13 03:09:54,998 - INFO - Deleted SI ['default-domain', 'ctest-TestSVCV2Mirror-19665451', 'ctest-si-78330120'] 2025-10-13 03:09:54,998 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:09:55,009 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:09:55,022 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:09:55,127 - DEBUG - Service instance ctest-si-78330120 removed from api server 2025-10-13 03:09:55,127 - DEBUG - Requesting: http://10.0.0.22:8082/virtual-machine/627bb881-61b4-4e77-b478-8a3f5e259383 2025-10-13 03:09:55,137 - DEBUG - All Service VMs unlinked from SI ctest-si-78330120 2025-10-13 03:09:55,146 - DEBUG - 0 svc intances found in all projects. They are [] 2025-10-13 03:09:55,146 - DEBUG - 0 svc intances found in current project. They are [] 2025-10-13 03:09:55,192 - DEBUG - 0 svc intances found in all projects. They are [] 2025-10-13 03:09:55,192 - DEBUG - 0 svc intances found in current project. They are [] 2025-10-13 03:09:55,192 - INFO - Deleting VM ctest-pt_svm0-43859799 2025-10-13 03:09:55,302 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-72125971'] 2025-10-13 03:09:55,408 - INFO - Service template: ['default-domain', 'ctest-service_template_1-72125971'] deleted successfully. 2025-10-13 03:09:55,408 - INFO - Deleting VM ctest-right_vm-69431828 2025-10-13 03:09:55,534 - INFO - Deleting VM ctest-left_vm-43348307 2025-10-13 03:09:55,600 - INFO - Deleting VN ctest-trans_right_vn-13525380 2025-10-13 03:09:55,732 - DEBUG - Response for deleting network () 2025-10-13 03:09:55,732 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b339ac11-9e09-4e17-b002-527bc0fab545 2025-10-13 03:09:55,739 - DEBUG - Response Code: 404 2025-10-13 03:09:55,739 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:09:55,745 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:09:55,777 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:09:55,892 - INFO - Validated that VN ctest-trans_right_vn-13525380 is not found in API Server 2025-10-13 03:09:55,905 - DEBUG - VN ctest-trans_right_vn-13525380 is not present in Agent 10.0.0.249 2025-10-13 03:09:55,922 - DEBUG - VN ctest-trans_right_vn-13525380 is not present in Agent 10.0.0.27 2025-10-13 03:09:55,922 - INFO - Validated that VN ctest-trans_right_vn-13525380 is not in any agent 2025-10-13 03:09:55,953 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-13525380 info 2025-10-13 03:09:55,954 - INFO - Deleting VN ctest-trans_left_vn-84621152 2025-10-13 03:09:56,014 - DEBUG - VN 2f115278-6492-4c33-88f8-ff5143bd57d6 still in use: Unable to complete operation on network 2f115278-6492-4c33-88f8-ff5143bd57d6. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1ec780ba-51b8-40e9-8598-9c65080a0035'] 2025-10-13 03:09:56,014 - WARNING - Deleting VN ctest-trans_left_vn-84621152 failed..Will retry 2025-10-13 03:09:58,184 - DEBUG - Response for deleting network () 2025-10-13 03:09:58,184 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/e16a7c04-ea5c-413f-ae1c-1930c3237ef9 2025-10-13 03:09:58,191 - DEBUG - Response Code: 404 2025-10-13 03:09:58,191 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:09:58,206 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:09:58,223 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:09:58,315 - INFO - Validated that VN ctest-trans_left_vn-84621152 is not found in API Server 2025-10-13 03:09:58,324 - DEBUG - VN ctest-trans_left_vn-84621152 is not present in Agent 10.0.0.249 2025-10-13 03:09:58,334 - DEBUG - VN ctest-trans_left_vn-84621152 is not present in Agent 10.0.0.27 2025-10-13 03:09:58,334 - INFO - Validated that VN ctest-trans_left_vn-84621152 is not in any agent 2025-10-13 03:09:58,364 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-84621152 info 2025-10-13 03:09:58,364 - INFO - Deleting VN ctest-mgmt_vn-57657866 2025-10-13 03:09:58,495 - DEBUG - Response for deleting network () 2025-10-13 03:09:58,495 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/82aa3c52-f110-4183-a7a6-202bfad328b7 2025-10-13 03:09:58,500 - DEBUG - Response Code: 404 2025-10-13 03:09:58,501 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:09:58,514 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:09:58,530 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:09:58,617 - INFO - Validated that VN ctest-mgmt_vn-57657866 is not found in API Server 2025-10-13 03:09:58,637 - DEBUG - VN ctest-mgmt_vn-57657866 is not present in Agent 10.0.0.249 2025-10-13 03:09:58,654 - DEBUG - VN ctest-mgmt_vn-57657866 is not present in Agent 10.0.0.27 2025-10-13 03:09:58,654 - INFO - Validated that VN ctest-mgmt_vn-57657866 is not in any agent 2025-10-13 03:09:58,682 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-57657866 info 2025-10-13 03:09:58,683 - INFO - Deleting VN ctest-right-50731278 2025-10-13 03:09:58,850 - DEBUG - Response for deleting network () 2025-10-13 03:09:58,850 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/4bbf3f59-9ad8-4273-bff1-fa9670792182 2025-10-13 03:09:58,870 - DEBUG - Response Code: 404 2025-10-13 03:09:58,870 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:09:58,876 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:09:58,940 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:09:59,048 - INFO - Validated that VN ctest-right-50731278 is not found in API Server 2025-10-13 03:09:59,060 - DEBUG - VN ctest-right-50731278 is not present in Agent 10.0.0.249 2025-10-13 03:09:59,071 - DEBUG - VN ctest-right-50731278 is not present in Agent 10.0.0.27 2025-10-13 03:09:59,071 - INFO - Validated that VN ctest-right-50731278 is not in any agent 2025-10-13 03:09:59,101 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-50731278 info 2025-10-13 03:09:59,101 - INFO - Deleting VN ctest-left-85139265 2025-10-13 03:09:59,262 - DEBUG - Response for deleting network () 2025-10-13 03:09:59,262 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/714720df-a5ff-44ac-9ef1-7475104a2c71 2025-10-13 03:09:59,268 - DEBUG - Response Code: 404 2025-10-13 03:09:59,268 - DEBUG - Requesting: http://10.0.0.22:8082/domains 2025-10-13 03:09:59,274 - DEBUG - Requesting: http://10.0.0.22:8082/domain/3f9f083c-1111-458a-a630-ac922d5b730c 2025-10-13 03:09:59,287 - DEBUG - Requesting: http://10.0.0.22:8082/project/2c0c3eda-d42a-49d5-b8d7-44459ce1f511 2025-10-13 03:09:59,391 - INFO - Validated that VN ctest-left-85139265 is not found in API Server 2025-10-13 03:09:59,400 - DEBUG - VN ctest-left-85139265 is not present in Agent 10.0.0.249 2025-10-13 03:09:59,410 - DEBUG - VN ctest-left-85139265 is not present in Agent 10.0.0.27 2025-10-13 03:09:59,410 - INFO - Validated that VN ctest-left-85139265 is not in any agent 2025-10-13 03:09:59,440 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-85139265 info 2025-10-13 03:10:00,708 - DEBUG - No XMPP flaps were noticed during the test 2025-10-13 03:10:00,708 - INFO -

2025-10-13 03:10:00,709 - INFO - END TEST : test_svc_v2_mirroring : PASSED[0:02:46]

2025-10-13 03:10:00,709 - INFO - -------------------------------------------------------------------------------- 2025-10-13 03:10:01,421 - INFO - Deleted project: ctest-TestSVCV2Mirror-19665451, ID : 2c0c3eda-d42a-49d5-b8d7-44459ce1f511