2025-10-15 16:47:35,421 - INFO - Domain Default found not creating 2025-10-15 16:47:35,562 - INFO - Project ctest-TestSVCV2Mirror-66353013 not found, creating it 2025-10-15 16:47:36,081 - INFO - Created Project:ctest-TestSVCV2Mirror-66353013, ID : 75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:47:37,444 - INFO - ================================================================================ 2025-10-15 16:47:37,444 - INFO - STARTING TEST : test_svc_v2_mirroring 2025-10-15 16:47:37,444 - INFO - TEST DESCRIPTION : Validate the service chain mirroring 2025-10-15 16:47:38,745 - DEBUG - Nothing to compare xmpp stats {'10.0.0.141': {'10.20.0.5': '0', '10.20.0.18': '0'}, '10.0.0.33': {'10.20.0.18': '0', '10.20.0.252': '0'}} with 2025-10-15 16:47:38,745 - INFO - Initial checks done. Running the testcase now 2025-10-15 16:47:38,745 - INFO - 2025-10-15 16:47:39,414 - DEBUG - Response for create_network : {'network': {'id': '8734b147-f9cd-4111-93fc-1e0c48bba6d6', 'name': 'ctest-left-67345601', 'tenant_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'project_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-66353013', 'ctest-left-67345601'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:39,685 - DEBUG - Response for create_subnet : {'subnet': {'id': '585db1e3-34bf-45ef-8b6f-b51fe43065bf', 'name': '', 'tenant_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'network_id': '8734b147-f9cd-4111-93fc-1e0c48bba6d6', 'ip_version': 4, 'cidr': '103.214.20.0/26', 'allocation_pools': [{'start': '103.214.20.2', 'end': '103.214.20.62'}], 'gateway_ip': '103.214.20.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '103.214.20.2', 'tags': [], 'project_id': '75dec350f6b34cd7b956ba08f3ba59cc'}} 2025-10-15 16:47:39,709 - INFO - Created VN ctest-left-67345601 2025-10-15 16:47:39,725 - DEBUG - VN ctest-left-67345601 UUID is 8734b147-f9cd-4111-93fc-1e0c48bba6d6 2025-10-15 16:47:39,808 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:40,103 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:40,129 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:40,145 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:47:40,234 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/8734b147-f9cd-4111-93fc-1e0c48bba6d6 2025-10-15 16:47:40,248 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/8734b147-f9cd-4111-93fc-1e0c48bba6d6 2025-10-15 16:47:40,257 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/020e2d87-a697-4028-a6d6-985123f43cc0 2025-10-15 16:47:40,265 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/020e2d87-a697-4028-a6d6-985123f43cc0 2025-10-15 16:47:40,272 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/f5c7d76c-3732-489a-92c2-4574411442ae 2025-10-15 16:47:40,279 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-15 16:47:40,279 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/8734b147-f9cd-4111-93fc-1e0c48bba6d6 2025-10-15 16:47:40,290 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/020e2d87-a697-4028-a6d6-985123f43cc0 2025-10-15 16:47:40,309 - INFO - Verified VN network id 15 for VN 8734b147-f9cd-4111-93fc-1e0c48bba6d6 2025-10-15 16:47:40,309 - INFO - Verifications in API Server for VN ctest-left-67345601 passed 2025-10-15 16:47:40,309 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/8734b147-f9cd-4111-93fc-1e0c48bba6d6 2025-10-15 16:47:40,320 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/020e2d87-a697-4028-a6d6-985123f43cc0 2025-10-15 16:47:40,328 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/020e2d87-a697-4028-a6d6-985123f43cc0 2025-10-15 16:47:40,336 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/f5c7d76c-3732-489a-92c2-4574411442ae 2025-10-15 16:47:40,348 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9742606816600998161', 'uuid-lslong': '10663431055815190230'}, 'enable': 'true', 'created': '2025-10-15T16:47:39', 'last-modified': '2025-10-15T16:47:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.714721'} 2025-10-15 16:47:40,353 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-15 16:47:40,361 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9742606816600998161', 'uuid-lslong': '10663431055815190230'}, 'enable': 'true', 'created': '2025-10-15T16:47:39', 'last-modified': '2025-10-15T16:47:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.725749'} 2025-10-15 16:47:40,368 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-15 16:47:40,374 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9742606816600998161', 'uuid-lslong': '10663431055815190230'}, 'enable': 'true', 'created': '2025-10-15T16:47:39', 'last-modified': '2025-10-15T16:47:39', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.740078'} 2025-10-15 16:47:40,380 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-10-15 16:47:40,380 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-left-67345601 passed 2025-10-15 16:47:40,380 - DEBUG - ====Verifying policy data for ctest-left-67345601 in API_Server ====== 2025-10-15 16:47:40,380 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:40,387 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:40,399 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:47:40,482 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/8734b147-f9cd-4111-93fc-1e0c48bba6d6 2025-10-15 16:47:40,493 - DEBUG - =>VN ctest-left-67345601 has no policy to be verified 2025-10-15 16:47:40,493 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:40,493 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:40,493 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:40,787 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:40,844 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601?flat'} 2025-10-15 16:47:40,844 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:40,844 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:41,136 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:41,198 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601?flat'} 2025-10-15 16:47:41,198 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:41,198 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:41,487 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:41,551 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601?flat'} 2025-10-15 16:47:41,551 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601 is found in opserver 2025-10-15 16:47:41,571 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:41,581 - DEBUG - VRF ids for VN ctest-left-67345601: {} 2025-10-15 16:47:41,827 - DEBUG - Response for create_network : {'network': {'id': 'c0a87ceb-6c3f-4b2f-9da9-5bec47e9d0dd', 'name': 'ctest-right-65563451', 'tenant_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'project_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-66353013', 'ctest-right-65563451'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:42,045 - DEBUG - Response for create_subnet : {'subnet': {'id': '9917b00d-8d5b-4f62-ac1c-97740e8eca0a', 'name': '', 'tenant_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'network_id': 'c0a87ceb-6c3f-4b2f-9da9-5bec47e9d0dd', 'ip_version': 4, 'cidr': '141.75.222.128/26', 'allocation_pools': [{'start': '141.75.222.130', 'end': '141.75.222.190'}], 'gateway_ip': '141.75.222.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '141.75.222.130', 'tags': [], 'project_id': '75dec350f6b34cd7b956ba08f3ba59cc'}} 2025-10-15 16:47:42,073 - INFO - Created VN ctest-right-65563451 2025-10-15 16:47:42,087 - DEBUG - VN ctest-right-65563451 UUID is c0a87ceb-6c3f-4b2f-9da9-5bec47e9d0dd 2025-10-15 16:47:42,171 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:42,178 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:42,197 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:47:42,285 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/c0a87ceb-6c3f-4b2f-9da9-5bec47e9d0dd 2025-10-15 16:47:42,299 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/c0a87ceb-6c3f-4b2f-9da9-5bec47e9d0dd 2025-10-15 16:47:42,310 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/0e2d73b8-5f4d-4add-a375-45ca4072b661 2025-10-15 16:47:42,320 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/0e2d73b8-5f4d-4add-a375-45ca4072b661 2025-10-15 16:47:42,330 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/ee87d30c-d981-4e1c-a2a9-1939472c0ef6 2025-10-15 16:47:42,338 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-15 16:47:42,339 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/c0a87ceb-6c3f-4b2f-9da9-5bec47e9d0dd 2025-10-15 16:47:42,349 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/0e2d73b8-5f4d-4add-a375-45ca4072b661 2025-10-15 16:47:42,365 - INFO - Verified VN network id 16 for VN c0a87ceb-6c3f-4b2f-9da9-5bec47e9d0dd 2025-10-15 16:47:42,366 - INFO - Verifications in API Server for VN ctest-right-65563451 passed 2025-10-15 16:47:42,366 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/c0a87ceb-6c3f-4b2f-9da9-5bec47e9d0dd 2025-10-15 16:47:42,376 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/0e2d73b8-5f4d-4add-a375-45ca4072b661 2025-10-15 16:47:42,383 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/0e2d73b8-5f4d-4add-a375-45ca4072b661 2025-10-15 16:47:42,392 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/ee87d30c-d981-4e1c-a2a9-1939472c0ef6 2025-10-15 16:47:42,405 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13882483201944800047', 'uuid-lslong': '11360712605395701981'}, 'enable': 'true', 'created': '2025-10-15T16:47:41', 'last-modified': '2025-10-15T16:47:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.407242'} 2025-10-15 16:47:42,410 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-15 16:47:42,416 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13882483201944800047', 'uuid-lslong': '11360712605395701981'}, 'enable': 'true', 'created': '2025-10-15T16:47:41', 'last-modified': '2025-10-15T16:47:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.420143'} 2025-10-15 16:47:42,422 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-15 16:47:42,428 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13882483201944800047', 'uuid-lslong': '11360712605395701981'}, 'enable': 'true', 'created': '2025-10-15T16:47:41', 'last-modified': '2025-10-15T16:47:41', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424879'} 2025-10-15 16:47:42,434 - DEBUG - Route Targets: ['target:64512:8000006'] 2025-10-15 16:47:42,434 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-right-65563451 passed 2025-10-15 16:47:42,434 - DEBUG - ====Verifying policy data for ctest-right-65563451 in API_Server ====== 2025-10-15 16:47:42,434 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:42,441 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:42,456 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:47:42,540 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/c0a87ceb-6c3f-4b2f-9da9-5bec47e9d0dd 2025-10-15 16:47:42,550 - DEBUG - =>VN ctest-right-65563451 has no policy to be verified 2025-10-15 16:47:42,550 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:42,550 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:42,550 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:42,622 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451?flat'} 2025-10-15 16:47:42,622 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:42,622 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:42,679 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451?flat'} 2025-10-15 16:47:42,679 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:42,680 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:42,740 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451?flat'} 2025-10-15 16:47:42,741 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451 is found in opserver 2025-10-15 16:47:42,763 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:42,774 - DEBUG - VRF ids for VN ctest-right-65563451: {} 2025-10-15 16:47:43,025 - DEBUG - Response for create_network : {'network': {'id': 'ce0f0346-ae73-4a02-9007-42c8c1ee518d', 'name': 'ctest-mgmt_vn-86216435', 'tenant_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'project_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-66353013', 'ctest-mgmt_vn-86216435'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:43,267 - DEBUG - Response for create_subnet : {'subnet': {'id': '4bc28233-ef39-4885-a1c8-2f2520f08527', 'name': '', 'tenant_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'network_id': 'ce0f0346-ae73-4a02-9007-42c8c1ee518d', 'ip_version': 4, 'cidr': '151.255.26.192/26', 'allocation_pools': [{'start': '151.255.26.194', 'end': '151.255.26.254'}], 'gateway_ip': '151.255.26.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '151.255.26.194', 'tags': [], 'project_id': '75dec350f6b34cd7b956ba08f3ba59cc'}} 2025-10-15 16:47:43,290 - INFO - Created VN ctest-mgmt_vn-86216435 2025-10-15 16:47:43,304 - DEBUG - VN ctest-mgmt_vn-86216435 UUID is ce0f0346-ae73-4a02-9007-42c8c1ee518d 2025-10-15 16:47:43,395 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:43,403 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:43,419 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:47:43,502 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/ce0f0346-ae73-4a02-9007-42c8c1ee518d 2025-10-15 16:47:43,513 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/ce0f0346-ae73-4a02-9007-42c8c1ee518d 2025-10-15 16:47:43,523 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/72b4fbbc-c63d-4a96-a7c3-b22c3d28c5de 2025-10-15 16:47:43,533 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/72b4fbbc-c63d-4a96-a7c3-b22c3d28c5de 2025-10-15 16:47:43,540 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/1ef9e61b-8483-4051-bbe8-a7e4e0ce77d3 2025-10-15 16:47:43,547 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-15 16:47:43,547 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/ce0f0346-ae73-4a02-9007-42c8c1ee518d 2025-10-15 16:47:43,556 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/72b4fbbc-c63d-4a96-a7c3-b22c3d28c5de 2025-10-15 16:47:43,578 - INFO - Verified VN network id 17 for VN ce0f0346-ae73-4a02-9007-42c8c1ee518d 2025-10-15 16:47:43,578 - INFO - Verifications in API Server for VN ctest-mgmt_vn-86216435 passed 2025-10-15 16:47:43,578 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/ce0f0346-ae73-4a02-9007-42c8c1ee518d 2025-10-15 16:47:43,592 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/72b4fbbc-c63d-4a96-a7c3-b22c3d28c5de 2025-10-15 16:47:43,603 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/72b4fbbc-c63d-4a96-a7c3-b22c3d28c5de 2025-10-15 16:47:43,612 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/1ef9e61b-8483-4051-bbe8-a7e4e0ce77d3 2025-10-15 16:47:43,624 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14848090098573199874', 'uuid-lslong': '10378337296313110925'}, 'enable': 'true', 'created': '2025-10-15T16:47:42', 'last-modified': '2025-10-15T16:47:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.398326'} 2025-10-15 16:47:43,629 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-15 16:47:43,635 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14848090098573199874', 'uuid-lslong': '10378337296313110925'}, 'enable': 'true', 'created': '2025-10-15T16:47:42', 'last-modified': '2025-10-15T16:47:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.410627'} 2025-10-15 16:47:43,642 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-15 16:47:43,648 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14848090098573199874', 'uuid-lslong': '10378337296313110925'}, 'enable': 'true', 'created': '2025-10-15T16:47:42', 'last-modified': '2025-10-15T16:47:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.424138'} 2025-10-15 16:47:43,654 - DEBUG - Route Targets: ['target:64512:8000007'] 2025-10-15 16:47:43,654 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-mgmt_vn-86216435 passed 2025-10-15 16:47:43,654 - DEBUG - ====Verifying policy data for ctest-mgmt_vn-86216435 in API_Server ====== 2025-10-15 16:47:43,654 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:43,660 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:43,671 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:47:43,754 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/ce0f0346-ae73-4a02-9007-42c8c1ee518d 2025-10-15 16:47:43,764 - DEBUG - =>VN ctest-mgmt_vn-86216435 has no policy to be verified 2025-10-15 16:47:43,764 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:43,764 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:43,764 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:43,828 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435?flat'} 2025-10-15 16:47:43,828 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:43,828 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:43,885 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435?flat'} 2025-10-15 16:47:43,885 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:43,885 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:43,938 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435?flat'} 2025-10-15 16:47:43,938 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-66353013:ctest-mgmt_vn-86216435 is found in opserver 2025-10-15 16:47:43,958 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:43,968 - DEBUG - VRF ids for VN ctest-mgmt_vn-86216435: {} 2025-10-15 16:47:44,223 - DEBUG - Response for create_network : {'network': {'id': '5a3cb9ac-3208-4c07-94af-c4c2d230b555', 'name': 'ctest-trans_left_vn-83948900', 'tenant_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'project_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-66353013', 'ctest-trans_left_vn-83948900'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:44,441 - DEBUG - Response for create_subnet : {'subnet': {'id': '6d2107d6-6abd-47e3-9460-1d31bbd3760f', 'name': '', 'tenant_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'network_id': '5a3cb9ac-3208-4c07-94af-c4c2d230b555', 'ip_version': 4, 'cidr': '149.168.223.192/26', 'allocation_pools': [{'start': '149.168.223.194', 'end': '149.168.223.254'}], 'gateway_ip': '149.168.223.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '149.168.223.194', 'tags': [], 'project_id': '75dec350f6b34cd7b956ba08f3ba59cc'}} 2025-10-15 16:47:44,466 - INFO - Created VN ctest-trans_left_vn-83948900 2025-10-15 16:47:44,482 - DEBUG - VN ctest-trans_left_vn-83948900 UUID is 5a3cb9ac-3208-4c07-94af-c4c2d230b555 2025-10-15 16:47:44,555 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:44,562 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:44,572 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:47:44,661 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a3cb9ac-3208-4c07-94af-c4c2d230b555 2025-10-15 16:47:44,676 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a3cb9ac-3208-4c07-94af-c4c2d230b555 2025-10-15 16:47:44,685 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/123802b9-91cd-4006-a68a-f27467ed0622 2025-10-15 16:47:44,692 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/123802b9-91cd-4006-a68a-f27467ed0622 2025-10-15 16:47:44,700 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/6d1412c2-7260-420e-9ad8-05ac21320b1b 2025-10-15 16:47:44,707 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-15 16:47:44,707 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a3cb9ac-3208-4c07-94af-c4c2d230b555 2025-10-15 16:47:44,717 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/123802b9-91cd-4006-a68a-f27467ed0622 2025-10-15 16:47:44,737 - INFO - Verified VN network id 18 for VN 5a3cb9ac-3208-4c07-94af-c4c2d230b555 2025-10-15 16:47:44,737 - INFO - Verifications in API Server for VN ctest-trans_left_vn-83948900 passed 2025-10-15 16:47:44,738 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a3cb9ac-3208-4c07-94af-c4c2d230b555 2025-10-15 16:47:44,748 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/123802b9-91cd-4006-a68a-f27467ed0622 2025-10-15 16:47:44,756 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/123802b9-91cd-4006-a68a-f27467ed0622 2025-10-15 16:47:44,764 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/6d1412c2-7260-420e-9ad8-05ac21320b1b 2025-10-15 16:47:44,776 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6502276111241071623', 'uuid-lslong': '10713998379566806357'}, 'enable': 'true', 'created': '2025-10-15T16:47:44', 'last-modified': '2025-10-15T16:47:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.374488'} 2025-10-15 16:47:44,782 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-15 16:47:44,788 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6502276111241071623', 'uuid-lslong': '10713998379566806357'}, 'enable': 'true', 'created': '2025-10-15T16:47:44', 'last-modified': '2025-10-15T16:47:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.392742'} 2025-10-15 16:47:44,795 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-15 16:47:44,801 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6502276111241071623', 'uuid-lslong': '10713998379566806357'}, 'enable': 'true', 'created': '2025-10-15T16:47:44', 'last-modified': '2025-10-15T16:47:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402740'} 2025-10-15 16:47:44,807 - DEBUG - Route Targets: ['target:64512:8000008'] 2025-10-15 16:47:44,808 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_left_vn-83948900 passed 2025-10-15 16:47:44,808 - DEBUG - ====Verifying policy data for ctest-trans_left_vn-83948900 in API_Server ====== 2025-10-15 16:47:44,808 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:44,815 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:44,830 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:47:44,929 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/5a3cb9ac-3208-4c07-94af-c4c2d230b555 2025-10-15 16:47:44,942 - DEBUG - =>VN ctest-trans_left_vn-83948900 has no policy to be verified 2025-10-15 16:47:44,942 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:44,942 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:44,942 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:44,958 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900?flat'} 2025-10-15 16:47:44,958 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:44,958 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:44,973 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900?flat'} 2025-10-15 16:47:44,974 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:44,974 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:44,990 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900?flat'} 2025-10-15 16:47:44,991 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is found in opserver 2025-10-15 16:47:45,017 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:45,029 - DEBUG - VRF ids for VN ctest-trans_left_vn-83948900: {} 2025-10-15 16:47:45,292 - DEBUG - Response for create_network : {'network': {'id': 'c1ed9b59-f8a4-4ad8-970b-6cf8476ebf81', 'name': 'ctest-trans_right_vn-74723091', 'tenant_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'project_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestSVCV2Mirror-66353013', 'ctest-trans_right_vn-74723091'], 'port_security_enabled': True, 'description': ''}} 2025-10-15 16:47:45,542 - DEBUG - Response for create_subnet : {'subnet': {'id': '9adf67e2-c008-49c4-a66c-b59622446b4a', 'name': '', 'tenant_id': '75dec350f6b34cd7b956ba08f3ba59cc', 'network_id': 'c1ed9b59-f8a4-4ad8-970b-6cf8476ebf81', 'ip_version': 4, 'cidr': '148.164.201.128/26', 'allocation_pools': [{'start': '148.164.201.130', 'end': '148.164.201.190'}], 'gateway_ip': '148.164.201.129', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '148.164.201.130', 'tags': [], 'project_id': '75dec350f6b34cd7b956ba08f3ba59cc'}} 2025-10-15 16:47:45,567 - INFO - Created VN ctest-trans_right_vn-74723091 2025-10-15 16:47:45,579 - DEBUG - VN ctest-trans_right_vn-74723091 UUID is c1ed9b59-f8a4-4ad8-970b-6cf8476ebf81 2025-10-15 16:47:45,655 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:45,662 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:45,675 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:47:45,771 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/c1ed9b59-f8a4-4ad8-970b-6cf8476ebf81 2025-10-15 16:47:45,785 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/c1ed9b59-f8a4-4ad8-970b-6cf8476ebf81 2025-10-15 16:47:45,797 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/204e1483-494c-4583-823b-1f14c5ba353a 2025-10-15 16:47:45,807 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/204e1483-494c-4583-823b-1f14c5ba353a 2025-10-15 16:47:45,817 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/04514195-4a11-4890-8dd4-1032789906b7 2025-10-15 16:47:45,826 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-15 16:47:45,826 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/c1ed9b59-f8a4-4ad8-970b-6cf8476ebf81 2025-10-15 16:47:45,837 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/204e1483-494c-4583-823b-1f14c5ba353a 2025-10-15 16:47:45,857 - INFO - Verified VN network id 19 for VN c1ed9b59-f8a4-4ad8-970b-6cf8476ebf81 2025-10-15 16:47:45,858 - INFO - Verifications in API Server for VN ctest-trans_right_vn-74723091 passed 2025-10-15 16:47:45,858 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/c1ed9b59-f8a4-4ad8-970b-6cf8476ebf81 2025-10-15 16:47:45,871 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/204e1483-494c-4583-823b-1f14c5ba353a 2025-10-15 16:47:45,880 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/204e1483-494c-4583-823b-1f14c5ba353a 2025-10-15 16:47:45,888 - DEBUG - Requesting: http://10.0.0.130:8082/route-target/04514195-4a11-4890-8dd4-1032789906b7 2025-10-15 16:47:45,900 - DEBUG - Control-node 10.0.0.130 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13973996029526428376', 'uuid-lslong': '10883912738077065089'}, 'enable': 'true', 'created': '2025-10-15T16:47:45', 'last-modified': '2025-10-15T16:47:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.402887'} 2025-10-15 16:47:45,905 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-15 16:47:45,912 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13973996029526428376', 'uuid-lslong': '10883912738077065089'}, 'enable': 'true', 'created': '2025-10-15T16:47:45', 'last-modified': '2025-10-15T16:47:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.412367'} 2025-10-15 16:47:45,920 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-15 16:47:45,927 - DEBUG - Control-node 10.0.0.137 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-TestSVCV2Mirror-66353013', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '13973996029526428376', 'uuid-lslong': '10883912738077065089'}, 'enable': 'true', 'created': '2025-10-15T16:47:45', 'last-modified': '2025-10-15T16:47:45', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.431304'} 2025-10-15 16:47:45,934 - DEBUG - Route Targets: ['target:64512:8000009'] 2025-10-15 16:47:45,934 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-trans_right_vn-74723091 passed 2025-10-15 16:47:45,934 - DEBUG - ====Verifying policy data for ctest-trans_right_vn-74723091 in API_Server ====== 2025-10-15 16:47:45,934 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:47:45,941 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:47:45,956 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:47:46,051 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-network/c1ed9b59-f8a4-4ad8-970b-6cf8476ebf81 2025-10-15 16:47:46,061 - DEBUG - =>VN ctest-trans_right_vn-74723091 has no policy to be verified 2025-10-15 16:47:46,061 - DEBUG - Verifying the vn in opserver 2025-10-15 16:47:46,061 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091 virtual network link through opserver 10.0.0.130 2025-10-15 16:47:46,061 - DEBUG - Requesting: http://10.0.0.130:8081/analytics/uves/virtual-networks 2025-10-15 16:47:46,076 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091', 'href': 'http://10.0.0.130:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091?flat'} 2025-10-15 16:47:46,076 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091 virtual network link through opserver 10.0.0.131 2025-10-15 16:47:46,076 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks 2025-10-15 16:47:46,092 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091?flat'} 2025-10-15 16:47:46,092 - DEBUG - Verifying the default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091 virtual network link through opserver 10.0.0.137 2025-10-15 16:47:46,092 - DEBUG - Requesting: http://10.0.0.137:8081/analytics/uves/virtual-networks 2025-10-15 16:47:46,109 - DEBUG - vn link and name as {'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091', 'href': 'http://10.0.0.137:8081/analytics/uves/virtual-network/default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091?flat'} 2025-10-15 16:47:46,109 - INFO - Validated that VN default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_right_vn-74723091 is found in opserver 2025-10-15 16:47:46,132 - DEBUG - Do not have enough data to verify VN in agent 2025-10-15 16:47:46,142 - DEBUG - VRF ids for VN ctest-trans_right_vn-74723091: {} 2025-10-15 16:47:46,203 - DEBUG - Services list from nova: [, , , ] 2025-10-15 16:47:47,274 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-1) 2025-10-15 16:47:48,431 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-2) 2025-10-15 16:47:48,432 - DEBUG - Creating service template: ['default-domain', 'ctest-service_template_1-61280549'] 2025-10-15 16:47:48,734 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-61280549'] created succesfully 2025-10-15 16:47:50,024 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4330-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4330-1) 2025-10-15 16:47:50,025 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/754e1eb3-6065-40e9-aab3-bccee1d8d9f6 2025-10-15 16:47:50,316 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/754e1eb3-6065-40e9-aab3-bccee1d8d9f6 2025-10-15 16:47:50,346 - DEBUG - Response Code: 404 2025-10-15 16:47:52,347 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/754e1eb3-6065-40e9-aab3-bccee1d8d9f6 2025-10-15 16:47:52,359 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/a91e20d0-887a-415f-8195-632ef605f5ec 2025-10-15 16:47:52,445 - INFO - Waiting for VM ctest-pt_svm0-81878118 to be up.. 2025-10-15 16:47:52,534 - DEBUG - VM is in ACTIVE state now 2025-10-15 16:47:52,534 - INFO - VM name : ctest-pt_svm0-81878118 2025-10-15 16:47:52,619 - DEBUG - VM ctest-pt_svm0-81878118 ID is 754e1eb3-6065-40e9-aab3-bccee1d8d9f6 2025-10-15 16:47:52,643 - DEBUG - VM ctest-pt_svm0-81878118 launched on Node an-jenkins-deploy-platform-ansible-os-4330-1 2025-10-15 16:47:52,737 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/754e1eb3-6065-40e9-aab3-bccee1d8d9f6 2025-10-15 16:47:52,748 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/a91e20d0-887a-415f-8195-632ef605f5ec 2025-10-15 16:47:55,919 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1001ms') 2025-10-15 16:47:55,919 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 failed! 2025-10-15 16:47:55,937 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is 149.168.223.193 and allocation pool is NOT set 2025-10-15 16:48:00,015 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2025-10-15 16:48:00,016 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 failed! 2025-10-15 16:48:00,031 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is 149.168.223.193 and allocation pool is NOT set 2025-10-15 16:48:04,108 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-15 16:48:04,108 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 failed! 2025-10-15 16:48:04,126 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is 149.168.223.193 and allocation pool is NOT set 2025-10-15 16:48:08,202 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-10-15 16:48:08,202 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 failed! 2025-10-15 16:48:08,221 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is 149.168.223.193 and allocation pool is NOT set 2025-10-15 16:48:12,304 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1014ms') 2025-10-15 16:48:12,304 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 failed! 2025-10-15 16:48:12,321 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is 149.168.223.193 and allocation pool is NOT set 2025-10-15 16:48:16,399 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-15 16:48:16,399 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 failed! 2025-10-15 16:48:16,420 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is 149.168.223.193 and allocation pool is NOT set 2025-10-15 16:48:20,496 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-10-15 16:48:20,496 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 failed! 2025-10-15 16:48:20,514 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is 149.168.223.193 and allocation pool is NOT set 2025-10-15 16:48:24,590 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2025-10-15 16:48:24,590 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 failed! 2025-10-15 16:48:24,606 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is 149.168.223.193 and allocation pool is NOT set 2025-10-15 16:48:28,685 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1010ms') 2025-10-15 16:48:28,685 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 failed! 2025-10-15 16:48:28,705 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is 149.168.223.193 and allocation pool is NOT set 2025-10-15 16:48:32,783 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms') 2025-10-15 16:48:32,783 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 failed! 2025-10-15 16:48:32,801 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is 149.168.223.193 and allocation pool is NOT set 2025-10-15 16:48:36,882 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-10-15 16:48:36,882 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 failed! 2025-10-15 16:48:36,899 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is 149.168.223.193 and allocation pool is NOT set 2025-10-15 16:48:40,970 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1005ms') 2025-10-15 16:48:40,970 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 failed! 2025-10-15 16:48:40,988 - DEBUG - Gateway for vn default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is 149.168.223.193 and allocation pool is NOT set 2025-10-15 16:48:43,058 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=4.24 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=1.74 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.737/2.989/4.242/1.252 ms') 2025-10-15 16:48:43,058 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 passed 2025-10-15 16:48:43,131 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 16:48:43,132 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-81878118, IP 149.168.223.195, Port 22 2025-10-15 16:48:43,200 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 16:48:43,289 - DEBUG - VM ctest-pt_svm0-81878118 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 16:48:48,290 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 16:48:48,291 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-81878118, IP 149.168.223.195, Port 22 2025-10-15 16:48:48,359 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 16:48:48,442 - DEBUG - VM ctest-pt_svm0-81878118 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 16:48:53,443 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 16:48:53,443 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-81878118, IP 149.168.223.195, Port 22 2025-10-15 16:48:53,512 - DEBUG - Error on ssh to ubuntu@169.254.0.4:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.4/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.4/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.4/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-10-15 16:48:53,598 - DEBUG - VM ctest-pt_svm0-81878118 is NOT ready for SSH connections, VM status: ACTIVE 2025-10-15 16:48:58,599 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 16:48:58,599 - DEBUG - Waiting to SSH to VM ctest-pt_svm0-81878118, IP 149.168.223.195, Port 22 2025-10-15 16:48:58,757 - DEBUG - VM ctest-pt_svm0-81878118 is ready for SSH connections 2025-10-15 16:48:58,763 - DEBUG - Creating service instance: ['default-domain', 'ctest-TestSVCV2Mirror-66353013', 'ctest-si-16995913'] 2025-10-15 16:48:59,261 - INFO - Waiting for VM ctest-left_vm-71169580 to be up.. 2025-10-15 16:48:59,345 - DEBUG - VM is in ACTIVE state now 2025-10-15 16:48:59,345 - INFO - VM name : ctest-left_vm-71169580 2025-10-15 16:48:59,429 - DEBUG - VM ctest-left_vm-71169580 ID is 37139b69-de49-41a0-9b52-bcc9f13c4561 2025-10-15 16:48:59,429 - DEBUG - VM ctest-left_vm-71169580 launched on Node an-jenkins-deploy-platform-ansible-os-4330-1 2025-10-15 16:48:59,517 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/37139b69-de49-41a0-9b52-bcc9f13c4561 2025-10-15 16:48:59,527 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/a33486a8-4467-4c35-bc8f-8be855378dd5 2025-10-15 16:49:00,692 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.63 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.22 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.219/3.426/5.633/2.207 ms') 2025-10-15 16:49:00,692 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-left_vm-71169580 passed 2025-10-15 16:49:00,762 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 16:49:00,762 - DEBUG - Waiting to SSH to VM ctest-left_vm-71169580, IP 103.214.20.3, Port 22 2025-10-15 16:49:00,931 - DEBUG - VM ctest-left_vm-71169580 is ready for SSH connections 2025-10-15 16:49:00,931 - INFO - Waiting for VM ctest-right_vm-57265852 to be up.. 2025-10-15 16:49:01,023 - DEBUG - VM is in ACTIVE state now 2025-10-15 16:49:01,023 - INFO - VM name : ctest-right_vm-57265852 2025-10-15 16:49:01,114 - DEBUG - VM ctest-right_vm-57265852 ID is c66977b2-4ad2-4674-8a01-8868ad100150 2025-10-15 16:49:01,114 - DEBUG - VM ctest-right_vm-57265852 launched on Node an-jenkins-deploy-platform-ansible-os-4330-2 2025-10-15 16:49:01,205 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/c66977b2-4ad2-4674-8a01-8868ad100150 2025-10-15 16:49:01,217 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/ca3d3148-0c91-4161-8d89-9690a77a8a13 2025-10-15 16:49:02,383 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=1.93 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.07 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.067/1.499/1.931/0.432 ms') 2025-10-15 16:49:02,383 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-right_vm-57265852 passed 2025-10-15 16:49:02,466 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 16:49:02,467 - DEBUG - Waiting to SSH to VM ctest-right_vm-57265852, IP 141.75.222.131, Port 22 2025-10-15 16:49:02,635 - DEBUG - VM ctest-right_vm-57265852 is ready for SSH connections 2025-10-15 16:49:02,644 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = any, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-66353013:ctest-si-16995913, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-15 16:49:03,022 - INFO - Attaching policy ctest-policy-04925378 to vn ctest-left-67345601 2025-10-15 16:49:03,409 - INFO - Attaching policy ctest-policy-04925378 to vn ctest-right-65563451 2025-10-15 16:49:03,742 - DEBUG - Service template: ['default-domain', 'ctest-service_template_1-61280549'] created succesfully 2025-10-15 16:49:03,949 - DEBUG - Service instance: ['default-domain', 'ctest-TestSVCV2Mirror-66353013', 'ctest-si-16995913'] created succesfully 2025-10-15 16:49:03,949 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:49:03,955 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:49:03,970 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:49:04,055 - DEBUG - Requesting: http://10.0.0.130:8082/service-instance/c80cfdd4-354f-4d5c-bd7a-005bafbd644a 2025-10-15 16:49:04,063 - DEBUG - SI 'ctest-si-16995913' has service template ref to ctest-service_template_1-61280549 2025-10-15 16:49:04,063 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:49:04,072 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:49:04,084 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:49:04,166 - DEBUG - Requesting: http://10.0.0.130:8082/service-instance/c80cfdd4-354f-4d5c-bd7a-005bafbd644a 2025-10-15 16:49:04,174 - DEBUG - Requesting: http://10.0.0.130:8082/port-tuple/f7d1f7be-8ee1-4138-919b-8d5e0e772491 2025-10-15 16:49:04,181 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-machine-interface/a91e20d0-887a-415f-8195-632ef605f5ec 2025-10-15 16:49:04,382 - DEBUG - VM is in ACTIVE state now 2025-10-15 16:49:04,633 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/754e1eb3-6065-40e9-aab3-bccee1d8d9f6 2025-10-15 16:49:04,643 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/a91e20d0-887a-415f-8195-632ef605f5ec 2025-10-15 16:49:04,655 - DEBUG - Requesting: http://10.0.0.137:8082/instance-ip/2bd1690e-2f51-461e-bc85-9cb7d0e079b9 2025-10-15 16:49:04,664 - DEBUG - Requesting: http://10.0.0.137:8082/instance-ip/9fb41e8e-2704-4f52-ab1f-c929bbd04e2a 2025-10-15 16:49:04,672 - DEBUG - Requesting: http://10.0.0.137:8082/instance-ip/b9d0f064-a21a-4245-b52a-30f72e33ac1c 2025-10-15 16:49:04,868 - DEBUG - VM is in ACTIVE state now 2025-10-15 16:49:04,868 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine/754e1eb3-6065-40e9-aab3-bccee1d8d9f6 2025-10-15 16:49:04,878 - DEBUG - Requesting: http://10.0.0.137:8082/virtual-machine-interface/a91e20d0-887a-415f-8195-632ef605f5ec 2025-10-15 16:49:06,040 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=64 time=3.16 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=64 time=2.64 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 2.637/2.898/3.159/0.261 ms') 2025-10-15 16:49:06,040 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-pt_svm0-81878118 passed 2025-10-15 16:49:06,078 - DEBUG - VM ctest-pt_svm0-81878118 Tap interface: {'index': '4', 'name': 'tapa91e20d0-88', 'uuid': 'a91e20d0-887a-415f-8195-632ef605f5ec', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900:ctest-trans_left_vn-83948900', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '18', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900', 'vm_uuid': '754e1eb3-6065-40e9-aab3-bccee1d8d9f6', 'vm_name': 'ctest-pt_svm0-81878118', 'ip_addr': '149.168.223.195', 'mac_addr': '02:a9:1e:20:d0:88', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-66353013:a91e20d0-887a-415f-8195-632ef605f5ec', 'sg_uuid_list': ['416b9d22-3852-44dc-9977-bb58745fe033'], 'static_route_list': None, 'vm_project_uuid': '75dec350-f6b3-4cd7-b956-ba08f3ba59cc', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-15 16:49:06,078 - DEBUG - Agent 10.0.0.141 vrf name: default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900:ctest-trans_left_vn-83948900 2025-10-15 16:49:06,085 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900:ctest-trans_left_vn-83948900', 'ucindex': '3', 'mcindex': '3', 'l2index': '3', 'source': 'Config; ', 'uc6index': '3', 'vn': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900', 'table_label': '-1', 'vxlan_id': '18', 'evpnindex': '3', 'brindex': '3', 'mplsindex': '0', 'RD': '10.20.0.14:3', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-10-15 16:49:06,177 - DEBUG - VM ctest-pt_svm0-81878118 : Tap interface tapa91e20d0-88 is set to Active 2025-10-15 16:49:06,177 - DEBUG - Tap interface tapa91e20d0-88 detail : {'index': '4', 'name': 'tapa91e20d0-88', 'uuid': 'a91e20d0-887a-415f-8195-632ef605f5ec', 'vrf_name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900:ctest-trans_left_vn-83948900', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '33', 'l2_label': '35', 'vxlan_id': '18', 'vn_name': 'default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900', 'vm_uuid': '754e1eb3-6065-40e9-aab3-bccee1d8d9f6', 'vm_name': 'ctest-pt_svm0-81878118', 'ip_addr': '149.168.223.195', 'mac_addr': '02:a9:1e:20:d0:88', 'policy': 'Disable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.4', 'service_vlan_list': None, 'os_ifindex': '93', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-TestSVCV2Mirror-66353013:a91e20d0-887a-415f-8195-632ef605f5ec', 'sg_uuid_list': ['416b9d22-3852-44dc-9977-bb58745fe033'], 'static_route_list': None, 'vm_project_uuid': '75dec350-f6b3-4cd7-b956-ba08f3ba59cc', 'admin_state': 'Enabled', 'flow_key_idx': '41', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-10-15 16:49:06,292 - DEBUG - Starting Layer 2 verification in Agent 2025-10-15 16:49:06,307 - DEBUG - Layer 2 path is seen for VM MAC 02:a9:1e:20:d0:88 in agent 10.0.0.141 2025-10-15 16:49:06,307 - DEBUG - Active layer 2 route in agent is present for VMI tapa91e20d0-88 2025-10-15 16:49:06,307 - DEBUG - L2 label(35) matches bw route table and interface table 2025-10-15 16:49:06,313 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is found in Agent of node 10.0.0.141 2025-10-15 16:49:06,451 - DEBUG - VRF IDs of VN default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 is consistent in agent 10.0.0.141 2025-10-15 16:49:06,452 - DEBUG - Route for VM IP ['149.168.223.195'] is consistent in agent 10.0.0.141 2025-10-15 16:49:06,452 - DEBUG - VN default-domain:ctest-TestSVCV2Mirror-66353013:ctest-trans_left_vn-83948900 verification for VM ctest-pt_svm0-81878118 in Agent 10.0.0.141 passed 2025-10-15 16:49:06,572 - DEBUG - Starting all layer 2 verification in agent 10.0.0.141 2025-10-15 16:49:06,590 - DEBUG - Route for VM MAC 02:a9:1e:20:d0:88 is consistent in agent 10.0.0.141 2025-10-15 16:49:06,596 - INFO - VM ctest-pt_svm0-81878118 verifications in Compute nodes passed 2025-10-15 16:49:06,596 - DEBUG - The SVMs in the SI are : [] 2025-10-15 16:49:06,596 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-machine/754e1eb3-6065-40e9-aab3-bccee1d8d9f6 2025-10-15 16:49:06,606 - DEBUG - Service VM for SI 'ctest-si-16995913' is launched 2025-10-15 16:49:06,606 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:49:06,613 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:49:06,624 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:49:06,716 - DEBUG - Requesting: http://10.0.0.130:8082/service-instance/c80cfdd4-354f-4d5c-bd7a-005bafbd644a 2025-10-15 16:49:06,725 - DEBUG - SI ctest-si-16995913 has Port Tuple: ['ctest-port_tuple-00596574'] 2025-10-15 16:49:06,797 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601 2025-10-15 16:49:06,871 - INFO - VMI and/or RI refs are present for VN default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451 2025-10-15 16:49:06,871 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 16:49:06,871 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 16:49:06,871 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 141.75.222.131, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 16:49:06,871 - DEBUG - ping -s 56 -c 3 -W 1 141.75.222.131 2025-10-15 16:49:56,910 - DEBUG - PING 141.75.222.131 (141.75.222.131) 56(84) bytes of data. 64 bytes from 141.75.222.131: icmp_req=1 ttl=63 time=10.8 ms 64 bytes from 141.75.222.131: icmp_req=2 ttl=63 time=1.73 ms 64 bytes from 141.75.222.131: icmp_req=3 ttl=63 time=1.07 ms --- 141.75.222.131 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2003ms rtt min/avg/max/mdev = 1.070/4.552/10.855/4.465 ms 2025-10-15 16:49:56,910 - INFO - Ping to IP 141.75.222.131 from VM ctest-left_vm-71169580 passed 2025-10-15 16:49:56,919 - DEBUG - Policy np_rules : [rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-66353013:ctest-si-16995913, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None, rule_sequence = None, rule_uuid = None, direction = <>, protocol = icmp6, src_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-66353013:ctest-left-67345601, security_group = None, network_policy = None, subnet_list = []], src_ports = [start_port = 0, end_port = 65535], application = [], dst_addresses = [subnet = None, virtual_network = default-domain:ctest-TestSVCV2Mirror-66353013:ctest-right-65563451, security_group = None, network_policy = None, subnet_list = []], dst_ports = [start_port = 0, end_port = 65535], action_list = simple_action = pass, gateway_name = None, apply_service = [], service_properties = None, mirror_to = analyzer_name = default-domain:ctest-TestSVCV2Mirror-66353013:ctest-si-16995913, encapsulation = None, analyzer_ip_address = None, analyzer_mac_address = None, routing_instance = None, udp_port = None, juniper_header = True, nh_mode = None, static_nh_header = None, nic_assisted_mirroring = False, nic_assisted_mirroring_vlan = None, assign_routing_instance = None, log = False, alert = False, qos_action = None, host_based_service = False, ethertype = None, created = None, last_modified = None, description = None] 2025-10-15 16:49:56,992 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-10-15 16:49:56,992 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:49:56,997 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:49:57,009 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:49:57,089 - DEBUG - Requesting: http://10.0.0.130:8082/service-instance/c80cfdd4-354f-4d5c-bd7a-005bafbd644a 2025-10-15 16:49:57,097 - DEBUG - Requesting: http://10.0.0.130:8082/port-tuple/f7d1f7be-8ee1-4138-919b-8d5e0e772491 2025-10-15 16:49:57,104 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-machine-interface/a91e20d0-887a-415f-8195-632ef605f5ec 2025-10-15 16:49:57,279 - DEBUG - Executing command: rm -f /tmp/mirror-tapa91e20d0-88_ctest-random-16520275.pcap 2025-10-15 16:50:07,387 - INFO - Starting tcpdump to capture the mirrored packets. 2025-10-15 16:50:07,387 - DEBUG - Executing command: sudo tcpdump -ni tapa91e20d0-88 -U udp port 8099 -w /tmp/mirror-tapa91e20d0-88_ctest-random-16520275.pcap 2025-10-15 16:50:17,421 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 141.75.222.131, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.141, gateway password: c0ntrail123 2025-10-15 16:50:17,422 - DEBUG - ping -s 56 -c 3 -W 1 141.75.222.131 2025-10-15 16:50:19,910 - DEBUG - PING 141.75.222.131 (141.75.222.131) 56(84) bytes of data. 64 bytes from 141.75.222.131: icmp_req=1 ttl=63 time=3.92 ms 64 bytes from 141.75.222.131: icmp_req=2 ttl=63 time=1.36 ms 64 bytes from 141.75.222.131: icmp_req=3 ttl=63 time=1.38 ms --- 141.75.222.131 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.366/2.227/3.927/1.202 ms 2025-10-15 16:50:19,910 - INFO - Ping to IP 141.75.222.131 from VM ctest-left_vm-71169580 passed 2025-10-15 16:50:19,910 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:50:19,917 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:50:19,929 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:50:20,014 - DEBUG - Requesting: http://10.0.0.130:8082/service-instance/c80cfdd4-354f-4d5c-bd7a-005bafbd644a 2025-10-15 16:50:20,024 - DEBUG - Requesting: http://10.0.0.130:8082/port-tuple/f7d1f7be-8ee1-4138-919b-8d5e0e772491 2025-10-15 16:50:20,031 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-machine-interface/a91e20d0-887a-415f-8195-632ef605f5ec 2025-10-15 16:50:20,133 - DEBUG - Waiting for the tcpdump write to complete. 2025-10-15 16:50:22,134 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep /tmp/mirror-tapa91e20d0-88_ctest-random-16520275.pcap| awk '{print $2}') 2025-10-15 16:50:22,137 - DEBUG - Executing command: sync 2025-10-15 16:50:25,187 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tapa91e20d0-88_ctest-random-16520275.pcap | wc -l 2025-10-15 16:50:25,203 - DEBUG - STDOUT: 12 2025-10-15 16:50:25,203 - DEBUG - STDERR: reading from file /tmp/mirror-tapa91e20d0-88_ctest-random-16520275.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2025-10-15 16:50:25,203 - DEBUG - Executing command: sudo tcpdump -n -r /tmp/mirror-tapa91e20d0-88_ctest-random-16520275.pcap 2025-10-15 16:50:25,248 - INFO - 12 ICMP packets are mirrored to the analyzer service VM 'ctest-pt_svm0-81878118' 2025-10-15 16:50:25,248 - INFO - Dettaching policy ctest-policy-04925378 from vn ctest-right-65563451 2025-10-15 16:50:25,393 - INFO - Dettaching policy ctest-policy-04925378 from vn ctest-left-67345601 2025-10-15 16:50:25,625 - INFO - Deleted policy ctest-policy-04925378 2025-10-15 16:50:25,625 - DEBUG - Deleting service instance: ['default-domain', 'ctest-TestSVCV2Mirror-66353013', 'ctest-si-16995913'] 2025-10-15 16:50:25,726 - INFO - Deleted SI ['default-domain', 'ctest-TestSVCV2Mirror-66353013', 'ctest-si-16995913'] 2025-10-15 16:50:25,727 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:50:25,736 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:50:25,748 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:50:25,865 - DEBUG - Service instance ctest-si-16995913 removed from api server 2025-10-15 16:50:25,865 - DEBUG - Requesting: http://10.0.0.130:8082/virtual-machine/754e1eb3-6065-40e9-aab3-bccee1d8d9f6 2025-10-15 16:50:25,879 - DEBUG - All Service VMs unlinked from SI ctest-si-16995913 2025-10-15 16:50:25,894 - DEBUG - 0 svc intances found in all projects. They are [] 2025-10-15 16:50:25,894 - DEBUG - 0 svc intances found in current project. They are [] 2025-10-15 16:50:25,945 - DEBUG - 0 svc intances found in all projects. They are [] 2025-10-15 16:50:25,945 - DEBUG - 0 svc intances found in current project. They are [] 2025-10-15 16:50:25,945 - INFO - Deleting VM ctest-pt_svm0-81878118 2025-10-15 16:50:26,047 - DEBUG - Deleting service template: ['default-domain', 'ctest-service_template_1-61280549'] 2025-10-15 16:50:26,141 - INFO - Service template: ['default-domain', 'ctest-service_template_1-61280549'] deleted successfully. 2025-10-15 16:50:26,141 - INFO - Deleting VM ctest-right_vm-57265852 2025-10-15 16:50:26,215 - INFO - Deleting VM ctest-left_vm-71169580 2025-10-15 16:50:26,284 - INFO - Deleting VN ctest-trans_right_vn-74723091 2025-10-15 16:50:26,427 - DEBUG - Response for deleting network () 2025-10-15 16:50:26,427 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/204e1483-494c-4583-823b-1f14c5ba353a 2025-10-15 16:50:26,433 - DEBUG - Response Code: 404 2025-10-15 16:50:26,433 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:50:26,438 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:50:26,457 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:50:26,551 - INFO - Validated that VN ctest-trans_right_vn-74723091 is not found in API Server 2025-10-15 16:50:26,564 - DEBUG - VN ctest-trans_right_vn-74723091 is not present in Agent 10.0.0.141 2025-10-15 16:50:26,574 - DEBUG - VN ctest-trans_right_vn-74723091 is not present in Agent 10.0.0.33 2025-10-15 16:50:26,574 - INFO - Validated that VN ctest-trans_right_vn-74723091 is not in any agent 2025-10-15 16:50:26,620 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_right_vn-74723091 info 2025-10-15 16:50:26,620 - INFO - Deleting VN ctest-trans_left_vn-83948900 2025-10-15 16:50:26,664 - DEBUG - VN 5a3cb9ac-3208-4c07-94af-c4c2d230b555 still in use: Unable to complete operation on network 5a3cb9ac-3208-4c07-94af-c4c2d230b555. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-c9246afd-3770-4449-b018-124b2af0de87'] 2025-10-15 16:50:26,664 - WARNING - Deleting VN ctest-trans_left_vn-83948900 failed..Will retry 2025-10-15 16:50:28,831 - DEBUG - Response for deleting network () 2025-10-15 16:50:28,831 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/123802b9-91cd-4006-a68a-f27467ed0622 2025-10-15 16:50:28,837 - DEBUG - Response Code: 404 2025-10-15 16:50:28,837 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:50:28,845 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:50:28,860 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:50:28,947 - INFO - Validated that VN ctest-trans_left_vn-83948900 is not found in API Server 2025-10-15 16:50:28,957 - DEBUG - VN ctest-trans_left_vn-83948900 is not present in Agent 10.0.0.141 2025-10-15 16:50:28,968 - DEBUG - VN ctest-trans_left_vn-83948900 is not present in Agent 10.0.0.33 2025-10-15 16:50:28,968 - INFO - Validated that VN ctest-trans_left_vn-83948900 is not in any agent 2025-10-15 16:50:29,002 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-trans_left_vn-83948900 info 2025-10-15 16:50:29,002 - INFO - Deleting VN ctest-mgmt_vn-86216435 2025-10-15 16:50:29,141 - DEBUG - Response for deleting network () 2025-10-15 16:50:29,141 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/72b4fbbc-c63d-4a96-a7c3-b22c3d28c5de 2025-10-15 16:50:29,146 - DEBUG - Response Code: 404 2025-10-15 16:50:29,146 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:50:29,158 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:50:29,168 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:50:29,256 - INFO - Validated that VN ctest-mgmt_vn-86216435 is not found in API Server 2025-10-15 16:50:29,268 - DEBUG - VN ctest-mgmt_vn-86216435 is not present in Agent 10.0.0.141 2025-10-15 16:50:29,279 - DEBUG - VN ctest-mgmt_vn-86216435 is not present in Agent 10.0.0.33 2025-10-15 16:50:29,279 - INFO - Validated that VN ctest-mgmt_vn-86216435 is not in any agent 2025-10-15 16:50:29,316 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-mgmt_vn-86216435 info 2025-10-15 16:50:29,316 - INFO - Deleting VN ctest-right-65563451 2025-10-15 16:50:29,490 - DEBUG - Response for deleting network () 2025-10-15 16:50:29,490 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/0e2d73b8-5f4d-4add-a375-45ca4072b661 2025-10-15 16:50:29,501 - DEBUG - Response Code: 404 2025-10-15 16:50:29,501 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:50:29,510 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:50:29,562 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:50:29,643 - INFO - Validated that VN ctest-right-65563451 is not found in API Server 2025-10-15 16:50:29,658 - DEBUG - VN ctest-right-65563451 is not present in Agent 10.0.0.141 2025-10-15 16:50:29,677 - DEBUG - VN ctest-right-65563451 is not present in Agent 10.0.0.33 2025-10-15 16:50:29,677 - INFO - Validated that VN ctest-right-65563451 is not in any agent 2025-10-15 16:50:29,714 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-right-65563451 info 2025-10-15 16:50:29,714 - INFO - Deleting VN ctest-left-67345601 2025-10-15 16:50:29,875 - DEBUG - Response for deleting network () 2025-10-15 16:50:29,875 - DEBUG - Requesting: http://10.0.0.130:8082/routing-instance/020e2d87-a697-4028-a6d6-985123f43cc0 2025-10-15 16:50:29,881 - DEBUG - Response Code: 404 2025-10-15 16:50:29,881 - DEBUG - Requesting: http://10.0.0.130:8082/domains 2025-10-15 16:50:29,887 - DEBUG - Requesting: http://10.0.0.130:8082/domain/424b027d-9a59-4bc3-a9ea-fd1131d532cb 2025-10-15 16:50:29,903 - DEBUG - Requesting: http://10.0.0.130:8082/project/75dec350-f6b3-4cd7-b956-ba08f3ba59cc 2025-10-15 16:50:29,988 - INFO - Validated that VN ctest-left-67345601 is not found in API Server 2025-10-15 16:50:29,998 - DEBUG - VN ctest-left-67345601 is not present in Agent 10.0.0.141 2025-10-15 16:50:30,011 - DEBUG - VN ctest-left-67345601 is not present in Agent 10.0.0.33 2025-10-15 16:50:30,011 - INFO - Validated that VN ctest-left-67345601 is not in any agent 2025-10-15 16:50:30,044 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-left-67345601 info 2025-10-15 16:50:31,337 - DEBUG - No XMPP flaps were noticed during the test 2025-10-15 16:50:31,337 - INFO -
2025-10-15 16:50:31,338 - INFO - END TEST : test_svc_v2_mirroring : PASSED[0:02:54]
2025-10-15 16:50:31,338 - INFO - -------------------------------------------------------------------------------- 2025-10-15 16:50:32,018 - INFO - Deleted project: ctest-TestSVCV2Mirror-66353013, ID : 75dec350-f6b3-4cd7-b956-ba08f3ba59cc