2025-09-18 02:56:59,710 - INFO - Domain Default found not creating 2025-09-18 02:56:59,885 - INFO - Project ctest-SecurityGroupBasicRegressionTests1-19905344 not found, creating it 2025-09-18 02:57:00,641 - INFO - Created Project:ctest-SecurityGroupBasicRegressionTests1-19905344, ID : cf7a7688-2db6-43e3-8e92-ca37cb048500 2025-09-18 02:57:03,223 - INFO - ================================================================================ 2025-09-18 02:57:03,223 - INFO - STARTING TEST : test_sec_group_basic 2025-09-18 02:57:03,223 - INFO - TEST DESCRIPTION : Description: Test basic SG features 1. Security group create and delete 2. Create security group with custom rules and then update it for tcp 3. Launch VM with custom created security group and verify 4. Remove secuity group association with VM 5. Add back custom security group to VM and verify 6. Try to delete security group with association to VM. It should fail. 7. Test with ping, which should fail 8. Test with TCP which should pass 9. Update the rules to allow icmp, ping should pass now. 2025-09-18 02:57:04,500 - DEBUG - Nothing to compare xmpp stats {'10.0.0.61': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.27': {'10.20.0.17': '0', '10.20.0.25': '0'}} with 2025-09-18 02:57:04,501 - INFO - Initial checks done. Running the testcase now 2025-09-18 02:57:04,501 - INFO - 2025-09-18 02:57:04,871 - INFO - Creating Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'ctest-test_sec_group-41152781'] 2025-09-18 02:57:06,050 - DEBUG - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'ctest-test_sec_group-41152781'] created succesfully 2025-09-18 02:57:06,050 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-18 02:57:06,423 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-18 02:57:06,463 - DEBUG - Requesting: http://10.0.0.56:8082/domain/245899c5-19ba-4930-be6a-859f116860e1 2025-09-18 02:57:06,482 - DEBUG - Requesting: http://10.0.0.56:8082/project/cf7a7688-2db6-43e3-8e92-ca37cb048500 2025-09-18 02:57:06,583 - DEBUG - Requesting: http://10.0.0.56:8082/security-group/ad440701-99e2-476e-9839-8e4bb617edca 2025-09-18 02:57:06,592 - INFO - Security group ctest-test_sec_group-41152781 found in the API Server 2025-09-18 02:57:06,592 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-18 02:57:06,598 - DEBUG - Requesting: http://10.0.0.56:8082/domain/245899c5-19ba-4930-be6a-859f116860e1 2025-09-18 02:57:06,610 - DEBUG - Requesting: http://10.0.0.56:8082/project/cf7a7688-2db6-43e3-8e92-ca37cb048500 2025-09-18 02:57:06,718 - DEBUG - Requesting: http://10.0.0.56:8082/access-control-lists 2025-09-18 02:57:06,732 - INFO - Validated that ACLs for Security group ctest-test_sec_group-41152781 are present in API Server 2025-09-18 02:57:06,740 - INFO - Validated that Security group ctest-test_sec_group-41152781 is found in control node 10.0.0.56 2025-09-18 02:57:06,747 - DEBUG - Security group ctest-test_sec_group-41152781 ACLs found in the control node 10.0.0.56 2025-09-18 02:57:06,754 - INFO - Validated that Security group ctest-test_sec_group-41152781 is found in control node 10.0.0.22 2025-09-18 02:57:06,760 - DEBUG - Security group ctest-test_sec_group-41152781 ACLs found in the control node 10.0.0.22 2025-09-18 02:57:06,766 - INFO - Validated that Security group ctest-test_sec_group-41152781 is found in control node 10.0.0.41 2025-09-18 02:57:06,772 - DEBUG - Security group ctest-test_sec_group-41152781 ACLs found in the control node 10.0.0.41 2025-09-18 02:57:06,772 - INFO - Validated SG ctest-test_sec_group-41152781 in Control nodes 2025-09-18 02:57:06,773 - INFO - Deleting Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'ctest-test_sec_group-41152781'] 2025-09-18 02:57:06,865 - INFO - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'ctest-test_sec_group-41152781'] deleted successfully. 2025-09-18 02:57:06,866 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-18 02:57:06,883 - DEBUG - Requesting: http://10.0.0.56:8082/domain/245899c5-19ba-4930-be6a-859f116860e1 2025-09-18 02:57:06,898 - DEBUG - Requesting: http://10.0.0.56:8082/project/cf7a7688-2db6-43e3-8e92-ca37cb048500 2025-09-18 02:57:06,989 - INFO - Security group ctest-test_sec_group-41152781 removed from the API Server 2025-09-18 02:57:06,989 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-18 02:57:07,000 - DEBUG - Requesting: http://10.0.0.56:8082/domain/245899c5-19ba-4930-be6a-859f116860e1 2025-09-18 02:57:07,016 - DEBUG - Requesting: http://10.0.0.56:8082/project/cf7a7688-2db6-43e3-8e92-ca37cb048500 2025-09-18 02:57:07,114 - DEBUG - Requesting: http://10.0.0.56:8082/access-control-lists 2025-09-18 02:57:07,122 - DEBUG - ACLs for Security group ctest-test_sec_group-41152781 removed from the API Server 2025-09-18 02:57:07,129 - INFO - security group ctest-test_sec_group-41152781 removed from Control-node 10.0.0.56 2025-09-18 02:57:07,137 - DEBUG - Security group ctest-test_sec_group-41152781 ACLs removed from the control node 10.0.0.56 2025-09-18 02:57:07,142 - INFO - security group ctest-test_sec_group-41152781 removed from Control-node 10.0.0.22 2025-09-18 02:57:07,148 - DEBUG - Security group ctest-test_sec_group-41152781 ACLs removed from the control node 10.0.0.22 2025-09-18 02:57:07,154 - INFO - security group ctest-test_sec_group-41152781 removed from Control-node 10.0.0.41 2025-09-18 02:57:07,160 - DEBUG - Security group ctest-test_sec_group-41152781 ACLs removed from the control node 10.0.0.41 2025-09-18 02:57:07,160 - INFO - Validated that SG ctest-test_sec_group-41152781 is not in control nodes 2025-09-18 02:57:07,166 - INFO - Creating Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'ctest-test_sec_group-41152781'] 2025-09-18 02:57:08,291 - DEBUG - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'ctest-test_sec_group-41152781'] created succesfully 2025-09-18 02:57:08,291 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-18 02:57:08,307 - DEBUG - Requesting: http://10.0.0.56:8082/domain/245899c5-19ba-4930-be6a-859f116860e1 2025-09-18 02:57:08,328 - DEBUG - Requesting: http://10.0.0.56:8082/project/cf7a7688-2db6-43e3-8e92-ca37cb048500 2025-09-18 02:57:08,431 - DEBUG - Requesting: http://10.0.0.56:8082/security-group/388e058b-0144-4cad-bcf7-b6dad44271be 2025-09-18 02:57:08,453 - INFO - Security group ctest-test_sec_group-41152781 found in the API Server 2025-09-18 02:57:08,453 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-18 02:57:08,462 - DEBUG - Requesting: http://10.0.0.56:8082/domain/245899c5-19ba-4930-be6a-859f116860e1 2025-09-18 02:57:08,477 - DEBUG - Requesting: http://10.0.0.56:8082/project/cf7a7688-2db6-43e3-8e92-ca37cb048500 2025-09-18 02:57:08,589 - DEBUG - Requesting: http://10.0.0.56:8082/access-control-lists 2025-09-18 02:57:08,598 - INFO - Validated that ACLs for Security group ctest-test_sec_group-41152781 are present in API Server 2025-09-18 02:57:08,605 - INFO - Validated that Security group ctest-test_sec_group-41152781 is found in control node 10.0.0.56 2025-09-18 02:57:08,612 - DEBUG - Security group ctest-test_sec_group-41152781 ACLs found in the control node 10.0.0.56 2025-09-18 02:57:08,619 - INFO - Validated that Security group ctest-test_sec_group-41152781 is found in control node 10.0.0.22 2025-09-18 02:57:08,625 - DEBUG - Security group ctest-test_sec_group-41152781 ACLs found in the control node 10.0.0.22 2025-09-18 02:57:08,632 - INFO - Validated that Security group ctest-test_sec_group-41152781 is found in control node 10.0.0.41 2025-09-18 02:57:08,638 - DEBUG - Security group ctest-test_sec_group-41152781 ACLs found in the control node 10.0.0.41 2025-09-18 02:57:08,638 - INFO - Validated SG ctest-test_sec_group-41152781 in Control nodes 2025-09-18 02:57:08,638 - DEBUG - Replace all the rules of this security group ctest-test_sec_group-41152781 with the new rules 2025-09-18 02:57:08,638 - DEBUG - [{'protocol': 'tcp', 'dst_addresses': [{'subnet': {'ip_prefix': '183.52.194.192', 'ip_prefix_len': '26'}}], 'dst_ports': [{'start_port': 0, 'end_port': -1}], 'src_ports': [{'start_port': 0, 'end_port': -1}], 'src_addresses': [{'security_group': 'local'}]}, {'protocol': 'tcp', 'src_addresses': [{'subnet': {'ip_prefix': '183.52.194.192', 'ip_prefix_len': '26'}}], 'dst_ports': [{'start_port': 0, 'end_port': -1}], 'src_ports': [{'start_port': 0, 'end_port': -1}], 'dst_addresses': [{'security_group': 'local'}]}] 2025-09-18 02:57:09,485 - DEBUG - Response for create_network : {'network': {'id': '9d7612e7-d4f8-4a9a-846f-45c1c6997f21', 'name': 'ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'tenant_id': 'cf7a76882db643e38e92ca37cb048500', 'project_id': 'cf7a76882db643e38e92ca37cb048500', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'ctest-SecurityGroupBasicRegressionTests1-19905344-76685173'], 'port_security_enabled': True, 'description': ''}} 2025-09-18 02:57:09,745 - DEBUG - Response for create_subnet : {'subnet': {'id': '3e69742d-ed9f-4d79-a234-06c666ac1bfc', 'name': '', 'tenant_id': 'cf7a76882db643e38e92ca37cb048500', 'network_id': '9d7612e7-d4f8-4a9a-846f-45c1c6997f21', 'ip_version': 4, 'cidr': '183.52.194.192/26', 'allocation_pools': [{'start': '183.52.194.194', 'end': '183.52.194.254'}], 'gateway_ip': '183.52.194.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '183.52.194.194', 'tags': [], 'project_id': 'cf7a76882db643e38e92ca37cb048500'}} 2025-09-18 02:57:09,776 - INFO - Created VN ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 02:57:09,793 - DEBUG - VN ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 UUID is 9d7612e7-d4f8-4a9a-846f-45c1c6997f21 2025-09-18 02:57:09,872 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-18 02:57:09,879 - DEBUG - Requesting: http://10.0.0.56:8082/domain/245899c5-19ba-4930-be6a-859f116860e1 2025-09-18 02:57:09,893 - DEBUG - Requesting: http://10.0.0.56:8082/project/cf7a7688-2db6-43e3-8e92-ca37cb048500 2025-09-18 02:57:09,996 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9d7612e7-d4f8-4a9a-846f-45c1c6997f21 2025-09-18 02:57:10,015 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9d7612e7-d4f8-4a9a-846f-45c1c6997f21 2025-09-18 02:57:10,029 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/b35e6815-c98c-4944-8434-c1abe749bcad 2025-09-18 02:57:10,037 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/b35e6815-c98c-4944-8434-c1abe749bcad 2025-09-18 02:57:10,045 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/6da9d6d2-2081-4341-af2b-d8e56ab465d0 2025-09-18 02:57:10,052 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-18 02:57:10,053 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9d7612e7-d4f8-4a9a-846f-45c1c6997f21 2025-09-18 02:57:10,063 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/b35e6815-c98c-4944-8434-c1abe749bcad 2025-09-18 02:57:10,081 - INFO - Verified VN network id 12 for VN 9d7612e7-d4f8-4a9a-846f-45c1c6997f21 2025-09-18 02:57:10,081 - INFO - Verifications in API Server for VN ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 passed 2025-09-18 02:57:10,081 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9d7612e7-d4f8-4a9a-846f-45c1c6997f21 2025-09-18 02:57:10,095 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/b35e6815-c98c-4944-8434-c1abe749bcad 2025-09-18 02:57:10,105 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/b35e6815-c98c-4944-8434-c1abe749bcad 2025-09-18 02:57:10,115 - DEBUG - Requesting: http://10.0.0.56:8082/route-target/6da9d6d2-2081-4341-af2b-d8e56ab465d0 2025-09-18 02:57:10,132 - DEBUG - Control-node 10.0.0.56 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11346277098126330522', 'uuid-lslong': '9542922833984323361'}, 'enable': 'true', 'created': '2025-09-18T02:57:09', 'last-modified': '2025-09-18T02:57:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.445237'} 2025-09-18 02:57:10,141 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-18 02:57:10,148 - DEBUG - Control-node 10.0.0.22 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11346277098126330522', 'uuid-lslong': '9542922833984323361'}, 'enable': 'true', 'created': '2025-09-18T02:57:09', 'last-modified': '2025-09-18T02:57:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.465677'} 2025-09-18 02:57:10,155 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-18 02:57:10,166 - DEBUG - Control-node 10.0.0.41 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '11346277098126330522', 'uuid-lslong': '9542922833984323361'}, 'enable': 'true', 'created': '2025-09-18T02:57:09', 'last-modified': '2025-09-18T02:57:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.486290'} 2025-09-18 02:57:10,180 - DEBUG - Route Targets: ['target:64512:8000004'] 2025-09-18 02:57:10,180 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 passed 2025-09-18 02:57:10,180 - DEBUG - ====Verifying policy data for ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 in API_Server ====== 2025-09-18 02:57:10,181 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-18 02:57:10,188 - DEBUG - Requesting: http://10.0.0.56:8082/domain/245899c5-19ba-4930-be6a-859f116860e1 2025-09-18 02:57:10,202 - DEBUG - Requesting: http://10.0.0.56:8082/project/cf7a7688-2db6-43e3-8e92-ca37cb048500 2025-09-18 02:57:10,302 - DEBUG - Requesting: http://10.0.0.56:8082/virtual-network/9d7612e7-d4f8-4a9a-846f-45c1c6997f21 2025-09-18 02:57:10,319 - DEBUG - =>VN ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 has no policy to be verified 2025-09-18 02:57:10,319 - DEBUG - Verifying the vn in opserver 2025-09-18 02:57:10,319 - DEBUG - Verifying the default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 virtual network link through opserver 10.0.0.56 2025-09-18 02:57:10,319 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-09-18 02:57:10,662 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-networks 2025-09-18 02:57:10,729 - DEBUG - vn link and name as {'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173?flat'} 2025-09-18 02:57:10,729 - DEBUG - Verifying the default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 virtual network link through opserver 10.0.0.22 2025-09-18 02:57:10,729 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-18 02:57:11,078 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-networks 2025-09-18 02:57:11,146 - DEBUG - vn link and name as {'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173?flat'} 2025-09-18 02:57:11,146 - DEBUG - Verifying the default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 virtual network link through opserver 10.0.0.41 2025-09-18 02:57:11,146 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-09-18 02:57:11,518 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-networks 2025-09-18 02:57:11,585 - DEBUG - vn link and name as {'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173?flat'} 2025-09-18 02:57:11,585 - INFO - Validated that VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is found in opserver 2025-09-18 02:57:11,610 - DEBUG - Do not have enough data to verify VN in agent 2025-09-18 02:57:11,625 - DEBUG - VRF ids for VN ctest-SecurityGroupBasicRegressionTests1-19905344-76685173: {} 2025-09-18 02:57:11,692 - DEBUG - Services list from nova: [, , , ] 2025-09-18 02:57:13,013 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4130-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4130-1) 2025-09-18 02:57:14,885 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-4130-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-4130-2) 2025-09-18 02:57:14,998 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-09-18 02:57:20,094 - DEBUG - VM is in ACTIVE state now 2025-09-18 02:57:20,095 - INFO - VM name : ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 2025-09-18 02:57:20,184 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 ID is d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 02:57:20,289 - DEBUG - VM is in ACTIVE state now 2025-09-18 02:57:20,321 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 launched on Node an-jenkins-deploy-platform-ansible-os-4130-1 2025-09-18 02:57:20,411 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 02:57:20,759 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 02:57:20,800 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 02:57:20,809 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/e8860bb7-d202-44ce-97a9-586fca91916e 2025-09-18 02:57:20,822 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 02:57:20,832 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/e8860bb7-d202-44ce-97a9-586fca91916e 2025-09-18 02:57:20,845 - DEBUG - Requesting: http://10.0.0.41:8082/instance-ip/21f8c2a8-a260-4fa3-999e-8feb0a108f79 2025-09-18 02:57:20,858 - DEBUG - Verifying in api server 10.0.0.41 2025-09-18 02:57:20,858 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 02:57:20,867 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/e8860bb7-d202-44ce-97a9-586fca91916e 2025-09-18 02:57:20,880 - DEBUG - Requesting: http://10.0.0.41:8082/instance-ip/21f8c2a8-a260-4fa3-999e-8feb0a108f79 2025-09-18 02:57:20,891 - INFO - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 verfication in all API Servers passed 2025-09-18 02:57:20,910 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 Tap interface: {'index': '3', 'name': 'tape8860bb7-d2', 'uuid': 'e8860bb7-d202-44ce-97a9-586fca91916e', 'vrf_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'vm_uuid': 'd790a63e-8cf8-4f02-a570-0c3b571c89e3', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1-19905344-20499969', 'ip_addr': '183.52.194.195', 'mac_addr': '02:e8:86:0b:b7:d2', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '76', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:e8860bb7-d202-44ce-97a9-586fca91916e', 'sg_uuid_list': ['388e058b-0144-4cad-bcf7-b6dad44271be'], 'static_route_list': None, 'vm_project_uuid': 'cf7a7688-2db6-43e3-8e92-ca37cb048500', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-09-18 02:57:20,910 - DEBUG - Agent 10.0.0.61 vrf name: default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 02:57:20,916 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'table_label': '-1', 'vxlan_id': '12', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.129:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-09-18 02:57:20,998 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 : Tap interface tape8860bb7-d2 is set to Active 2025-09-18 02:57:20,998 - DEBUG - Tap interface tape8860bb7-d2 detail : {'index': '3', 'name': 'tape8860bb7-d2', 'uuid': 'e8860bb7-d202-44ce-97a9-586fca91916e', 'vrf_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'vm_uuid': 'd790a63e-8cf8-4f02-a570-0c3b571c89e3', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1-19905344-20499969', 'ip_addr': '183.52.194.195', 'mac_addr': '02:e8:86:0b:b7:d2', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '76', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:e8860bb7-d202-44ce-97a9-586fca91916e', 'sg_uuid_list': ['388e058b-0144-4cad-bcf7-b6dad44271be'], 'static_route_list': None, 'vm_project_uuid': 'cf7a7688-2db6-43e3-8e92-ca37cb048500', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-09-18 02:57:21,115 - DEBUG - Starting Layer 2 verification in Agent 2025-09-18 02:57:21,131 - DEBUG - Layer 2 path is seen for VM MAC 02:e8:86:0b:b7:d2 in agent 10.0.0.61 2025-09-18 02:57:21,131 - DEBUG - Active layer 2 route in agent is present for VMI tape8860bb7-d2 2025-09-18 02:57:21,131 - DEBUG - L2 label(29) matches bw route table and interface table 2025-09-18 02:57:21,139 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is found in Agent of node 10.0.0.61 2025-09-18 02:57:21,273 - DEBUG - VRF IDs of VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is consistent in agent 10.0.0.61 2025-09-18 02:57:21,273 - DEBUG - Route for VM IP ['183.52.194.195'] is consistent in agent 10.0.0.61 2025-09-18 02:57:21,273 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 verification for VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 in Agent 10.0.0.61 passed 2025-09-18 02:57:21,386 - DEBUG - Starting all layer 2 verification in agent 10.0.0.61 2025-09-18 02:57:21,399 - DEBUG - Route for VM MAC 02:e8:86:0b:b7:d2 is consistent in agent 10.0.0.61 2025-09-18 02:57:21,405 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is found in Agent of node 10.0.0.27 2025-09-18 02:57:21,532 - DEBUG - VRF IDs of VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is consistent in agent 10.0.0.27 2025-09-18 02:57:21,533 - DEBUG - Route for VM IP ['183.52.194.195'] is consistent in agent 10.0.0.27 2025-09-18 02:57:21,533 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 verification for VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 in Agent 10.0.0.27 passed 2025-09-18 02:57:21,652 - DEBUG - Starting all layer 2 verification in agent 10.0.0.27 2025-09-18 02:57:21,662 - DEBUG - Route for VM MAC 02:e8:86:0b:b7:d2 is consistent in agent 10.0.0.27 2025-09-18 02:57:24,847 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2025-09-18 02:57:24,847 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 failed! 2025-09-18 02:57:24,861 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is 183.52.194.193 and allocation pool is NOT set 2025-09-18 02:57:28,935 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms') 2025-09-18 02:57:28,935 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 failed! 2025-09-18 02:57:28,949 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is 183.52.194.193 and allocation pool is NOT set 2025-09-18 02:57:33,033 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1022ms') 2025-09-18 02:57:33,033 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 failed! 2025-09-18 02:57:33,049 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is 183.52.194.193 and allocation pool is NOT set 2025-09-18 02:57:37,134 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-09-18 02:57:37,134 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 failed! 2025-09-18 02:57:37,149 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is 183.52.194.193 and allocation pool is NOT set 2025-09-18 02:57:41,229 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-09-18 02:57:41,229 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 failed! 2025-09-18 02:57:41,244 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is 183.52.194.193 and allocation pool is NOT set 2025-09-18 02:57:45,326 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2025-09-18 02:57:45,327 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 failed! 2025-09-18 02:57:45,350 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is 183.52.194.193 and allocation pool is NOT set 2025-09-18 02:57:49,420 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1007ms') 2025-09-18 02:57:49,420 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 failed! 2025-09-18 02:57:49,435 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is 183.52.194.193 and allocation pool is NOT set 2025-09-18 02:57:53,517 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1019ms') 2025-09-18 02:57:53,517 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 failed! 2025-09-18 02:57:53,533 - DEBUG - Gateway for vn default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is 183.52.194.193 and allocation pool is NOT set 2025-09-18 02:57:55,593 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=8.16 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=3.77 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 3.773/5.964/8.155/2.191 ms') 2025-09-18 02:57:55,593 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 passed 2025-09-18 02:57:55,593 - INFO - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 verifications in Compute nodes passed 2025-09-18 02:57:55,802 - DEBUG - Validated VM route 183.52.194.195 in vrouter of 10.0.0.61 2025-09-18 02:57:55,809 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-09-18 02:57:55,929 - DEBUG - Validated VM route 183.52.194.195 in vrouter of 10.0.0.27 2025-09-18 02:57:55,935 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: 10.20.0.129, 25; Got 10.20.0.129,25 2025-09-18 02:57:55,935 - DEBUG - Validated VM route 183.52.194.195 in vrouter of 10.0.0.27 2025-09-18 02:57:55,935 - INFO - Validated routes of VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 in all vrouters 2025-09-18 02:57:56,347 - DEBUG - Starting all layer2 verification in 10.0.0.22 Control Node 2025-09-18 02:57:56,478 - DEBUG - Layer2 route found for VM MAC 02:e8:86:0b:b7:d2 in Control-node 10.0.0.22 2025-09-18 02:57:56,478 - DEBUG - L2 Label for VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 same between Control-node 10.0.0.22 and Agent, Expected: 29, Seen: 29 2025-09-18 02:57:56,478 - DEBUG - Starting all layer2 verification in 10.0.0.56 Control Node 2025-09-18 02:57:56,611 - DEBUG - Layer2 route found for VM MAC 02:e8:86:0b:b7:d2 in Control-node 10.0.0.56 2025-09-18 02:57:56,611 - DEBUG - L2 Label for VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 same between Control-node 10.0.0.56 and Agent, Expected: 29, Seen: 29 2025-09-18 02:57:56,611 - INFO - Verification in Control-nodes for VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 passed 2025-09-18 02:57:56,612 - DEBUG - Verifying the vm in opserver 2025-09-18 02:57:56,612 - DEBUG - Verifying in collector 10.0.0.41 ... 2025-09-18 02:57:56,612 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3?flat 2025-09-18 02:57:56,681 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:e8860bb7-d202-44ce-97a9-586fca91916e?flat 2025-09-18 02:57:56,755 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:e8860bb7-d202-44ce-97a9-586fca91916e?flat 2025-09-18 02:57:56,826 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3?flat 2025-09-18 02:57:56,841 - DEBUG - Verifying vm in vn uve 2025-09-18 02:57:56,841 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:e8860bb7-d202-44ce-97a9-586fca91916e?flat 2025-09-18 02:57:56,861 - DEBUG - VM uve shows interface as {'ip_address': '183.52.194.195', 'label': 25, 'uuid': 'e8860bb7-d202-44ce-97a9-586fca91916e', 'ip6_active': False, 'gateway': '183.52.194.193', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1-19905344-20499969', 'ip6_address': '::', 'active': True, 'port_mirror_enabled': False, 'mac_address': '02:e8:86:0b:b7:d2', 'virtual_network': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'ip4_active': True, 'is_health_check_active': True, 'vhostuser_mode': 0, 'admin_state': True, 'l2_active': True, 'fixed_ip4_list': ['183.52.194.195'], 'rx_vlan': 65535, 'vm_uuid': 'd790a63e-8cf8-4f02-a570-0c3b571c89e3', 'tx_vlan': 65535, 'vn_uuid': '9d7612e7-d4f8-4a9a-846f-45c1c6997f21', '__T': 1758164244051008} 2025-09-18 02:57:56,861 - DEBUG - VM uve shows ip address as ['183.52.194.195', '::'] 2025-09-18 02:57:56,861 - DEBUG - VM uve shows virtual network as default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 02:57:56,861 - INFO - Verifying through opserver in 10.0.0.56 2025-09-18 02:57:56,861 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173?flat 2025-09-18 02:57:56,887 - DEBUG - expected vm list d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 02:57:56,887 - DEBUG - Extracted vm list ['d790a63e-8cf8-4f02-a570-0c3b571c89e3'] 2025-09-18 02:57:56,887 - INFO - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is present in default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 02:57:56,887 - DEBUG - Verifying vm in vrouter uve 2025-09-18 02:57:56,887 - DEBUG - Getting info from collector 10.0.0.41.. 2025-09-18 02:57:56,887 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3?flat 2025-09-18 02:57:56,955 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4130-1'] 2025-09-18 02:57:56,955 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-1:Compute:contrail-vrouter-agent:0?flat 2025-09-18 02:57:56,990 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-1?flat 2025-09-18 02:57:57,023 - DEBUG - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 02:57:57,023 - DEBUG - Validated that VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 is in Vrouter an-jenkins-deploy-platform-ansible-os-4130-1 UVE 2025-09-18 02:57:57,023 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-09-18 02:57:57,033 - DEBUG - Expected tap interface of VM uuid d790a63e-8cf8-4f02-a570-0c3b571c89e3 is default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:e8860bb7-d202-44ce-97a9-586fca91916e 2025-09-18 02:57:57,034 - DEBUG - Expected VN of VM uuid d790a63e-8cf8-4f02-a570-0c3b571c89e3 is default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 02:57:57,034 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-1:Compute:contrail-vrouter-agent:0?flat 2025-09-18 02:57:57,073 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-1?flat 2025-09-18 02:57:57,105 - DEBUG - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 02:57:57,105 - INFO - tap interface default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:e8860bb7-d202-44ce-97a9-586fca91916e of vm d790a63e-8cf8-4f02-a570-0c3b571c89e3 is present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 02:57:57,105 - DEBUG - Connected network default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 of vm d790a63e-8cf8-4f02-a570-0c3b571c89e3 is present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 02:57:57,105 - DEBUG - Verifying the d790a63e-8cf8-4f02-a570-0c3b571c89e3 virtual network link through opserver 10.0.0.56 2025-09-18 02:57:57,106 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2025-09-18 02:57:57,118 - DEBUG - VM link and name as {'name': 'd790a63e-8cf8-4f02-a570-0c3b571c89e3', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3?flat'} 2025-09-18 02:57:57,118 - DEBUG - Verifying the d790a63e-8cf8-4f02-a570-0c3b571c89e3 virtual network link through opserver 10.0.0.22 2025-09-18 02:57:57,118 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2025-09-18 02:57:57,178 - DEBUG - VM link and name as {'name': 'd790a63e-8cf8-4f02-a570-0c3b571c89e3', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3?flat'} 2025-09-18 02:57:57,178 - DEBUG - Verifying the d790a63e-8cf8-4f02-a570-0c3b571c89e3 virtual network link through opserver 10.0.0.41 2025-09-18 02:57:57,178 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machines 2025-09-18 02:57:57,191 - DEBUG - VM link and name as {'name': 'd790a63e-8cf8-4f02-a570-0c3b571c89e3', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3?flat'} 2025-09-18 02:57:57,191 - INFO - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 validations in Opserver passed 2025-09-18 02:57:57,191 - INFO - Waiting for VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 to be up.. 2025-09-18 02:57:57,191 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-18 02:57:57,191 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 02:57:57,210 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/e8860bb7-d202-44ce-97a9-586fca91916e 2025-09-18 02:57:58,379 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=1.85 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.67 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.668/1.757/1.846/0.089 ms') 2025-09-18 02:57:58,379 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 passed 2025-09-18 02:57:58,452 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-18 02:57:58,452 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969, IP 183.52.194.195, Port 22 2025-09-18 02:57:58,509 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-18 02:57:58,627 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-18 02:58:03,628 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-18 02:58:03,629 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969, IP 183.52.194.195, Port 22 2025-09-18 02:58:03,696 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-18 02:58:03,793 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-18 02:58:08,794 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-18 02:58:08,794 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969, IP 183.52.194.195, Port 22 2025-09-18 02:58:08,863 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-18 02:58:08,960 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-18 02:58:13,961 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-18 02:58:13,961 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969, IP 183.52.194.195, Port 22 2025-09-18 02:58:14,132 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 is ready for SSH connections 2025-09-18 02:58:14,217 - DEBUG - VM is in ACTIVE state now 2025-09-18 02:58:14,217 - INFO - VM name : ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 2025-09-18 02:58:14,306 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 ID is 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 2025-09-18 02:58:14,400 - DEBUG - VM is in ACTIVE state now 2025-09-18 02:58:14,400 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 launched on Node an-jenkins-deploy-platform-ansible-os-4130-2 2025-09-18 02:58:14,486 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093 2025-09-18 02:58:14,496 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093 2025-09-18 02:58:14,503 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/4e5cdf43-e896-483e-9f55-1acd6027cce4 2025-09-18 02:58:14,513 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093 2025-09-18 02:58:14,520 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/4e5cdf43-e896-483e-9f55-1acd6027cce4 2025-09-18 02:58:14,531 - DEBUG - Requesting: http://10.0.0.41:8082/instance-ip/6e03263e-64a5-4c27-9b4a-a8dbea5c0c37 2025-09-18 02:58:14,540 - DEBUG - Verifying in api server 10.0.0.41 2025-09-18 02:58:14,540 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093 2025-09-18 02:58:14,547 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/4e5cdf43-e896-483e-9f55-1acd6027cce4 2025-09-18 02:58:14,559 - DEBUG - Requesting: http://10.0.0.41:8082/instance-ip/6e03263e-64a5-4c27-9b4a-a8dbea5c0c37 2025-09-18 02:58:14,569 - INFO - VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 verfication in all API Servers passed 2025-09-18 02:58:14,592 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 Tap interface: {'index': '3', 'name': 'tap4e5cdf43-e8', 'uuid': '4e5cdf43-e896-483e-9f55-1acd6027cce4', 'vrf_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'vm_uuid': '7f44ee58-e0fe-44d9-808b-8ebb33b5a093', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1-19905344-59612402', 'ip_addr': '183.52.194.196', 'mac_addr': '02:4e:5c:df:43:e8', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '68', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:4e5cdf43-e896-483e-9f55-1acd6027cce4', 'sg_uuid_list': ['388e058b-0144-4cad-bcf7-b6dad44271be'], 'static_route_list': None, 'vm_project_uuid': 'cf7a7688-2db6-43e3-8e92-ca37cb048500', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-09-18 02:58:14,592 - DEBUG - Agent 10.0.0.27 vrf name: default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 02:58:14,598 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'table_label': '-1', 'vxlan_id': '12', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.192:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-09-18 02:58:14,683 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 : Tap interface tap4e5cdf43-e8 is set to Active 2025-09-18 02:58:14,683 - DEBUG - Tap interface tap4e5cdf43-e8 detail : {'index': '3', 'name': 'tap4e5cdf43-e8', 'uuid': '4e5cdf43-e896-483e-9f55-1acd6027cce4', 'vrf_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '12', 'vn_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'vm_uuid': '7f44ee58-e0fe-44d9-808b-8ebb33b5a093', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1-19905344-59612402', 'ip_addr': '183.52.194.196', 'mac_addr': '02:4e:5c:df:43:e8', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '68', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:4e5cdf43-e896-483e-9f55-1acd6027cce4', 'sg_uuid_list': ['388e058b-0144-4cad-bcf7-b6dad44271be'], 'static_route_list': None, 'vm_project_uuid': 'cf7a7688-2db6-43e3-8e92-ca37cb048500', 'admin_state': 'Enabled', 'flow_key_idx': '30', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-09-18 02:58:14,798 - DEBUG - Starting Layer 2 verification in Agent 2025-09-18 02:58:14,812 - DEBUG - Layer 2 path is seen for VM MAC 02:4e:5c:df:43:e8 in agent 10.0.0.27 2025-09-18 02:58:14,812 - DEBUG - Active layer 2 route in agent is present for VMI tap4e5cdf43-e8 2025-09-18 02:58:14,812 - DEBUG - L2 label(29) matches bw route table and interface table 2025-09-18 02:58:14,819 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is found in Agent of node 10.0.0.61 2025-09-18 02:58:14,946 - DEBUG - VRF IDs of VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is consistent in agent 10.0.0.61 2025-09-18 02:58:14,946 - DEBUG - Route for VM IP ['183.52.194.196'] is consistent in agent 10.0.0.61 2025-09-18 02:58:14,946 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 verification for VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 in Agent 10.0.0.61 passed 2025-09-18 02:58:15,058 - DEBUG - Starting all layer 2 verification in agent 10.0.0.61 2025-09-18 02:58:15,074 - DEBUG - Route for VM MAC 02:4e:5c:df:43:e8 is consistent in agent 10.0.0.61 2025-09-18 02:58:15,082 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is found in Agent of node 10.0.0.27 2025-09-18 02:58:15,212 - DEBUG - VRF IDs of VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is consistent in agent 10.0.0.27 2025-09-18 02:58:15,212 - DEBUG - Route for VM IP ['183.52.194.196'] is consistent in agent 10.0.0.27 2025-09-18 02:58:15,212 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 verification for VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 in Agent 10.0.0.27 passed 2025-09-18 02:58:15,326 - DEBUG - Starting all layer 2 verification in agent 10.0.0.27 2025-09-18 02:58:15,343 - DEBUG - Route for VM MAC 02:4e:5c:df:43:e8 is consistent in agent 10.0.0.27 2025-09-18 02:58:16,528 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.67 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=12.5 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 5.666/9.059/12.452/3.393 ms') 2025-09-18 02:58:16,529 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 passed 2025-09-18 02:58:16,529 - INFO - VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 verifications in Compute nodes passed 2025-09-18 02:58:16,759 - DEBUG - Validated VM route 183.52.194.196 in vrouter of 10.0.0.61 2025-09-18 02:58:16,765 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: 10.20.0.192, 25; Got 10.20.0.192,25 2025-09-18 02:58:16,765 - DEBUG - Validated VM route 183.52.194.196 in vrouter of 10.0.0.61 2025-09-18 02:58:16,902 - DEBUG - Validated VM route 183.52.194.196 in vrouter of 10.0.0.27 2025-09-18 02:58:16,908 - DEBUG - Remote Nh validation passed. Expected Tunnel, label: None, 0; Got None,0 2025-09-18 02:58:16,908 - INFO - Validated routes of VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 in all vrouters 2025-09-18 02:58:17,313 - DEBUG - Starting all layer2 verification in 10.0.0.22 Control Node 2025-09-18 02:58:17,451 - DEBUG - Layer2 route found for VM MAC 02:4e:5c:df:43:e8 in Control-node 10.0.0.22 2025-09-18 02:58:17,452 - DEBUG - L2 Label for VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 same between Control-node 10.0.0.22 and Agent, Expected: 29, Seen: 29 2025-09-18 02:58:17,452 - DEBUG - Starting all layer2 verification in 10.0.0.56 Control Node 2025-09-18 02:58:17,584 - DEBUG - Layer2 route found for VM MAC 02:4e:5c:df:43:e8 in Control-node 10.0.0.56 2025-09-18 02:58:17,584 - DEBUG - L2 Label for VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 same between Control-node 10.0.0.56 and Agent, Expected: 29, Seen: 29 2025-09-18 02:58:17,584 - INFO - Verification in Control-nodes for VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 passed 2025-09-18 02:58:17,584 - DEBUG - Verifying the vm in opserver 2025-09-18 02:58:17,584 - DEBUG - Verifying in collector 10.0.0.41 ... 2025-09-18 02:58:17,585 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093?flat 2025-09-18 02:58:17,599 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:4e5cdf43-e896-483e-9f55-1acd6027cce4?flat 2025-09-18 02:58:17,617 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:4e5cdf43-e896-483e-9f55-1acd6027cce4?flat 2025-09-18 02:58:17,637 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093?flat 2025-09-18 02:58:17,651 - DEBUG - Verifying vm in vn uve 2025-09-18 02:58:17,652 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machine-interface/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:4e5cdf43-e896-483e-9f55-1acd6027cce4?flat 2025-09-18 02:58:17,693 - DEBUG - VM uve shows interface as {'ip_address': '183.52.194.196', 'label': 25, 'uuid': '4e5cdf43-e896-483e-9f55-1acd6027cce4', 'ip6_active': False, 'gateway': '183.52.194.193', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1-19905344-59612402', 'ip6_address': '::', 'active': True, 'port_mirror_enabled': False, 'mac_address': '02:4e:5c:df:43:e8', 'virtual_network': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173', 'ip4_active': True, 'is_health_check_active': True, 'vhostuser_mode': 0, 'admin_state': True, 'l2_active': True, 'fixed_ip4_list': ['183.52.194.196'], 'rx_vlan': 65535, 'vm_uuid': '7f44ee58-e0fe-44d9-808b-8ebb33b5a093', 'tx_vlan': 65535, 'vn_uuid': '9d7612e7-d4f8-4a9a-846f-45c1c6997f21', '__T': 1758164274561056} 2025-09-18 02:58:17,694 - DEBUG - VM uve shows ip address as ['183.52.194.196', '::'] 2025-09-18 02:58:17,694 - DEBUG - VM uve shows virtual network as default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 02:58:17,694 - INFO - Verifying through opserver in 10.0.0.56 2025-09-18 02:58:17,694 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173?flat 2025-09-18 02:58:17,727 - DEBUG - expected vm list 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 2025-09-18 02:58:17,727 - DEBUG - Extracted vm list ['7f44ee58-e0fe-44d9-808b-8ebb33b5a093'] 2025-09-18 02:58:17,727 - INFO - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is present in default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 02:58:17,727 - DEBUG - Verifying vm in vrouter uve 2025-09-18 02:58:17,727 - DEBUG - Getting info from collector 10.0.0.41.. 2025-09-18 02:58:17,727 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093?flat 2025-09-18 02:58:17,742 - DEBUG - VM uve shows vrouter as ['an-jenkins-deploy-platform-ansible-os-4130-2'] 2025-09-18 02:58:17,742 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-2:Compute:contrail-vrouter-agent:0?flat 2025-09-18 02:58:17,788 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-2?flat 2025-09-18 02:58:17,817 - DEBUG - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 02:58:17,817 - DEBUG - Validated that VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 is in Vrouter an-jenkins-deploy-platform-ansible-os-4130-2 UVE 2025-09-18 02:58:17,817 - DEBUG - Verifying vm tap interface/vn in vrouter uve 2025-09-18 02:58:17,826 - DEBUG - Expected tap interface of VM uuid 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:4e5cdf43-e896-483e-9f55-1acd6027cce4 2025-09-18 02:58:17,827 - DEBUG - Expected VN of VM uuid 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 02:58:17,827 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-2:Compute:contrail-vrouter-agent:0?flat 2025-09-18 02:58:17,862 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-2?flat 2025-09-18 02:58:17,891 - DEBUG - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 02:58:17,892 - INFO - tap interface default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:4e5cdf43-e896-483e-9f55-1acd6027cce4 of vm 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 02:58:17,892 - DEBUG - Connected network default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 of vm 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 02:58:17,892 - DEBUG - Verifying the 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 virtual network link through opserver 10.0.0.56 2025-09-18 02:58:17,892 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2025-09-18 02:58:17,906 - DEBUG - VM link and name as {'name': '7f44ee58-e0fe-44d9-808b-8ebb33b5a093', 'href': 'http://10.0.0.56:8081/analytics/uves/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093?flat'} 2025-09-18 02:58:17,906 - DEBUG - Verifying the 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 virtual network link through opserver 10.0.0.22 2025-09-18 02:58:17,907 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2025-09-18 02:58:17,920 - DEBUG - VM link and name as {'name': '7f44ee58-e0fe-44d9-808b-8ebb33b5a093', 'href': 'http://10.0.0.22:8081/analytics/uves/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093?flat'} 2025-09-18 02:58:17,920 - DEBUG - Verifying the 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 virtual network link through opserver 10.0.0.41 2025-09-18 02:58:17,920 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machines 2025-09-18 02:58:17,932 - DEBUG - VM link and name as {'name': '7f44ee58-e0fe-44d9-808b-8ebb33b5a093', 'href': 'http://10.0.0.41:8081/analytics/uves/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093?flat'} 2025-09-18 02:58:17,932 - INFO - VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 validations in Opserver passed 2025-09-18 02:58:17,932 - INFO - Waiting for VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 to be up.. 2025-09-18 02:58:17,932 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-18 02:58:17,932 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093 2025-09-18 02:58:17,941 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/4e5cdf43-e896-483e-9f55-1acd6027cce4 2025-09-18 02:58:19,105 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.98 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.389 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.389/2.684/4.979/2.295 ms') 2025-09-18 02:58:19,105 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 passed 2025-09-18 02:58:19,175 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-18 02:58:19,175 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402, IP 183.52.194.196, Port 22 2025-09-18 02:58:19,244 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2025-09-18 02:58:19,336 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 is NOT ready for SSH connections, VM status: ACTIVE 2025-09-18 02:58:24,337 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-18 02:58:24,337 - DEBUG - Waiting to SSH to VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402, IP 183.52.194.196, Port 22 2025-09-18 02:58:24,503 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 is ready for SSH connections 2025-09-18 02:58:24,503 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 02:58:24,519 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/e8860bb7-d202-44ce-97a9-586fca91916e 2025-09-18 02:58:24,535 - DEBUG - Security group ctest-test_sec_group-41152781 is attached to the VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 2025-09-18 02:58:24,553 - DEBUG - Agent: Security group ctest-test_sec_group-41152781 is attached to the VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 2025-09-18 02:58:24,647 - INFO - Validated that SG ctest-test_sec_group-41152781 is bound to VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 2025-09-18 02:58:24,647 - INFO - Remove security group ctest-test_sec_group-41152781 from VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 2025-09-18 02:58:24,907 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 02:58:24,916 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/e8860bb7-d202-44ce-97a9-586fca91916e 2025-09-18 02:58:24,929 - WARNING - Security group ctest-test_sec_group-41152781 is not attached to the VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 2025-09-18 02:58:25,172 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 02:58:25,180 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine-interface/e8860bb7-d202-44ce-97a9-586fca91916e 2025-09-18 02:58:25,195 - DEBUG - Security group ctest-test_sec_group-41152781 is attached to the VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 2025-09-18 02:58:25,221 - DEBUG - Agent: Security group ctest-test_sec_group-41152781 is attached to the VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 2025-09-18 02:58:25,315 - INFO - Validated that SG ctest-test_sec_group-41152781 is bound to VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 2025-09-18 02:58:25,315 - INFO - Try deleting the security group ctest-test_sec_group-41152781 with back ref. 2025-09-18 02:58:25,315 - INFO - Deleting Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'ctest-test_sec_group-41152781'] 2025-09-18 02:58:25,351 - INFO - Security Group 388e058b-0144-4cad-bcf7-b6dad44271be in use. Neutron server returns request_ids: ['req-7966032b-2cb6-42ee-8c38-22b521dbbab1'] 2025-09-18 02:58:25,352 - INFO - Not able to delete the security group with back ref as expected 2025-09-18 02:58:25,352 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-18 02:58:25,352 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 183.52.194.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.61, gateway password: c0ntrail123 2025-09-18 02:58:25,352 - DEBUG - ping -s 56 -c 3 -W 1 183.52.194.196 2025-09-18 02:59:14,407 - DEBUG - PING 183.52.194.196 (183.52.194.196) 56(84) bytes of data. --- 183.52.194.196 ping statistics --- 3 packets transmitted, 0 received, 100% packet loss, time 2001ms 2025-09-18 02:59:14,407 - WARNING - Ping to IP 183.52.194.196 from VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 failed 2025-09-18 02:59:14,407 - INFO - Ping FAILED as expected 2025-09-18 02:59:14,407 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-18 02:59:14,407 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -ll -p 10000 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-09-18 02:59:14,407 - DEBUG - nohup rm -f testfile;ls -la;nc -ll -p 10000 > testfile & 2025-09-18 02:59:52,834 - DEBUG - total 132 drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 . drwxr-xr-x 3 root root 4096 Jan 4 2013 .. -rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history -rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout -rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache -rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins -rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla -rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh -rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh -rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0 -rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz -rw------- 1 root root 4695 Dec 17 2017 .viminfo -rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority -rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors 2025-09-18 02:59:52,835 - DEBUG - Running remote_cmd, Cmd : nc -ll 10000 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-09-18 02:59:52,835 - DEBUG - nohup nc -ll 10000 > testfile & 2025-09-18 02:59:53,287 - DEBUG - None 2025-09-18 02:59:53,287 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -p 10001 183.52.194.196 10000 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.61, gateway password: c0ntrail123 2025-09-18 02:59:53,288 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -p 10001 183.52.194.196 10000 < testfile 2025-09-18 03:00:20,371 - DEBUG - 1+0 records in 1+0 records out 100 bytes (100 B) copied, 0.00117752 s, 84.9 kB/s 2025-09-18 03:00:20,372 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.27, gateway password: c0ntrail123 2025-09-18 03:00:20,372 - DEBUG - ls -l testfile 2025-09-18 03:00:20,722 - DEBUG - -rw-r--r-- 1 root root 100 Sep 18 02:59 testfile 2025-09-18 03:00:20,722 - INFO - File transfer verification for file size 100 passed on the VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 2025-09-18 03:00:20,722 - DEBUG - Replace all the rules of this security group ctest-test_sec_group-41152781 with the new rules 2025-09-18 03:00:20,722 - DEBUG - [{'protocol': '1', 'dst_addresses': [{'subnet': {'ip_prefix': '183.52.194.192', 'ip_prefix_len': '26'}}], 'dst_ports': [{'start_port': 0, 'end_port': -1}], 'src_ports': [{'start_port': 0, 'end_port': -1}], 'src_addresses': [{'security_group': 'local'}]}, {'protocol': '1', 'src_addresses': [{'subnet': {'ip_prefix': '183.52.194.192', 'ip_prefix_len': '26'}}], 'dst_ports': [{'start_port': 0, 'end_port': -1}], 'src_ports': [{'start_port': 0, 'end_port': -1}], 'dst_addresses': [{'security_group': 'local'}]}] 2025-09-18 03:00:21,547 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-09-18 03:00:21,547 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 183.52.194.196, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.61, gateway password: c0ntrail123 2025-09-18 03:00:21,548 - DEBUG - ping -s 56 -c 3 -W 1 183.52.194.196 2025-09-18 03:00:24,044 - DEBUG - PING 183.52.194.196 (183.52.194.196) 56(84) bytes of data. 64 bytes from 183.52.194.196: icmp_req=1 ttl=64 time=2.69 ms 64 bytes from 183.52.194.196: icmp_req=2 ttl=64 time=1.22 ms 64 bytes from 183.52.194.196: icmp_req=3 ttl=64 time=1.22 ms --- 183.52.194.196 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 2004ms rtt min/avg/max/mdev = 1.225/1.715/2.691/0.690 ms 2025-09-18 03:00:24,044 - INFO - Ping to IP 183.52.194.196 from VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 passed 2025-09-18 03:00:24,046 - INFO - Removing the security group from VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 2025-09-18 03:00:24,279 - INFO - Deleting VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 2025-09-18 03:00:24,371 - DEBUG - Verifying in api server 10.0.0.41 2025-09-18 03:00:24,371 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093 2025-09-18 03:00:24,381 - DEBUG - VM ID 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 is still found in API Server 2025-09-18 03:00:26,381 - DEBUG - Verifying in api server 10.0.0.41 2025-09-18 03:00:26,381 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093 2025-09-18 03:00:26,390 - DEBUG - Response Code: 404 2025-09-18 03:00:26,391 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093 2025-09-18 03:00:26,398 - DEBUG - Response Code: 404 2025-09-18 03:00:26,398 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/7f44ee58-e0fe-44d9-808b-8ebb33b5a093 2025-09-18 03:00:26,406 - DEBUG - Response Code: 404 2025-09-18 03:00:26,406 - INFO - VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 is fully removed in API-Server 2025-09-18 03:00:26,567 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-09-18 03:00:26,751 - DEBUG - VM route 183.52.194.196 has been marked for discard in VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 of compute 10.0.0.61 2025-09-18 03:00:26,759 - DEBUG - Validated that vrouter 10.0.0.61 does not have VMs route for VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 03:00:26,759 - DEBUG - Validated that vrouter 10.0.0.27 does not have VMs route for VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 03:00:26,759 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 03:00:26,759 - INFO - VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 is removed in Compute, and routes are removed in all compute nodes 2025-09-18 03:00:26,983 - INFO - Routes for VM ctest-SecurityGroupBasicRegressionTests1-19905344-59612402 is removed in all control-nodes 2025-09-18 03:00:26,983 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-2:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:00:27,023 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-2?flat 2025-09-18 03:00:27,055 - DEBUG - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 03:00:27,055 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:00:27,055 - DEBUG - interface for vm 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 deleted from vrouter uve ... 2025-09-18 03:00:30,056 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-2:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:00:30,098 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-2?flat 2025-09-18 03:00:30,134 - DEBUG - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 03:00:30,134 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:00:30,134 - DEBUG - interface for vm 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 deleted from vrouter uve ... 2025-09-18 03:00:33,135 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-2:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:00:33,174 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-2?flat 2025-09-18 03:00:33,203 - DEBUG - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 03:00:33,203 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:00:33,203 - DEBUG - interface for vm 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 deleted from vrouter uve ... 2025-09-18 03:00:36,204 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-2:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:00:36,247 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-2?flat 2025-09-18 03:00:36,281 - DEBUG - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 03:00:36,281 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:00:36,282 - DEBUG - interface for vm 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 deleted from vrouter uve ... 2025-09-18 03:00:39,282 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-2:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:00:39,325 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-2?flat 2025-09-18 03:00:39,364 - DEBUG - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 03:00:39,364 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:00:39,364 - DEBUG - interface for vm 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 deleted from vrouter uve ... 2025-09-18 03:00:42,365 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-2:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:00:42,404 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-2?flat 2025-09-18 03:00:42,436 - DEBUG - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 03:00:42,437 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:00:42,437 - DEBUG - interface for vm 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 deleted from vrouter uve ... 2025-09-18 03:00:45,437 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-2:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:00:45,476 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-2?flat 2025-09-18 03:00:45,524 - DEBUG - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 03:00:45,524 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:00:45,524 - DEBUG - interface for vm 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 deleted from vrouter uve ... 2025-09-18 03:00:48,525 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-2:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:00:48,564 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-2?flat 2025-09-18 03:00:48,601 - DEBUG - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 03:00:48,601 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:00:48,601 - DEBUG - interface for vm 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 deleted from vrouter uve ... 2025-09-18 03:00:51,602 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-2:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:00:51,643 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-2?flat 2025-09-18 03:00:51,683 - DEBUG - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 03:00:51,683 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:00:51,683 - DEBUG - interface for vm 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 deleted from vrouter uve ... 2025-09-18 03:00:54,684 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-2:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:00:54,724 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-2?flat 2025-09-18 03:00:54,756 - DEBUG - VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4130-2 uve 2025-09-18 03:00:54,756 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:00:54,756 - DEBUG - interface for vm 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 deleted from vrouter uve ... 2025-09-18 03:00:54,756 - DEBUG - Deleted interface not in error interface list ... 2025-09-18 03:00:54,756 - DEBUG - Validated that VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is removed in Vrouter UVE 2025-09-18 03:00:54,756 - DEBUG - Verifying through opserver in 10.0.0.56 2025-09-18 03:00:54,757 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173?flat 2025-09-18 03:00:54,779 - DEBUG - 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 BM not in default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 uve 2025-09-18 03:00:54,780 - DEBUG - Validated that VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is not present in the VN UVE 2025-09-18 03:00:54,780 - DEBUG - Verifying the 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 virtual network link through opserver 10.0.0.56 2025-09-18 03:00:54,780 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2025-09-18 03:00:54,793 - INFO - 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 vm uve deleted from opserver 2025-09-18 03:00:54,793 - DEBUG - Verifying the 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 virtual network link through opserver 10.0.0.22 2025-09-18 03:00:54,793 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2025-09-18 03:00:54,808 - INFO - 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 vm uve deleted from opserver 2025-09-18 03:00:54,808 - DEBUG - Verifying the 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 virtual network link through opserver 10.0.0.41 2025-09-18 03:00:54,808 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machines 2025-09-18 03:00:54,821 - INFO - 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 vm uve deleted from opserver 2025-09-18 03:00:54,821 - INFO - Validated that VM 7f44ee58-e0fe-44d9-808b-8ebb33b5a093 is removed from Opserver 2025-09-18 03:00:54,821 - INFO - Removing the security group from VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 2025-09-18 03:00:55,088 - INFO - Deleting VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 2025-09-18 03:00:55,169 - DEBUG - Verifying in api server 10.0.0.41 2025-09-18 03:00:55,169 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 03:00:55,180 - DEBUG - VM ID d790a63e-8cf8-4f02-a570-0c3b571c89e3 of VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 is still found in API Server 2025-09-18 03:00:57,180 - DEBUG - Verifying in api server 10.0.0.41 2025-09-18 03:00:57,181 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 03:00:57,188 - DEBUG - Response Code: 404 2025-09-18 03:00:57,188 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 03:00:57,195 - DEBUG - Response Code: 404 2025-09-18 03:00:57,195 - DEBUG - Requesting: http://10.0.0.41:8082/virtual-machine/d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 03:00:57,203 - DEBUG - Response Code: 404 2025-09-18 03:00:57,203 - INFO - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 is fully removed in API-Server 2025-09-18 03:00:57,362 - DEBUG - Skipping VM-deletion-check in nova db since mysql_token is not found 2025-09-18 03:00:57,417 - DEBUG - Validated that vrouter 10.0.0.61 does not have VMs route for VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 03:00:57,430 - DEBUG - Validated that vrouter 10.0.0.27 does not have VMs route for VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 03:00:57,430 - INFO - Validated that all vrouters do not have VMs route for VN default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 03:00:57,430 - INFO - VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 is removed in Compute, and routes are removed in all compute nodes 2025-09-18 03:00:57,631 - INFO - Routes for VM ctest-SecurityGroupBasicRegressionTests1-19905344-20499969 is removed in all control-nodes 2025-09-18 03:00:57,631 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-1:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:00:57,670 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-1?flat 2025-09-18 03:00:57,700 - DEBUG - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 03:00:57,700 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:00:57,700 - DEBUG - interface for vm d790a63e-8cf8-4f02-a570-0c3b571c89e3 deleted from vrouter uve ... 2025-09-18 03:00:57,700 - DEBUG - Deleted interface not in error interface list ... 2025-09-18 03:01:00,701 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-1:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:01:00,747 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-1?flat 2025-09-18 03:01:00,779 - DEBUG - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 03:01:00,779 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:01:00,779 - DEBUG - interface for vm d790a63e-8cf8-4f02-a570-0c3b571c89e3 deleted from vrouter uve ... 2025-09-18 03:01:00,779 - DEBUG - Deleted interface not in error interface list ... 2025-09-18 03:01:03,779 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-1:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:01:03,819 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-1?flat 2025-09-18 03:01:03,856 - DEBUG - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 03:01:03,856 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:01:03,856 - DEBUG - interface for vm d790a63e-8cf8-4f02-a570-0c3b571c89e3 deleted from vrouter uve ... 2025-09-18 03:01:03,856 - DEBUG - Deleted interface not in error interface list ... 2025-09-18 03:01:06,857 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-1:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:01:06,904 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-1?flat 2025-09-18 03:01:06,936 - DEBUG - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 03:01:06,936 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:01:06,936 - DEBUG - interface for vm d790a63e-8cf8-4f02-a570-0c3b571c89e3 deleted from vrouter uve ... 2025-09-18 03:01:06,936 - DEBUG - Deleted interface not in error interface list ... 2025-09-18 03:01:09,936 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-1:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:01:09,973 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-1?flat 2025-09-18 03:01:10,004 - DEBUG - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 03:01:10,005 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:01:10,005 - DEBUG - interface for vm d790a63e-8cf8-4f02-a570-0c3b571c89e3 deleted from vrouter uve ... 2025-09-18 03:01:10,005 - DEBUG - Deleted interface not in error interface list ... 2025-09-18 03:01:13,005 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-1:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:01:13,047 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-1?flat 2025-09-18 03:01:13,077 - DEBUG - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 03:01:13,077 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:01:13,077 - DEBUG - interface for vm d790a63e-8cf8-4f02-a570-0c3b571c89e3 deleted from vrouter uve ... 2025-09-18 03:01:13,077 - DEBUG - Deleted interface not in error interface list ... 2025-09-18 03:01:16,078 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-1:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:01:16,116 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-1?flat 2025-09-18 03:01:16,148 - DEBUG - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 03:01:16,148 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:01:16,148 - DEBUG - interface for vm d790a63e-8cf8-4f02-a570-0c3b571c89e3 deleted from vrouter uve ... 2025-09-18 03:01:16,148 - DEBUG - Deleted interface not in error interface list ... 2025-09-18 03:01:19,150 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-1:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:01:19,188 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-1?flat 2025-09-18 03:01:19,218 - DEBUG - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 03:01:19,218 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:01:19,219 - DEBUG - interface for vm d790a63e-8cf8-4f02-a570-0c3b571c89e3 deleted from vrouter uve ... 2025-09-18 03:01:19,219 - DEBUG - Deleted interface not in error interface list ... 2025-09-18 03:01:22,220 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-1:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:01:22,258 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-1?flat 2025-09-18 03:01:22,286 - DEBUG - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is still present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 03:01:22,286 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:01:22,286 - DEBUG - interface for vm d790a63e-8cf8-4f02-a570-0c3b571c89e3 deleted from vrouter uve ... 2025-09-18 03:01:22,286 - DEBUG - Deleted interface not in error interface list ... 2025-09-18 03:01:25,288 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/generator/an-jenkins-deploy-platform-ansible-os-4130-1:Compute:contrail-vrouter-agent:0?flat 2025-09-18 03:01:25,325 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/vrouter/an-jenkins-deploy-platform-ansible-os-4130-1?flat 2025-09-18 03:01:25,355 - DEBUG - VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is not present in vrouter an-jenkins-deploy-platform-ansible-os-4130-1 uve 2025-09-18 03:01:25,355 - DEBUG - Verifying if the vm interface deleted from vroter uve... 2025-09-18 03:01:25,355 - DEBUG - interface for vm d790a63e-8cf8-4f02-a570-0c3b571c89e3 deleted from vrouter uve ... 2025-09-18 03:01:25,355 - DEBUG - Deleted interface not in error interface list ... 2025-09-18 03:01:25,355 - DEBUG - Validated that VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is removed in Vrouter UVE 2025-09-18 03:01:25,355 - DEBUG - Verifying through opserver in 10.0.0.56 2025-09-18 03:01:25,355 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173?flat 2025-09-18 03:01:25,374 - DEBUG - d790a63e-8cf8-4f02-a570-0c3b571c89e3 BM not in default-domain:ctest-SecurityGroupBasicRegressionTests1-19905344:ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 uve 2025-09-18 03:01:25,374 - DEBUG - Validated that VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is not present in the VN UVE 2025-09-18 03:01:25,374 - DEBUG - Verifying the d790a63e-8cf8-4f02-a570-0c3b571c89e3 virtual network link through opserver 10.0.0.56 2025-09-18 03:01:25,375 - DEBUG - Requesting: http://10.0.0.56:8081/analytics/uves/virtual-machines 2025-09-18 03:01:25,386 - DEBUG - No links retuned for d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 03:01:25,386 - INFO - d790a63e-8cf8-4f02-a570-0c3b571c89e3 vm uve deleted from opserver 2025-09-18 03:01:25,386 - DEBUG - Verifying the d790a63e-8cf8-4f02-a570-0c3b571c89e3 virtual network link through opserver 10.0.0.22 2025-09-18 03:01:25,386 - DEBUG - Requesting: http://10.0.0.22:8081/analytics/uves/virtual-machines 2025-09-18 03:01:25,461 - DEBUG - No links retuned for d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 03:01:25,461 - INFO - d790a63e-8cf8-4f02-a570-0c3b571c89e3 vm uve deleted from opserver 2025-09-18 03:01:25,461 - DEBUG - Verifying the d790a63e-8cf8-4f02-a570-0c3b571c89e3 virtual network link through opserver 10.0.0.41 2025-09-18 03:01:25,461 - DEBUG - Requesting: http://10.0.0.41:8081/analytics/uves/virtual-machines 2025-09-18 03:01:25,474 - DEBUG - No links retuned for d790a63e-8cf8-4f02-a570-0c3b571c89e3 2025-09-18 03:01:25,474 - INFO - d790a63e-8cf8-4f02-a570-0c3b571c89e3 vm uve deleted from opserver 2025-09-18 03:01:25,474 - INFO - Validated that VM d790a63e-8cf8-4f02-a570-0c3b571c89e3 is removed from Opserver 2025-09-18 03:01:25,474 - INFO - Deleting VN ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 2025-09-18 03:01:25,655 - DEBUG - Response for deleting network () 2025-09-18 03:01:25,655 - DEBUG - Requesting: http://10.0.0.56:8082/routing-instance/b35e6815-c98c-4944-8434-c1abe749bcad 2025-09-18 03:01:25,662 - DEBUG - Response Code: 404 2025-09-18 03:01:25,662 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-18 03:01:25,669 - DEBUG - Requesting: http://10.0.0.56:8082/domain/245899c5-19ba-4930-be6a-859f116860e1 2025-09-18 03:01:25,690 - DEBUG - Requesting: http://10.0.0.56:8082/project/cf7a7688-2db6-43e3-8e92-ca37cb048500 2025-09-18 03:01:25,813 - INFO - Validated that VN ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is not found in API Server 2025-09-18 03:01:25,825 - DEBUG - VN ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is not present in Agent 10.0.0.61 2025-09-18 03:01:25,838 - DEBUG - VN ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is not present in Agent 10.0.0.27 2025-09-18 03:01:25,838 - INFO - Validated that VN ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 is not in any agent 2025-09-18 03:01:25,873 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-SecurityGroupBasicRegressionTests1-19905344-76685173 info 2025-09-18 03:01:25,873 - INFO - Deleting Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'ctest-test_sec_group-41152781'] 2025-09-18 03:01:25,966 - INFO - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-19905344', 'ctest-test_sec_group-41152781'] deleted successfully. 2025-09-18 03:01:25,966 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-18 03:01:25,974 - DEBUG - Requesting: http://10.0.0.56:8082/domain/245899c5-19ba-4930-be6a-859f116860e1 2025-09-18 03:01:26,009 - DEBUG - Requesting: http://10.0.0.56:8082/project/cf7a7688-2db6-43e3-8e92-ca37cb048500 2025-09-18 03:01:26,153 - INFO - Security group ctest-test_sec_group-41152781 removed from the API Server 2025-09-18 03:01:26,154 - DEBUG - Requesting: http://10.0.0.56:8082/domains 2025-09-18 03:01:26,165 - DEBUG - Requesting: http://10.0.0.56:8082/domain/245899c5-19ba-4930-be6a-859f116860e1 2025-09-18 03:01:26,178 - DEBUG - Requesting: http://10.0.0.56:8082/project/cf7a7688-2db6-43e3-8e92-ca37cb048500 2025-09-18 03:01:26,287 - DEBUG - Requesting: http://10.0.0.56:8082/access-control-lists 2025-09-18 03:01:26,300 - DEBUG - ACLs for Security group ctest-test_sec_group-41152781 removed from the API Server 2025-09-18 03:01:26,306 - INFO - security group ctest-test_sec_group-41152781 removed from Control-node 10.0.0.56 2025-09-18 03:01:26,317 - DEBUG - Security group ctest-test_sec_group-41152781 ACLs removed from the control node 10.0.0.56 2025-09-18 03:01:26,323 - INFO - security group ctest-test_sec_group-41152781 removed from Control-node 10.0.0.22 2025-09-18 03:01:26,334 - DEBUG - Security group ctest-test_sec_group-41152781 ACLs removed from the control node 10.0.0.22 2025-09-18 03:01:26,344 - INFO - security group ctest-test_sec_group-41152781 removed from Control-node 10.0.0.41 2025-09-18 03:01:26,351 - DEBUG - Security group ctest-test_sec_group-41152781 ACLs removed from the control node 10.0.0.41 2025-09-18 03:01:26,351 - INFO - Validated that SG ctest-test_sec_group-41152781 is not in control nodes 2025-09-18 03:01:27,642 - DEBUG - No XMPP flaps were noticed during the test 2025-09-18 03:01:27,642 - INFO - END TEST : test_sec_group_basic : PASSED[0:04:24] 2025-09-18 03:01:27,643 - INFO - -------------------------------------------------------------------------------- 2025-09-18 03:01:28,428 - INFO - Deleted project: ctest-SecurityGroupBasicRegressionTests1-19905344, ID : cf7a7688-2db6-43e3-8e92-ca37cb048500