2025-08-10 21:32:36,190 - INFO - Domain Default found not creating 2025-08-10 21:32:36,315 - INFO - Project ctest-SecurityGroupBasicRegressionTests1-24185510 not found, creating it 2025-08-10 21:32:36,794 - INFO - Created Project:ctest-SecurityGroupBasicRegressionTests1-24185510, ID : 3e7b21fe-3630-4bfb-9b24-f58a80ce58b7 2025-08-10 21:32:38,130 - INFO - ================================================================================ 2025-08-10 21:32:38,130 - INFO - STARTING TEST : test_sec_group_basic 2025-08-10 21:32:38,130 - INFO - TEST DESCRIPTION : Description: Test basic SG features 1. Security group create and delete 2. Create security group with custom rules and then update it for tcp 3. Launch VM with custom created security group and verify 4. Remove secuity group association with VM 5. Add back custom security group to VM and verify 6. Try to delete security group with association to VM. It should fail. 7. Test with ping, which should fail 8. Test with TCP which should pass 9. Update the rules to allow icmp, ping should pass now. 2025-08-10 21:32:39,386 - DEBUG - Nothing to compare xmpp stats {'10.0.0.254': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.50': {'10.20.0.25': '0', '10.20.0.17': '0'}} with 2025-08-10 21:32:39,387 - INFO - Initial checks done. Running the testcase now 2025-08-10 21:32:39,387 - INFO - 2025-08-10 21:32:39,731 - INFO - Creating Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-24185510', 'ctest-test_sec_group-39248075'] 2025-08-10 21:32:40,737 - DEBUG - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-24185510', 'ctest-test_sec_group-39248075'] created succesfully 2025-08-10 21:32:40,737 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:32:41,031 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:32:41,066 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:32:41,080 - DEBUG - Requesting: http://10.0.0.48:8082/project/3e7b21fe-3630-4bfb-9b24-f58a80ce58b7 2025-08-10 21:32:41,171 - DEBUG - Requesting: http://10.0.0.48:8082/security-group/4ae18596-a8c1-46f8-9b93-377082933dbe 2025-08-10 21:32:41,181 - INFO - Security group ctest-test_sec_group-39248075 found in the API Server 2025-08-10 21:32:41,181 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:32:41,187 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:32:41,199 - DEBUG - Requesting: http://10.0.0.48:8082/project/3e7b21fe-3630-4bfb-9b24-f58a80ce58b7 2025-08-10 21:32:41,279 - DEBUG - Requesting: http://10.0.0.48:8082/access-control-lists 2025-08-10 21:32:41,286 - INFO - Validated that ACLs for Security group ctest-test_sec_group-39248075 are present in API Server 2025-08-10 21:32:41,293 - INFO - Validated that Security group ctest-test_sec_group-39248075 is found in control node 10.0.0.48 2025-08-10 21:32:41,298 - DEBUG - Security group ctest-test_sec_group-39248075 ACLs found in the control node 10.0.0.48 2025-08-10 21:32:41,304 - INFO - Validated that Security group ctest-test_sec_group-39248075 is found in control node 10.0.0.38 2025-08-10 21:32:41,310 - DEBUG - Security group ctest-test_sec_group-39248075 ACLs found in the control node 10.0.0.38 2025-08-10 21:32:41,316 - INFO - Validated that Security group ctest-test_sec_group-39248075 is found in control node 10.0.0.49 2025-08-10 21:32:41,322 - DEBUG - Security group ctest-test_sec_group-39248075 ACLs found in the control node 10.0.0.49 2025-08-10 21:32:41,322 - INFO - Validated SG ctest-test_sec_group-39248075 in Control nodes 2025-08-10 21:32:41,322 - INFO - Deleting Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-24185510', 'ctest-test_sec_group-39248075'] 2025-08-10 21:32:41,389 - INFO - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-24185510', 'ctest-test_sec_group-39248075'] deleted successfully. 2025-08-10 21:32:41,389 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:32:41,402 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:32:41,414 - DEBUG - Requesting: http://10.0.0.48:8082/project/3e7b21fe-3630-4bfb-9b24-f58a80ce58b7 2025-08-10 21:32:41,510 - INFO - Security group ctest-test_sec_group-39248075 removed from the API Server 2025-08-10 21:32:41,510 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:32:41,519 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:32:41,534 - DEBUG - Requesting: http://10.0.0.48:8082/project/3e7b21fe-3630-4bfb-9b24-f58a80ce58b7 2025-08-10 21:32:41,625 - DEBUG - Requesting: http://10.0.0.48:8082/access-control-lists 2025-08-10 21:32:41,634 - DEBUG - ACLs for Security group ctest-test_sec_group-39248075 removed from the API Server 2025-08-10 21:32:41,640 - INFO - security group ctest-test_sec_group-39248075 removed from Control-node 10.0.0.48 2025-08-10 21:32:41,645 - DEBUG - Security group ctest-test_sec_group-39248075 ACLs removed from the control node 10.0.0.48 2025-08-10 21:32:41,650 - INFO - security group ctest-test_sec_group-39248075 removed from Control-node 10.0.0.38 2025-08-10 21:32:41,655 - DEBUG - Security group ctest-test_sec_group-39248075 ACLs removed from the control node 10.0.0.38 2025-08-10 21:32:41,661 - INFO - security group ctest-test_sec_group-39248075 removed from Control-node 10.0.0.49 2025-08-10 21:32:41,666 - DEBUG - Security group ctest-test_sec_group-39248075 ACLs removed from the control node 10.0.0.49 2025-08-10 21:32:41,666 - INFO - Validated that SG ctest-test_sec_group-39248075 is not in control nodes 2025-08-10 21:32:41,671 - INFO - Creating Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-24185510', 'ctest-test_sec_group-39248075'] 2025-08-10 21:32:42,782 - DEBUG - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-24185510', 'ctest-test_sec_group-39248075'] created succesfully 2025-08-10 21:32:42,782 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:32:42,789 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:32:42,803 - DEBUG - Requesting: http://10.0.0.48:8082/project/3e7b21fe-3630-4bfb-9b24-f58a80ce58b7 2025-08-10 21:32:42,884 - DEBUG - Requesting: http://10.0.0.48:8082/security-group/b92d45c2-0b92-45fd-b452-8fe18ad0b60d 2025-08-10 21:32:42,895 - INFO - Security group ctest-test_sec_group-39248075 found in the API Server 2025-08-10 21:32:42,895 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:32:42,901 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:32:42,911 - DEBUG - Requesting: http://10.0.0.48:8082/project/3e7b21fe-3630-4bfb-9b24-f58a80ce58b7 2025-08-10 21:32:42,988 - DEBUG - Requesting: http://10.0.0.48:8082/access-control-lists 2025-08-10 21:32:42,999 - INFO - Validated that ACLs for Security group ctest-test_sec_group-39248075 are present in API Server 2025-08-10 21:32:43,005 - INFO - Validated that Security group ctest-test_sec_group-39248075 is found in control node 10.0.0.48 2025-08-10 21:32:43,011 - DEBUG - Security group ctest-test_sec_group-39248075 ACLs found in the control node 10.0.0.48 2025-08-10 21:32:43,019 - INFO - Validated that Security group ctest-test_sec_group-39248075 is found in control node 10.0.0.38 2025-08-10 21:32:43,025 - DEBUG - Security group ctest-test_sec_group-39248075 ACLs found in the control node 10.0.0.38 2025-08-10 21:32:43,031 - INFO - Validated that Security group ctest-test_sec_group-39248075 is found in control node 10.0.0.49 2025-08-10 21:32:43,036 - DEBUG - Security group ctest-test_sec_group-39248075 ACLs found in the control node 10.0.0.49 2025-08-10 21:32:43,037 - INFO - Validated SG ctest-test_sec_group-39248075 in Control nodes 2025-08-10 21:32:43,037 - DEBUG - Replace all the rules of this security group ctest-test_sec_group-39248075 with the new rules 2025-08-10 21:32:43,037 - DEBUG - [{'protocol': 'tcp', 'dst_addresses': [{'subnet': {'ip_prefix': '43.232.151.192', 'ip_prefix_len': '26'}}], 'dst_ports': [{'start_port': 0, 'end_port': -1}], 'src_ports': [{'start_port': 0, 'end_port': -1}], 'src_addresses': [{'security_group': 'local'}]}, {'protocol': 'tcp', 'src_addresses': [{'subnet': {'ip_prefix': '43.232.151.192', 'ip_prefix_len': '26'}}], 'dst_ports': [{'start_port': 0, 'end_port': -1}], 'src_ports': [{'start_port': 0, 'end_port': -1}], 'dst_addresses': [{'security_group': 'local'}]}] 2025-08-10 21:32:43,811 - DEBUG - Response for create_network : {'network': {'id': '7e95bc84-9838-4483-bac9-6abaaea80d9b', 'name': 'ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'tenant_id': '3e7b21fe36304bfb9b24f58a80ce58b7', 'project_id': '3e7b21fe36304bfb9b24f58a80ce58b7', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-24185510', 'ctest-SecurityGroupBasicRegressionTests1-24185510-95884403'], 'port_security_enabled': True, 'description': ''}} 2025-08-10 21:32:44,039 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd25abf29-0a38-4f8d-96bf-35b164fc7cfe', 'name': '', 'tenant_id': '3e7b21fe36304bfb9b24f58a80ce58b7', 'network_id': '7e95bc84-9838-4483-bac9-6abaaea80d9b', 'ip_version': 4, 'cidr': '43.232.151.192/26', 'allocation_pools': [{'start': '43.232.151.194', 'end': '43.232.151.254'}], 'gateway_ip': '43.232.151.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '43.232.151.194', 'tags': [], 'project_id': '3e7b21fe36304bfb9b24f58a80ce58b7'}} 2025-08-10 21:32:44,062 - INFO - Created VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 2025-08-10 21:32:44,072 - DEBUG - VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 UUID is 7e95bc84-9838-4483-bac9-6abaaea80d9b 2025-08-10 21:32:44,130 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:32:44,136 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:32:44,148 - DEBUG - Requesting: http://10.0.0.48:8082/project/3e7b21fe-3630-4bfb-9b24-f58a80ce58b7 2025-08-10 21:32:44,236 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7e95bc84-9838-4483-bac9-6abaaea80d9b 2025-08-10 21:32:44,248 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7e95bc84-9838-4483-bac9-6abaaea80d9b 2025-08-10 21:32:44,257 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/1dad0e85-2888-48bf-be98-2c6468f9fc79 2025-08-10 21:32:44,266 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/1dad0e85-2888-48bf-be98-2c6468f9fc79 2025-08-10 21:32:44,272 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/6de4d729-c637-4382-8a60-ccf63ef472a1 2025-08-10 21:32:44,278 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 21:32:44,278 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7e95bc84-9838-4483-bac9-6abaaea80d9b 2025-08-10 21:32:44,286 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/1dad0e85-2888-48bf-be98-2c6468f9fc79 2025-08-10 21:32:44,300 - INFO - Verified VN network id 11 for VN 7e95bc84-9838-4483-bac9-6abaaea80d9b 2025-08-10 21:32:44,300 - INFO - Verifications in API Server for VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 passed 2025-08-10 21:32:44,300 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7e95bc84-9838-4483-bac9-6abaaea80d9b 2025-08-10 21:32:44,309 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/1dad0e85-2888-48bf-be98-2c6468f9fc79 2025-08-10 21:32:44,315 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/1dad0e85-2888-48bf-be98-2c6468f9fc79 2025-08-10 21:32:44,321 - DEBUG - Requesting: http://10.0.0.48:8082/route-target/6de4d729-c637-4382-8a60-ccf63ef472a1 2025-08-10 21:32:44,333 - DEBUG - Control-node 10.0.0.48 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-SecurityGroupBasicRegressionTests1-24185510', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9121403897984337027', 'uuid-lslong': '13459406311400148379'}, 'enable': 'true', 'created': '2025-08-10T21:32:43', 'last-modified': '2025-08-10T21:32:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.349590'} 2025-08-10 21:32:44,340 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 21:32:44,345 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-SecurityGroupBasicRegressionTests1-24185510', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9121403897984337027', 'uuid-lslong': '13459406311400148379'}, 'enable': 'true', 'created': '2025-08-10T21:32:43', 'last-modified': '2025-08-10T21:32:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.356012'} 2025-08-10 21:32:44,351 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 21:32:44,356 - DEBUG - Control-node 10.0.0.49 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-SecurityGroupBasicRegressionTests1-24185510', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9121403897984337027', 'uuid-lslong': '13459406311400148379'}, 'enable': 'true', 'created': '2025-08-10T21:32:43', 'last-modified': '2025-08-10T21:32:43', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.373279'} 2025-08-10 21:32:44,362 - DEBUG - Route Targets: ['target:64512:8000005'] 2025-08-10 21:32:44,362 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 passed 2025-08-10 21:32:44,362 - DEBUG - ====Verifying policy data for ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 in API_Server ====== 2025-08-10 21:32:44,362 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:32:44,368 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:32:44,379 - DEBUG - Requesting: http://10.0.0.48:8082/project/3e7b21fe-3630-4bfb-9b24-f58a80ce58b7 2025-08-10 21:32:44,475 - DEBUG - Requesting: http://10.0.0.48:8082/virtual-network/7e95bc84-9838-4483-bac9-6abaaea80d9b 2025-08-10 21:32:44,486 - DEBUG - =>VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 has no policy to be verified 2025-08-10 21:32:44,486 - DEBUG - Verifying the vn in opserver 2025-08-10 21:32:44,486 - DEBUG - Verifying the default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 virtual network link through opserver 10.0.0.48 2025-08-10 21:32:44,486 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-10 21:32:44,778 - DEBUG - Requesting: http://10.0.0.48:8081/analytics/uves/virtual-networks 2025-08-10 21:32:44,828 - DEBUG - vn link and name as {'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'href': 'http://10.0.0.48:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403?flat'} 2025-08-10 21:32:44,828 - DEBUG - Verifying the default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 virtual network link through opserver 10.0.0.38 2025-08-10 21:32:44,828 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-10 21:32:45,129 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-10 21:32:45,176 - DEBUG - vn link and name as {'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403?flat'} 2025-08-10 21:32:45,176 - DEBUG - Verifying the default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 virtual network link through opserver 10.0.0.49 2025-08-10 21:32:45,176 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-08-10 21:32:45,465 - DEBUG - Requesting: http://10.0.0.49:8081/analytics/uves/virtual-networks 2025-08-10 21:32:45,515 - DEBUG - vn link and name as {'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'href': 'http://10.0.0.49:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403?flat'} 2025-08-10 21:32:45,515 - INFO - Validated that VN default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 is found in opserver 2025-08-10 21:32:45,537 - DEBUG - Do not have enough data to verify VN in agent 2025-08-10 21:32:45,546 - DEBUG - VRF ids for VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403: {} 2025-08-10 21:32:45,596 - DEBUG - Services list from nova: [, , , ] 2025-08-10 21:32:46,616 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3790-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3790-1) 2025-08-10 21:32:47,910 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3790-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3790-2) 2025-08-10 21:32:47,992 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-08-10 21:32:53,075 - DEBUG - VM is in ACTIVE state now 2025-08-10 21:32:53,075 - INFO - VM name : ctest-SecurityGroupBasicRegressionTests1-24185510-87941190 2025-08-10 21:32:53,148 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-24185510-87941190 ID is 244117ac-f445-44f4-a633-ab275ed49cc0 2025-08-10 21:32:53,213 - DEBUG - VM is in ACTIVE state now 2025-08-10 21:32:53,241 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-24185510-87941190 launched on Node an-jenkins-deploy-platform-ansible-os-3790-1 2025-08-10 21:32:53,306 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/244117ac-f445-44f4-a633-ab275ed49cc0 2025-08-10 21:32:53,601 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/244117ac-f445-44f4-a633-ab275ed49cc0 2025-08-10 21:32:53,632 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/244117ac-f445-44f4-a633-ab275ed49cc0 2025-08-10 21:32:53,639 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/5575762c-efdf-4d47-96ac-ee4ff12847d9 2025-08-10 21:32:53,651 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/244117ac-f445-44f4-a633-ab275ed49cc0 2025-08-10 21:32:53,658 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/5575762c-efdf-4d47-96ac-ee4ff12847d9 2025-08-10 21:32:53,671 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/4125de31-f10a-41d5-83b0-1bf808ac7ddc 2025-08-10 21:32:53,686 - DEBUG - Verifying in api server 10.0.0.49 2025-08-10 21:32:53,686 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine/244117ac-f445-44f4-a633-ab275ed49cc0 2025-08-10 21:32:53,706 - DEBUG - Requesting: http://10.0.0.49:8082/virtual-machine-interface/5575762c-efdf-4d47-96ac-ee4ff12847d9 2025-08-10 21:32:53,717 - DEBUG - Requesting: http://10.0.0.49:8082/instance-ip/4125de31-f10a-41d5-83b0-1bf808ac7ddc 2025-08-10 21:32:53,726 - INFO - VM ctest-SecurityGroupBasicRegressionTests1-24185510-87941190 verfication in all API Servers passed 2025-08-10 21:32:53,747 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-24185510-87941190 Tap interface: {'index': '3', 'name': 'tap5575762c-ef', 'uuid': '5575762c-efdf-4d47-96ac-ee4ff12847d9', 'vrf_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'vm_uuid': '244117ac-f445-44f4-a633-ab275ed49cc0', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1-24185510-87941190', 'ip_addr': '43.232.151.195', 'mac_addr': '02:55:75:76:2c:ef', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '76', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:5575762c-efdf-4d47-96ac-ee4ff12847d9', 'sg_uuid_list': ['b92d45c2-0b92-45fd-b452-8fe18ad0b60d'], 'static_route_list': None, 'vm_project_uuid': '3e7b21fe-3630-4bfb-9b24-f58a80ce58b7', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-10 21:32:53,747 - DEBUG - Agent 10.0.0.254 vrf name: default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 2025-08-10 21:32:53,757 - DEBUG - Agent VRF Object : {'vrf_list': [{'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'ucindex': '2', 'mcindex': '2', 'l2index': '2', 'source': 'Config; ', 'uc6index': '2', 'vn': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'table_label': '-1', 'vxlan_id': '11', 'evpnindex': '2', 'brindex': '2', 'mplsindex': '0', 'RD': '10.20.0.193:2', 'mac_aging_time': '0', 'layer2_control_word': 'false', 'forwarding_vrf': None, 'hbf_rintf': '-1', 'hbf_lintf': '-1'}]} 2025-08-10 21:32:53,890 - DEBUG - VM ctest-SecurityGroupBasicRegressionTests1-24185510-87941190 : Tap interface tap5575762c-ef is set to Active 2025-08-10 21:32:53,891 - DEBUG - Tap interface tap5575762c-ef detail : {'index': '3', 'name': 'tap5575762c-ef', 'uuid': '5575762c-efdf-4d47-96ac-ee4ff12847d9', 'vrf_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'active': 'Active', 'ipv4_active': 'Active', 'l2_active': 'L2 Active', 'ip6_active': 'Ipv6 Inactive < no-ipv6-addr >', 'health_check_active': 'Active', 'dhcp_service': 'Enable', 'dhcp_service_v6': 'Disable', 'dns_service': 'Enable', 'type': 'vport', 'label': '25', 'l2_label': '29', 'vxlan_id': '11', 'vn_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403', 'vm_uuid': '244117ac-f445-44f4-a633-ab275ed49cc0', 'vm_name': 'ctest-SecurityGroupBasicRegressionTests1-24185510-87941190', 'ip_addr': '43.232.151.195', 'mac_addr': '02:55:75:76:2c:ef', 'policy': 'Enable', 'fip_list': [], 'mdata_ip_addr': '169.254.0.3', 'service_vlan_list': None, 'os_ifindex': '76', 'fabric_port': 'NotFabricPort', 'alloc_linklocal_ip': 'LL-Enable', 'analyzer_name': None, 'config_name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:5575762c-efdf-4d47-96ac-ee4ff12847d9', 'sg_uuid_list': ['b92d45c2-0b92-45fd-b452-8fe18ad0b60d'], 'static_route_list': None, 'vm_project_uuid': '3e7b21fe-3630-4bfb-9b24-f58a80ce58b7', 'admin_state': 'Enabled', 'flow_key_idx': '31', 'allowed_address_pair_list': None, 'ip6_addr': '::', 'local_preference': '0', 'tx_vlan_id': '-1', 'rx_vlan_id': '-1', 'parent_interface': None, 'subnet': '--NA--', 'sub_type': 'Tap', 'vrf_assign_acl_uuid': '--NA--', 'vmi_type': 'Virtual Machine', 'transport': 'Ethernet', 'logical_interface_uuid': '00000000-0000-0000-0000-000000000000', 'flood_unknown_unicast': 'false', 'physical_device': None, 'physical_interface': None, 'fixed_ip4_list': None, 'fixed_ip6_list': None, 'fat_flow_list': None, 'metadata_ip_active': 'Active', 'service_health_check_ip': '0.0.0.0', 'alias_ip_list': None, 'drop_new_flows': 'false', 'bridge_domain_list': [], 'vmi_tag_list': None, 'policy_set_acl_list': None, 'slo_list': None, 'vhostuser_mode': '0', 'si_other_end_vmi': '00000000-0000-0000-0000-000000000000', 'cfg_igmp_enable': 'false', 'igmp_enabled': 'false', 'max_flows': '0', 'policy_set_fwaas_list': None, 'bond_interface_list': None, 'mac_ip_learning_enable': 'false', 'mac_ip_list': []} 2025-08-10 21:32:54,044 - DEBUG - Starting Layer 2 verification in Agent 2025-08-10 21:32:54,062 - DEBUG - Layer 2 path is seen for VM MAC 02:55:75:76:2c:ef in agent 10.0.0.254 2025-08-10 21:32:54,062 - DEBUG - Active layer 2 route in agent is present for VMI tap5575762c-ef 2025-08-10 21:32:54,062 - DEBUG - L2 label(29) matches bw route table and interface table 2025-08-10 21:32:54,070 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 is found in Agent of node 10.0.0.254 2025-08-10 21:32:54,247 - DEBUG - VRF IDs of VN default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 is consistent in agent 10.0.0.254 2025-08-10 21:32:54,248 - DEBUG - Route for VM IP ['43.232.151.195'] is consistent in agent 10.0.0.254 2025-08-10 21:32:54,248 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 verification for VM ctest-SecurityGroupBasicRegressionTests1-24185510-87941190 in Agent 10.0.0.254 passed 2025-08-10 21:32:54,406 - DEBUG - Starting all layer 2 verification in agent 10.0.0.254 2025-08-10 21:32:54,419 - DEBUG - Route for VM MAC 02:55:75:76:2c:ef is consistent in agent 10.0.0.254 2025-08-10 21:32:54,425 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 is found in Agent of node 10.0.0.50 2025-08-10 21:32:54,591 - DEBUG - VRF IDs of VN default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 is consistent in agent 10.0.0.50 2025-08-10 21:32:54,591 - DEBUG - Route for VM IP ['43.232.151.195'] is consistent in agent 10.0.0.50 2025-08-10 21:32:54,591 - DEBUG - VN default-domain:ctest-SecurityGroupBasicRegressionTests1-24185510:ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 verification for VM ctest-SecurityGroupBasicRegressionTests1-24185510-87941190 in Agent 10.0.0.50 passed 2025-08-10 21:32:54,745 - DEBUG - Starting all layer 2 verification in agent 10.0.0.50 2025-08-10 21:32:54,756 - DEBUG - Route for VM MAC 02:55:75:76:2c:ef is consistent in agent 10.0.0.50 2025-08-10 21:32:57,991 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1028ms') 2025-08-10 21:32:57,991 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-24185510-87941190 failed! 2025-08-10 21:34:25,771 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.51 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.334 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.334/2.419/4.505/2.085 ms') 2025-08-10 21:34:25,771 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-SecurityGroupBasicRegressionTests1-24185510-87941190 passed 2025-08-10 21:34:25,784 - INFO - Skip interface_detach for VM ctest-SecurityGroupBasicRegressionTests1-24185510-46390365 in state BUILD 2025-08-10 21:34:25,784 - INFO - Removing the security group from VM ctest-SecurityGroupBasicRegressionTests1-24185510-46390365 2025-08-10 21:34:25,925 - INFO - Deleting VM ctest-SecurityGroupBasicRegressionTests1-24185510-46390365 2025-08-10 21:34:25,925 - ERROR - VM ctest-SecurityGroupBasicRegressionTests1-24185510-46390365 has failed to come up 2025-08-10 21:34:25,925 - ERROR - Nova failed to get host of the VM 2025-08-10 21:34:25,925 - ERROR - VM ctest-SecurityGroupBasicRegressionTests1-24185510-46390365 has failed to come up 2025-08-10 21:34:25,926 - ERROR - Nova failed to get host of the VM 2025-08-10 21:34:25,987 - INFO - Removing the security group from VM ctest-SecurityGroupBasicRegressionTests1-24185510-87941190 2025-08-10 21:34:26,135 - INFO - Deleting VM ctest-SecurityGroupBasicRegressionTests1-24185510-87941190 2025-08-10 21:34:26,198 - INFO - Deleting VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 2025-08-10 21:34:26,233 - DEBUG - VN 7e95bc84-9838-4483-bac9-6abaaea80d9b still in use: Unable to complete operation on network 7e95bc84-9838-4483-bac9-6abaaea80d9b. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-c05ec19c-a2b4-407b-b2fe-abfd9d8a17b2'] 2025-08-10 21:34:26,233 - WARNING - Deleting VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 failed..Will retry 2025-08-10 21:34:28,381 - DEBUG - Response for deleting network () 2025-08-10 21:34:28,381 - DEBUG - Requesting: http://10.0.0.48:8082/routing-instance/1dad0e85-2888-48bf-be98-2c6468f9fc79 2025-08-10 21:34:28,387 - DEBUG - Response Code: 404 2025-08-10 21:34:28,388 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:34:28,393 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:34:28,406 - DEBUG - Requesting: http://10.0.0.48:8082/project/3e7b21fe-3630-4bfb-9b24-f58a80ce58b7 2025-08-10 21:34:28,509 - INFO - Validated that VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 is not found in API Server 2025-08-10 21:34:28,520 - DEBUG - VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 is not present in Agent 10.0.0.254 2025-08-10 21:34:28,531 - DEBUG - VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 is not present in Agent 10.0.0.50 2025-08-10 21:34:28,531 - INFO - Validated that VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 is not in any agent 2025-08-10 21:34:28,567 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-SecurityGroupBasicRegressionTests1-24185510-95884403 info 2025-08-10 21:34:28,567 - INFO - Deleting Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-24185510', 'ctest-test_sec_group-39248075'] 2025-08-10 21:34:28,635 - INFO - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-24185510', 'ctest-test_sec_group-39248075'] deleted successfully. 2025-08-10 21:34:28,635 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:34:28,647 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:34:28,659 - DEBUG - Requesting: http://10.0.0.48:8082/project/3e7b21fe-3630-4bfb-9b24-f58a80ce58b7 2025-08-10 21:34:28,772 - INFO - Security group ctest-test_sec_group-39248075 removed from the API Server 2025-08-10 21:34:28,773 - DEBUG - Requesting: http://10.0.0.48:8082/domains 2025-08-10 21:34:28,780 - DEBUG - Requesting: http://10.0.0.48:8082/domain/f4633f28-8e52-4cb4-8182-938022088c32 2025-08-10 21:34:28,792 - DEBUG - Requesting: http://10.0.0.48:8082/project/3e7b21fe-3630-4bfb-9b24-f58a80ce58b7 2025-08-10 21:34:28,886 - DEBUG - Requesting: http://10.0.0.48:8082/access-control-lists 2025-08-10 21:34:28,893 - DEBUG - ACLs for Security group ctest-test_sec_group-39248075 removed from the API Server 2025-08-10 21:34:28,900 - INFO - security group ctest-test_sec_group-39248075 removed from Control-node 10.0.0.48 2025-08-10 21:34:28,909 - DEBUG - Security group ctest-test_sec_group-39248075 ACLs removed from the control node 10.0.0.48 2025-08-10 21:34:28,915 - INFO - security group ctest-test_sec_group-39248075 removed from Control-node 10.0.0.38 2025-08-10 21:34:28,920 - DEBUG - Security group ctest-test_sec_group-39248075 ACLs removed from the control node 10.0.0.38 2025-08-10 21:34:28,927 - INFO - security group ctest-test_sec_group-39248075 removed from Control-node 10.0.0.49 2025-08-10 21:34:28,934 - DEBUG - Security group ctest-test_sec_group-39248075 ACLs removed from the control node 10.0.0.49 2025-08-10 21:34:28,934 - INFO - Validated that SG ctest-test_sec_group-39248075 is not in control nodes 2025-08-10 21:34:29,440 - ERROR - [Errno 104] Connection reset by peer Traceback (most recent call last): File "/contrail-test/tcutils/cores.py", line 42, in get_cores_node if exists(CORE_DIR): File "/usr/local/lib/python3.6/site-packages/fabric/contrib/files.py", line 31, in exists cmd = 'stat %s' % _expand_path(path) File "/usr/local/lib/python3.6/site-packages/fabric/contrib/files.py", line 485, in _expand_path return path if is_win() else '"$(echo %s)"' % path File "/usr/local/lib/python3.6/site-packages/fabric/contrib/files.py", line 472, in is_win return '"' in run('echo "Will you echo quotation marks"') File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1095, in run shell_escape=shell_escape, capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 923, in open_session timeout=timeout, File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/usr/local/lib/python3.6/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/usr/local/lib/python3.6/site-packages/paramiko/packet.py", line 301, in read_all x = self.__socket.recv(n) File "/usr/local/lib64/python3.6/site-packages/gevent/_socket3.py", line 443, in recv return self._sock.recv(*args) ConnectionResetError: [Errno 104] Connection reset by peer 2025-08-10 21:34:29,953 - ERROR - 
Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 426, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 421, in _make_request
    httplib_response = conn.getresponse()
  File "/usr/lib64/python3.6/http/client.py", line 1346, in getresponse
    response.begin()
  File "/usr/lib64/python3.6/http/client.py", line 307, in begin
    version, status, reason = self._read_status()
  File "/usr/lib64/python3.6/http/client.py", line 268, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib64/python3.6/socket.py", line 586, in readinto
    return self._sock.recv_into(b)
  File "/usr/local/lib64/python3.6/site-packages/gevent/_socket3.py", line 498, in recv_into
    self._wait(self._read_event)
  File "src/gevent/_hub_primitives.py", line 317, in gevent.__hub_primitives.wait_on_socket
  File "src/gevent/_hub_primitives.py", line 322, in gevent.__hub_primitives.wait_on_socket
  File "src/gevent/_hub_primitives.py", line 313, in gevent.__hub_primitives._primitive_wait
  File "src/gevent/_hub_primitives.py", line 314, in gevent.__hub_primitives._primitive_wait
  File "src/gevent/_hub_primitives.py", line 46, in gevent.__hub_primitives.WaitOperationsGreenlet.wait
  File "src/gevent/_hub_primitives.py", line 46, in gevent.__hub_primitives.WaitOperationsGreenlet.wait
  File "src/gevent/_hub_primitives.py", line 55, in gevent.__hub_primitives.WaitOperationsGreenlet.wait
  File "src/gevent/_waiter.py", line 151, in gevent.__waiter.Waiter.get
  File "src/gevent/_greenlet_primitives.py", line 61, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch
  File "src/gevent/_greenlet_primitives.py", line 61, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch
  File "src/gevent/_greenlet_primitives.py", line 65, in gevent.__greenlet_primitives.SwitchOutGreenletWithLoop.switch
  File "src/gevent/__greenlet_primitives.pxd", line 35, in gevent.__greenlet_primitives._greenlet_switch
socket.timeout: timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/requests/adapters.py", line 449, in send
    timeout=timeout
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 727, in urlopen
    method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
  File "/usr/local/lib/python3.6/site-packages/urllib3/util/retry.py", line 410, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/usr/local/lib/python3.6/site-packages/urllib3/packages/six.py", line 735, in reraise
    raise value
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 677, in urlopen
    chunked=chunked,
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 428, in _make_request
    self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
  File "/usr/local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 336, in _raise_timeout
    self, url, "Read timed out. (read timeout=%s)" % timeout_value
urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='10.0.0.49', port=8082): Read timed out. (read timeout=60)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
    result = function(self, *args, **kwargs)
  File "/contrail-test/scripts/securitygroup/test_regression_basic.py", line 88, in test_sec_group_basic
    assert vm1_fixture.verify_on_setup()
  File "/contrail-test/fixtures/vm_test.py", line 712, in verify_on_setup
    result = self.verify_vm_in_agent()
  File "/contrail-test/tcutils/util.py", line 84, in f_retry
    result = f(*args, **kwargs)  # first attempt
  File "/contrail-test/fixtures/vm_test.py", line 1143, in verify_vm_in_agent
    if not self.local_ip:
  File "/contrail-test/fixtures/vm_test.py", line 957, in local_ip
    return self.get_local_ip()
  File "/contrail-test/fixtures/vm_test.py", line 939, in get_local_ip
    if self.ping_vm_from_host(vn_fq_name):
  File "/contrail-test/tcutils/util.py", line 84, in f_retry
    result = f(*args, **kwargs)  # first attempt
  File "/contrail-test/fixtures/vm_test.py", line 1202, in ping_vm_from_host
    vn_obj = self.vnc_lib_h.virtual_network_read(fq_name = vn_fq_name.split(":"))
  File "/usr/local/lib/python3.6/site-packages/vnc_api/vnc_api.py", line 52, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/vnc_api/vnc_api.py", line 728, in _object_read
    response = self._request_server(OP_GET, uri, query_params)
  File "/usr/local/lib/python3.6/site-packages/vnc_api/vnc_api.py", line 1128, in _request_server
    retry_after_authn=retry_after_authn, retry_count=retry_count)
  File "/usr/local/lib/python3.6/site-packages/vnc_api/vnc_api.py", line 1144, in _request
    url, headers=headers, query_params=data)
  File "/contrail-test/fixtures/vnc_api_test.py", line 39, in _http_get
    headers=headers, query_params=query_params)
  File "/usr/local/lib/python3.6/site-packages/vnc_api/vnc_api.py", line 1000, in _http_get
    url, headers=headers, params=query_params, verify=False)
  File "/usr/local/lib/python3.6/site-packages/vnc_api/vnc_api.py", line 282, in get
    return self.crud('get', url, *args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/vnc_api/vnc_api.py", line 250, in crud
    result = crud_method(url, *args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/requests/sessions.py", line 546, in get
    return self.request('GET', url, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/requests/sessions.py", line 533, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python3.6/site-packages/requests/sessions.py", line 646, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/requests/adapters.py", line 529, in send
    raise ReadTimeout(e, request=request)
requests.exceptions.ReadTimeout: HTTPConnectionPool(host='10.0.0.49', port=8082): Read timed out. (read timeout=60)
2025-08-10 21:34:29,966 - DEBUG - No XMPP flaps were noticed during the test 2025-08-10 21:34:29,966 - INFO - 2025-08-10 21:34:29,966 - INFO - END TEST : test_sec_group_basic : FAILED[0:01:51] 2025-08-10 21:34:29,966 - INFO - -------------------------------------------------------------------------------- 2025-08-10 21:34:30,717 - INFO - Deleted project: ctest-SecurityGroupBasicRegressionTests1-24185510, ID : 3e7b21fe-3630-4bfb-9b24-f58a80ce58b7