2026-11-09 03:43:01,139 - INFO - Domain Default found not creating 2026-11-09 03:43:01,378 - INFO - Project ctest-SecurityGroupBasicRegressionTests1-85927639 not found, creating it 2026-11-09 03:43:01,960 - INFO - Created Project:ctest-SecurityGroupBasicRegressionTests1-85927639, ID : 222a52aa-b11c-4513-be1b-276b4c4ba5d5 2026-11-09 03:43:03,760 - INFO - ================================================================================ 2026-11-09 03:43:03,760 - INFO - STARTING TEST : test_sec_group_basic 2026-11-09 03:43:03,760 - INFO - TEST DESCRIPTION : Description: Test basic SG features 1. Security group create and delete 2. Create security group with custom rules and then update it for tcp 3. Launch VM with custom created security group and verify 4. Remove secuity group association with VM 5. Add back custom security group to VM and verify 6. Test with ping, which should fail 7. Test with TCP which should pass 8. Update the rules to allow icmp, ping should pass now 9. Delete security group while ports still reference it; SG is detached from VMs and removed (Neutron and Contrail API) 2026-11-09 03:43:05,087 - DEBUG - Nothing to compare xmpp stats {'10.0.0.250': {'10.20.0.25': '0', '10.20.0.17': '0'}, '10.0.0.38': {'10.20.0.254': '0', '10.20.0.25': '0'}} with 2026-11-09 03:43:05,087 - INFO - Initial checks done. Running the testcase now 2026-11-09 03:43:05,087 - INFO - 2026-11-09 03:43:05,523 - INFO - Creating Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-85927639', 'ctest-test_sec_group-49487158'] 2026-11-09 03:43:06,677 - DEBUG - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-85927639', 'ctest-test_sec_group-49487158'] created succesfully 2026-11-09 03:43:06,677 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 03:43:07,062 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 03:43:07,099 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 03:43:07,119 - DEBUG - Requesting: http://10.0.0.248:8082/project/222a52aa-b11c-4513-be1b-276b4c4ba5d5 2026-11-09 03:43:07,232 - DEBUG - Requesting: http://10.0.0.248:8082/security-group/96fc7e4d-75ae-4855-97b3-5e2d68f01d92 2026-11-09 03:43:07,249 - INFO - Security group ctest-test_sec_group-49487158 found in the API Server 2026-11-09 03:43:07,249 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 03:43:07,256 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 03:43:07,270 - DEBUG - Requesting: http://10.0.0.248:8082/project/222a52aa-b11c-4513-be1b-276b4c4ba5d5 2026-11-09 03:43:07,377 - DEBUG - Requesting: http://10.0.0.248:8082/access-control-lists 2026-11-09 03:43:07,389 - INFO - Validated that ACLs for Security group ctest-test_sec_group-49487158 are present in API Server 2026-11-09 03:43:07,398 - INFO - Validated that Security group ctest-test_sec_group-49487158 is found in control node 10.0.0.248 2026-11-09 03:43:07,407 - DEBUG - Security group ctest-test_sec_group-49487158 ACLs found in the control node 10.0.0.248 2026-11-09 03:43:07,415 - INFO - Validated that Security group ctest-test_sec_group-49487158 is found in control node 10.0.0.249 2026-11-09 03:43:07,423 - DEBUG - Security group ctest-test_sec_group-49487158 ACLs found in the control node 10.0.0.249 2026-11-09 03:43:07,432 - INFO - Validated that Security group ctest-test_sec_group-49487158 is found in control node 10.0.0.33 2026-11-09 03:43:07,442 - DEBUG - Security group ctest-test_sec_group-49487158 ACLs found in the control node 10.0.0.33 2026-11-09 03:43:07,443 - INFO - Validated SG ctest-test_sec_group-49487158 in Control nodes 2026-11-09 03:43:07,443 - INFO - Deleting Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-85927639', 'ctest-test_sec_group-49487158'] 2026-11-09 03:43:07,569 - INFO - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-85927639', 'ctest-test_sec_group-49487158'] deleted successfully. 2026-11-09 03:43:07,570 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 03:43:07,579 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 03:43:07,618 - DEBUG - Requesting: http://10.0.0.248:8082/project/222a52aa-b11c-4513-be1b-276b4c4ba5d5 2026-11-09 03:43:07,738 - INFO - Security group ctest-test_sec_group-49487158 removed from the API Server 2026-11-09 03:43:07,738 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 03:43:07,746 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 03:43:07,760 - DEBUG - Requesting: http://10.0.0.248:8082/project/222a52aa-b11c-4513-be1b-276b4c4ba5d5 2026-11-09 03:43:07,855 - DEBUG - Requesting: http://10.0.0.248:8082/access-control-lists 2026-11-09 03:43:07,870 - DEBUG - ACLs for Security group ctest-test_sec_group-49487158 removed from the API Server 2026-11-09 03:43:07,876 - INFO - security group ctest-test_sec_group-49487158 removed from Control-node 10.0.0.248 2026-11-09 03:43:07,883 - DEBUG - Security group ctest-test_sec_group-49487158 ACLs removed from the control node 10.0.0.248 2026-11-09 03:43:07,889 - INFO - security group ctest-test_sec_group-49487158 removed from Control-node 10.0.0.249 2026-11-09 03:43:07,896 - DEBUG - Security group ctest-test_sec_group-49487158 ACLs removed from the control node 10.0.0.249 2026-11-09 03:43:07,903 - INFO - security group ctest-test_sec_group-49487158 removed from Control-node 10.0.0.33 2026-11-09 03:43:07,910 - DEBUG - Security group ctest-test_sec_group-49487158 ACLs removed from the control node 10.0.0.33 2026-11-09 03:43:07,910 - INFO - Validated that SG ctest-test_sec_group-49487158 is not in control nodes 2026-11-09 03:43:07,917 - INFO - Creating Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-85927639', 'ctest-test_sec_group-49487158'] 2026-11-09 03:43:09,031 - DEBUG - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-85927639', 'ctest-test_sec_group-49487158'] created succesfully 2026-11-09 03:43:09,032 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 03:43:09,044 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 03:43:09,057 - DEBUG - Requesting: http://10.0.0.248:8082/project/222a52aa-b11c-4513-be1b-276b4c4ba5d5 2026-11-09 03:43:09,156 - DEBUG - Requesting: http://10.0.0.248:8082/security-group/028f2d30-eea7-4c84-bc8f-d1106cd65bdb 2026-11-09 03:43:09,168 - INFO - Security group ctest-test_sec_group-49487158 found in the API Server 2026-11-09 03:43:09,168 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 03:43:09,177 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 03:43:09,191 - DEBUG - Requesting: http://10.0.0.248:8082/project/222a52aa-b11c-4513-be1b-276b4c4ba5d5 2026-11-09 03:43:09,293 - DEBUG - Requesting: http://10.0.0.248:8082/access-control-lists 2026-11-09 03:43:09,304 - INFO - Validated that ACLs for Security group ctest-test_sec_group-49487158 are present in API Server 2026-11-09 03:43:09,313 - INFO - Validated that Security group ctest-test_sec_group-49487158 is found in control node 10.0.0.248 2026-11-09 03:43:09,319 - DEBUG - Security group ctest-test_sec_group-49487158 ACLs found in the control node 10.0.0.248 2026-11-09 03:43:09,326 - INFO - Validated that Security group ctest-test_sec_group-49487158 is found in control node 10.0.0.249 2026-11-09 03:43:09,334 - DEBUG - Security group ctest-test_sec_group-49487158 ACLs found in the control node 10.0.0.249 2026-11-09 03:43:09,340 - INFO - Validated that Security group ctest-test_sec_group-49487158 is found in control node 10.0.0.33 2026-11-09 03:43:09,348 - DEBUG - Security group ctest-test_sec_group-49487158 ACLs found in the control node 10.0.0.33 2026-11-09 03:43:09,348 - INFO - Validated SG ctest-test_sec_group-49487158 in Control nodes 2026-11-09 03:43:09,348 - DEBUG - Replace all the rules of this security group ctest-test_sec_group-49487158 with the new rules 2026-11-09 03:43:09,348 - DEBUG - [{'protocol': 'tcp', 'dst_addresses': [{'subnet': {'ip_prefix': '159.166.93.0', 'ip_prefix_len': '26'}}], 'dst_ports': [{'start_port': 0, 'end_port': -1}], 'src_ports': [{'start_port': 0, 'end_port': -1}], 'src_addresses': [{'security_group': 'local'}]}, {'protocol': 'tcp', 'src_addresses': [{'subnet': {'ip_prefix': '159.166.93.0', 'ip_prefix_len': '26'}}], 'dst_ports': [{'start_port': 0, 'end_port': -1}], 'src_ports': [{'start_port': 0, 'end_port': -1}], 'dst_addresses': [{'security_group': 'local'}]}] 2026-11-09 03:43:10,165 - DEBUG - Response for create_network : {'network': {'id': 'c25cf49c-054b-4544-8919-999ee55934ff', 'name': 'ctest-SecurityGroupBasicRegressionTests1-85927639-54594037', 'tenant_id': '222a52aab11c4513be1b276b4c4ba5d5', 'project_id': '222a52aab11c4513be1b276b4c4ba5d5', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'tags': [], 'subnets': [], 'fq_name': ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-85927639', 'ctest-SecurityGroupBasicRegressionTests1-85927639-54594037'], 'port_security_enabled': True, 'description': ''}} 2026-11-09 03:43:10,430 - DEBUG - Response for create_subnet : {'subnet': {'id': '8e614e0f-b32f-4d75-bbb9-d953eabccf00', 'name': '', 'tenant_id': '222a52aab11c4513be1b276b4c4ba5d5', 'network_id': 'c25cf49c-054b-4544-8919-999ee55934ff', 'ip_version': 4, 'cidr': '159.166.93.0/26', 'allocation_pools': [{'start': '159.166.93.2', 'end': '159.166.93.62'}], 'gateway_ip': '159.166.93.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '159.166.93.2', 'tags': [], 'project_id': '222a52aab11c4513be1b276b4c4ba5d5'}} 2026-11-09 03:43:10,453 - INFO - Created VN ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 2026-11-09 03:43:10,469 - DEBUG - VN ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 UUID is c25cf49c-054b-4544-8919-999ee55934ff 2026-11-09 03:43:10,544 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 03:43:10,552 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 03:43:10,565 - DEBUG - Requesting: http://10.0.0.248:8082/project/222a52aa-b11c-4513-be1b-276b4c4ba5d5 2026-11-09 03:43:10,675 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/c25cf49c-054b-4544-8919-999ee55934ff 2026-11-09 03:43:10,689 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/c25cf49c-054b-4544-8919-999ee55934ff 2026-11-09 03:43:10,700 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/11a2daae-4b56-428c-a9d6-070e981953e7 2026-11-09 03:43:10,709 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/11a2daae-4b56-428c-a9d6-070e981953e7 2026-11-09 03:43:10,718 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/82218d64-de09-433d-bb27-223f73d81c3f 2026-11-09 03:43:10,728 - DEBUG - Route Targets: ['target:64512:8000012'] 2026-11-09 03:43:10,728 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/c25cf49c-054b-4544-8919-999ee55934ff 2026-11-09 03:43:10,738 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/11a2daae-4b56-428c-a9d6-070e981953e7 2026-11-09 03:43:10,759 - INFO - Verified VN network id 20 for VN c25cf49c-054b-4544-8919-999ee55934ff 2026-11-09 03:43:10,759 - INFO - Verifications in API Server for VN ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 passed 2026-11-09 03:43:10,760 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/c25cf49c-054b-4544-8919-999ee55934ff 2026-11-09 03:43:10,773 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/11a2daae-4b56-428c-a9d6-070e981953e7 2026-11-09 03:43:10,782 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/11a2daae-4b56-428c-a9d6-070e981953e7 2026-11-09 03:43:10,792 - DEBUG - Requesting: http://10.0.0.248:8082/route-target/82218d64-de09-433d-bb27-223f73d81c3f 2026-11-09 03:43:10,808 - DEBUG - Control-node 10.0.0.248 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-SecurityGroupBasicRegressionTests1-85927639', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14005337892156294468', 'uuid-lslong': '9879096165345604863'}, 'enable': 'true', 'created': '2026-11-09T03:43:10', 'last-modified': '2026-11-09T03:43:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.463838'} 2026-11-09 03:43:10,816 - DEBUG - Route Targets: ['target:64512:8000012'] 2026-11-09 03:43:10,823 - DEBUG - Control-node 10.0.0.249 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-SecurityGroupBasicRegressionTests1-85927639', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14005337892156294468', 'uuid-lslong': '9879096165345604863'}, 'enable': 'true', 'created': '2026-11-09T03:43:10', 'last-modified': '2026-11-09T03:43:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.485242'} 2026-11-09 03:43:10,829 - DEBUG - Route Targets: ['target:64512:8000012'] 2026-11-09 03:43:10,836 - DEBUG - Control-node 10.0.0.33 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-SecurityGroupBasicRegressionTests1-85927639', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '14005337892156294468', 'uuid-lslong': '9879096165345604863'}, 'enable': 'true', 'created': '2026-11-09T03:43:10', 'last-modified': '2026-11-09T03:43:10', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.495903'} 2026-11-09 03:43:10,843 - DEBUG - Route Targets: ['target:64512:8000012'] 2026-11-09 03:43:10,844 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 passed 2026-11-09 03:43:10,844 - DEBUG - ====Verifying policy data for ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 in API_Server ====== 2026-11-09 03:43:10,844 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 03:43:10,851 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 03:43:10,866 - DEBUG - Requesting: http://10.0.0.248:8082/project/222a52aa-b11c-4513-be1b-276b4c4ba5d5 2026-11-09 03:43:10,983 - DEBUG - Requesting: http://10.0.0.248:8082/virtual-network/c25cf49c-054b-4544-8919-999ee55934ff 2026-11-09 03:43:10,996 - DEBUG - =>VN ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 has no policy to be verified 2026-11-09 03:43:10,996 - DEBUG - Verifying the vn in opserver 2026-11-09 03:43:10,996 - DEBUG - Verifying the default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 virtual network link through opserver 10.0.0.248 2026-11-09 03:43:10,996 - DEBUG - Requesting: http://10.0.0.248:8081/analytics/uves/virtual-networks 2026-11-09 03:43:11,368 - DEBUG - Requesting: http://10.0.0.248:8081/analytics/uves/virtual-networks 2026-11-09 03:43:11,445 - DEBUG - vn link and name as {'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037', 'href': 'http://10.0.0.248:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037?flat'} 2026-11-09 03:43:11,445 - DEBUG - Verifying the default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 virtual network link through opserver 10.0.0.249 2026-11-09 03:43:11,445 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-11-09 03:43:11,825 - DEBUG - Requesting: http://10.0.0.249:8081/analytics/uves/virtual-networks 2026-11-09 03:43:11,906 - DEBUG - vn link and name as {'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037', 'href': 'http://10.0.0.249:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037?flat'} 2026-11-09 03:43:11,906 - DEBUG - Verifying the default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 virtual network link through opserver 10.0.0.33 2026-11-09 03:43:11,906 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-11-09 03:43:12,285 - DEBUG - Requesting: http://10.0.0.33:8081/analytics/uves/virtual-networks 2026-11-09 03:43:12,355 - DEBUG - vn link and name as {'name': 'default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037', 'href': 'http://10.0.0.33:8081/analytics/uves/virtual-network/default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037?flat'} 2026-11-09 03:43:12,355 - INFO - Validated that VN default-domain:ctest-SecurityGroupBasicRegressionTests1-85927639:ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 is found in opserver 2026-11-09 03:43:12,379 - DEBUG - Do not have enough data to verify VN in agent 2026-11-09 03:43:12,390 - DEBUG - VRF ids for VN ctest-SecurityGroupBasicRegressionTests1-85927639-54594037: {} 2026-11-09 03:43:12,612 - DEBUG - Services list from nova: [, , , ] 2026-11-09 03:43:13,254 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-2) 2026-11-09 03:43:14,193 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-6500-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-6500-1) 2026-11-09 03:43:14,260 - DEBUG - VM is in ERROR state now 2026-11-09 03:43:14,260 - WARNING - VM in error state. Asserting... 2026-11-09 03:43:14,261 - INFO - Skip interface_detach for VM ctest-SecurityGroupBasicRegressionTests1-85927639-95260898 in state BUILD 2026-11-09 03:43:14,261 - INFO - Removing the security group from VM ctest-SecurityGroupBasicRegressionTests1-85927639-95260898 2026-11-09 03:43:14,322 - DEBUG - Security group 028f2d30-eea7-4c84-bc8f-d1106cd65bdb not found for VM aa0bd67a-616e-4dba-a9a7-4fe652261a5d, skip remove 2026-11-09 03:43:14,322 - INFO - Deleting VM ctest-SecurityGroupBasicRegressionTests1-85927639-95260898 2026-11-09 03:43:14,351 - ERROR - VM ctest-SecurityGroupBasicRegressionTests1-85927639-95260898 has failed to come up 2026-11-09 03:43:14,351 - ERROR - Nova failed to get host of the VM 2026-11-09 03:43:14,352 - ERROR - VM ctest-SecurityGroupBasicRegressionTests1-85927639-95260898 has failed to come up 2026-11-09 03:43:14,352 - ERROR - Nova failed to get host of the VM 2026-11-09 03:43:14,421 - INFO - Skip interface_detach for VM ctest-SecurityGroupBasicRegressionTests1-85927639-85062990 in state ERROR 2026-11-09 03:43:14,421 - INFO - Removing the security group from VM ctest-SecurityGroupBasicRegressionTests1-85927639-85062990 2026-11-09 03:43:14,507 - DEBUG - Security group 028f2d30-eea7-4c84-bc8f-d1106cd65bdb not found for VM 76e9fde8-4018-40b2-ba70-752d6123aac2, skip remove 2026-11-09 03:43:14,507 - INFO - Deleting VM ctest-SecurityGroupBasicRegressionTests1-85927639-85062990 2026-11-09 03:43:14,507 - ERROR - VM ctest-SecurityGroupBasicRegressionTests1-85927639-85062990 has failed to come up 2026-11-09 03:43:14,507 - ERROR - Fault seen in nova show is: {'code': 500, 'created': '2026-11-09T03:43:13Z', 'message': 'No valid host was found. ', 'details': 'Traceback (most recent call last):\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 1654, in schedule_and_build_instances\n host_lists = self._schedule_instances(context, request_specs[0],\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/conductor/manager.py", line 942, in _schedule_instances\n host_lists = self.query_client.select_destinations(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/client/query.py", line 41, in select_destinations\n return self.scheduler_rpcapi.select_destinations(context, spec_obj,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/rpcapi.py", line 160, in select_destinations\n return cctxt.call(ctxt, \'select_destinations\', **msg_args)\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/client.py", line 190, in call\n result = self.transport._send(\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send\n return self._driver.send(target, ctxt, message,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 806, in send\n return self._send(target, ctxt, message, wait_for_reply, timeout,\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 798, in _send\n raise result\nnova.exception_Remote.NoValidHost_Remote: No valid host was found. \nTraceback (most recent call last):\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/oslo_messaging/rpc/server.py", line 269, in inner\n return func(*args, **kwargs)\n\n File "/var/lib/kolla/venv/lib64/python3.9/site-packages/nova/scheduler/manager.py", line 255, in select_destinations\n raise exception.NoValidHost(reason="")\n\nnova.exception.NoValidHost: No valid host was found. \n\n'} 2026-11-09 03:43:14,508 - INFO - Deleting VN ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 2026-11-09 03:43:14,714 - DEBUG - Response for deleting network () 2026-11-09 03:43:14,714 - DEBUG - Requesting: http://10.0.0.248:8082/routing-instance/11a2daae-4b56-428c-a9d6-070e981953e7 2026-11-09 03:43:14,722 - DEBUG - Response Code: 404 2026-11-09 03:43:14,722 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 03:43:14,742 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 03:43:14,757 - DEBUG - Requesting: http://10.0.0.248:8082/project/222a52aa-b11c-4513-be1b-276b4c4ba5d5 2026-11-09 03:43:14,857 - INFO - Validated that VN ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 is not found in API Server 2026-11-09 03:43:14,871 - DEBUG - VN ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 is not present in Agent 10.0.0.250 2026-11-09 03:43:14,883 - DEBUG - VN ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 is not present in Agent 10.0.0.38 2026-11-09 03:43:14,883 - INFO - Validated that VN ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 is not in any agent 2026-11-09 03:43:14,918 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-SecurityGroupBasicRegressionTests1-85927639-54594037 info 2026-11-09 03:43:14,918 - INFO - Deleting Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-85927639', 'ctest-test_sec_group-49487158'] 2026-11-09 03:43:15,027 - INFO - Security group: ['default-domain', 'ctest-SecurityGroupBasicRegressionTests1-85927639', 'ctest-test_sec_group-49487158'] deleted successfully. 2026-11-09 03:43:15,027 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 03:43:15,034 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 03:43:15,048 - DEBUG - Requesting: http://10.0.0.248:8082/project/222a52aa-b11c-4513-be1b-276b4c4ba5d5 2026-11-09 03:43:15,155 - INFO - Security group ctest-test_sec_group-49487158 removed from the API Server 2026-11-09 03:43:15,155 - DEBUG - Requesting: http://10.0.0.248:8082/domains 2026-11-09 03:43:15,161 - DEBUG - Requesting: http://10.0.0.248:8082/domain/48397716-fb81-4046-93f4-8bda606db062 2026-11-09 03:43:15,174 - DEBUG - Requesting: http://10.0.0.248:8082/project/222a52aa-b11c-4513-be1b-276b4c4ba5d5 2026-11-09 03:43:15,274 - DEBUG - Requesting: http://10.0.0.248:8082/access-control-lists 2026-11-09 03:43:15,286 - DEBUG - ACLs for Security group ctest-test_sec_group-49487158 removed from the API Server 2026-11-09 03:43:15,295 - INFO - security group ctest-test_sec_group-49487158 removed from Control-node 10.0.0.248 2026-11-09 03:43:15,304 - DEBUG - Security group ctest-test_sec_group-49487158 ACLs removed from the control node 10.0.0.248 2026-11-09 03:43:15,312 - INFO - security group ctest-test_sec_group-49487158 removed from Control-node 10.0.0.249 2026-11-09 03:43:15,318 - DEBUG - Security group ctest-test_sec_group-49487158 ACLs removed from the control node 10.0.0.249 2026-11-09 03:43:15,323 - INFO - security group ctest-test_sec_group-49487158 removed from Control-node 10.0.0.33 2026-11-09 03:43:15,328 - DEBUG - Security group ctest-test_sec_group-49487158 ACLs removed from the control node 10.0.0.33 2026-11-09 03:43:15,328 - INFO - Validated that SG ctest-test_sec_group-49487158 is not in control nodes 2026-11-09 03:43:16,604 - ERROR - AssertionError Python 3.9.25: /usr/bin/python3 Mon Nov 9 03:43:14 2026 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/securitygroup/test_regression_basic.py in test_sec_group_basic(self=) 87 project_name=self.inputs.project_name, connections=self.connections, 88 vn_obj=vn_fixture.obj, image_name=img_name, flavor='contrail_flavor_small',sg_ids=[secgrp_id])) 89 assert vm1_fixture.verify_on_setup() 90 assert vm1_fixture.wait_till_vm_is_up() 91 assert vm2_fixture.verify_on_setup() vm1_fixture = vm1_fixture.verify_on_setup = > AssertionError: __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = () with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/securitygroup/test_regression_basic.py", line 89, in test_sec_group_basic assert vm1_fixture.verify_on_setup() AssertionError 2026-11-09 03:43:16,626 - DEBUG - No XMPP flaps were noticed during the test 2026-11-09 03:43:16,626 - INFO - 2026-11-09 03:43:16,626 - INFO - END TEST : test_sec_group_basic : FAILED[0:00:13] 2026-11-09 03:43:16,626 - INFO - -------------------------------------------------------------------------------- 2026-11-09 03:43:17,515 - INFO - Deleted project: ctest-SecurityGroupBasicRegressionTests1-85927639, ID : 222a52aa-b11c-4513-be1b-276b4c4ba5d5