2026-05-28 02:59:32,299 - INFO - Domain Default found not creating 2026-05-28 02:59:32,648 - INFO - Project ctest-TestQos-20006452 not found, creating it 2026-05-28 02:59:33,238 - INFO - Created Project:ctest-TestQos-20006452, ID : b5c589e3-1cc3-4400-aec2-1c0eaa2a6e92 2026-05-28 02:59:35,994 - DEBUG - Response for create_network : {'network': {'id': '04f526f4-4acf-4a32-b54c-ef582a3b9325', 'name': 'ctest-vn-48255537', 'tenant_id': 'b5c589e31cc34400aec21c0eaa2a6e92', 'project_id': 'b5c589e31cc34400aec21c0eaa2a6e92', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestQos-20006452', 'ctest-vn-48255537'], 'port_security_enabled': True, 'description': ''}} 2026-05-28 02:59:36,311 - DEBUG - Response for create_subnet : {'subnet': {'id': '986108f9-e92a-48b3-b034-9b76a987fd36', 'name': '', 'tenant_id': 'b5c589e31cc34400aec21c0eaa2a6e92', 'network_id': '04f526f4-4acf-4a32-b54c-ef582a3b9325', 'ip_version': 4, 'cidr': '56.171.59.64/26', 'allocation_pools': [{'start': '56.171.59.66', 'end': '56.171.59.126'}], 'gateway_ip': '56.171.59.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '56.171.59.66', 'tags': [], 'project_id': 'b5c589e31cc34400aec21c0eaa2a6e92'}} 2026-05-28 02:59:36,565 - DEBUG - Response for create_subnet : {'subnet': {'id': '85be4358-7805-4883-a79d-1029610c7309', 'name': '', 'tenant_id': 'b5c589e31cc34400aec21c0eaa2a6e92', 'network_id': '04f526f4-4acf-4a32-b54c-ef582a3b9325', 'ip_version': 6, 'cidr': '2a23:cfaf:3d70:5054:561f:7fa3::/96', 'allocation_pools': [{'start': '2a23:cfaf:3d70:5054:561f:7fa3:0:2', 'end': '2a23:cfaf:3d70:5054:561f:7fa3:ffff:fffe'}], 'gateway_ip': '2a23:cfaf:3d70:5054:561f:7fa3:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2a23:cfaf:3d70:5054:561f:7fa3:0:2', 'tags': [], 'project_id': 'b5c589e31cc34400aec21c0eaa2a6e92'}} 2026-05-28 02:59:36,594 - INFO - Created VN ctest-vn-48255537 2026-05-28 02:59:36,612 - DEBUG - VN ctest-vn-48255537 UUID is 04f526f4-4acf-4a32-b54c-ef582a3b9325 2026-05-28 02:59:37,054 - DEBUG - Response for create_network : {'network': {'id': '038d5bcb-3026-4936-99cb-ef404032e4a0', 'name': 'ctest-vn-99569441', 'tenant_id': 'b5c589e31cc34400aec21c0eaa2a6e92', 'project_id': 'b5c589e31cc34400aec21c0eaa2a6e92', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestQos-20006452', 'ctest-vn-99569441'], 'port_security_enabled': True, 'description': ''}} 2026-05-28 02:59:37,303 - DEBUG - Response for create_subnet : {'subnet': {'id': '4605b0a4-7f15-4658-b406-551a7b63ce76', 'name': '', 'tenant_id': 'b5c589e31cc34400aec21c0eaa2a6e92', 'network_id': '038d5bcb-3026-4936-99cb-ef404032e4a0', 'ip_version': 4, 'cidr': '207.206.132.64/26', 'allocation_pools': [{'start': '207.206.132.66', 'end': '207.206.132.126'}], 'gateway_ip': '207.206.132.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '207.206.132.66', 'tags': [], 'project_id': 'b5c589e31cc34400aec21c0eaa2a6e92'}} 2026-05-28 02:59:37,595 - DEBUG - Response for create_subnet : {'subnet': {'id': '7ce09f1d-7be7-40f6-aa3f-7c5b1794cc0c', 'name': '', 'tenant_id': 'b5c589e31cc34400aec21c0eaa2a6e92', 'network_id': '038d5bcb-3026-4936-99cb-ef404032e4a0', 'ip_version': 6, 'cidr': '35ee:5b38:f9d4:c3b2:b9a7:3829::/96', 'allocation_pools': [{'start': '35ee:5b38:f9d4:c3b2:b9a7:3829:0:2', 'end': '35ee:5b38:f9d4:c3b2:b9a7:3829:ffff:fffe'}], 'gateway_ip': '35ee:5b38:f9d4:c3b2:b9a7:3829:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '35ee:5b38:f9d4:c3b2:b9a7:3829:0:2', 'tags': [], 'project_id': 'b5c589e31cc34400aec21c0eaa2a6e92'}} 2026-05-28 02:59:37,627 - INFO - Created VN ctest-vn-99569441 2026-05-28 02:59:37,643 - DEBUG - VN ctest-vn-99569441 UUID is 038d5bcb-3026-4936-99cb-ef404032e4a0 2026-05-28 02:59:37,865 - DEBUG - Services list from nova: [, , , ] 2026-05-28 02:59:39,059 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5841-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5841-1) 2026-05-28 02:59:40,734 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5841-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5841-2) 2026-05-28 02:59:42,320 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-5841-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-5841-2) 2026-05-28 02:59:42,320 - INFO - Waiting for VM ctest-TestQos-20006452-57578921 to be up.. 2026-05-28 02:59:42,455 - DEBUG - VM is in ACTIVE state now 2026-05-28 02:59:42,455 - INFO - VM name : ctest-TestQos-20006452-57578921 2026-05-28 02:59:42,575 - DEBUG - VM ctest-TestQos-20006452-57578921 ID is 425243bf-d62c-49a8-bc45-bd0f0ddd1691 2026-05-28 02:59:42,606 - DEBUG - VM ctest-TestQos-20006452-57578921 launched on Node an-jenkins-deploy-platform-ansible-os-5841-1 2026-05-28 02:59:42,749 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/425243bf-d62c-49a8-bc45-bd0f0ddd1691 2026-05-28 02:59:43,296 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/425243bf-d62c-49a8-bc45-bd0f0ddd1691 2026-05-28 02:59:43,356 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/a4fab113-4b42-45a2-b0ea-138465d41d1a 2026-05-28 02:59:46,562 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1034ms') 2026-05-28 02:59:46,563 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestQos-20006452-57578921 failed! 2026-05-28 02:59:46,581 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 56.171.59.65 and allocation pool is NOT set 2026-05-28 02:59:46,581 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 2a23:cfaf:3d70:5054:561f:7fa3:0:1 and allocation pool is NOT set 2026-05-28 02:59:50,657 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1009ms') 2026-05-28 02:59:50,658 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestQos-20006452-57578921 failed! 2026-05-28 02:59:50,674 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 56.171.59.65 and allocation pool is NOT set 2026-05-28 02:59:50,674 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 2a23:cfaf:3d70:5054:561f:7fa3:0:1 and allocation pool is NOT set 2026-05-28 02:59:54,759 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2026-05-28 02:59:54,759 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestQos-20006452-57578921 failed! 2026-05-28 02:59:54,776 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 56.171.59.65 and allocation pool is NOT set 2026-05-28 02:59:54,776 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 2a23:cfaf:3d70:5054:561f:7fa3:0:1 and allocation pool is NOT set 2026-05-28 02:59:58,851 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2026-05-28 02:59:58,851 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestQos-20006452-57578921 failed! 2026-05-28 02:59:58,868 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 56.171.59.65 and allocation pool is NOT set 2026-05-28 02:59:58,868 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 2a23:cfaf:3d70:5054:561f:7fa3:0:1 and allocation pool is NOT set 2026-05-28 03:00:02,950 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1011ms') 2026-05-28 03:00:02,951 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestQos-20006452-57578921 failed! 2026-05-28 03:00:02,971 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 56.171.59.65 and allocation pool is NOT set 2026-05-28 03:00:02,971 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 2a23:cfaf:3d70:5054:561f:7fa3:0:1 and allocation pool is NOT set 2026-05-28 03:00:07,042 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1004ms') 2026-05-28 03:00:07,042 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestQos-20006452-57578921 failed! 2026-05-28 03:00:07,066 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 56.171.59.65 and allocation pool is NOT set 2026-05-28 03:00:07,066 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 2a23:cfaf:3d70:5054:561f:7fa3:0:1 and allocation pool is NOT set 2026-05-28 03:00:11,137 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2026-05-28 03:00:11,137 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestQos-20006452-57578921 failed! 2026-05-28 03:00:11,153 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 56.171.59.65 and allocation pool is NOT set 2026-05-28 03:00:11,153 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 2a23:cfaf:3d70:5054:561f:7fa3:0:1 and allocation pool is NOT set 2026-05-28 03:00:15,239 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1018ms') 2026-05-28 03:00:15,239 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestQos-20006452-57578921 failed! 2026-05-28 03:00:15,260 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 56.171.59.65 and allocation pool is NOT set 2026-05-28 03:00:15,260 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 2a23:cfaf:3d70:5054:561f:7fa3:0:1 and allocation pool is NOT set 2026-05-28 03:00:19,327 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2026-05-28 03:00:19,328 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-TestQos-20006452-57578921 failed! 2026-05-28 03:00:19,349 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 56.171.59.65 and allocation pool is NOT set 2026-05-28 03:00:19,349 - DEBUG - Gateway for vn default-domain:ctest-TestQos-20006452:ctest-vn-48255537 is 2a23:cfaf:3d70:5054:561f:7fa3:0:1 and allocation pool is NOT set 2026-05-28 03:00:23,422 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=4.01 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 1 received, 50% packet loss, time 1010ms\r\nrtt min/avg/max/mdev = 4.008/4.008/4.008/0.000 ms') 2026-05-28 03:00:23,423 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestQos-20006452-57578921 passed 2026-05-28 03:00:23,500 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-28 03:00:23,500 - DEBUG - Waiting to SSH to VM ctest-TestQos-20006452-57578921, IP 56.171.59.67, Port 22 2026-05-28 03:00:23,571 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-28 03:00:23,680 - DEBUG - VM ctest-TestQos-20006452-57578921 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-28 03:00:28,681 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-28 03:00:28,681 - DEBUG - Waiting to SSH to VM ctest-TestQos-20006452-57578921, IP 56.171.59.67, Port 22 2026-05-28 03:00:28,752 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-28 03:00:28,897 - DEBUG - VM ctest-TestQos-20006452-57578921 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-28 03:00:33,898 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-28 03:00:33,898 - DEBUG - Waiting to SSH to VM ctest-TestQos-20006452-57578921, IP 56.171.59.67, Port 22 2026-05-28 03:00:33,967 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-28 03:00:34,088 - DEBUG - VM ctest-TestQos-20006452-57578921 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-28 03:00:39,089 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-28 03:00:39,089 - DEBUG - Waiting to SSH to VM ctest-TestQos-20006452-57578921, IP 56.171.59.67, Port 22 2026-05-28 03:00:39,153 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-28 03:00:39,271 - DEBUG - VM ctest-TestQos-20006452-57578921 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-28 03:00:44,271 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-28 03:00:44,272 - DEBUG - Waiting to SSH to VM ctest-TestQos-20006452-57578921, IP 56.171.59.67, Port 22 2026-05-28 03:00:44,338 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-28 03:00:44,452 - DEBUG - VM ctest-TestQos-20006452-57578921 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-28 03:00:49,452 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-28 03:00:49,453 - DEBUG - Waiting to SSH to VM ctest-TestQos-20006452-57578921, IP 56.171.59.67, Port 22 2026-05-28 03:00:49,623 - DEBUG - VM ctest-TestQos-20006452-57578921 is ready for SSH connections 2026-05-28 03:00:49,623 - INFO - Waiting for VM ctest-TestQos-20006452-47830657 to be up.. 2026-05-28 03:00:49,784 - DEBUG - VM is in ACTIVE state now 2026-05-28 03:00:49,784 - INFO - VM name : ctest-TestQos-20006452-47830657 2026-05-28 03:00:49,913 - DEBUG - VM ctest-TestQos-20006452-47830657 ID is 11803b71-1dc0-405b-a1f5-4d7e5cf9b101 2026-05-28 03:00:49,913 - DEBUG - VM ctest-TestQos-20006452-47830657 launched on Node an-jenkins-deploy-platform-ansible-os-5841-2 2026-05-28 03:00:50,031 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/11803b71-1dc0-405b-a1f5-4d7e5cf9b101 2026-05-28 03:00:50,043 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/fc910dc3-a187-4c45-8f45-d29bd1e93d91 2026-05-28 03:00:51,239 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.64 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.485 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.485/3.061/5.637/2.576 ms') 2026-05-28 03:00:51,239 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-TestQos-20006452-47830657 passed 2026-05-28 03:00:51,315 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-28 03:00:51,316 - DEBUG - Waiting to SSH to VM ctest-TestQos-20006452-47830657, IP 56.171.59.68, Port 22 2026-05-28 03:00:51,387 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused /bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''} 2026-05-28 03:00:51,499 - DEBUG - VM ctest-TestQos-20006452-47830657 is NOT ready for SSH connections, VM status: ACTIVE 2026-05-28 03:00:56,500 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-28 03:00:56,500 - DEBUG - Waiting to SSH to VM ctest-TestQos-20006452-47830657, IP 56.171.59.68, Port 22 2026-05-28 03:00:56,670 - DEBUG - VM ctest-TestQos-20006452-47830657 is ready for SSH connections 2026-05-28 03:00:56,670 - INFO - Waiting for VM ctest-TestQos-20006452-69440145 to be up.. 2026-05-28 03:00:56,785 - DEBUG - VM is in ACTIVE state now 2026-05-28 03:00:56,785 - INFO - VM name : ctest-TestQos-20006452-69440145 2026-05-28 03:00:56,900 - DEBUG - VM ctest-TestQos-20006452-69440145 ID is ccc732b6-442f-43de-9d0e-6fd2779962aa 2026-05-28 03:00:56,900 - DEBUG - VM ctest-TestQos-20006452-69440145 launched on Node an-jenkins-deploy-platform-ansible-os-5841-2 2026-05-28 03:00:57,035 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/ccc732b6-442f-43de-9d0e-6fd2779962aa 2026-05-28 03:00:57,048 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/0701f9d8-4fd4-450d-a872-09c4c8e75455 2026-05-28 03:00:58,227 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=1.79 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.23 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 1.785/2.008/2.231/0.223 ms') 2026-05-28 03:00:58,227 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-TestQos-20006452-69440145 passed 2026-05-28 03:00:58,304 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-28 03:00:58,304 - DEBUG - Waiting to SSH to VM ctest-TestQos-20006452-69440145, IP 207.206.132.67, Port 22 2026-05-28 03:00:58,483 - DEBUG - VM ctest-TestQos-20006452-69440145 is ready for SSH connections 2026-05-28 03:00:58,489 - INFO - ================================================================================ 2026-05-28 03:00:58,489 - INFO - STARTING TEST : test_qos_remark_dscp_on_vmi 2026-05-28 03:00:58,489 - INFO - TEST DESCRIPTION : Create a qos config for remarking DSCP 1 to 10 Have VMs A, B Apply the qos config to VM A Validate that packets from A to B have DSCP marked correctly 2026-05-28 03:00:59,834 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.252': '0', '10.20.0.249': '0'}, '10.0.0.49': {'10.20.0.249': '0', '10.20.0.19': '0'}} with 2026-05-28 03:00:59,834 - INFO - Initial checks done. Running the testcase now 2026-05-28 03:00:59,834 - INFO - 2026-05-28 03:00:59,845 - DEBUG - FC Dict is {'fc_id': 0, 'dscp': 10, 'dot1p': 1, 'exp': 1, 'connections': } 2026-05-28 03:01:00,149 - INFO - Created FC ['default-global-system-config', 'default-global-qos-config', 'ctest-fc-21149637'], UUID 31455e04-05e0-4682-93a6-48f6a9b3d897 2026-05-28 03:01:00,553 - INFO - Created QosConfig ['default-domain', 'ctest-TestQos-20006452', 'ctest-qos_config-91094932'], UUID: 707ba2f2-1663-4ddc-951c-2cb2b8282f32 2026-05-28 03:01:00,605 - INFO - Applying qos-config on VM a4fab113-4b42-45a2-b0ea-138465d41d1a 2026-05-28 03:01:00,938 - DEBUG - VM is in ACTIVE state now 2026-05-28 03:01:01,303 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/425243bf-d62c-49a8-bc45-bd0f0ddd1691 2026-05-28 03:01:01,314 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/a4fab113-4b42-45a2-b0ea-138465d41d1a 2026-05-28 03:01:01,326 - DEBUG - Requesting: http://10.0.0.131:8082/instance-ip/75e2073f-41ae-4fe9-953c-dd4442dcf553 2026-05-28 03:01:01,341 - DEBUG - Requesting: http://10.0.0.131:8082/instance-ip/e012c0ec-f0ff-431c-aca0-53e5d5cccbfd 2026-05-28 03:01:01,599 - DEBUG - VM is in ACTIVE state now 2026-05-28 03:01:01,984 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine/11803b71-1dc0-405b-a1f5-4d7e5cf9b101 2026-05-28 03:01:01,997 - DEBUG - Requesting: http://10.0.0.131:8082/virtual-machine-interface/fc910dc3-a187-4c45-8f45-d29bd1e93d91 2026-05-28 03:01:02,012 - DEBUG - Requesting: http://10.0.0.131:8082/instance-ip/17c06177-31e8-4172-8023-d4422c69177f 2026-05-28 03:01:02,030 - DEBUG - Requesting: http://10.0.0.131:8082/instance-ip/46453382-d68f-4a18-8026-dc09a028bd76 2026-05-28 03:01:02,076 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-28 03:01:02,077 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-28 03:01:02,077 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2026-05-28 03:01:02,077 - INFO - Starting hping3 on ctest-TestQos-20006452-57578921, args: --destport 20000 --baseport 10000 --count 20000 --interval 1 --udp --tos 4 --keep --numeric 2026-05-28 03:01:02,077 - DEBUG - Hping3 cmd : hping3 --destport 20000 --baseport 10000 --count 20000 --interval 1 --udp --tos 4 --keep --numeric 56.171.59.68 1>/tmp/hping_ctest-random-95182735.log 2>/tmp/hping_ctest-random-95182735.result 2026-05-28 03:01:02,077 - DEBUG - Running remote_cmd, Cmd : hping3 --destport 20000 --baseport 10000 --count 20000 --interval 1 --udp --tos 4 --keep --numeric 56.171.59.68 1>/tmp/hping_ctest-random-95182735.log 2>/tmp/hping_ctest-random-95182735.result, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2026-05-28 03:01:02,077 - DEBUG - nohup hping3 --destport 20000 --baseport 10000 --count 20000 --interval 1 --udp --tos 4 --keep --numeric 56.171.59.68 1>/tmp/hping_ctest-random-95182735.log 2>/tmp/hping_ctest-random-95182735.result & echo $! > /tmp/hping_ctest-random-95182735.pid 2026-05-28 03:01:10,082 - DEBUG - None 2026-05-28 03:01:15,427 - DEBUG - Forward flow: {'index': '470396', 'rflow': '326732', 'sip': '56.171.59.67', 'sport': '10000', 'dip': '56.171.59.68', 'dport': '20000', 'proto': '17', 'vrf_id': '2', 'action': 'FORWARD', 'flags': ' ACTIVE | RFLOW_VALID ', 'd_vrf_id': '0', 'bytes': '252', 'pkts': '6', 'insight': '0', 'nhid': '30', 'underlay_udp_sport': '62841', 'ttl': '0', 'qos_id': '0', 'gen_id': '1', 'tcp_seq': '0', 'oflow_bytes': '0', 'oflow_packets': '0', 'underlay_gw_index': '-1'} 2026-05-28 03:01:15,429 - DEBUG - Reverse flow: {'index': '326732', 'rflow': '470396', 'sip': '56.171.59.68', 'sport': '20000', 'dip': '56.171.59.67', 'dport': '10000', 'proto': '17', 'vrf_id': '2', 'action': 'FORWARD', 'flags': ' ACTIVE | RFLOW_VALID ', 'd_vrf_id': '0', 'bytes': '420', 'pkts': '6', 'insight': '0', 'nhid': '30', 'underlay_udp_sport': '62020', 'ttl': '0', 'qos_id': '0', 'gen_id': '1', 'tcp_seq': '0', 'oflow_bytes': '0', 'oflow_packets': '0', 'underlay_gw_index': '-1'} 2026-05-28 03:01:15,429 - DEBUG - The filter pattern is ['udp', 'and', 'src port 62841'] 2026-05-28 03:01:15,429 - DEBUG - The filter string is '(udp and src port 62841)' 2026-05-28 03:01:15,523 - DEBUG - Executing command: sudo tcpdump -nni ens6 -U -vvxx '(udp and src port 62841)' -w /tmp/ens6_ctest-random-23742256.pcap 2026-05-28 03:01:20,627 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2026-05-28 03:01:22,631 - DEBUG - Ensuring hping3 instance with result file /tmp/hping_ctest-random-95182735.result on ctest-TestQos-20006452-57578921 is stopped 2026-05-28 03:01:22,631 - DEBUG - Running remote_cmd, Cmd : cat /tmp/hping_ctest-random-95182735.pid | xargs kill , host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2026-05-28 03:01:22,631 - DEBUG - cat /tmp/hping_ctest-random-95182735.pid | xargs kill 2026-05-28 03:01:23,398 - DEBUG - None 2026-05-28 03:01:23,398 - DEBUG - Running remote_cmd, Cmd : cat /tmp/hping_ctest-random-95182735.result, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2026-05-28 03:01:23,398 - DEBUG - cat /tmp/hping_ctest-random-95182735.result 2026-05-28 03:01:23,736 - DEBUG - --- 56.171.59.68 hping statistic --- 14 packets transmitted, 14 packets received, 0% packet loss round-trip min/avg/max = 14.0/6512.7/13016.6 ms 2026-05-28 03:01:23,736 - DEBUG - Running remote_cmd, Cmd : cat /tmp/hping_ctest-random-95182735.log, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.48, gateway password: c0ntrail123 2026-05-28 03:01:23,736 - DEBUG - cat /tmp/hping_ctest-random-95182735.log 2026-05-28 03:01:24,083 - DEBUG - HPING 56.171.59.68 (eth0 56.171.59.68): udp mode set, 28 headers + 0 data bytes ICMP Port Unreachable from ip=56.171.59.68 status=0 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 ICMP Port Unreachable from ip=56.171.59.68 status=1 port=10000 seq=0 2026-05-28 03:01:24,084 - DEBUG - Hping3 stats: {'sent': '14', 'received': '14', 'loss': '0', 'rtt_min': '14.0', 'rtt_avg': '6512.7', 'rtt_max': '13016.6'} 2026-05-28 03:01:24,084 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/ens6_ctest-random-23742256.pcap | wc -l 2026-05-28 03:01:24,101 - DEBUG - STDOUT: 16 2026-05-28 03:01:24,101 - DEBUG - STDERR: reading from file /tmp/ens6_ctest-random-23742256.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2026-05-28 03:01:24,101 - DEBUG - 16 packets are found in tcpdump output file /tmp/ens6_ctest-random-23742256.pcap but expected 1, which is fine 2026-05-28 03:01:24,101 - INFO - 16 packets are found in tcpdump output as expected 2026-05-28 03:01:24,102 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2026-05-28 03:01:26,171 - DEBUG - ['/contrail-test/ens6_ctest-random-23742256.pcap'] 2026-05-28 03:01:26,171 - DEBUG - Verifying for packet number 0 2026-05-28 03:01:26,171 - DEBUG - Validated DSCP marking of 10 2026-05-28 03:01:26,171 - DEBUG - Verifying for packet number 1 2026-05-28 03:01:26,171 - DEBUG - Validated DSCP marking of 10 2026-05-28 03:01:26,172 - DEBUG - Verifying for packet number 2 2026-05-28 03:01:26,172 - DEBUG - Validated DSCP marking of 10 2026-05-28 03:01:26,172 - DEBUG - Verifying for packet number 3 2026-05-28 03:01:26,172 - DEBUG - Validated DSCP marking of 10 2026-05-28 03:01:26,172 - INFO - Packet QoS marking validation passed 2026-05-28 03:01:26,172 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/ens6_ctest-random-23742256.pcap | wc -l 2026-05-28 03:01:26,189 - DEBUG - STDOUT: 16 2026-05-28 03:01:26,190 - DEBUG - STDERR: reading from file /tmp/ens6_ctest-random-23742256.pcap, link-type EN10MB (Ethernet), snapshot length 262144 2026-05-28 03:01:26,190 - DEBUG - 16 packets are found in tcpdump output file /tmp/ens6_ctest-random-23742256.pcap but expected 1, which is fine 2026-05-28 03:01:26,190 - INFO - 16 packets are found in tcpdump output as expected 2026-05-28 03:01:26,190 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}') 2026-05-28 03:01:28,255 - DEBUG - ['/contrail-test/ens6_ctest-random-23742256.pcap'] 2026-05-28 03:01:28,256 - DEBUG - Verifying for packet number 0 2026-05-28 03:01:28,256 - DEBUG - Interface ens6 does not seem to be a tagged intf. Skipping dot1p check 2026-05-28 03:01:28,256 - DEBUG - Verifying for packet number 1 2026-05-28 03:01:28,256 - DEBUG - Interface ens6 does not seem to be a tagged intf. Skipping dot1p check 2026-05-28 03:01:28,256 - DEBUG - Verifying for packet number 2 2026-05-28 03:01:28,256 - DEBUG - Interface ens6 does not seem to be a tagged intf. Skipping dot1p check 2026-05-28 03:01:28,256 - DEBUG - Verifying for packet number 3 2026-05-28 03:01:28,256 - DEBUG - Interface ens6 does not seem to be a tagged intf. Skipping dot1p check 2026-05-28 03:01:28,256 - INFO - Packet QoS marking validation passed 2026-05-28 03:01:28,368 - INFO - Removing qos-config on VM a4fab113-4b42-45a2-b0ea-138465d41d1a 2026-05-28 03:01:28,445 - INFO - Deleting Qos config ['default-domain', 'ctest-TestQos-20006452', 'ctest-qos_config-91094932'], UUID: 707ba2f2-1663-4ddc-951c-2cb2b8282f32 2026-05-28 03:01:28,545 - INFO - Deleting FC ['default-global-system-config', 'default-global-qos-config', 'ctest-fc-21149637'], UUID: 31455e04-05e0-4682-93a6-48f6a9b3d897 2026-05-28 03:01:29,912 - DEBUG - No XMPP flaps were noticed during the test 2026-05-28 03:01:29,912 - INFO - END TEST : test_qos_remark_dscp_on_vmi : PASSED[0:00:31] 2026-05-28 03:01:29,912 - INFO - -------------------------------------------------------------------------------- 2026-05-28 03:01:29,918 - INFO - Deleting VM ctest-TestQos-20006452-69440145 2026-05-28 03:01:30,006 - INFO - Deleting VM ctest-TestQos-20006452-47830657 2026-05-28 03:01:30,106 - INFO - Deleting VM ctest-TestQos-20006452-57578921 2026-05-28 03:01:30,212 - INFO - Deleting VN ctest-vn-99569441 2026-05-28 03:01:30,277 - DEBUG - VN 038d5bcb-3026-4936-99cb-ef404032e4a0 still in use: Unable to complete operation on network 038d5bcb-3026-4936-99cb-ef404032e4a0. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-17fb23dd-cb63-40e6-be2f-422f103fc0e6'] 2026-05-28 03:01:30,277 - WARNING - Deleting VN ctest-vn-99569441 failed..Will retry 2026-05-28 03:01:32,515 - DEBUG - Response for deleting network () 2026-05-28 03:01:32,515 - INFO - Deleting VN ctest-vn-48255537 2026-05-28 03:01:32,834 - DEBUG - Response for deleting network () 2026-05-28 03:01:33,657 - INFO - Deleted project: ctest-TestQos-20006452, ID : b5c589e3-1cc3-4400-aec2-1c0eaa2a6e92