2025-08-11 07:13:31,541 - INFO - Domain Default found not creating
2025-08-11 07:13:31,745 - INFO - Project ctest-DisablePolicyEcmpIpv6-61041483 not found, creating it
2025-08-11 07:13:32,284 - INFO - Created Project:ctest-DisablePolicyEcmpIpv6-61041483, ID : e7fe3a5a-33d1-4a7e-b363-f2ce7fbf9598
2025-08-11 07:13:34,120 - INFO - ================================================================================
2025-08-11 07:13:34,120 - INFO - STARTING TEST : test_ecmp_with_static_routes
2025-08-11 07:13:34,120 - INFO - TEST DESCRIPTION :
Description: Verify disabling policy for ECMP routes with static routes on VM
Steps:
1. launch 1 VN and launch 3 VMs in it.
2. create a static route for a new subnet prefix and add this on 2 VMIs.
this will create 2 ECMP routes.
3. Disable the policy on all VMIs.
4. Now from 3rd VM send traffic to an IP from static route prefix
5. add new ECMP destinations and verify load is distributed to new destinations too
6. remove ECMP destinations and verify load is distributed to remaining destinations
Pass criteria:
1. traffic should go through fine
2. flows should not be created
3. load should be distributed among ecmp routes.
2025-08-11 07:13:35,396 - DEBUG - Nothing to compare xmpp stats {'10.0.0.49': {'10.20.0.17': '0', '10.20.0.25': '0'}, '10.0.0.57': {'10.20.0.17': '0', '10.20.0.254': '0'}} with
2025-08-11 07:13:35,396 - INFO - Address family configured is dual
2025-08-11 07:13:35,396 - INFO - we are setting address family as v6
2025-08-11 07:13:35,396 - INFO - we are setting address family as v6
2025-08-11 07:13:35,396 - INFO - Initial checks done. Running the testcase now
2025-08-11 07:13:35,397 - INFO -
2025-08-11 07:13:35,420 - DEBUG - Services list from nova: [, , , ]
2025-08-11 07:13:35,420 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3798-2', 'an-jenkins-deploy-platform-ansible-os-3798-1']}
2025-08-11 07:13:36,114 - DEBUG - Response for create_network : {'network': {'id': '7d0cfbd5-fed4-4aeb-9308-e285f7b990b8', 'name': 'ctest-vn-87089986', 'tenant_id': 'e7fe3a5a33d14a7eb363f2ce7fbf9598', 'project_id': 'e7fe3a5a33d14a7eb363f2ce7fbf9598', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-DisablePolicyEcmpIpv6-61041483', 'ctest-vn-87089986'], 'port_security_enabled': True, 'description': ''}}
2025-08-11 07:13:36,370 - DEBUG - Response for create_subnet : {'subnet': {'id': 'bce00b39-604b-4c11-8208-c2aae9a8f814', 'name': '', 'tenant_id': 'e7fe3a5a33d14a7eb363f2ce7fbf9598', 'network_id': '7d0cfbd5-fed4-4aeb-9308-e285f7b990b8', 'ip_version': 6, 'cidr': '2ddc:3d0f:a3e8:e7d:91a1:21f0::/96', 'allocation_pools': [{'start': '2ddc:3d0f:a3e8:e7d:91a1:21f0:0:2', 'end': '2ddc:3d0f:a3e8:e7d:91a1:21f0:ffff:fffe'}], 'gateway_ip': '2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2ddc:3d0f:a3e8:e7d:91a1:21f0:0:2', 'tags': [], 'project_id': 'e7fe3a5a33d14a7eb363f2ce7fbf9598'}}
2025-08-11 07:13:36,592 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd67e0bbf-82b1-45f9-a667-1c515bac6b64', 'name': '', 'tenant_id': 'e7fe3a5a33d14a7eb363f2ce7fbf9598', 'network_id': '7d0cfbd5-fed4-4aeb-9308-e285f7b990b8', 'ip_version': 4, 'cidr': '12.114.30.192/26', 'allocation_pools': [{'start': '12.114.30.194', 'end': '12.114.30.254'}], 'gateway_ip': '12.114.30.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '12.114.30.194', 'tags': [], 'project_id': 'e7fe3a5a33d14a7eb363f2ce7fbf9598'}}
2025-08-11 07:13:36,617 - INFO - Created VN ctest-vn-87089986
2025-08-11 07:13:36,630 - DEBUG - VN ctest-vn-87089986 UUID is 7d0cfbd5-fed4-4aeb-9308-e285f7b990b8
2025-08-11 07:13:36,733 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-08-11 07:13:37,028 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-08-11 07:13:37,056 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979
2025-08-11 07:13:37,071 - DEBUG - Requesting: http://10.0.0.254:8082/project/e7fe3a5a-33d1-4a7e-b363-f2ce7fbf9598
2025-08-11 07:13:37,179 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7d0cfbd5-fed4-4aeb-9308-e285f7b990b8
2025-08-11 07:13:37,195 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7d0cfbd5-fed4-4aeb-9308-e285f7b990b8
2025-08-11 07:13:37,208 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6e232104-edd9-4902-86cf-842257011e5a
2025-08-11 07:13:37,216 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6e232104-edd9-4902-86cf-842257011e5a
2025-08-11 07:13:37,224 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/1931ff9a-db10-4c31-9392-3fd14f96d04f
2025-08-11 07:13:37,232 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 07:13:37,232 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7d0cfbd5-fed4-4aeb-9308-e285f7b990b8
2025-08-11 07:13:37,243 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6e232104-edd9-4902-86cf-842257011e5a
2025-08-11 07:13:37,264 - INFO - Verified VN network id 14 for VN 7d0cfbd5-fed4-4aeb-9308-e285f7b990b8
2025-08-11 07:13:37,264 - INFO - Verifications in API Server for VN ctest-vn-87089986 passed
2025-08-11 07:13:37,264 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7d0cfbd5-fed4-4aeb-9308-e285f7b990b8
2025-08-11 07:13:37,276 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6e232104-edd9-4902-86cf-842257011e5a
2025-08-11 07:13:37,284 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6e232104-edd9-4902-86cf-842257011e5a
2025-08-11 07:13:37,293 - DEBUG - Requesting: http://10.0.0.254:8082/route-target/1931ff9a-db10-4c31-9392-3fd14f96d04f
2025-08-11 07:13:37,307 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-DisablePolicyEcmpIpv6-61041483', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9010853850983451371', 'uuid-lslong': '10594967188403753144'}, 'enable': 'true', 'created': '2025-08-11T07:13:36', 'last-modified': '2025-08-11T07:13:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.776422'}
2025-08-11 07:13:37,313 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 07:13:37,321 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-DisablePolicyEcmpIpv6-61041483', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9010853850983451371', 'uuid-lslong': '10594967188403753144'}, 'enable': 'true', 'created': '2025-08-11T07:13:36', 'last-modified': '2025-08-11T07:13:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.795609'}
2025-08-11 07:13:37,328 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 07:13:37,336 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-DisablePolicyEcmpIpv6-61041483', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9010853850983451371', 'uuid-lslong': '10594967188403753144'}, 'enable': 'true', 'created': '2025-08-11T07:13:36', 'last-modified': '2025-08-11T07:13:36', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.809356'}
2025-08-11 07:13:37,344 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-11 07:13:37,344 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-87089986 passed
2025-08-11 07:13:37,344 - DEBUG - ====Verifying policy data for ctest-vn-87089986 in API_Server ======
2025-08-11 07:13:37,344 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-08-11 07:13:37,350 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979
2025-08-11 07:13:37,363 - DEBUG - Requesting: http://10.0.0.254:8082/project/e7fe3a5a-33d1-4a7e-b363-f2ce7fbf9598
2025-08-11 07:13:37,459 - DEBUG - Requesting: http://10.0.0.254:8082/virtual-network/7d0cfbd5-fed4-4aeb-9308-e285f7b990b8
2025-08-11 07:13:37,471 - DEBUG - =>VN ctest-vn-87089986 has no policy to be verified
2025-08-11 07:13:37,471 - DEBUG - Verifying the vn in opserver
2025-08-11 07:13:37,471 - DEBUG - Verifying the default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 virtual network link through opserver 10.0.0.254
2025-08-11 07:13:37,471 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-08-11 07:13:37,768 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-08-11 07:13:37,830 - DEBUG - vn link and name as {'name': 'default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986?flat'}
2025-08-11 07:13:37,830 - DEBUG - Verifying the default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 virtual network link through opserver 10.0.0.38
2025-08-11 07:13:37,830 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-11 07:13:38,127 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-11 07:13:38,189 - DEBUG - vn link and name as {'name': 'default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986?flat'}
2025-08-11 07:13:38,189 - DEBUG - Verifying the default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 virtual network link through opserver 10.0.0.50
2025-08-11 07:13:38,189 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-08-11 07:13:38,493 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-08-11 07:13:38,551 - DEBUG - vn link and name as {'name': 'default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986?flat'}
2025-08-11 07:13:38,551 - INFO - Validated that VN default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is found in opserver
2025-08-11 07:13:38,575 - DEBUG - Do not have enough data to verify VN in agent
2025-08-11 07:13:38,586 - DEBUG - VRF ids for VN ctest-vn-87089986: {}
2025-08-11 07:13:38,586 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3798-2', 'an-jenkins-deploy-platform-ansible-os-3798-1']}
2025-08-11 07:13:39,640 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3798-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3798-2)
2025-08-11 07:13:39,640 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3798-2', 'an-jenkins-deploy-platform-ansible-os-3798-1']}
2025-08-11 07:13:40,922 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3798-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3798-1)
2025-08-11 07:13:42,308 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3798-1), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3798-1)
2025-08-11 07:13:42,310 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3798-2', 'an-jenkins-deploy-platform-ansible-os-3798-1']}
2025-08-11 07:13:43,749 - INFO - VM ([]) created on node: (an-jenkins-deploy-platform-ansible-os-3798-2), Zone: (nova:an-jenkins-deploy-platform-ansible-os-3798-2)
2025-08-11 07:13:43,749 - INFO - Waiting for VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 to be up..
2025-08-11 07:13:43,850 - DEBUG - VM is in ACTIVE state now
2025-08-11 07:13:43,850 - INFO - VM name : ctest-DisablePolicyEcmpIpv6-61041483-17223366
2025-08-11 07:13:43,945 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 ID is de1e3fb6-dd9e-4f2a-aee7-6eba3953c296
2025-08-11 07:13:43,945 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 launched on Node an-jenkins-deploy-platform-ansible-os-3798-1
2025-08-11 07:13:44,037 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/de1e3fb6-dd9e-4f2a-aee7-6eba3953c296
2025-08-11 07:13:44,427 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/de1e3fb6-dd9e-4f2a-aee7-6eba3953c296
2025-08-11 07:13:44,488 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/b7c6da00-8015-46de-b559-55fb5334272f
2025-08-11 07:13:47,748 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1031ms')
2025-08-11 07:13:47,748 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 failed!
2025-08-11 07:13:47,767 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1 and allocation pool is NOT set
2025-08-11 07:13:47,767 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 12.114.30.193 and allocation pool is NOT set
2025-08-11 07:13:51,840 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1012ms')
2025-08-11 07:13:51,840 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 failed!
2025-08-11 07:13:51,857 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1 and allocation pool is NOT set
2025-08-11 07:13:51,857 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 12.114.30.193 and allocation pool is NOT set
2025-08-11 07:13:55,933 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms')
2025-08-11 07:13:55,934 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 failed!
2025-08-11 07:13:55,951 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1 and allocation pool is NOT set
2025-08-11 07:13:55,951 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 12.114.30.193 and allocation pool is NOT set
2025-08-11 07:14:00,035 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1017ms')
2025-08-11 07:14:00,035 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 failed!
2025-08-11 07:14:00,051 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1 and allocation pool is NOT set
2025-08-11 07:14:00,051 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 12.114.30.193 and allocation pool is NOT set
2025-08-11 07:14:04,125 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms')
2025-08-11 07:14:04,126 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 failed!
2025-08-11 07:14:04,141 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1 and allocation pool is NOT set
2025-08-11 07:14:04,141 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 12.114.30.193 and allocation pool is NOT set
2025-08-11 07:14:08,225 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2025-08-11 07:14:08,225 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 failed!
2025-08-11 07:14:08,259 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1 and allocation pool is NOT set
2025-08-11 07:14:08,259 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 12.114.30.193 and allocation pool is NOT set
2025-08-11 07:14:12,355 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1036ms')
2025-08-11 07:14:12,355 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 failed!
2025-08-11 07:14:12,370 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1 and allocation pool is NOT set
2025-08-11 07:14:12,370 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 12.114.30.193 and allocation pool is NOT set
2025-08-11 07:14:16,454 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1023ms')
2025-08-11 07:14:16,454 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 failed!
2025-08-11 07:14:16,472 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1 and allocation pool is NOT set
2025-08-11 07:14:16,472 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 12.114.30.193 and allocation pool is NOT set
2025-08-11 07:14:20,546 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1013ms')
2025-08-11 07:14:20,546 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 failed!
2025-08-11 07:14:20,561 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1 and allocation pool is NOT set
2025-08-11 07:14:20,561 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 12.114.30.193 and allocation pool is NOT set
2025-08-11 07:14:24,647 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1024ms')
2025-08-11 07:14:24,648 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 failed!
2025-08-11 07:14:24,662 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1 and allocation pool is NOT set
2025-08-11 07:14:24,662 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 12.114.30.193 and allocation pool is NOT set
2025-08-11 07:14:28,741 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1016ms')
2025-08-11 07:14:28,741 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 failed!
2025-08-11 07:14:28,758 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1 and allocation pool is NOT set
2025-08-11 07:14:28,758 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 12.114.30.193 and allocation pool is NOT set
2025-08-11 07:14:32,835 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1015ms')
2025-08-11 07:14:32,835 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 failed!
2025-08-11 07:14:32,849 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:1 and allocation pool is NOT set
2025-08-11 07:14:32,850 - DEBUG - Gateway for vn default-domain:ctest-DisablePolicyEcmpIpv6-61041483:ctest-vn-87089986 is 12.114.30.193 and allocation pool is NOT set
2025-08-11 07:14:34,911 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.80 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.690 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.690/3.243/5.796/2.553 ms')
2025-08-11 07:14:34,911 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 passed
2025-08-11 07:14:35,029 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 07:14:35,029 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-61041483-17223366, IP 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:4, Port 22
2025-08-11 07:14:35,097 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-11 07:14:35,213 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-11 07:14:40,214 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 07:14:40,214 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-61041483-17223366, IP 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:4, Port 22
2025-08-11 07:14:40,280 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-11 07:14:40,361 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-11 07:14:45,362 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 07:14:45,362 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-61041483-17223366, IP 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:4, Port 22
2025-08-11 07:14:45,417 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-11 07:14:45,499 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-11 07:14:50,501 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 07:14:50,501 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-61041483-17223366, IP 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:4, Port 22
2025-08-11 07:14:50,568 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2025-08-11 07:14:50,641 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 is NOT ready for SSH connections, VM status: ACTIVE
2025-08-11 07:14:55,642 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 07:14:55,642 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-61041483-17223366, IP 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:4, Port 22
2025-08-11 07:14:55,808 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-17223366 is ready for SSH connections
2025-08-11 07:14:55,808 - INFO - Waiting for VM ctest-DisablePolicyEcmpIpv6-61041483-20955269 to be up..
2025-08-11 07:14:55,894 - DEBUG - VM is in ACTIVE state now
2025-08-11 07:14:55,894 - INFO - VM name : ctest-DisablePolicyEcmpIpv6-61041483-20955269
2025-08-11 07:14:55,972 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-20955269 ID is 9b37655b-cdde-49bc-9cdc-7c319755e809
2025-08-11 07:14:55,973 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-20955269 launched on Node an-jenkins-deploy-platform-ansible-os-3798-1
2025-08-11 07:14:56,051 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/9b37655b-cdde-49bc-9cdc-7c319755e809
2025-08-11 07:14:56,061 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/fc68e865-ab34-4200-9582-307a42dd7396
2025-08-11 07:14:57,262 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=2.66 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=2.30 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 2.302/2.482/2.663/0.180 ms')
2025-08-11 07:14:57,262 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-DisablePolicyEcmpIpv6-61041483-20955269 passed
2025-08-11 07:14:57,377 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 07:14:57,377 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-61041483-20955269, IP 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:5, Port 22
2025-08-11 07:14:57,555 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-20955269 is ready for SSH connections
2025-08-11 07:14:57,555 - INFO - Waiting for VM ctest-DisablePolicyEcmpIpv6-61041483-18308604 to be up..
2025-08-11 07:14:57,635 - DEBUG - VM is in ACTIVE state now
2025-08-11 07:14:57,635 - INFO - VM name : ctest-DisablePolicyEcmpIpv6-61041483-18308604
2025-08-11 07:14:57,714 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-18308604 ID is 2f0aa43a-94e8-4f62-ad1d-702daeb0318e
2025-08-11 07:14:57,714 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-18308604 launched on Node an-jenkins-deploy-platform-ansible-os-3798-2
2025-08-11 07:14:57,787 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/2f0aa43a-94e8-4f62-ad1d-702daeb0318e
2025-08-11 07:14:57,798 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/f95d196c-d79f-4fdc-a724-bcb6ef666643
2025-08-11 07:14:58,999 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.19 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.78 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.781/3.483/5.186/1.702 ms')
2025-08-11 07:14:58,999 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-DisablePolicyEcmpIpv6-61041483-18308604 passed
2025-08-11 07:14:59,109 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 07:14:59,109 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-61041483-18308604, IP 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3, Port 22
2025-08-11 07:14:59,271 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-18308604 is ready for SSH connections
2025-08-11 07:14:59,271 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 07:14:59,271 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:4 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-11 07:14:59,271 - DEBUG - ifconfig -a| grep 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:4 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1
2025-08-11 07:15:15,395 - DEBUG - eth0
2025-08-11 07:15:15,395 - DEBUG - Running remote_cmd, Cmd : sysctl net.ipv6.conf.eth0.accept_dad=0, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-11 07:15:15,395 - DEBUG - sysctl net.ipv6.conf.eth0.accept_dad=0
2025-08-11 07:15:15,891 - DEBUG - net.ipv6.conf.eth0.accept_dad = 0
2025-08-11 07:15:16,121 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-DisablePolicyEcmpIpv6-61041483', 'ctest-intf-rtb-05345872'](UUID 3bf791cd-2af9-43ac-938f-4117ee2f3aa7), prefixes : ['3bee:1715:1a1b:d575:195b:536e::/96']
2025-08-11 07:15:16,188 - INFO - Added intf route table 3bf791cd-2af9-43ac-938f-4117ee2f3aa7 to port b7c6da00-8015-46de-b559-55fb5334272f
2025-08-11 07:15:16,189 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-11 07:15:16,189 - DEBUG - ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1
2025-08-11 07:15:16,656 - DEBUG - eth0
2025-08-11 07:15:16,656 - DEBUG - Running remote_cmd, Cmd : ifconfig eth0 inet6 add 3bee:1715:1a1b:d575:195b:536e:40b1:383c, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-11 07:15:16,656 - DEBUG - ifconfig eth0 inet6 add 3bee:1715:1a1b:d575:195b:536e:40b1:383c
2025-08-11 07:15:17,132 - DEBUG - None
2025-08-11 07:15:17,132 - DEBUG - Running remote_cmd, Cmd : ifconfig -a, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-11 07:15:17,132 - DEBUG - ifconfig -a
2025-08-11 07:15:17,632 - DEBUG - eth0 Link encap:Ethernet HWaddr 02:b7:c6:da:00:80
inet addr:12.114.30.196 Bcast:12.114.30.255 Mask:255.255.255.192
inet6 addr: 3bee:1715:1a1b:d575:195b:536e:40b1:383c/128 Scope:Global
inet6 addr: 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:4/64 Scope:Global
inet6 addr: fe80::b7:c6ff:feda:80/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:457 errors:0 dropped:0 overruns:0 frame:0
TX packets:375 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:44966 (44.9 KB) TX bytes:35071 (35.0 KB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
2025-08-11 07:15:17,632 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 07:15:17,632 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:5 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-11 07:15:17,633 - DEBUG - ifconfig -a| grep 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:5 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1
2025-08-11 07:15:24,008 - DEBUG - eth0
2025-08-11 07:15:24,008 - DEBUG - Running remote_cmd, Cmd : sysctl net.ipv6.conf.eth0.accept_dad=0, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-11 07:15:24,008 - DEBUG - sysctl net.ipv6.conf.eth0.accept_dad=0
2025-08-11 07:15:24,904 - DEBUG - net.ipv6.conf.eth0.accept_dad = 0
2025-08-11 07:15:25,113 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-DisablePolicyEcmpIpv6-61041483', 'ctest-intf-rtb-04985983'](UUID e8b0db19-f6df-4185-b210-b267acb2ff18), prefixes : ['3bee:1715:1a1b:d575:195b:536e::/96']
2025-08-11 07:15:25,176 - INFO - Added intf route table e8b0db19-f6df-4185-b210-b267acb2ff18 to port fc68e865-ab34-4200-9582-307a42dd7396
2025-08-11 07:15:25,177 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-11 07:15:25,177 - DEBUG - ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1
2025-08-11 07:15:26,043 - DEBUG - eth0
2025-08-11 07:15:26,043 - DEBUG - Running remote_cmd, Cmd : ifconfig eth0 inet6 add 3bee:1715:1a1b:d575:195b:536e:40b1:383c, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-11 07:15:26,044 - DEBUG - ifconfig eth0 inet6 add 3bee:1715:1a1b:d575:195b:536e:40b1:383c
2025-08-11 07:15:26,797 - DEBUG - None
2025-08-11 07:15:26,797 - DEBUG - Running remote_cmd, Cmd : ifconfig -a, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.49, gateway password: c0ntrail123
2025-08-11 07:15:26,798 - DEBUG - ifconfig -a
2025-08-11 07:15:27,346 - DEBUG - eth0 Link encap:Ethernet HWaddr 02:fc:68:e8:65:ab
inet addr:12.114.30.197 Bcast:12.114.30.255 Mask:255.255.255.192
inet6 addr: 3bee:1715:1a1b:d575:195b:536e:40b1:383c/128 Scope:Global
inet6 addr: 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:5/64 Scope:Global
inet6 addr: fe80::fc:68ff:fee8:65ab/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:453 errors:0 dropped:0 overruns:0 frame:0
TX packets:382 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:43851 (43.8 KB) TX bytes:35575 (35.5 KB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
2025-08-11 07:15:27,409 - INFO - Policy DISABLED on VMI f95d196c-d79f-4fdc-a724-bcb6ef666643
2025-08-11 07:15:27,477 - INFO - Policy DISABLED on VMI b7c6da00-8015-46de-b559-55fb5334272f
2025-08-11 07:15:27,540 - INFO - Policy DISABLED on VMI fc68e865-ab34-4200-9582-307a42dd7396
2025-08-11 07:15:27,557 - INFO - ECMP routes found in agent 10.0.0.49, for prefix 3bee:1715:1a1b:d575:195b:536e::/96
2025-08-11 07:15:27,557 - INFO - Tap interface tapb7c6da00-80 found in ecmp routes in agent 10.0.0.49
2025-08-11 07:15:27,557 - INFO - Tap interface tapfc68e865-ab found in ecmp routes in agent 10.0.0.49
2025-08-11 07:15:27,571 - INFO - ECMP routes found in agent 10.0.0.49, for prefix 3bee:1715:1a1b:d575:195b:536e::/96
2025-08-11 07:15:27,650 - DEBUG - Executing command: sudo tcpdump -nni tapb7c6da00-80 -U '(udp and src host 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3 and dst host 3bee:1715:1a1b:d575:195b:536e:40b1:383c and dst port 11000)' -w /tmp/tapb7c6da00-80_ctest-random-93958398.pcap
2025-08-11 07:15:27,798 - DEBUG - Executing command: sudo tcpdump -nni tapfc68e865-ab -U '(udp and src host 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3 and dst host 3bee:1715:1a1b:d575:195b:536e:40b1:383c and dst port 11000)' -w /tmp/tapfc68e865-ab_ctest-random-69923341.pcap
2025-08-11 07:15:27,874 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 13744 3bee:1715:1a1b:d575:195b:536e:40b1:383c 11000 < icmp_error, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-11 07:15:27,874 - DEBUG - dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 13744 3bee:1715:1a1b:d575:195b:536e:40b1:383c 11000 < icmp_error
2025-08-11 07:16:04,031 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000746076 s, 134 kB/s
2025-08-11 07:16:04,031 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapb7c6da00-80_ctest-random-93958398.pcap | grep -c length
2025-08-11 07:16:04,043 - DEBUG - STDOUT: 0
2025-08-11 07:16:04,043 - DEBUG - STDERR: reading from file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:16:04,043 - WARNING - No packets are found in tcpdump output file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap but expected some packets
2025-08-11 07:16:06,044 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapb7c6da00-80_ctest-random-93958398.pcap | grep -c length
2025-08-11 07:16:06,057 - DEBUG - STDOUT: 0
2025-08-11 07:16:06,057 - DEBUG - STDERR: reading from file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:16:06,057 - WARNING - No packets are found in tcpdump output file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap but expected some packets
2025-08-11 07:16:08,058 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapb7c6da00-80_ctest-random-93958398.pcap | grep -c length
2025-08-11 07:16:08,070 - DEBUG - STDOUT: 0
2025-08-11 07:16:08,071 - DEBUG - STDERR: reading from file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:16:08,071 - WARNING - No packets are found in tcpdump output file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap but expected some packets
2025-08-11 07:16:10,071 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapb7c6da00-80_ctest-random-93958398.pcap | grep -c length
2025-08-11 07:16:10,084 - DEBUG - STDOUT: 0
2025-08-11 07:16:10,084 - DEBUG - STDERR: reading from file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:16:10,084 - WARNING - No packets are found in tcpdump output file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap but expected some packets
2025-08-11 07:16:12,085 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapb7c6da00-80_ctest-random-93958398.pcap | grep -c length
2025-08-11 07:16:12,097 - DEBUG - STDOUT: 0
2025-08-11 07:16:12,097 - DEBUG - STDERR: reading from file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:16:12,097 - WARNING - No packets are found in tcpdump output file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap but expected some packets
2025-08-11 07:16:14,098 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapb7c6da00-80_ctest-random-93958398.pcap | grep -c length
2025-08-11 07:16:14,110 - DEBUG - STDOUT: 0
2025-08-11 07:16:14,110 - DEBUG - STDERR: reading from file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:16:14,110 - WARNING - No packets are found in tcpdump output file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap but expected some packets
2025-08-11 07:16:16,111 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapb7c6da00-80_ctest-random-93958398.pcap | grep -c length
2025-08-11 07:16:16,123 - DEBUG - STDOUT: 0
2025-08-11 07:16:16,123 - DEBUG - STDERR: reading from file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:16:16,123 - WARNING - No packets are found in tcpdump output file /tmp/tapb7c6da00-80_ctest-random-93958398.pcap but expected some packets
2025-08-11 07:16:16,123 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfc68e865-ab_ctest-random-69923341.pcap | grep -c length
2025-08-11 07:16:16,134 - DEBUG - STDOUT: 1
2025-08-11 07:16:16,134 - DEBUG - STDERR: reading from file /tmp/tapfc68e865-ab_ctest-random-69923341.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:16:16,134 - INFO - 1 packets are found in tcpdump output as expected
2025-08-11 07:16:16,134 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-08-11 07:16:18,180 - INFO - Tcpdump verification on VM 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:5 passed
2025-08-11 07:16:18,400 - DEBUG - Forward and reverse flows for match {'sip': '2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3', 'dip': '3bee:1715:1a1b:d575:195b:536e:40b1:383c', 'sport': '13744', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0
2025-08-11 07:16:18,401 - DEBUG - Flow verification PASSED on node: 10.0.0.49 for VMs - Sender: 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3, Receiver: 3bee:1715:1a1b:d575:195b:536e:40b1:383c, Flow count expected: 0 0, got: 0 0
2025-08-11 07:16:18,401 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-08-11 07:16:20,409 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-08-11 07:16:22,733 - DEBUG - Forward and reverse flows for match {'sip': '2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3', 'dip': '3bee:1715:1a1b:d575:195b:536e:40b1:383c', 'sport': '13744', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0
2025-08-11 07:16:22,735 - DEBUG - Flow verification PASSED on node: 10.0.0.57 for VMs - Sender: 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3, Receiver: 3bee:1715:1a1b:d575:195b:536e:40b1:383c, Flow count expected: 0 0, got: 0 0
2025-08-11 07:16:22,735 - INFO - Traffic verification for ECMP passed
2025-08-11 07:16:22,735 - INFO - Waiting for VM ctest-DisablePolicyEcmpIpv6-61041483-83854672 to be up..
2025-08-11 07:16:22,818 - DEBUG - VM is in ACTIVE state now
2025-08-11 07:16:22,818 - INFO - VM name : ctest-DisablePolicyEcmpIpv6-61041483-83854672
2025-08-11 07:16:22,895 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-83854672 ID is 209f5b75-268a-4980-a69d-bb5a3316a403
2025-08-11 07:16:22,895 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-83854672 launched on Node an-jenkins-deploy-platform-ansible-os-3798-2
2025-08-11 07:16:22,975 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/209f5b75-268a-4980-a69d-bb5a3316a403
2025-08-11 07:16:22,986 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/449601ae-2a9e-486d-892d-120e7f29f6b7
2025-08-11 07:16:24,188 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.09 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.619 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.619/1.853/3.087/1.234 ms')
2025-08-11 07:16:24,188 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-DisablePolicyEcmpIpv6-61041483-83854672 passed
2025-08-11 07:16:24,301 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 07:16:24,301 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-61041483-83854672, IP 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:6, Port 22
2025-08-11 07:16:24,452 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-61041483-83854672 is ready for SSH connections
2025-08-11 07:16:24,524 - INFO - Policy DISABLED on VMI 449601ae-2a9e-486d-892d-120e7f29f6b7
2025-08-11 07:16:24,525 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-11 07:16:24,525 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:6 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-11 07:16:24,525 - DEBUG - ifconfig -a| grep 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:6 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1
2025-08-11 07:16:57,134 - DEBUG - eth0
2025-08-11 07:16:57,134 - DEBUG - Running remote_cmd, Cmd : sysctl net.ipv6.conf.eth0.accept_dad=0, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-11 07:16:57,134 - DEBUG - sysctl net.ipv6.conf.eth0.accept_dad=0
2025-08-11 07:16:57,634 - DEBUG - net.ipv6.conf.eth0.accept_dad = 0
2025-08-11 07:16:57,849 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-DisablePolicyEcmpIpv6-61041483', 'ctest-intf-rtb-69908931'](UUID a98ad080-b1fe-48d3-8f21-3d7018000366), prefixes : ['3bee:1715:1a1b:d575:195b:536e::/96']
2025-08-11 07:16:57,917 - INFO - Added intf route table a98ad080-b1fe-48d3-8f21-3d7018000366 to port 449601ae-2a9e-486d-892d-120e7f29f6b7
2025-08-11 07:16:57,917 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-11 07:16:57,917 - DEBUG - ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1
2025-08-11 07:16:58,310 - DEBUG - eth0
2025-08-11 07:16:58,310 - DEBUG - Running remote_cmd, Cmd : ifconfig eth0 inet6 add 3bee:1715:1a1b:d575:195b:536e:40b1:383c, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-11 07:16:58,310 - DEBUG - ifconfig eth0 inet6 add 3bee:1715:1a1b:d575:195b:536e:40b1:383c
2025-08-11 07:16:58,763 - DEBUG - None
2025-08-11 07:16:58,763 - DEBUG - Running remote_cmd, Cmd : ifconfig -a, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-11 07:16:58,764 - DEBUG - ifconfig -a
2025-08-11 07:16:59,238 - DEBUG - eth0 Link encap:Ethernet HWaddr 02:44:96:01:ae:2a
inet addr:12.114.30.198 Bcast:12.114.30.255 Mask:255.255.255.192
inet6 addr: 3bee:1715:1a1b:d575:195b:536e:40b1:383c/128 Scope:Global
inet6 addr: 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:6/64 Scope:Global
inet6 addr: fe80::44:96ff:fe01:ae2a/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:516 errors:0 dropped:0 overruns:0 frame:0
TX packets:461 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:47648 (47.6 KB) TX bytes:40525 (40.5 KB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
2025-08-11 07:16:59,238 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-61041483-17223366
2025-08-11 07:16:59,368 - INFO - Removed intf route table 3bf791cd-2af9-43ac-938f-4117ee2f3aa7 from port b7c6da00-8015-46de-b559-55fb5334272f
2025-08-11 07:16:59,396 - INFO - Deleted Interface route table 3bf791cd-2af9-43ac-938f-4117ee2f3aa7
2025-08-11 07:16:59,411 - INFO - ECMP routes found in agent 10.0.0.49, for prefix 3bee:1715:1a1b:d575:195b:536e::/96
2025-08-11 07:16:59,411 - INFO - Tap interface tapfc68e865-ab found in ecmp routes in agent 10.0.0.49
2025-08-11 07:16:59,423 - INFO - ECMP routes found in agent 10.0.0.57, for prefix 3bee:1715:1a1b:d575:195b:536e::/96
2025-08-11 07:16:59,424 - INFO - Tap interface tap449601ae-2a found in ecmp routes in agent 10.0.0.57
2025-08-11 07:16:59,498 - DEBUG - Executing command: sudo tcpdump -nni tapfc68e865-ab -U '(udp and src host 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3 and dst host 3bee:1715:1a1b:d575:195b:536e:40b1:383c and dst port 11000)' -w /tmp/tapfc68e865-ab_ctest-random-17431768.pcap
2025-08-11 07:16:59,973 - DEBUG - Executing command: sudo tcpdump -nni tap449601ae-2a -U '(udp and src host 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3 and dst host 3bee:1715:1a1b:d575:195b:536e:40b1:383c and dst port 11000)' -w /tmp/tap449601ae-2a_ctest-random-02371946.pcap
2025-08-11 07:17:00,302 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 58883 3bee:1715:1a1b:d575:195b:536e:40b1:383c 11000 < icmp_error, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2025-08-11 07:17:00,302 - DEBUG - dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 58883 3bee:1715:1a1b:d575:195b:536e:40b1:383c 11000 < icmp_error
2025-08-11 07:17:02,781 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000859114 s, 116 kB/s
2025-08-11 07:17:02,781 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfc68e865-ab_ctest-random-17431768.pcap | grep -c length
2025-08-11 07:17:02,793 - DEBUG - STDOUT: 0
2025-08-11 07:17:02,793 - DEBUG - STDERR: reading from file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:17:02,793 - WARNING - No packets are found in tcpdump output file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap but expected some packets
2025-08-11 07:17:04,794 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfc68e865-ab_ctest-random-17431768.pcap | grep -c length
2025-08-11 07:17:04,805 - DEBUG - STDOUT: 0
2025-08-11 07:17:04,806 - DEBUG - STDERR: reading from file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:17:04,806 - WARNING - No packets are found in tcpdump output file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap but expected some packets
2025-08-11 07:17:06,807 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfc68e865-ab_ctest-random-17431768.pcap | grep -c length
2025-08-11 07:17:06,818 - DEBUG - STDOUT: 0
2025-08-11 07:17:06,818 - DEBUG - STDERR: reading from file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:17:06,818 - WARNING - No packets are found in tcpdump output file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap but expected some packets
2025-08-11 07:17:08,818 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfc68e865-ab_ctest-random-17431768.pcap | grep -c length
2025-08-11 07:17:08,830 - DEBUG - STDOUT: 0
2025-08-11 07:17:08,830 - DEBUG - STDERR: reading from file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:17:08,831 - WARNING - No packets are found in tcpdump output file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap but expected some packets
2025-08-11 07:17:10,832 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfc68e865-ab_ctest-random-17431768.pcap | grep -c length
2025-08-11 07:17:10,844 - DEBUG - STDOUT: 0
2025-08-11 07:17:10,844 - DEBUG - STDERR: reading from file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:17:10,844 - WARNING - No packets are found in tcpdump output file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap but expected some packets
2025-08-11 07:17:12,845 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfc68e865-ab_ctest-random-17431768.pcap | grep -c length
2025-08-11 07:17:12,858 - DEBUG - STDOUT: 0
2025-08-11 07:17:12,858 - DEBUG - STDERR: reading from file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:17:12,858 - WARNING - No packets are found in tcpdump output file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap but expected some packets
2025-08-11 07:17:14,859 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapfc68e865-ab_ctest-random-17431768.pcap | grep -c length
2025-08-11 07:17:14,873 - DEBUG - STDOUT: 0
2025-08-11 07:17:14,874 - DEBUG - STDERR: reading from file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:17:14,874 - WARNING - No packets are found in tcpdump output file /tmp/tapfc68e865-ab_ctest-random-17431768.pcap but expected some packets
2025-08-11 07:17:14,874 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tap449601ae-2a_ctest-random-02371946.pcap | grep -c length
2025-08-11 07:17:14,889 - DEBUG - STDOUT: 1
2025-08-11 07:17:14,889 - DEBUG - STDERR: reading from file /tmp/tap449601ae-2a_ctest-random-02371946.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-11 07:17:14,889 - INFO - 1 packets are found in tcpdump output as expected
2025-08-11 07:17:14,890 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-08-11 07:17:16,938 - INFO - Tcpdump verification on VM 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:6 passed
2025-08-11 07:17:17,256 - DEBUG - Forward and reverse flows for match {'sip': '2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3', 'dip': '3bee:1715:1a1b:d575:195b:536e:40b1:383c', 'sport': '58883', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0
2025-08-11 07:17:17,256 - DEBUG - Flow verification PASSED on node: 10.0.0.57 for VMs - Sender: 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3, Receiver: 3bee:1715:1a1b:d575:195b:536e:40b1:383c, Flow count expected: 0 0, got: 0 0
2025-08-11 07:17:17,256 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-08-11 07:17:19,264 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-08-11 07:17:21,550 - DEBUG - Forward and reverse flows for match {'sip': '2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3', 'dip': '3bee:1715:1a1b:d575:195b:536e:40b1:383c', 'sport': '58883', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0
2025-08-11 07:17:21,550 - DEBUG - Flow verification PASSED on node: 10.0.0.57 for VMs - Sender: 2ddc:3d0f:a3e8:e7d:91a1:21f0:0:3, Receiver: 3bee:1715:1a1b:d575:195b:536e:40b1:383c, Flow count expected: 0 0, got: 0 0
2025-08-11 07:17:21,550 - INFO - Traffic verification for ECMP passed
2025-08-11 07:17:21,550 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-61041483-83854672
2025-08-11 07:17:21,681 - INFO - Removed intf route table a98ad080-b1fe-48d3-8f21-3d7018000366 from port 449601ae-2a9e-486d-892d-120e7f29f6b7
2025-08-11 07:17:21,710 - INFO - Deleted Interface route table a98ad080-b1fe-48d3-8f21-3d7018000366
2025-08-11 07:17:21,710 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-61041483-20955269
2025-08-11 07:17:21,861 - INFO - Removed intf route table e8b0db19-f6df-4185-b210-b267acb2ff18 from port fc68e865-ab34-4200-9582-307a42dd7396
2025-08-11 07:17:21,893 - INFO - Deleted Interface route table e8b0db19-f6df-4185-b210-b267acb2ff18
2025-08-11 07:17:21,893 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-61041483-18308604
2025-08-11 07:17:21,960 - INFO - Deleting VN ctest-vn-87089986
2025-08-11 07:17:21,996 - DEBUG - VN 7d0cfbd5-fed4-4aeb-9308-e285f7b990b8 still in use: Unable to complete operation on network 7d0cfbd5-fed4-4aeb-9308-e285f7b990b8. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-26c62495-b357-46be-8e71-42216294ba94']
2025-08-11 07:17:21,996 - WARNING - Deleting VN ctest-vn-87089986 failed..Will retry
2025-08-11 07:17:24,172 - DEBUG - Response for deleting network ()
2025-08-11 07:17:24,172 - DEBUG - Requesting: http://10.0.0.254:8082/routing-instance/6e232104-edd9-4902-86cf-842257011e5a
2025-08-11 07:17:24,177 - DEBUG - Response Code: 404
2025-08-11 07:17:24,177 - DEBUG - Requesting: http://10.0.0.254:8082/domains
2025-08-11 07:17:24,184 - DEBUG - Requesting: http://10.0.0.254:8082/domain/0566ad86-51fd-4570-9dcc-fd1153322979
2025-08-11 07:17:24,242 - DEBUG - Requesting: http://10.0.0.254:8082/project/e7fe3a5a-33d1-4a7e-b363-f2ce7fbf9598
2025-08-11 07:17:24,354 - INFO - Validated that VN ctest-vn-87089986 is not found in API Server
2025-08-11 07:17:24,370 - DEBUG - VN ctest-vn-87089986 is not present in Agent 10.0.0.49
2025-08-11 07:17:24,381 - DEBUG - VN ctest-vn-87089986 is not present in Agent 10.0.0.57
2025-08-11 07:17:24,381 - INFO - Validated that VN ctest-vn-87089986 is not in any agent
2025-08-11 07:17:24,419 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-87089986 info
2025-08-11 07:17:25,664 - DEBUG - No XMPP flaps were noticed during the test
2025-08-11 07:17:25,664 - INFO - END TEST : test_ecmp_with_static_routes : PASSED[0:03:51]
2025-08-11 07:17:25,664 - INFO - --------------------------------------------------------------------------------
2025-08-11 07:17:26,389 - INFO - Deleted project: ctest-DisablePolicyEcmpIpv6-61041483, ID : e7fe3a5a-33d1-4a7e-b363-f2ce7fbf9598