is in ACTIVE state now
2025-08-10 12:03:44,594 - INFO - VM name : ctest-DisablePolicyEcmpIpv6-05545489-44464165
2025-08-10 12:03:44,654 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-05545489-44464165 ID is c0147572-6b13-4d74-bff5-55dfaa77025a
2025-08-10 12:03:44,655 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-05545489-44464165 launched on Node an-jenkins-deploy-platform-ansible-os-3786-1
2025-08-10 12:03:44,714 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-machine/c0147572-6b13-4d74-bff5-55dfaa77025a
2025-08-10 12:03:44,722 - DEBUG - Requesting: http://10.0.0.57:8082/virtual-machine-interface/bd83d1e1-fdd8-4475-8ab4-6cea43130774
2025-08-10 12:03:45,919 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.11 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.310 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.310/1.710/3.111/1.400 ms')
2025-08-10 12:03:45,919 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-DisablePolicyEcmpIpv6-05545489-44464165 passed
2025-08-10 12:03:46,026 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-10 12:03:46,027 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-05545489-44464165, IP 3943:dceb:6da5:e05c:65de:7094:0:6, Port 22
2025-08-10 12:03:46,176 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-05545489-44464165 is ready for SSH connections
2025-08-10 12:03:46,240 - INFO - Policy DISABLED on VMI bd83d1e1-fdd8-4475-8ab4-6cea43130774
2025-08-10 12:03:46,240 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-08-10 12:03:46,240 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep 3943:dceb:6da5:e05c:65de:7094:0:6 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-08-10 12:03:46,240 - DEBUG - ifconfig -a| grep 3943:dceb:6da5:e05c:65de:7094:0:6 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1
2025-08-10 12:04:19,626 - DEBUG - eth0
2025-08-10 12:04:19,626 - DEBUG - Running remote_cmd, Cmd : sysctl net.ipv6.conf.eth0.accept_dad=0, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-08-10 12:04:19,626 - DEBUG - sysctl net.ipv6.conf.eth0.accept_dad=0
2025-08-10 12:04:20,110 - DEBUG - net.ipv6.conf.eth0.accept_dad = 0
2025-08-10 12:04:20,324 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-DisablePolicyEcmpIpv6-05545489', 'ctest-intf-rtb-64751228'](UUID 3c301580-9689-408d-82b0-3f67b573bc01), prefixes : ['3b1d:8c29:8186:3073:5556:f35::/96']
2025-08-10 12:04:20,392 - INFO - Added intf route table 3c301580-9689-408d-82b0-3f67b573bc01 to port bd83d1e1-fdd8-4475-8ab4-6cea43130774
2025-08-10 12:04:20,392 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-08-10 12:04:20,392 - DEBUG - ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1
2025-08-10 12:04:20,786 - DEBUG - eth0
2025-08-10 12:04:20,786 - DEBUG - Running remote_cmd, Cmd : ifconfig eth0 inet6 add 3b1d:8c29:8186:3073:5556:f35:c9cc:a59a, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-08-10 12:04:20,786 - DEBUG - ifconfig eth0 inet6 add 3b1d:8c29:8186:3073:5556:f35:c9cc:a59a
2025-08-10 12:04:21,248 - DEBUG - None
2025-08-10 12:04:21,248 - DEBUG - Running remote_cmd, Cmd : ifconfig -a, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-08-10 12:04:21,248 - DEBUG - ifconfig -a
2025-08-10 12:04:21,719 - DEBUG - eth0 Link encap:Ethernet HWaddr 02:bd:83:d1:e1:fd
inet addr:4.10.218.70 Bcast:4.10.218.127 Mask:255.255.255.192
inet6 addr: 3943:dceb:6da5:e05c:65de:7094:0:6/64 Scope:Global
inet6 addr: fe80::bd:83ff:fed1:e1fd/64 Scope:Link
inet6 addr: 3b1d:8c29:8186:3073:5556:f35:c9cc:a59a/128 Scope:Global
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:488 errors:0 dropped:0 overruns:0 frame:0
TX packets:450 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:46764 (46.7 KB) TX bytes:40265 (40.2 KB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
2025-08-10 12:04:21,719 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-05545489-65199954
2025-08-10 12:04:21,844 - INFO - Removed intf route table eb94842b-e50a-4de9-80ac-018e5e365179 from port 2804ba51-35df-4811-95ba-267c5a980ee7
2025-08-10 12:04:21,872 - INFO - Deleted Interface route table eb94842b-e50a-4de9-80ac-018e5e365179
2025-08-10 12:04:21,885 - INFO - ECMP routes found in agent 10.0.0.56, for prefix 3b1d:8c29:8186:3073:5556:f35::/96
2025-08-10 12:04:21,885 - INFO - Tap interface tapc2aa2054-8f found in ecmp routes in agent 10.0.0.56
2025-08-10 12:04:21,901 - INFO - ECMP routes found in agent 10.0.0.65, for prefix 3b1d:8c29:8186:3073:5556:f35::/96
2025-08-10 12:04:21,901 - INFO - Tap interface tapbd83d1e1-fd found in ecmp routes in agent 10.0.0.65
2025-08-10 12:04:21,975 - DEBUG - Executing command: sudo tcpdump -nni tapc2aa2054-8f -U '(udp and src host 3943:dceb:6da5:e05c:65de:7094:0:3 and dst host 3b1d:8c29:8186:3073:5556:f35:c9cc:a59a and dst port 11000)' -w /tmp/tapc2aa2054-8f_ctest-random-05034829.pcap
2025-08-10 12:04:22,427 - DEBUG - Executing command: sudo tcpdump -nni tapbd83d1e1-fd -U '(udp and src host 3943:dceb:6da5:e05c:65de:7094:0:3 and dst host 3b1d:8c29:8186:3073:5556:f35:c9cc:a59a and dst port 11000)' -w /tmp/tapbd83d1e1-fd_ctest-random-19472420.pcap
2025-08-10 12:04:22,513 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 47279 3b1d:8c29:8186:3073:5556:f35:c9cc:a59a 11000 < icmp_error, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.65, gateway password: c0ntrail123
2025-08-10 12:04:22,513 - DEBUG - dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 47279 3b1d:8c29:8186:3073:5556:f35:c9cc:a59a 11000 < icmp_error
2025-08-10 12:04:25,021 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000950471 s, 105 kB/s
2025-08-10 12:04:25,021 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tapc2aa2054-8f_ctest-random-05034829.pcap | grep -c length
2025-08-10 12:04:25,034 - DEBUG - STDOUT: 1
2025-08-10 12:04:25,034 - DEBUG - STDERR: reading from file /tmp/tapc2aa2054-8f_ctest-random-05034829.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-08-10 12:04:25,034 - INFO - 1 packets are found in tcpdump output as expected
2025-08-10 12:04:25,034 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-08-10 12:04:27,081 - INFO - Tcpdump verification on VM 3943:dceb:6da5:e05c:65de:7094:0:5 passed
2025-08-10 12:04:27,227 - DEBUG - Forward and reverse flows for match {'sip': '3943:dceb:6da5:e05c:65de:7094:0:3', 'dip': '3b1d:8c29:8186:3073:5556:f35:c9cc:a59a', 'sport': '47279', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0
2025-08-10 12:04:27,228 - DEBUG - Flow verification PASSED on node: 10.0.0.56 for VMs - Sender: 3943:dceb:6da5:e05c:65de:7094:0:3, Receiver: 3b1d:8c29:8186:3073:5556:f35:c9cc:a59a, Flow count expected: 0 0, got: 0 0
2025-08-10 12:04:27,228 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-08-10 12:04:29,234 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-08-10 12:04:31,502 - DEBUG - Forward and reverse flows for match {'sip': '3943:dceb:6da5:e05c:65de:7094:0:3', 'dip': '3b1d:8c29:8186:3073:5556:f35:c9cc:a59a', 'sport': '47279', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0
2025-08-10 12:04:31,502 - DEBUG - Flow verification PASSED on node: 10.0.0.65 for VMs - Sender: 3943:dceb:6da5:e05c:65de:7094:0:3, Receiver: 3b1d:8c29:8186:3073:5556:f35:c9cc:a59a, Flow count expected: 0 0, got: 0 0
2025-08-10 12:04:31,502 - INFO - Traffic verification for ECMP passed
2025-08-10 12:04:31,502 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-05545489-44464165
2025-08-10 12:04:31,628 - INFO - Removed intf route table 3c301580-9689-408d-82b0-3f67b573bc01 from port bd83d1e1-fdd8-4475-8ab4-6cea43130774
2025-08-10 12:04:31,660 - INFO - Deleted Interface route table 3c301580-9689-408d-82b0-3f67b573bc01
2025-08-10 12:04:31,664 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-05545489-99868905
2025-08-10 12:04:31,784 - INFO - Removed intf route table f83ffb4e-1697-4781-a4eb-5cd618bb2fd6 from port c2aa2054-8f1c-47a9-84ef-281763ce2886
2025-08-10 12:04:31,814 - INFO - Deleted Interface route table f83ffb4e-1697-4781-a4eb-5cd618bb2fd6
2025-08-10 12:04:31,814 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-05545489-53656848
2025-08-10 12:04:31,880 - INFO - Deleting VN ctest-vn-24762405
2025-08-10 12:04:31,919 - DEBUG - VN c1b7799c-7757-4d44-9789-aace919f8969 still in use: Unable to complete operation on network c1b7799c-7757-4d44-9789-aace919f8969. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-15fec6d9-e6d8-4cae-8320-5602ef42daaf']
2025-08-10 12:04:31,919 - WARNING - Deleting VN ctest-vn-24762405 failed..Will retry
2025-08-10 12:04:34,060 - DEBUG - Response for deleting network ()
2025-08-10 12:04:34,060 - DEBUG - Requesting: http://10.0.0.49:8082/routing-instance/b25262c5-2bcb-47ef-bc5d-1ebfd83bd594
2025-08-10 12:04:34,066 - DEBUG - Response Code: 404
2025-08-10 12:04:34,066 - DEBUG - Requesting: http://10.0.0.49:8082/domains
2025-08-10 12:04:34,072 - DEBUG - Requesting: http://10.0.0.49:8082/domain/506b9682-8eb9-488e-ab69-24d332f4d228
2025-08-10 12:04:34,139 - DEBUG - Requesting: http://10.0.0.49:8082/project/b32b71dc-3fad-4068-ba14-9c729003fed4
2025-08-10 12:04:34,226 - INFO - Validated that VN ctest-vn-24762405 is not found in API Server
2025-08-10 12:04:34,236 - DEBUG - VN ctest-vn-24762405 is not present in Agent 10.0.0.65
2025-08-10 12:04:34,246 - DEBUG - VN ctest-vn-24762405 is not present in Agent 10.0.0.56
2025-08-10 12:04:34,246 - INFO - Validated that VN ctest-vn-24762405 is not in any agent
2025-08-10 12:04:34,279 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-24762405 info
2025-08-10 12:04:35,530 - DEBUG - No XMPP flaps were noticed during the test
2025-08-10 12:04:35,530 - INFO - END TEST : test_ecmp_with_static_routes : PASSED[0:03:20]
2025-08-10 12:04:35,530 - INFO - --------------------------------------------------------------------------------
2025-08-10 12:04:36,199 - INFO - Deleted project: ctest-DisablePolicyEcmpIpv6-05545489, ID : b32b71dc-3fad-4068-ba14-9c729003fed4