is in ACTIVE state now
2025-11-17 03:27:34,721 - INFO - VM name : ctest-DisablePolicyEcmpIpv6-98519176-34168186
2025-11-17 03:27:34,828 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-98519176-34168186 ID is d3e4af5e-d226-4673-9afb-4c942a0a569f
2025-11-17 03:27:34,828 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-98519176-34168186 launched on Node an-jenkins-deploy-platform-ansible-os-4736-1
2025-11-17 03:27:34,919 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine/d3e4af5e-d226-4673-9afb-4c942a0a569f
2025-11-17 03:27:34,930 - DEBUG - Requesting: http://10.0.0.23:8082/virtual-machine-interface/f76ceed6-c6ba-4464-9237-9e0a21f0c594
2025-11-17 03:27:36,096 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=3.68 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.443 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.443/2.060/3.677/1.617 ms')
2025-11-17 03:27:36,096 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-DisablePolicyEcmpIpv6-98519176-34168186 passed
2025-11-17 03:27:36,166 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-17 03:27:36,166 - DEBUG - Waiting to SSH to VM ctest-DisablePolicyEcmpIpv6-98519176-34168186, IP 2c84:5898:7e18:5a84:42a3:274c:0:6, Port 22
2025-11-17 03:27:36,334 - DEBUG - VM ctest-DisablePolicyEcmpIpv6-98519176-34168186 is ready for SSH connections
2025-11-17 03:27:36,405 - INFO - Policy DISABLED on VMI f76ceed6-c6ba-4464-9237-9e0a21f0c594
2025-11-17 03:27:36,405 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2025-11-17 03:27:36,405 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep 2c84:5898:7e18:5a84:42a3:274c:0:6 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-11-17 03:27:36,405 - DEBUG - ifconfig -a| grep 2c84:5898:7e18:5a84:42a3:274c:0:6 -A2 -B4| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1
2025-11-17 03:28:19,162 - DEBUG - eth0
2025-11-17 03:28:19,163 - DEBUG - Running remote_cmd, Cmd : sysctl net.ipv6.conf.eth0.accept_dad=0, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-11-17 03:28:19,163 - DEBUG - sysctl net.ipv6.conf.eth0.accept_dad=0
2025-11-17 03:28:19,770 - DEBUG - net.ipv6.conf.eth0.accept_dad = 0
2025-11-17 03:28:20,025 - INFO - Created InterfaceRouteTable ['default-domain', 'ctest-DisablePolicyEcmpIpv6-98519176', 'ctest-intf-rtb-96925653'](UUID ea9db780-80c2-49eb-afe4-214bda5ecaa1), prefixes : ['24ff:977d:85e8:5f69:d5d4:3644::/96']
2025-11-17 03:28:20,101 - INFO - Added intf route table ea9db780-80c2-49eb-afe4-214bda5ecaa1 to port f76ceed6-c6ba-4464-9237-9e0a21f0c594
2025-11-17 03:28:20,101 - DEBUG - Running remote_cmd, Cmd : ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-11-17 03:28:20,101 - DEBUG - ifconfig -a| grep -i 'hwaddr\|flags' | awk '{print $1}' | cut -d ':' -f 1
2025-11-17 03:28:20,595 - DEBUG - eth0
2025-11-17 03:28:20,595 - DEBUG - Running remote_cmd, Cmd : ifconfig eth0 inet6 add 24ff:977d:85e8:5f69:d5d4:3644:349e:8bd8, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-11-17 03:28:20,596 - DEBUG - ifconfig eth0 inet6 add 24ff:977d:85e8:5f69:d5d4:3644:349e:8bd8
2025-11-17 03:28:21,218 - DEBUG - None
2025-11-17 03:28:21,218 - DEBUG - Running remote_cmd, Cmd : ifconfig -a, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-11-17 03:28:21,218 - DEBUG - ifconfig -a
2025-11-17 03:28:21,823 - DEBUG - eth0 Link encap:Ethernet HWaddr 02:f7:6c:ee:d6:c6
inet addr:217.123.198.134 Bcast:217.123.198.191 Mask:255.255.255.192
inet6 addr: 24ff:977d:85e8:5f69:d5d4:3644:349e:8bd8/128 Scope:Global
inet6 addr: fe80::f7:6cff:feee:d6c6/64 Scope:Link
inet6 addr: 2c84:5898:7e18:5a84:42a3:274c:0:6/64 Scope:Global
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:503 errors:0 dropped:0 overruns:0 frame:0
TX packets:437 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:47162 (47.1 KB) TX bytes:39210 (39.2 KB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
2025-11-17 03:28:21,823 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-98519176-99030056
2025-11-17 03:28:21,973 - INFO - Removed intf route table ea96d30d-b508-4f42-8fd0-6329fa7fdcfc from port d38ad9ed-f688-4522-aa34-c87baa222666
2025-11-17 03:28:22,007 - INFO - Deleted Interface route table ea96d30d-b508-4f42-8fd0-6329fa7fdcfc
2025-11-17 03:28:22,023 - INFO - ECMP routes found in agent 10.0.0.73, for prefix 24ff:977d:85e8:5f69:d5d4:3644::/96
2025-11-17 03:28:22,024 - INFO - Tap interface tap08128fc6-64 found in ecmp routes in agent 10.0.0.73
2025-11-17 03:28:22,038 - INFO - ECMP routes found in agent 10.0.0.50, for prefix 24ff:977d:85e8:5f69:d5d4:3644::/96
2025-11-17 03:28:22,038 - INFO - Tap interface tapf76ceed6-c6 found in ecmp routes in agent 10.0.0.50
2025-11-17 03:28:22,151 - DEBUG - Executing command: sudo tcpdump -nni tap08128fc6-64 -U '(udp and src host 2c84:5898:7e18:5a84:42a3:274c:0:3 and dst host 24ff:977d:85e8:5f69:d5d4:3644:349e:8bd8 and dst port 11000)' -w /tmp/tap08128fc6-64_ctest-random-95271462.pcap
2025-11-17 03:28:22,611 - DEBUG - Executing command: sudo tcpdump -nni tapf76ceed6-c6 -U '(udp and src host 2c84:5898:7e18:5a84:42a3:274c:0:3 and dst host 24ff:977d:85e8:5f69:d5d4:3644:349e:8bd8 and dst port 11000)' -w /tmp/tapf76ceed6-c6_ctest-random-22107837.pcap
2025-11-17 03:28:23,038 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 16012 24ff:977d:85e8:5f69:d5d4:3644:349e:8bd8 11000 < icmp_error, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.50, gateway password: c0ntrail123
2025-11-17 03:28:23,039 - DEBUG - dd bs=100 count=1 if=/dev/zero of=icmp_error;nc -6 -q 2 -u -p 16012 24ff:977d:85e8:5f69:d5d4:3644:349e:8bd8 11000 < icmp_error
2025-11-17 03:28:25,704 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00105844 s, 94.5 kB/s
2025-11-17 03:28:25,704 - DEBUG - Executing command: sudo tcpdump -nnr /tmp/tap08128fc6-64_ctest-random-95271462.pcap | grep -c length
2025-11-17 03:28:25,719 - DEBUG - STDOUT: 1
2025-11-17 03:28:25,719 - DEBUG - STDERR: reading from file /tmp/tap08128fc6-64_ctest-random-95271462.pcap, link-type EN10MB (Ethernet), snapshot length 262144
2025-11-17 03:28:25,719 - INFO - 1 packets are found in tcpdump output as expected
2025-11-17 03:28:25,719 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-11-17 03:28:27,766 - INFO - Tcpdump verification on VM 2c84:5898:7e18:5a84:42a3:274c:0:5 passed
2025-11-17 03:28:28,013 - DEBUG - Forward and reverse flows for match {'sip': '2c84:5898:7e18:5a84:42a3:274c:0:3', 'dip': '24ff:977d:85e8:5f69:d5d4:3644:349e:8bd8', 'sport': '16012', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0
2025-11-17 03:28:28,013 - DEBUG - Flow verification PASSED on node: 10.0.0.73 for VMs - Sender: 2c84:5898:7e18:5a84:42a3:274c:0:3, Receiver: 24ff:977d:85e8:5f69:d5d4:3644:349e:8bd8, Flow count expected: 0 0, got: 0 0
2025-11-17 03:28:28,014 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-11-17 03:28:30,021 - DEBUG - Executing command: sudo kill $(ps -ef|grep tcpdump | grep pcap| awk '{print $2}')
2025-11-17 03:28:32,342 - DEBUG - Forward and reverse flows for match {'sip': '2c84:5898:7e18:5a84:42a3:274c:0:3', 'dip': '24ff:977d:85e8:5f69:d5d4:3644:349e:8bd8', 'sport': '16012', 'dport': '11000', 'proto': '17', 'vrf_id': '2'}: 0, 0
2025-11-17 03:28:32,342 - DEBUG - Flow verification PASSED on node: 10.0.0.50 for VMs - Sender: 2c84:5898:7e18:5a84:42a3:274c:0:3, Receiver: 24ff:977d:85e8:5f69:d5d4:3644:349e:8bd8, Flow count expected: 0 0, got: 0 0
2025-11-17 03:28:32,342 - INFO - Traffic verification for ECMP passed
2025-11-17 03:28:32,342 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-98519176-34168186
2025-11-17 03:28:32,505 - INFO - Removed intf route table ea9db780-80c2-49eb-afe4-214bda5ecaa1 from port f76ceed6-c6ba-4464-9237-9e0a21f0c594
2025-11-17 03:28:32,539 - INFO - Deleted Interface route table ea9db780-80c2-49eb-afe4-214bda5ecaa1
2025-11-17 03:28:32,542 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-98519176-69779977
2025-11-17 03:28:32,697 - INFO - Removed intf route table b31d2f3f-7a58-406e-b672-727ac614dc33 from port 08128fc6-6493-4572-9056-ed285e8ace61
2025-11-17 03:28:32,737 - INFO - Deleted Interface route table b31d2f3f-7a58-406e-b672-727ac614dc33
2025-11-17 03:28:32,737 - INFO - Deleting VM ctest-DisablePolicyEcmpIpv6-98519176-63335811
2025-11-17 03:28:32,824 - INFO - Deleting VN ctest-vn-69802346
2025-11-17 03:28:32,877 - DEBUG - VN fad64f96-6b61-467d-b452-80f84abe354a still in use: Unable to complete operation on network fad64f96-6b61-467d-b452-80f84abe354a. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-0c1379d5-666e-4548-a164-acca20fe935c']
2025-11-17 03:28:32,877 - WARNING - Deleting VN ctest-vn-69802346 failed..Will retry
2025-11-17 03:28:35,113 - DEBUG - Response for deleting network ()
2025-11-17 03:28:35,113 - DEBUG - Requesting: http://10.0.0.22:8082/routing-instance/b8f94bba-e88d-4673-957a-67a39aa88627
2025-11-17 03:28:35,119 - DEBUG - Response Code: 404
2025-11-17 03:28:35,120 - DEBUG - Requesting: http://10.0.0.22:8082/domains
2025-11-17 03:28:35,126 - DEBUG - Requesting: http://10.0.0.22:8082/domain/b575f39c-ab2e-404a-877c-00e9b4192b03
2025-11-17 03:28:35,182 - DEBUG - Requesting: http://10.0.0.22:8082/project/11d3a0fe-bc4e-4c65-b6a0-ee09c3d79fe1
2025-11-17 03:28:35,279 - INFO - Validated that VN ctest-vn-69802346 is not found in API Server
2025-11-17 03:28:35,291 - DEBUG - VN ctest-vn-69802346 is not present in Agent 10.0.0.50
2025-11-17 03:28:35,302 - DEBUG - VN ctest-vn-69802346 is not present in Agent 10.0.0.73
2025-11-17 03:28:35,302 - INFO - Validated that VN ctest-vn-69802346 is not in any agent
2025-11-17 03:28:35,337 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-69802346 info
2025-11-17 03:28:36,599 - DEBUG - No XMPP flaps were noticed during the test
2025-11-17 03:28:36,599 - INFO - END TEST : test_ecmp_with_static_routes : PASSED[0:03:15]
2025-11-17 03:28:36,599 - INFO - --------------------------------------------------------------------------------
2025-11-17 03:28:37,392 - INFO - Deleted project: ctest-DisablePolicyEcmpIpv6-98519176, ID : 11d3a0fe-bc4e-4c65-b6a0-ee09c3d79fe1