is in ACTIVE state now
2026-01-08 04:27:04,084 - INFO - VM name : ctest-FatFlowSerialIpv6-51092411-46673732
2026-01-08 04:27:04,173 - DEBUG - VM ctest-FatFlowSerialIpv6-51092411-46673732 ID is c43bf0fc-7b0d-4880-b505-c6304af732e0
2026-01-08 04:27:04,173 - DEBUG - VM ctest-FatFlowSerialIpv6-51092411-46673732 launched on Node an-jenkins-deploy-platform-ansible-os-4976-1
2026-01-08 04:27:04,256 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine/c43bf0fc-7b0d-4880-b505-c6304af732e0
2026-01-08 04:27:04,266 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-machine-interface/b3ed2d85-c7e0-4dc4-a456-be505f11fd54
2026-01-08 04:27:05,424 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.72 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.391 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.391/2.056/3.722/1.665 ms')
2026-01-08 04:27:05,424 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-FatFlowSerialIpv6-51092411-46673732 passed
2026-01-08 04:27:05,493 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-01-08 04:27:05,493 - DEBUG - Waiting to SSH to VM ctest-FatFlowSerialIpv6-51092411-46673732, IP 222.165.234.5, Port 22
2026-01-08 04:27:05,660 - DEBUG - VM ctest-FatFlowSerialIpv6-51092411-46673732 is ready for SSH connections
2026-01-08 04:27:05,727 - INFO - Fat flow added on VMI b3ed2d85-c7e0-4dc4-a456-be505f11fd54: {'proto': 'udp', 'port': 53}
2026-01-08 04:27:05,727 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:27:05,727 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-01-08 04:27:15,868 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-01-08 04:27:15,868 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:27:15,868 - DEBUG - nohup nc -4 -q 2 -w 5 -u -ll 53 > testfile &
2026-01-08 04:27:16,393 - DEBUG - None
2026-01-08 04:27:16,393 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -u -p 10000 222.165.234.5 53 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2026-01-08 04:27:16,393 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -u -p 10000 222.165.234.5 53 < testfile
2026-01-08 04:27:25,458 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000871938 s, 115 kB/s
2026-01-08 04:27:25,458 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:27:25,458 - DEBUG - ls -l testfile
2026-01-08 04:27:25,872 - DEBUG - -rw-r--r-- 1 root root 100 Jan 8 04:27 testfile
2026-01-08 04:27:25,872 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-51092411-46673732
2026-01-08 04:27:25,872 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:27:25,872 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-01-08 04:27:26,580 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jan 8 04:27 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-01-08 04:27:26,580 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:27:26,580 - DEBUG - nohup nc -4 -q 2 -w 5 -u -ll 53 > testfile &
2026-01-08 04:27:27,128 - DEBUG - None
2026-01-08 04:27:27,128 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -u -p 10000 222.165.234.5 53 < testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2026-01-08 04:27:27,128 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -u -p 10000 222.165.234.5 53 < testfile
2026-01-08 04:28:11,907 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000895286 s, 112 kB/s
2026-01-08 04:28:11,907 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:11,907 - DEBUG - ls -l testfile
2026-01-08 04:28:12,268 - DEBUG - -rw-r--r-- 1 root root 100 Jan 8 04:28 testfile
2026-01-08 04:28:12,268 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-51092411-46673732
2026-01-08 04:28:12,363 - DEBUG - Forward and reverse flows for match {'sip': '222.165.234.3', 'dip': '222.165.234.5', 'sport': '10000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-01-08 04:28:12,427 - DEBUG - Forward and reverse flows for match {'sip': '222.165.234.3', 'dip': '222.165.234.5', 'sport': '10000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-01-08 04:28:12,521 - DEBUG - Forward and reverse flows for match {'sip': '222.165.234.4', 'dip': '222.165.234.5', 'sport': '10000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-01-08 04:28:12,593 - DEBUG - Forward and reverse flows for match {'sip': '222.165.234.4', 'dip': '222.165.234.5', 'sport': '10000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-01-08 04:28:12,672 - DEBUG - Forward and reverse flows for match {'sip': '222.165.234.3', 'dip': '222.165.234.5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-01-08 04:28:12,673 - INFO - Fat flow verification PASSED on node: 10.0.0.57 for - SIP: 222.165.234.3, DIP: 222.165.234.5, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 1, got: 1
2026-01-08 04:28:12,779 - DEBUG - Forward and reverse flows for match {'sip': '222.165.234.3', 'dip': '222.165.234.5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-01-08 04:28:12,779 - INFO - Fat flow verification PASSED on node: 10.0.0.56 for - SIP: 222.165.234.3, DIP: 222.165.234.5, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 0, got: 0
2026-01-08 04:28:12,847 - DEBUG - Forward and reverse flows for match {'sip': '222.165.234.4', 'dip': '222.165.234.5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-01-08 04:28:12,847 - INFO - Fat flow verification PASSED on node: 10.0.0.57 for - SIP: 222.165.234.4, DIP: 222.165.234.5, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 1, got: 1
2026-01-08 04:28:12,942 - DEBUG - Forward and reverse flows for match {'sip': '222.165.234.4', 'dip': '222.165.234.5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-01-08 04:28:12,942 - INFO - Fat flow verification PASSED on node: 10.0.0.56 for - SIP: 222.165.234.4, DIP: 222.165.234.5, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 0, got: 0
2026-01-08 04:28:12,942 - INFO - Fat flow verification passed for protocol udp and port 53
2026-01-08 04:28:12,942 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:12,943 - DEBUG - nohup rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-01-08 04:28:13,634 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jan 8 04:28 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-01-08 04:28:13,634 - DEBUG - Running remote_cmd, Cmd : nc -6 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:13,634 - DEBUG - nohup nc -6 -q 2 -w 5 -u -ll 53 > testfile &
2026-01-08 04:28:14,125 - DEBUG - None
2026-01-08 04:28:14,125 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20000 3c00:5e38:29b0:7068:842e:66cf:0:5 53 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2026-01-08 04:28:14,125 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20000 3c00:5e38:29b0:7068:842e:66cf:0:5 53 < testfile
2026-01-08 04:28:16,726 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00107578 s, 93.0 kB/s
2026-01-08 04:28:16,726 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:16,726 - DEBUG - ls -l testfile
2026-01-08 04:28:17,077 - DEBUG - -rw-r--r-- 1 root root 100 Jan 8 04:28 testfile
2026-01-08 04:28:17,077 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-51092411-46673732
2026-01-08 04:28:17,077 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:17,077 - DEBUG - nohup rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-01-08 04:28:18,240 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jan 8 04:28 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-01-08 04:28:18,240 - DEBUG - Running remote_cmd, Cmd : nc -6 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:18,240 - DEBUG - nohup nc -6 -q 2 -w 5 -u -ll 53 > testfile &
2026-01-08 04:28:18,814 - DEBUG - None
2026-01-08 04:28:18,814 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20001 3c00:5e38:29b0:7068:842e:66cf:0:5 53 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2026-01-08 04:28:18,814 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20001 3c00:5e38:29b0:7068:842e:66cf:0:5 53 < testfile
2026-01-08 04:28:21,412 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00404658 s, 24.7 kB/s
2026-01-08 04:28:21,412 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:21,412 - DEBUG - ls -l testfile
2026-01-08 04:28:21,797 - DEBUG - -rw-r--r-- 1 root root 100 Jan 8 04:28 testfile
2026-01-08 04:28:21,797 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-51092411-46673732
2026-01-08 04:28:21,797 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:21,797 - DEBUG - nohup rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-01-08 04:28:22,459 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jan 8 04:28 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-01-08 04:28:22,459 - DEBUG - Running remote_cmd, Cmd : nc -6 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:22,459 - DEBUG - nohup nc -6 -q 2 -w 5 -u -ll 53 > testfile &
2026-01-08 04:28:22,962 - DEBUG - None
2026-01-08 04:28:22,962 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20000 3c00:5e38:29b0:7068:842e:66cf:0:5 53 < testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2026-01-08 04:28:22,962 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20000 3c00:5e38:29b0:7068:842e:66cf:0:5 53 < testfile
2026-01-08 04:28:25,563 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00100142 s, 99.9 kB/s
2026-01-08 04:28:25,563 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:25,563 - DEBUG - ls -l testfile
2026-01-08 04:28:25,964 - DEBUG - -rw-r--r-- 1 root root 100 Jan 8 04:28 testfile
2026-01-08 04:28:25,964 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-51092411-46673732
2026-01-08 04:28:25,964 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:25,964 - DEBUG - nohup rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-01-08 04:28:26,681 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jan 8 04:28 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-01-08 04:28:26,681 - DEBUG - Running remote_cmd, Cmd : nc -6 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:26,681 - DEBUG - nohup nc -6 -q 2 -w 5 -u -ll 53 > testfile &
2026-01-08 04:28:27,193 - DEBUG - None
2026-01-08 04:28:27,193 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20001 3c00:5e38:29b0:7068:842e:66cf:0:5 53 < testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.56, gateway password: c0ntrail123
2026-01-08 04:28:27,194 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20001 3c00:5e38:29b0:7068:842e:66cf:0:5 53 < testfile
2026-01-08 04:28:29,770 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00220002 s, 45.5 kB/s
2026-01-08 04:28:29,771 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.57, gateway password: c0ntrail123
2026-01-08 04:28:29,771 - DEBUG - ls -l testfile
2026-01-08 04:28:30,108 - DEBUG - -rw-r--r-- 1 root root 100 Jan 8 04:28 testfile
2026-01-08 04:28:30,109 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-51092411-46673732
2026-01-08 04:28:30,204 - DEBUG - Forward and reverse flows for match {'sip': '3c00:5e38:29b0:7068:842e:66cf:0:3', 'dip': '3c00:5e38:29b0:7068:842e:66cf:0:5', 'sport': '20000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-01-08 04:28:30,267 - DEBUG - Forward and reverse flows for match {'sip': '3c00:5e38:29b0:7068:842e:66cf:0:3', 'dip': '3c00:5e38:29b0:7068:842e:66cf:0:5', 'sport': '20000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-01-08 04:28:30,363 - DEBUG - Forward and reverse flows for match {'sip': '3c00:5e38:29b0:7068:842e:66cf:0:3', 'dip': '3c00:5e38:29b0:7068:842e:66cf:0:5', 'sport': '20001', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-01-08 04:28:30,432 - DEBUG - Forward and reverse flows for match {'sip': '3c00:5e38:29b0:7068:842e:66cf:0:3', 'dip': '3c00:5e38:29b0:7068:842e:66cf:0:5', 'sport': '20001', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-01-08 04:28:30,527 - DEBUG - Forward and reverse flows for match {'sip': '3c00:5e38:29b0:7068:842e:66cf:0:4', 'dip': '3c00:5e38:29b0:7068:842e:66cf:0:5', 'sport': '20000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-01-08 04:28:30,591 - DEBUG - Forward and reverse flows for match {'sip': '3c00:5e38:29b0:7068:842e:66cf:0:4', 'dip': '3c00:5e38:29b0:7068:842e:66cf:0:5', 'sport': '20000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-01-08 04:28:30,686 - DEBUG - Forward and reverse flows for match {'sip': '3c00:5e38:29b0:7068:842e:66cf:0:4', 'dip': '3c00:5e38:29b0:7068:842e:66cf:0:5', 'sport': '20001', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-01-08 04:28:30,747 - DEBUG - Forward and reverse flows for match {'sip': '3c00:5e38:29b0:7068:842e:66cf:0:4', 'dip': '3c00:5e38:29b0:7068:842e:66cf:0:5', 'sport': '20001', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-01-08 04:28:30,823 - DEBUG - Forward and reverse flows for match {'sip': '3c00:5e38:29b0:7068:842e:66cf:0:3', 'dip': '3c00:5e38:29b0:7068:842e:66cf:0:5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-01-08 04:28:30,824 - INFO - Fat flow verification PASSED on node: 10.0.0.57 for - SIP: 3c00:5e38:29b0:7068:842e:66cf:0:3, DIP: 3c00:5e38:29b0:7068:842e:66cf:0:5, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 1, got: 1
2026-01-08 04:28:30,931 - DEBUG - Forward and reverse flows for match {'sip': '3c00:5e38:29b0:7068:842e:66cf:0:3', 'dip': '3c00:5e38:29b0:7068:842e:66cf:0:5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-01-08 04:28:30,932 - INFO - Fat flow verification PASSED on node: 10.0.0.56 for - SIP: 3c00:5e38:29b0:7068:842e:66cf:0:3, DIP: 3c00:5e38:29b0:7068:842e:66cf:0:5, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 0, got: 0
2026-01-08 04:28:31,007 - DEBUG - Forward and reverse flows for match {'sip': '3c00:5e38:29b0:7068:842e:66cf:0:4', 'dip': '3c00:5e38:29b0:7068:842e:66cf:0:5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-01-08 04:28:31,007 - INFO - Fat flow verification PASSED on node: 10.0.0.57 for - SIP: 3c00:5e38:29b0:7068:842e:66cf:0:4, DIP: 3c00:5e38:29b0:7068:842e:66cf:0:5, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 1, got: 1
2026-01-08 04:28:31,097 - DEBUG - Forward and reverse flows for match {'sip': '3c00:5e38:29b0:7068:842e:66cf:0:4', 'dip': '3c00:5e38:29b0:7068:842e:66cf:0:5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-01-08 04:28:31,097 - INFO - Fat flow verification PASSED on node: 10.0.0.56 for - SIP: 3c00:5e38:29b0:7068:842e:66cf:0:4, DIP: 3c00:5e38:29b0:7068:842e:66cf:0:5, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 0, got: 0
2026-01-08 04:28:31,097 - INFO - Fat flow verification passed for protocol udp and port 53
2026-01-08 04:28:31,097 - INFO - Deleting VM ctest-FatFlowSerialIpv6-51092411-46673732
2026-01-08 04:28:31,170 - INFO - Deleting VM ctest-FatFlowSerialIpv6-51092411-39024157
2026-01-08 04:28:31,243 - INFO - Deleting VM ctest-FatFlowSerialIpv6-51092411-56938230
2026-01-08 04:28:31,326 - INFO - Deleting VN ctest-vn-17188853
2026-01-08 04:28:31,374 - DEBUG - VN 52c7b60d-ce3a-4545-9120-ecb39c92c9c7 still in use: Unable to complete operation on network 52c7b60d-ce3a-4545-9120-ecb39c92c9c7. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-046f8175-7900-4630-86ab-30cf62851b99']
2026-01-08 04:28:31,374 - WARNING - Deleting VN ctest-vn-17188853 failed..Will retry
2026-01-08 04:28:33,548 - DEBUG - Response for deleting network ()
2026-01-08 04:28:33,548 - DEBUG - Requesting: http://10.0.0.242:8082/routing-instance/4c9e7f56-31d4-4f0e-9fc0-0bd0a5f8cdfa
2026-01-08 04:28:33,554 - DEBUG - Response Code: 404
2026-01-08 04:28:33,554 - DEBUG - Requesting: http://10.0.0.242:8082/domains
2026-01-08 04:28:33,562 - DEBUG - Requesting: http://10.0.0.242:8082/domain/01640a83-288f-426f-a2f2-0c0b4b93ac50
2026-01-08 04:28:33,584 - DEBUG - Requesting: http://10.0.0.242:8082/project/9a390e89-3bdb-4eec-aa8e-77b9b517e64f
2026-01-08 04:28:33,689 - INFO - Validated that VN ctest-vn-17188853 is not found in API Server
2026-01-08 04:28:33,702 - DEBUG - VN ctest-vn-17188853 is not present in Agent 10.0.0.57
2026-01-08 04:28:33,713 - DEBUG - VN ctest-vn-17188853 is not present in Agent 10.0.0.56
2026-01-08 04:28:33,713 - INFO - Validated that VN ctest-vn-17188853 is not in any agent
2026-01-08 04:28:33,747 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-17188853 info
2026-01-08 04:28:35,010 - DEBUG - Skipping xmpp flap check
2026-01-08 04:28:35,010 - INFO - END TEST : test_fat_flow_intra_vn_inter_node : PASSED[0:03:04]
2026-01-08 04:28:35,011 - INFO - --------------------------------------------------------------------------------
2026-01-08 04:28:35,793 - INFO - Deleted project: ctest-FatFlowSerialIpv6-51092411, ID : 9a390e89-3bdb-4eec-aa8e-77b9b517e64f