is in ACTIVE state now
2026-06-22 04:41:26,493 - INFO - VM name : ctest-FatFlowSerialIpv6-42334445-62203337
2026-06-22 04:41:26,580 - DEBUG - VM ctest-FatFlowSerialIpv6-42334445-62203337 ID is f8e905f0-8a7e-4f01-ad7d-3a594b1abec9
2026-06-22 04:41:26,580 - DEBUG - VM ctest-FatFlowSerialIpv6-42334445-62203337 launched on Node an-jenkins-deploy-platform-ansible-os-6014-2
2026-06-22 04:41:26,673 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine/f8e905f0-8a7e-4f01-ad7d-3a594b1abec9
2026-06-22 04:41:26,696 - DEBUG - Requesting: http://10.0.0.241:8082/virtual-machine-interface/e0e91161-7adf-48f7-87bb-1e788c695de1
2026-06-22 04:41:27,852 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=3.74 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.444 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1002ms\r\nrtt min/avg/max/mdev = 0.444/2.094/3.744/1.650 ms')
2026-06-22 04:41:27,853 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-FatFlowSerialIpv6-42334445-62203337 passed
2026-06-22 04:41:27,926 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:41:27,927 - DEBUG - Waiting to SSH to VM ctest-FatFlowSerialIpv6-42334445-62203337, IP 105.61.72.133, Port 22
2026-06-22 04:41:27,994 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-22 04:41:28,075 - DEBUG - VM ctest-FatFlowSerialIpv6-42334445-62203337 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-22 04:41:33,076 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:41:33,076 - DEBUG - Waiting to SSH to VM ctest-FatFlowSerialIpv6-42334445-62203337, IP 105.61.72.133, Port 22
2026-06-22 04:41:33,141 - DEBUG - Error on ssh to ubuntu@169.254.0.3:22, result: /bin/bash: connect: Connection refused
/bin/bash: line 1: /dev/tcp/169.254.0.3/22: Connection refused {'failed': True, 'command': '(echo > /dev/tcp/169.254.0.3/22)', 'real_command': '/bin/bash -l -c "(echo > /dev/tcp/169.254.0.3/22)"', 'return_code': 1, 'succeeded': False, 'stderr': ''}
2026-06-22 04:41:33,221 - DEBUG - VM ctest-FatFlowSerialIpv6-42334445-62203337 is NOT ready for SSH connections, VM status: ACTIVE
2026-06-22 04:41:38,222 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-06-22 04:41:38,222 - DEBUG - Waiting to SSH to VM ctest-FatFlowSerialIpv6-42334445-62203337, IP 105.61.72.133, Port 22
2026-06-22 04:41:38,398 - DEBUG - VM ctest-FatFlowSerialIpv6-42334445-62203337 is ready for SSH connections
2026-06-22 04:41:38,467 - INFO - Fat flow added on VMI e0e91161-7adf-48f7-87bb-1e788c695de1: {'proto': 'udp', 'port': 53}
2026-06-22 04:41:38,468 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:41:38,468 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-06-22 04:41:46,344 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-06-22 04:41:46,344 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:41:46,344 - DEBUG - nohup nc -4 -q 2 -w 5 -u -ll 53 > testfile &
2026-06-22 04:41:46,740 - DEBUG - None
2026-06-22 04:41:46,740 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -u -p 10000 105.61.72.133 53 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 04:41:46,741 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -u -p 10000 105.61.72.133 53 < testfile
2026-06-22 04:42:22,143 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000918024 s, 109 kB/s
2026-06-22 04:42:22,143 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:42:22,143 - DEBUG - ls -l testfile
2026-06-22 04:42:22,342 - DEBUG - -rw-r--r-- 1 root root 100 Jun 22 04:42 testfile
2026-06-22 04:42:22,342 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-42334445-62203337
2026-06-22 04:42:22,342 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:42:22,343 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-06-22 04:42:22,683 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jun 22 04:42 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-06-22 04:42:22,683 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:42:22,683 - DEBUG - nohup nc -4 -q 2 -w 5 -u -ll 53 > testfile &
2026-06-22 04:42:22,911 - DEBUG - None
2026-06-22 04:42:22,911 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -u -p 10000 105.61.72.133 53 < testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 04:42:22,911 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -u -p 10000 105.61.72.133 53 < testfile
2026-06-22 04:42:59,809 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000871027 s, 115 kB/s
2026-06-22 04:42:59,809 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:42:59,809 - DEBUG - ls -l testfile
2026-06-22 04:42:59,988 - DEBUG - -rw-r--r-- 1 root root 100 Jun 22 04:42 testfile
2026-06-22 04:42:59,988 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-42334445-62203337
2026-06-22 04:43:00,083 - DEBUG - Forward and reverse flows for match {'sip': '105.61.72.131', 'dip': '105.61.72.133', 'sport': '10000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-06-22 04:43:00,158 - DEBUG - Forward and reverse flows for match {'sip': '105.61.72.131', 'dip': '105.61.72.133', 'sport': '10000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-06-22 04:43:00,261 - DEBUG - Forward and reverse flows for match {'sip': '105.61.72.132', 'dip': '105.61.72.133', 'sport': '10000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-06-22 04:43:00,326 - DEBUG - Forward and reverse flows for match {'sip': '105.61.72.132', 'dip': '105.61.72.133', 'sport': '10000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-06-22 04:43:00,394 - DEBUG - Forward and reverse flows for match {'sip': '105.61.72.131', 'dip': '105.61.72.133', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-06-22 04:43:00,395 - INFO - Fat flow verification PASSED on node: 10.0.0.22 for - SIP: 105.61.72.131, DIP: 105.61.72.133, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 1, got: 1
2026-06-22 04:43:00,491 - DEBUG - Forward and reverse flows for match {'sip': '105.61.72.131', 'dip': '105.61.72.133', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-06-22 04:43:00,491 - INFO - Fat flow verification PASSED on node: 10.0.0.242 for - SIP: 105.61.72.131, DIP: 105.61.72.133, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 0, got: 0
2026-06-22 04:43:00,552 - DEBUG - Forward and reverse flows for match {'sip': '105.61.72.132', 'dip': '105.61.72.133', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-06-22 04:43:00,552 - INFO - Fat flow verification PASSED on node: 10.0.0.22 for - SIP: 105.61.72.132, DIP: 105.61.72.133, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 1, got: 1
2026-06-22 04:43:00,631 - DEBUG - Forward and reverse flows for match {'sip': '105.61.72.132', 'dip': '105.61.72.133', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-06-22 04:43:00,631 - INFO - Fat flow verification PASSED on node: 10.0.0.242 for - SIP: 105.61.72.132, DIP: 105.61.72.133, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 0, got: 0
2026-06-22 04:43:00,632 - INFO - Fat flow verification passed for protocol udp and port 53
2026-06-22 04:43:00,632 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:43:00,632 - DEBUG - nohup rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-06-22 04:43:00,917 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jun 22 04:43 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-06-22 04:43:00,917 - DEBUG - Running remote_cmd, Cmd : nc -6 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:43:00,918 - DEBUG - nohup nc -6 -q 2 -w 5 -u -ll 53 > testfile &
2026-06-22 04:43:01,157 - DEBUG - None
2026-06-22 04:43:01,157 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20000 341e:cb82:d131:7296:4408:97d4:0:5 53 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 04:43:01,157 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20000 341e:cb82:d131:7296:4408:97d4:0:5 53 < testfile
2026-06-22 04:43:03,398 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00062161 s, 161 kB/s
2026-06-22 04:43:03,398 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:43:03,398 - DEBUG - ls -l testfile
2026-06-22 04:43:03,561 - DEBUG - -rw-r--r-- 1 root root 100 Jun 22 04:43 testfile
2026-06-22 04:43:03,562 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-42334445-62203337
2026-06-22 04:43:03,562 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:43:03,562 - DEBUG - nohup rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-06-22 04:43:03,857 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jun 22 04:43 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-06-22 04:43:03,857 - DEBUG - Running remote_cmd, Cmd : nc -6 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:43:03,857 - DEBUG - nohup nc -6 -q 2 -w 5 -u -ll 53 > testfile &
2026-06-22 04:43:04,087 - DEBUG - None
2026-06-22 04:43:04,087 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20001 341e:cb82:d131:7296:4408:97d4:0:5 53 < testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 04:43:04,087 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20001 341e:cb82:d131:7296:4408:97d4:0:5 53 < testfile
2026-06-22 04:43:06,344 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000845429 s, 118 kB/s
2026-06-22 04:43:06,344 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:43:06,344 - DEBUG - ls -l testfile
2026-06-22 04:43:06,559 - DEBUG - -rw-r--r-- 1 root root 100 Jun 22 04:43 testfile
2026-06-22 04:43:06,559 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-42334445-62203337
2026-06-22 04:43:06,559 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:43:06,559 - DEBUG - nohup rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-06-22 04:43:06,831 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jun 22 04:43 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-06-22 04:43:06,832 - DEBUG - Running remote_cmd, Cmd : nc -6 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:43:06,832 - DEBUG - nohup nc -6 -q 2 -w 5 -u -ll 53 > testfile &
2026-06-22 04:43:07,063 - DEBUG - None
2026-06-22 04:43:07,063 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20000 341e:cb82:d131:7296:4408:97d4:0:5 53 < testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 04:43:07,063 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20000 341e:cb82:d131:7296:4408:97d4:0:5 53 < testfile
2026-06-22 04:43:09,294 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000739826 s, 135 kB/s
2026-06-22 04:43:09,294 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:43:09,295 - DEBUG - ls -l testfile
2026-06-22 04:43:09,467 - DEBUG - -rw-r--r-- 1 root root 100 Jun 22 04:43 testfile
2026-06-22 04:43:09,467 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-42334445-62203337
2026-06-22 04:43:09,468 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:43:09,468 - DEBUG - nohup rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-06-22 04:43:09,744 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Jun 22 04:43 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-06-22 04:43:09,745 - DEBUG - Running remote_cmd, Cmd : nc -6 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:43:09,745 - DEBUG - nohup nc -6 -q 2 -w 5 -u -ll 53 > testfile &
2026-06-22 04:43:09,979 - DEBUG - None
2026-06-22 04:43:09,979 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20001 341e:cb82:d131:7296:4408:97d4:0:5 53 < testfile, host_string: ubuntu@169.254.0.4, password: ubuntugateway: ubuntu@10.0.0.242, gateway password: c0ntrail123
2026-06-22 04:43:09,979 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20001 341e:cb82:d131:7296:4408:97d4:0:5 53 < testfile
2026-06-22 04:43:12,214 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.000646806 s, 155 kB/s
2026-06-22 04:43:12,214 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.22, gateway password: c0ntrail123
2026-06-22 04:43:12,214 - DEBUG - ls -l testfile
2026-06-22 04:43:12,392 - DEBUG - -rw-r--r-- 1 root root 100 Jun 22 04:43 testfile
2026-06-22 04:43:12,392 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-42334445-62203337
2026-06-22 04:43:12,485 - DEBUG - Forward and reverse flows for match {'sip': '341e:cb82:d131:7296:4408:97d4:0:3', 'dip': '341e:cb82:d131:7296:4408:97d4:0:5', 'sport': '20000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-06-22 04:43:12,547 - DEBUG - Forward and reverse flows for match {'sip': '341e:cb82:d131:7296:4408:97d4:0:3', 'dip': '341e:cb82:d131:7296:4408:97d4:0:5', 'sport': '20000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-06-22 04:43:12,630 - DEBUG - Forward and reverse flows for match {'sip': '341e:cb82:d131:7296:4408:97d4:0:3', 'dip': '341e:cb82:d131:7296:4408:97d4:0:5', 'sport': '20001', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-06-22 04:43:12,692 - DEBUG - Forward and reverse flows for match {'sip': '341e:cb82:d131:7296:4408:97d4:0:3', 'dip': '341e:cb82:d131:7296:4408:97d4:0:5', 'sport': '20001', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-06-22 04:43:12,777 - DEBUG - Forward and reverse flows for match {'sip': '341e:cb82:d131:7296:4408:97d4:0:4', 'dip': '341e:cb82:d131:7296:4408:97d4:0:5', 'sport': '20000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-06-22 04:43:12,836 - DEBUG - Forward and reverse flows for match {'sip': '341e:cb82:d131:7296:4408:97d4:0:4', 'dip': '341e:cb82:d131:7296:4408:97d4:0:5', 'sport': '20000', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-06-22 04:43:12,918 - DEBUG - Forward and reverse flows for match {'sip': '341e:cb82:d131:7296:4408:97d4:0:4', 'dip': '341e:cb82:d131:7296:4408:97d4:0:5', 'sport': '20001', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-06-22 04:43:12,978 - DEBUG - Forward and reverse flows for match {'sip': '341e:cb82:d131:7296:4408:97d4:0:4', 'dip': '341e:cb82:d131:7296:4408:97d4:0:5', 'sport': '20001', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-06-22 04:43:13,044 - DEBUG - Forward and reverse flows for match {'sip': '341e:cb82:d131:7296:4408:97d4:0:3', 'dip': '341e:cb82:d131:7296:4408:97d4:0:5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-06-22 04:43:13,044 - INFO - Fat flow verification PASSED on node: 10.0.0.22 for - SIP: 341e:cb82:d131:7296:4408:97d4:0:3, DIP: 341e:cb82:d131:7296:4408:97d4:0:5, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 1, got: 1
2026-06-22 04:43:13,122 - DEBUG - Forward and reverse flows for match {'sip': '341e:cb82:d131:7296:4408:97d4:0:3', 'dip': '341e:cb82:d131:7296:4408:97d4:0:5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-06-22 04:43:13,122 - INFO - Fat flow verification PASSED on node: 10.0.0.242 for - SIP: 341e:cb82:d131:7296:4408:97d4:0:3, DIP: 341e:cb82:d131:7296:4408:97d4:0:5, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 0, got: 0
2026-06-22 04:43:13,185 - DEBUG - Forward and reverse flows for match {'sip': '341e:cb82:d131:7296:4408:97d4:0:4', 'dip': '341e:cb82:d131:7296:4408:97d4:0:5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 1, 1
2026-06-22 04:43:13,185 - INFO - Fat flow verification PASSED on node: 10.0.0.22 for - SIP: 341e:cb82:d131:7296:4408:97d4:0:4, DIP: 341e:cb82:d131:7296:4408:97d4:0:5, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 1, got: 1
2026-06-22 04:43:13,268 - DEBUG - Forward and reverse flows for match {'sip': '341e:cb82:d131:7296:4408:97d4:0:4', 'dip': '341e:cb82:d131:7296:4408:97d4:0:5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '2'}: 0, 0
2026-06-22 04:43:13,268 - INFO - Fat flow verification PASSED on node: 10.0.0.242 for - SIP: 341e:cb82:d131:7296:4408:97d4:0:4, DIP: 341e:cb82:d131:7296:4408:97d4:0:5, sport: 0, dport: 53, vrf-id: 2 Fat flow expected: 0, got: 0
2026-06-22 04:43:13,268 - INFO - Fat flow verification passed for protocol udp and port 53
2026-06-22 04:43:13,268 - INFO - Deleting VM ctest-FatFlowSerialIpv6-42334445-62203337
2026-06-22 04:43:13,348 - INFO - Deleting VM ctest-FatFlowSerialIpv6-42334445-98751329
2026-06-22 04:43:13,423 - INFO - Deleting VM ctest-FatFlowSerialIpv6-42334445-67383769
2026-06-22 04:43:13,498 - INFO - Deleting VN ctest-vn-03586424
2026-06-22 04:43:13,536 - DEBUG - VN 03c085c6-e290-492d-8145-cabeca3ad15a still in use: Unable to complete operation on network 03c085c6-e290-492d-8145-cabeca3ad15a. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-e5264637-bb79-4a90-9699-6fc1d2447919']
2026-06-22 04:43:13,536 - WARNING - Deleting VN ctest-vn-03586424 failed..Will retry
2026-06-22 04:43:15,592 - DEBUG - VN 03c085c6-e290-492d-8145-cabeca3ad15a still in use: Unable to complete operation on network 03c085c6-e290-492d-8145-cabeca3ad15a. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-89a2908f-2737-42f1-9787-d3be99983324']
2026-06-22 04:43:15,592 - WARNING - Deleting VN ctest-vn-03586424 failed..Will retry
2026-06-22 04:43:17,800 - DEBUG - Response for deleting network ()
2026-06-22 04:43:17,800 - DEBUG - Requesting: http://10.0.0.19:8082/routing-instance/1976a0e6-26ff-430a-8598-068f4faceab9
2026-06-22 04:43:17,806 - DEBUG - Response Code: 404
2026-06-22 04:43:17,806 - DEBUG - Requesting: http://10.0.0.19:8082/domains
2026-06-22 04:43:17,811 - DEBUG - Requesting: http://10.0.0.19:8082/domain/9d11d15d-7b70-42f4-9c2c-0dcfdbec4a75
2026-06-22 04:43:17,856 - DEBUG - Requesting: http://10.0.0.19:8082/project/fb74946e-032e-41dd-b92d-57a09b03b4a5
2026-06-22 04:43:17,950 - INFO - Validated that VN ctest-vn-03586424 is not found in API Server
2026-06-22 04:43:17,965 - DEBUG - VN ctest-vn-03586424 is not present in Agent 10.0.0.242
2026-06-22 04:43:17,977 - DEBUG - VN ctest-vn-03586424 is not present in Agent 10.0.0.22
2026-06-22 04:43:17,977 - INFO - Validated that VN ctest-vn-03586424 is not in any agent
2026-06-22 04:43:18,014 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-03586424 info
2026-06-22 04:43:19,267 - DEBUG - Skipping xmpp flap check
2026-06-22 04:43:19,267 - INFO - END TEST : test_fat_flow_intra_vn_inter_node : PASSED[0:02:58]
2026-06-22 04:43:19,267 - INFO - --------------------------------------------------------------------------------
2026-06-22 04:43:20,109 - INFO - Deleted project: ctest-FatFlowSerialIpv6-42334445, ID : fb74946e-032e-41dd-b92d-57a09b03b4a5