is in ACTIVE state now
2026-04-30 05:06:37,992 - INFO - VM name : ctest-FatFlowSerialIpv6-21311031-61501773
2026-04-30 05:06:38,099 - DEBUG - VM ctest-FatFlowSerialIpv6-21311031-61501773 ID is aefd6ac6-5461-442d-8c5c-da3e3d47f11d
2026-04-30 05:06:38,100 - DEBUG - VM ctest-FatFlowSerialIpv6-21311031-61501773 launched on Node an-jenkins-deploy-platform-ansible-os-5725-1
2026-04-30 05:06:38,217 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine/aefd6ac6-5461-442d-8c5c-da3e3d47f11d
2026-04-30 05:06:38,232 - DEBUG - Requesting: http://10.0.0.33:8082/virtual-machine-interface/176019d0-067f-4404-93b5-25fdcbb14b7e
2026-04-30 05:06:39,422 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=5.65 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=1.58 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 1.576/3.615/5.654/2.039 ms')
2026-04-30 05:06:39,422 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-FatFlowSerialIpv6-21311031-61501773 passed
2026-04-30 05:06:39,497 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set
2026-04-30 05:06:39,497 - DEBUG - Waiting to SSH to VM ctest-FatFlowSerialIpv6-21311031-61501773, IP 99.28.176.197, Port 22
2026-04-30 05:06:39,665 - DEBUG - VM ctest-FatFlowSerialIpv6-21311031-61501773 is ready for SSH connections
2026-04-30 05:06:39,742 - INFO - Fat flow added on VMI 176019d0-067f-4404-93b5-25fdcbb14b7e: {'proto': 'udp', 'port': 53}
2026-04-30 05:06:39,742 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:06:39,742 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-04-30 05:07:25,572 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Dec 29 2017 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-04-30 05:07:25,572 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:07:25,572 - DEBUG - nohup nc -4 -q 2 -w 5 -u -ll 53 > testfile &
2026-04-30 05:07:26,097 - DEBUG - None
2026-04-30 05:07:26,097 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -u -p 10000 99.28.176.197 53 < testfile, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-04-30 05:07:26,097 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -u -p 10000 99.28.176.197 53 < testfile
2026-04-30 05:08:11,837 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00156513 s, 63.9 kB/s
2026-04-30 05:08:11,837 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:08:11,837 - DEBUG - ls -l testfile
2026-04-30 05:08:12,220 - DEBUG - -rw-r--r-- 1 root root 100 Apr 30 05:08 testfile
2026-04-30 05:08:12,220 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-21311031-61501773
2026-04-30 05:08:12,220 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -4 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:08:12,220 - DEBUG - nohup rm -f testfile;ls -la;nc -4 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-04-30 05:08:12,924 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Apr 30 05:08 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-04-30 05:08:12,924 - DEBUG - Running remote_cmd, Cmd : nc -4 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:08:12,924 - DEBUG - nohup nc -4 -q 2 -w 5 -u -ll 53 > testfile &
2026-04-30 05:08:13,461 - DEBUG - None
2026-04-30 05:08:13,461 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -u -p 10000 99.28.176.197 53 < testfile, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-04-30 05:08:13,461 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -4 -q 2 -w 5 -u -p 10000 99.28.176.197 53 < testfile
2026-04-30 05:08:59,883 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.0012134 s, 82.4 kB/s
2026-04-30 05:08:59,883 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:08:59,883 - DEBUG - ls -l testfile
2026-04-30 05:09:00,277 - DEBUG - -rw-r--r-- 1 root root 100 Apr 30 05:08 testfile
2026-04-30 05:09:00,277 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-21311031-61501773
2026-04-30 05:09:00,377 - DEBUG - Forward and reverse flows for match {'sip': '99.28.176.195', 'dip': '99.28.176.197', 'sport': '10000', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 1, 1
2026-04-30 05:09:00,440 - DEBUG - Forward and reverse flows for match {'sip': '99.28.176.195', 'dip': '99.28.176.197', 'sport': '10000', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 0, 0
2026-04-30 05:09:00,556 - DEBUG - Forward and reverse flows for match {'sip': '99.28.176.196', 'dip': '99.28.176.197', 'sport': '10000', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 1, 1
2026-04-30 05:09:00,621 - DEBUG - Forward and reverse flows for match {'sip': '99.28.176.196', 'dip': '99.28.176.197', 'sport': '10000', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 0, 0
2026-04-30 05:09:00,696 - DEBUG - Forward and reverse flows for match {'sip': '99.28.176.195', 'dip': '99.28.176.197', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 1, 1
2026-04-30 05:09:00,696 - INFO - Fat flow verification PASSED on node: 10.0.0.19 for - SIP: 99.28.176.195, DIP: 99.28.176.197, sport: 0, dport: 53, vrf-id: 4 Fat flow expected: 1, got: 1
2026-04-30 05:09:00,804 - DEBUG - Forward and reverse flows for match {'sip': '99.28.176.195', 'dip': '99.28.176.197', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 0, 0
2026-04-30 05:09:00,804 - INFO - Fat flow verification PASSED on node: 10.0.0.241 for - SIP: 99.28.176.195, DIP: 99.28.176.197, sport: 0, dport: 53, vrf-id: 4 Fat flow expected: 0, got: 0
2026-04-30 05:09:00,869 - DEBUG - Forward and reverse flows for match {'sip': '99.28.176.196', 'dip': '99.28.176.197', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 1, 1
2026-04-30 05:09:00,869 - INFO - Fat flow verification PASSED on node: 10.0.0.19 for - SIP: 99.28.176.196, DIP: 99.28.176.197, sport: 0, dport: 53, vrf-id: 4 Fat flow expected: 1, got: 1
2026-04-30 05:09:00,983 - DEBUG - Forward and reverse flows for match {'sip': '99.28.176.196', 'dip': '99.28.176.197', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 0, 0
2026-04-30 05:09:00,984 - INFO - Fat flow verification PASSED on node: 10.0.0.241 for - SIP: 99.28.176.196, DIP: 99.28.176.197, sport: 0, dport: 53, vrf-id: 4 Fat flow expected: 0, got: 0
2026-04-30 05:09:00,984 - INFO - Fat flow verification passed for protocol udp and port 53
2026-04-30 05:09:00,984 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:09:00,984 - DEBUG - nohup rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-04-30 05:09:01,755 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Apr 30 05:09 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-04-30 05:09:01,755 - DEBUG - Running remote_cmd, Cmd : nc -6 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:09:01,755 - DEBUG - nohup nc -6 -q 2 -w 5 -u -ll 53 > testfile &
2026-04-30 05:09:02,843 - DEBUG - None
2026-04-30 05:09:02,843 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20000 35df:6ce2:4201:e450:65cd:602c:0:5 53 < testfile, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-04-30 05:09:02,843 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20000 35df:6ce2:4201:e450:65cd:602c:0:5 53 < testfile
2026-04-30 05:09:05,551 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00126392 s, 79.1 kB/s
2026-04-30 05:09:05,551 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:09:05,551 - DEBUG - ls -l testfile
2026-04-30 05:09:05,996 - DEBUG - -rw-r--r-- 1 root root 100 Apr 30 05:09 testfile
2026-04-30 05:09:05,996 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-21311031-61501773
2026-04-30 05:09:05,996 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:09:05,996 - DEBUG - nohup rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-04-30 05:09:06,695 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Apr 30 05:09 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-04-30 05:09:06,695 - DEBUG - Running remote_cmd, Cmd : nc -6 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:09:06,695 - DEBUG - nohup nc -6 -q 2 -w 5 -u -ll 53 > testfile &
2026-04-30 05:09:07,239 - DEBUG - None
2026-04-30 05:09:07,239 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20001 35df:6ce2:4201:e450:65cd:602c:0:5 53 < testfile, host_string: ubuntu@169.254.0.5, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-04-30 05:09:07,240 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20001 35df:6ce2:4201:e450:65cd:602c:0:5 53 < testfile
2026-04-30 05:09:09,840 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00103414 s, 96.7 kB/s
2026-04-30 05:09:09,840 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:09:09,840 - DEBUG - ls -l testfile
2026-04-30 05:09:10,242 - DEBUG - -rw-r--r-- 1 root root 100 Apr 30 05:09 testfile
2026-04-30 05:09:10,242 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-21311031-61501773
2026-04-30 05:09:10,242 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:09:10,242 - DEBUG - nohup rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-04-30 05:09:11,022 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Apr 30 05:09 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-04-30 05:09:11,022 - DEBUG - Running remote_cmd, Cmd : nc -6 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:09:11,023 - DEBUG - nohup nc -6 -q 2 -w 5 -u -ll 53 > testfile &
2026-04-30 05:09:11,597 - DEBUG - None
2026-04-30 05:09:11,597 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20000 35df:6ce2:4201:e450:65cd:602c:0:5 53 < testfile, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-04-30 05:09:11,597 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20000 35df:6ce2:4201:e450:65cd:602c:0:5 53 < testfile
2026-04-30 05:09:14,254 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00123547 s, 80.9 kB/s
2026-04-30 05:09:14,254 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:09:14,255 - DEBUG - ls -l testfile
2026-04-30 05:09:14,639 - DEBUG - -rw-r--r-- 1 root root 100 Apr 30 05:09 testfile
2026-04-30 05:09:14,639 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-21311031-61501773
2026-04-30 05:09:14,639 - DEBUG - Running remote_cmd, Cmd : rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:09:14,639 - DEBUG - nohup rm -f testfile;ls -la;nc -6 -q 2 -w 5 -u -ll -p 53 > testfile &
2026-04-30 05:09:15,390 - DEBUG - total 132
drwxr-xr-x 11 ubuntu ubuntu 4096 Apr 30 05:09 .
drwxr-xr-x 3 root root 4096 Jan 4 2013 ..
-rw------- 1 ubuntu ubuntu 2689 Dec 29 2017 .bash_history
-rw-r--r-- 1 ubuntu ubuntu 220 Apr 3 2012 .bash_logout
-rw-r--r-- 1 ubuntu ubuntu 3486 Apr 3 2012 .bashrc
drwx------ 2 ubuntu ubuntu 4096 Jan 9 2013 .cache
-rwxrwxr-x 1 ubuntu ubuntu 1431 Feb 5 2015 flow_test_pktgen.sh
drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fontconfig
drwxrwxr-x 2 ubuntu ubuntu 4096 Jan 9 2013 .fvwm
drwxrwxr-x 3 ubuntu ubuntu 4096 Nov 29 2016 .jenkins
-rw------- 1 ubuntu ubuntu 52 Jul 2 2014 .lesshst
drwx------ 4 ubuntu ubuntu 4096 Jan 9 2013 .mozilla
-rwxrwxr-x 1 ubuntu ubuntu 1378 Jun 27 2014 pktgen_new.sh
-rw-r--r-- 1 ubuntu ubuntu 675 Apr 3 2012 .profile
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 scr
drwx------ 2 ubuntu ubuntu 4096 Feb 3 2015 .ssh
-rw-r--r-- 1 ubuntu ubuntu 0 Jan 9 2013 .sudo_as_admin_successful
drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 27 2014 traffic
drwxr-xr-x 4 root root 4096 Jun 27 2014 traffic-1.0
-rw-rw-r-- 1 ubuntu ubuntu 16361 Jan 9 2015 traffic-1.0.tar.gz
-rw------- 1 root root 4695 Dec 17 2017 .viminfo
-rw------- 1 ubuntu ubuntu 152 Jul 2 2014 .Xauthority
-rw------- 1 ubuntu ubuntu 29828 Jan 9 2013 .xsession-errors
2026-04-30 05:09:15,390 - DEBUG - Running remote_cmd, Cmd : nc -6 -q 2 -w 5 -u -ll 53 > testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:09:15,391 - DEBUG - nohup nc -6 -q 2 -w 5 -u -ll 53 > testfile &
2026-04-30 05:09:15,913 - DEBUG - None
2026-04-30 05:09:15,913 - DEBUG - Running remote_cmd, Cmd : dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20001 35df:6ce2:4201:e450:65cd:602c:0:5 53 < testfile, host_string: ubuntu@169.254.0.6, password: ubuntugateway: ubuntu@10.0.0.241, gateway password: c0ntrail123
2026-04-30 05:09:15,913 - DEBUG - dd bs=100 count=1 if=/dev/zero of=testfile;nc -6 -q 2 -w 5 -u -p 20001 35df:6ce2:4201:e450:65cd:602c:0:5 53 < testfile
2026-04-30 05:09:18,566 - DEBUG - 1+0 records in
1+0 records out
100 bytes (100 B) copied, 0.00111206 s, 89.9 kB/s
2026-04-30 05:09:18,566 - DEBUG - Running remote_cmd, Cmd : ls -l testfile, host_string: ubuntu@169.254.0.3, password: ubuntugateway: ubuntu@10.0.0.19, gateway password: c0ntrail123
2026-04-30 05:09:18,566 - DEBUG - ls -l testfile
2026-04-30 05:09:18,986 - DEBUG - -rw-r--r-- 1 root root 100 Apr 30 05:09 testfile
2026-04-30 05:09:18,986 - INFO - File transfer verification for file size 100 passed on the VM ctest-FatFlowSerialIpv6-21311031-61501773
2026-04-30 05:09:19,095 - DEBUG - Forward and reverse flows for match {'sip': '35df:6ce2:4201:e450:65cd:602c:0:3', 'dip': '35df:6ce2:4201:e450:65cd:602c:0:5', 'sport': '20000', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 1, 1
2026-04-30 05:09:19,155 - DEBUG - Forward and reverse flows for match {'sip': '35df:6ce2:4201:e450:65cd:602c:0:3', 'dip': '35df:6ce2:4201:e450:65cd:602c:0:5', 'sport': '20000', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 0, 0
2026-04-30 05:09:19,251 - DEBUG - Forward and reverse flows for match {'sip': '35df:6ce2:4201:e450:65cd:602c:0:3', 'dip': '35df:6ce2:4201:e450:65cd:602c:0:5', 'sport': '20001', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 1, 1
2026-04-30 05:09:19,317 - DEBUG - Forward and reverse flows for match {'sip': '35df:6ce2:4201:e450:65cd:602c:0:3', 'dip': '35df:6ce2:4201:e450:65cd:602c:0:5', 'sport': '20001', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 0, 0
2026-04-30 05:09:19,418 - DEBUG - Forward and reverse flows for match {'sip': '35df:6ce2:4201:e450:65cd:602c:0:4', 'dip': '35df:6ce2:4201:e450:65cd:602c:0:5', 'sport': '20000', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 1, 1
2026-04-30 05:09:19,511 - DEBUG - Forward and reverse flows for match {'sip': '35df:6ce2:4201:e450:65cd:602c:0:4', 'dip': '35df:6ce2:4201:e450:65cd:602c:0:5', 'sport': '20000', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 0, 0
2026-04-30 05:09:19,626 - DEBUG - Forward and reverse flows for match {'sip': '35df:6ce2:4201:e450:65cd:602c:0:4', 'dip': '35df:6ce2:4201:e450:65cd:602c:0:5', 'sport': '20001', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 1, 1
2026-04-30 05:09:19,694 - DEBUG - Forward and reverse flows for match {'sip': '35df:6ce2:4201:e450:65cd:602c:0:4', 'dip': '35df:6ce2:4201:e450:65cd:602c:0:5', 'sport': '20001', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 0, 0
2026-04-30 05:09:19,766 - DEBUG - Forward and reverse flows for match {'sip': '35df:6ce2:4201:e450:65cd:602c:0:3', 'dip': '35df:6ce2:4201:e450:65cd:602c:0:5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 1, 1
2026-04-30 05:09:19,767 - INFO - Fat flow verification PASSED on node: 10.0.0.19 for - SIP: 35df:6ce2:4201:e450:65cd:602c:0:3, DIP: 35df:6ce2:4201:e450:65cd:602c:0:5, sport: 0, dport: 53, vrf-id: 4 Fat flow expected: 1, got: 1
2026-04-30 05:09:19,869 - DEBUG - Forward and reverse flows for match {'sip': '35df:6ce2:4201:e450:65cd:602c:0:3', 'dip': '35df:6ce2:4201:e450:65cd:602c:0:5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 0, 0
2026-04-30 05:09:19,869 - INFO - Fat flow verification PASSED on node: 10.0.0.241 for - SIP: 35df:6ce2:4201:e450:65cd:602c:0:3, DIP: 35df:6ce2:4201:e450:65cd:602c:0:5, sport: 0, dport: 53, vrf-id: 4 Fat flow expected: 0, got: 0
2026-04-30 05:09:19,936 - DEBUG - Forward and reverse flows for match {'sip': '35df:6ce2:4201:e450:65cd:602c:0:4', 'dip': '35df:6ce2:4201:e450:65cd:602c:0:5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 1, 1
2026-04-30 05:09:19,936 - INFO - Fat flow verification PASSED on node: 10.0.0.19 for - SIP: 35df:6ce2:4201:e450:65cd:602c:0:4, DIP: 35df:6ce2:4201:e450:65cd:602c:0:5, sport: 0, dport: 53, vrf-id: 4 Fat flow expected: 1, got: 1
2026-04-30 05:09:20,055 - DEBUG - Forward and reverse flows for match {'sip': '35df:6ce2:4201:e450:65cd:602c:0:4', 'dip': '35df:6ce2:4201:e450:65cd:602c:0:5', 'sport': '0', 'dport': '53', 'proto': '17', 'vrf_id': '4'}: 0, 0
2026-04-30 05:09:20,056 - INFO - Fat flow verification PASSED on node: 10.0.0.241 for - SIP: 35df:6ce2:4201:e450:65cd:602c:0:4, DIP: 35df:6ce2:4201:e450:65cd:602c:0:5, sport: 0, dport: 53, vrf-id: 4 Fat flow expected: 0, got: 0
2026-04-30 05:09:20,056 - INFO - Fat flow verification passed for protocol udp and port 53
2026-04-30 05:09:20,056 - INFO - Deleting VM ctest-FatFlowSerialIpv6-21311031-61501773
2026-04-30 05:09:20,135 - INFO - Deleting VM ctest-FatFlowSerialIpv6-21311031-60112239
2026-04-30 05:09:20,212 - INFO - Deleting VM ctest-FatFlowSerialIpv6-21311031-29274472
2026-04-30 05:09:20,287 - INFO - Deleting VN ctest-vn-33514327
2026-04-30 05:09:20,341 - DEBUG - VN ade2ab57-2850-4b6b-99ba-08a0502c8ce1 still in use: Unable to complete operation on network ade2ab57-2850-4b6b-99ba-08a0502c8ce1. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-4fb244dd-e899-437d-b86a-26df018d03fd']
2026-04-30 05:09:20,341 - WARNING - Deleting VN ctest-vn-33514327 failed..Will retry
2026-04-30 05:09:22,546 - DEBUG - Response for deleting network ()
2026-04-30 05:09:22,547 - DEBUG - Requesting: http://10.0.0.73:8082/routing-instance/250214e9-df6e-49bb-85b3-c2cf89f7ff33
2026-04-30 05:09:22,555 - DEBUG - Response Code: 404
2026-04-30 05:09:22,555 - DEBUG - Requesting: http://10.0.0.73:8082/domains
2026-04-30 05:09:22,561 - DEBUG - Requesting: http://10.0.0.73:8082/domain/f8fddec0-a757-47f7-9dc4-33479425fadb
2026-04-30 05:09:22,576 - DEBUG - Requesting: http://10.0.0.73:8082/project/76e927c3-a43a-47e4-91a0-1b31cebf69e6
2026-04-30 05:09:22,676 - INFO - Validated that VN ctest-vn-33514327 is not found in API Server
2026-04-30 05:09:22,689 - DEBUG - VN ctest-vn-33514327 is not present in Agent 10.0.0.19
2026-04-30 05:09:22,704 - DEBUG - VN ctest-vn-33514327 is not present in Agent 10.0.0.241
2026-04-30 05:09:22,704 - INFO - Validated that VN ctest-vn-33514327 is not in any agent
2026-04-30 05:09:22,737 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-33514327 info
2026-04-30 05:09:24,012 - DEBUG - Skipping xmpp flap check
2026-04-30 05:09:24,012 - INFO - END TEST : test_fat_flow_intra_vn_inter_node : PASSED[0:04:37]
2026-04-30 05:09:24,012 - INFO - --------------------------------------------------------------------------------
2026-04-30 05:09:24,918 - INFO - Deleted project: ctest-FatFlowSerialIpv6-21311031, ID : 76e927c3-a43a-47e4-91a0-1b31cebf69e6