2025-04-18 14:14:40,960 - INFO - Domain Default found not creating 2025-04-18 14:14:41,178 - INFO - Project ctest-TestvDNSBasic0-61161941 not found, creating it 2025-04-18 14:14:41,713 - INFO - Created Project:ctest-TestvDNSBasic0-61161941, ID : b2c0039a-7dc9-460a-acc6-1c5c1efdf850 2025-04-18 14:14:43,583 - INFO - ================================================================================ 2025-04-18 14:14:43,583 - INFO - STARTING TEST : test_vdns_ping_same_vn 2025-04-18 14:14:43,583 - INFO - TEST DESCRIPTION : Test:- Test vdns functionality. On VM launch agent should dynamically update dns records to dns agent 1. Create vDNS server 2. Create IPAM using above vDNS data 3. Create VN using above IPAM and launch 2 VM's within it 4. Ping between these 2 VM's using dns name 5. Try to delete vDNS server which has IPAM back-reference[Negative case] 6. Add CNAME VDNS record for vm1-test and verify we able to ping by alias name Pass criteria: Step 4,5 and 6 should pass Maintainer: cf-test@juniper.net 2025-04-18 14:14:43,862 - DEBUG - Nothing to compare xmpp stats {'10.0.0.50': {'10.20.0.17': '0'}} with 2025-04-18 14:14:43,862 - INFO - Initial checks done. Running the testcase now 2025-04-18 14:14:43,863 - INFO - 2025-04-18 14:14:44,674 - INFO - Using existing project ['default-domain', 'ctest-TestvDNSBasic0-61161941'](b2c0039a-7dc9-460a-acc6-1c5c1efdf850) 2025-04-18 14:14:44,738 - DEBUG - Creating VDNS : ctest-vdns1-69557331 2025-04-18 14:14:44,966 - DEBUG - VDNS: ['default-domain', 'ctest-vdns1-69557331'] created succesfully 2025-04-18 14:14:44,966 - DEBUG - Verify VDNS entry is shown in control node 2025-04-18 14:14:44,976 - DEBUG - Verify VDNS entry is shown in the API server 2025-04-18 14:14:44,977 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-04-18 14:14:45,310 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-04-18 14:14:45,357 - DEBUG - Requesting: http://10.0.0.50:8082/domain/163811d2-a944-42ca-b519-e54badd96edd 2025-04-18 14:14:45,381 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-DNS/ce7f892d-361b-4240-b8a6-c38b2fc848ff 2025-04-18 14:14:46,081 - DEBUG - Response for create_network : {'network': {'id': '669fe2aa-4d8d-46f5-9919-213db367e3d3', 'name': 'ctest-vn1-vdns-59114339', 'tenant_id': 'b2c0039a7dc9460aacc61c5c1efdf850', 'project_id': 'b2c0039a7dc9460aacc61c5c1efdf850', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-TestvDNSBasic0-61161941', 'ctest-vn1-vdns-59114339'], 'port_security_enabled': True, 'description': ''}} 2025-04-18 14:14:46,295 - DEBUG - Response for create_subnet : {'subnet': {'id': 'd0ddd36e-03f4-4d03-a2c0-d1a8b77efaa8', 'name': '', 'tenant_id': 'b2c0039a7dc9460aacc61c5c1efdf850', 'network_id': '669fe2aa-4d8d-46f5-9919-213db367e3d3', 'ip_version': 4, 'cidr': '10.10.10.0/24', 'allocation_pools': [{'start': '10.10.10.2', 'end': '10.10.10.254'}], 'gateway_ip': '10.10.10.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '10.10.10.2', 'tags': [], 'project_id': 'b2c0039a7dc9460aacc61c5c1efdf850'}} 2025-04-18 14:14:46,318 - INFO - Created VN ctest-vn1-vdns-59114339 2025-04-18 14:14:46,378 - DEBUG - VN ctest-vn1-vdns-59114339 UUID is 669fe2aa-4d8d-46f5-9919-213db367e3d3 2025-04-18 14:14:46,669 - DEBUG - Services list from nova: [, , ] 2025-04-18 14:14:47,865 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3139-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3139-1) 2025-04-18 14:14:47,865 - INFO - Waiting for VM ctest-vm1-test-51610155 to be up.. 2025-04-18 14:14:47,926 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-04-18 14:14:53,045 - DEBUG - VM is in ACTIVE state now 2025-04-18 14:14:53,045 - INFO - VM name : ctest-vm1-test-51610155 2025-04-18 14:14:53,157 - DEBUG - VM ctest-vm1-test-51610155 ID is f8269be5-a521-45ca-8cbd-75bd5ab6dc01 2025-04-18 14:14:53,157 - DEBUG - VM ctest-vm1-test-51610155 launched on Node cn-jenkins-deploy-platform-ansible-os-3139-1 2025-04-18 14:14:53,265 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/f8269be5-a521-45ca-8cbd-75bd5ab6dc01 2025-04-18 14:14:53,281 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/3d0d918c-7a60-4d8f-9519-0b2e7d343c8f 2025-04-18 14:14:56,558 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1003ms') 2025-04-18 14:14:56,559 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-test-51610155 failed! 2025-04-18 14:14:56,618 - DEBUG - Gateway for vn default-domain:ctest-TestvDNSBasic0-61161941:ctest-vn1-vdns-59114339 is 10.10.10.1 and allocation pool is NOT set 2025-04-18 14:15:00,695 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1006ms') 2025-04-18 14:15:00,695 - DEBUG - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-test-51610155 failed! 2025-04-18 14:15:00,754 - DEBUG - Gateway for vn default-domain:ctest-TestvDNSBasic0-61161941:ctest-vn1-vdns-59114339 is 10.10.10.1 and allocation pool is NOT set 2025-04-18 14:15:02,820 - DEBUG - (True, 'PING 169.254.0.3 (169.254.0.3) 56(84) bytes of data.\r\n64 bytes from 169.254.0.3: icmp_seq=1 ttl=63 time=4.90 ms\r\n64 bytes from 169.254.0.3: icmp_seq=2 ttl=63 time=0.801 ms\r\n\r\n--- 169.254.0.3 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.801/2.849/4.898/2.048 ms') 2025-04-18 14:15:02,820 - INFO - Ping to Metadata IP 169.254.0.3 of VM ctest-vm1-test-51610155 passed 2025-04-18 14:15:02,978 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-18 14:15:02,978 - DEBUG - Waiting to SSH to VM ctest-vm1-test-51610155, IP 10.10.10.3, Port 22 2025-04-18 14:15:03,152 - DEBUG - VM ctest-vm1-test-51610155 is ready for SSH connections 2025-04-18 14:15:03,152 - DEBUG - Running remote_cmd, Cmd : ifconfig | grep 10.10.10.3, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:15:03,152 - DEBUG - ifconfig | grep 10.10.10.3 2025-04-18 14:15:04,907 - DEBUG - inet addr:10.10.10.3 Bcast:10.10.10.255 Mask:255.255.255.0 2025-04-18 14:15:04,908 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm1-test-51610155", None, socket.AF_INET6)', host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:15:04,908 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm1-test-51610155", None, socket.AF_INET6)' 2025-04-18 14:15:05,208 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 ctest-vm1-test-51610155, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:15:05,208 - DEBUG - ping -s 56 -c 3 -W 1 ctest-vm1-test-51610155 2025-04-18 14:15:07,514 - DEBUG - PING ctest-vm1-test-51610155 (10.10.10.3): 56 data bytes 64 bytes from 10.10.10.3: seq=0 ttl=64 time=3.819 ms 64 bytes from 10.10.10.3: seq=1 ttl=64 time=0.546 ms 64 bytes from 10.10.10.3: seq=2 ttl=64 time=0.733 ms --- ctest-vm1-test-51610155 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.546/1.699/3.819 ms 2025-04-18 14:15:07,514 - INFO - Ping to IP ctest-vm1-test-51610155 from VM ctest-vm1-test-51610155 passed 2025-04-18 14:15:07,532 - DEBUG - Requesting: http://10.0.0.50:8092/Snh_PageReq?x=AllEntries%20VdnsServersReq 2025-04-18 14:15:07,540 - DEBUG - Requesting: http://10.0.0.50:8092/Snh_PageReq?x=default-domain:ctest-vdns1-69557331@0%20AllEntriesVdnsRecordsReq 2025-04-18 14:15:07,547 - DEBUG - Actual record data {'name': 'default-domain:ctest-vdns1-69557331:1:ctest-vm1-test-51610155:10.10.10.3', 'rec_name': 'ctest-vm1-test-51610155', 'rec_type': 'A', 'rec_class': 'IN', 'rec_data': '10.10.10.3', 'rec_ttl': '100', 'source': 'Agent', 'installed': 'true', 'flags': '3', 'rec_source_name': 'cn-jenkins-deploy-platform-ansible-os-3139-1/dns'} , Expected record data {'rec_data': '10.10.10.3', 'rec_type': 'A', 'rec_class': 'IN', 'rec_ttl': '100', 'rec_name': 'ctest-vm1-test-51610155.juniper.net', 'installed': 'yes', 'zone': 'juniper.net'} 2025-04-18 14:15:07,547 - DEBUG - Actual record data {'name': 'default-domain:ctest-vdns1-69557331:12:3.10.10.10.in-addr.arpa:ctest-vm1-test-51610155', 'rec_name': '3.10.10.10.in-addr.arpa', 'rec_type': 'PTR', 'rec_class': 'IN', 'rec_data': 'ctest-vm1-test-51610155', 'rec_ttl': '100', 'source': 'Agent', 'installed': 'true', 'flags': '3', 'rec_source_name': 'cn-jenkins-deploy-platform-ansible-os-3139-1/dns'} , Expected record data {'rec_data': 'ctest-vm1-test-51610155.juniper.net', 'rec_type': 'PTR', 'rec_class': 'IN', 'rec_ttl': '100', 'rec_name': '3.10.10.10.in-addr.arpa', 'installed': 'yes', 'zone': '10.10.10.in-addr.arpa'} 2025-04-18 14:15:08,971 - INFO - VM ([]) created on node: (cn-jenkins-deploy-platform-ansible-os-3139-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3139-1) 2025-04-18 14:15:08,972 - INFO - Waiting for VM ctest-vm2-test-34316544 to be up.. 2025-04-18 14:15:09,025 - DEBUG - VM is still in BUILD state, Expected: ACTIVE 2025-04-18 14:15:14,148 - DEBUG - VM is in ACTIVE state now 2025-04-18 14:15:14,148 - INFO - VM name : ctest-vm2-test-34316544 2025-04-18 14:15:14,258 - DEBUG - VM ctest-vm2-test-34316544 ID is 84310585-831d-4b82-bad4-ebe7ec52fc45 2025-04-18 14:15:14,259 - DEBUG - VM ctest-vm2-test-34316544 launched on Node cn-jenkins-deploy-platform-ansible-os-3139-1 2025-04-18 14:15:14,365 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine/84310585-831d-4b82-bad4-ebe7ec52fc45 2025-04-18 14:15:14,379 - DEBUG - Requesting: http://10.0.0.50:8082/virtual-machine-interface/b31883e5-454e-47bc-9e9e-0dab7d20fd03 2025-04-18 14:15:17,649 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1001ms') 2025-04-18 14:15:17,649 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-vm2-test-34316544 failed! 2025-04-18 14:15:17,714 - DEBUG - Gateway for vn default-domain:ctest-TestvDNSBasic0-61161941:ctest-vn1-vdns-59114339 is 10.10.10.1 and allocation pool is NOT set 2025-04-18 14:15:21,811 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 0 received, 100% packet loss, time 1026ms') 2025-04-18 14:15:21,811 - DEBUG - Ping to Metadata IP 169.254.0.4 of VM ctest-vm2-test-34316544 failed! 2025-04-18 14:15:21,874 - DEBUG - Gateway for vn default-domain:ctest-TestvDNSBasic0-61161941:ctest-vn1-vdns-59114339 is 10.10.10.1 and allocation pool is NOT set 2025-04-18 14:15:23,945 - DEBUG - (True, 'PING 169.254.0.4 (169.254.0.4) 56(84) bytes of data.\r\n64 bytes from 169.254.0.4: icmp_seq=1 ttl=63 time=4.91 ms\r\n64 bytes from 169.254.0.4: icmp_seq=2 ttl=63 time=0.654 ms\r\n\r\n--- 169.254.0.4 ping statistics ---\r\n2 packets transmitted, 2 received, 0% packet loss, time 1001ms\r\nrtt min/avg/max/mdev = 0.654/2.784/4.914/2.130 ms') 2025-04-18 14:15:23,945 - INFO - Ping to Metadata IP 169.254.0.4 of VM ctest-vm2-test-34316544 passed 2025-04-18 14:15:24,106 - DEBUG - verify_vm_launched is skipped since self.vm_launch_flag is set 2025-04-18 14:15:24,106 - DEBUG - Waiting to SSH to VM ctest-vm2-test-34316544, IP 10.10.10.4, Port 22 2025-04-18 14:15:24,284 - DEBUG - VM ctest-vm2-test-34316544 is ready for SSH connections 2025-04-18 14:15:24,285 - DEBUG - Running remote_cmd, Cmd : ifconfig | grep 10.10.10.4, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:15:24,285 - DEBUG - ifconfig | grep 10.10.10.4 2025-04-18 14:15:24,962 - DEBUG - inet addr:10.10.10.4 Bcast:10.10.10.255 Mask:255.255.255.0 2025-04-18 14:15:24,962 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)', host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:15:24,962 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)' 2025-04-18 14:15:25,232 - DEBUG - Running remote_cmd, Cmd : ping -s 56 -c 3 -W 1 ctest-vm2-test-34316544, host_string: cirros@169.254.0.4, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:15:25,232 - DEBUG - ping -s 56 -c 3 -W 1 ctest-vm2-test-34316544 2025-04-18 14:15:27,548 - DEBUG - PING ctest-vm2-test-34316544 (10.10.10.4): 56 data bytes 64 bytes from 10.10.10.4: seq=0 ttl=64 time=3.845 ms 64 bytes from 10.10.10.4: seq=1 ttl=64 time=0.522 ms 64 bytes from 10.10.10.4: seq=2 ttl=64 time=0.679 ms --- ctest-vm2-test-34316544 ping statistics --- 3 packets transmitted, 3 packets received, 0% packet loss round-trip min/avg/max = 0.522/1.682/3.845 ms 2025-04-18 14:15:27,549 - INFO - Ping to IP ctest-vm2-test-34316544 from VM ctest-vm2-test-34316544 passed 2025-04-18 14:15:27,568 - DEBUG - Requesting: http://10.0.0.50:8092/Snh_PageReq?x=AllEntries%20VdnsServersReq 2025-04-18 14:15:27,578 - DEBUG - Requesting: http://10.0.0.50:8092/Snh_PageReq?x=default-domain:ctest-vdns1-69557331@0%20AllEntriesVdnsRecordsReq 2025-04-18 14:15:27,588 - DEBUG - Actual record data {'name': 'default-domain:ctest-vdns1-69557331:1:ctest-vm2-test-34316544:10.10.10.4', 'rec_name': 'ctest-vm2-test-34316544', 'rec_type': 'A', 'rec_class': 'IN', 'rec_data': '10.10.10.4', 'rec_ttl': '100', 'source': 'Agent', 'installed': 'true', 'flags': '3', 'rec_source_name': 'cn-jenkins-deploy-platform-ansible-os-3139-1/dns'} , Expected record data {'rec_data': '10.10.10.4', 'rec_type': 'A', 'rec_class': 'IN', 'rec_ttl': '100', 'rec_name': 'ctest-vm2-test-34316544.juniper.net', 'installed': 'yes', 'zone': 'juniper.net'} 2025-04-18 14:15:27,588 - DEBUG - Actual record data {'name': 'default-domain:ctest-vdns1-69557331:12:4.10.10.10.in-addr.arpa:ctest-vm2-test-34316544', 'rec_name': '4.10.10.10.in-addr.arpa', 'rec_type': 'PTR', 'rec_class': 'IN', 'rec_data': 'ctest-vm2-test-34316544', 'rec_ttl': '100', 'source': 'Agent', 'installed': 'true', 'flags': '3', 'rec_source_name': 'cn-jenkins-deploy-platform-ansible-os-3139-1/dns'} , Expected record data {'rec_data': 'ctest-vm2-test-34316544.juniper.net', 'rec_type': 'PTR', 'rec_class': 'IN', 'rec_ttl': '100', 'rec_name': '4.10.10.10.in-addr.arpa', 'installed': 'yes', 'zone': '10.10.10.in-addr.arpa'} 2025-04-18 14:15:27,588 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)', host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:15:27,588 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)' 2025-04-18 14:17:27,601 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1341, in ping_to_ip logger=self.logger File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 923, in open_session timeout=timeout, File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2025-04-18 14:17:28,605 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)', host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:17:28,605 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)' 2025-04-18 14:19:28,680 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1341, in ping_to_ip logger=self.logger File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 923, in open_session timeout=timeout, File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2025-04-18 14:19:29,682 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)', host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:19:29,682 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)' 2025-04-18 14:21:29,718 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1341, in ping_to_ip logger=self.logger File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 923, in open_session timeout=timeout, File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2025-04-18 14:21:30,720 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)', host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:21:30,721 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)' 2025-04-18 14:23:30,757 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1341, in ping_to_ip logger=self.logger File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 923, in open_session timeout=timeout, File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2025-04-18 14:23:31,758 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)', host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:23:31,758 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)' 2025-04-18 14:25:31,775 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1341, in ping_to_ip logger=self.logger File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 923, in open_session timeout=timeout, File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2025-04-18 14:25:32,777 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)', host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:25:32,777 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)' 2025-04-18 14:27:32,832 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1341, in ping_to_ip logger=self.logger File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 923, in open_session timeout=timeout, File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2025-04-18 14:27:33,834 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)', host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:27:33,834 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)' 2025-04-18 14:29:33,898 - ERROR - Exception occured while trying ping from VM Traceback (most recent call last): File "/contrail-test/fixtures/vm_test.py", line 1341, in ping_to_ip logger=self.logger File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 420, in _open_session session = transport.open_session(timeout=env.timeout) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 923, in open_session timeout=timeout, File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2025-04-18 14:29:34,900 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)', host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:29:34,900 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)' 2025-04-18 14:33:15,367 - DEBUG - Running remote_cmd, Cmd : ping6 -s 56 -c 3 -W 1 ctest-vm2-test-34316544, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:33:15,367 - DEBUG - ping6 -s 56 -c 3 -W 1 ctest-vm2-test-34316544 2025-04-18 14:35:25,530 - ERROR - Unable to run command ping6 -s 56 -c 3 -W 1 ctest-vm2-test-34316544: ChannelException(2, 'Connect failed') Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 455, in connect sock = get_gateway(host, port, cache, replace=tries > 0) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 95, in get_gateway sock = direct_tcpip(dict.__getitem__(cache, gateway), host, port) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 41, in direct_tcpip ('', 0) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1061, in open_channel raise e paramiko.ssh_exception.ChannelException: ChannelException(2, 'Connect failed') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 416, in _open_session transport = connections[env.host_string].get_transport() File "/contrail-test/tcutils/fabutils.py", line 47, in __getitem__ self.connect(key) File "/contrail-test/tcutils/fabutils.py", line 34, in connect user, host, port, cache=self, seek_gateway=seek_gateway) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 508, in connect raise NetworkError(msg, e) fabric.exceptions.NetworkError: ChannelException(2, 'Connect failed') 2025-04-18 14:35:30,532 - DEBUG - None 2025-04-18 14:35:30,532 - WARNING - Got exception in ping_to_ip:argument of type 'NoneType' is not iterable 2025-04-18 14:35:31,534 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)', host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:35:31,534 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)' 2025-04-18 14:37:42,746 - ERROR - Unable to run command python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)': ChannelException(2, 'Connect failed') Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 455, in connect sock = get_gateway(host, port, cache, replace=tries > 0) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 95, in get_gateway sock = direct_tcpip(dict.__getitem__(cache, gateway), host, port) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 41, in direct_tcpip ('', 0) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1061, in open_channel raise e paramiko.ssh_exception.ChannelException: ChannelException(2, 'Connect failed') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 416, in _open_session transport = connections[env.host_string].get_transport() File "/contrail-test/tcutils/fabutils.py", line 47, in __getitem__ self.connect(key) File "/contrail-test/tcutils/fabutils.py", line 34, in connect user, host, port, cache=self, seek_gateway=seek_gateway) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 508, in connect raise NetworkError(msg, e) fabric.exceptions.NetworkError: ChannelException(2, 'Connect failed') 2025-04-18 14:37:47,748 - DEBUG - Running remote_cmd, Cmd : ping6 -s 56 -c 3 -W 1 ctest-vm2-test-34316544, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:37:47,748 - DEBUG - ping6 -s 56 -c 3 -W 1 ctest-vm2-test-34316544 2025-04-18 14:39:57,914 - ERROR - Unable to run command ping6 -s 56 -c 3 -W 1 ctest-vm2-test-34316544: ChannelException(2, 'Connect failed') Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 455, in connect sock = get_gateway(host, port, cache, replace=tries > 0) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 95, in get_gateway sock = direct_tcpip(dict.__getitem__(cache, gateway), host, port) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 41, in direct_tcpip ('', 0) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1061, in open_channel raise e paramiko.ssh_exception.ChannelException: ChannelException(2, 'Connect failed') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 416, in _open_session transport = connections[env.host_string].get_transport() File "/contrail-test/tcutils/fabutils.py", line 47, in __getitem__ self.connect(key) File "/contrail-test/tcutils/fabutils.py", line 34, in connect user, host, port, cache=self, seek_gateway=seek_gateway) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 508, in connect raise NetworkError(msg, e) fabric.exceptions.NetworkError: ChannelException(2, 'Connect failed') 2025-04-18 14:40:02,915 - DEBUG - None 2025-04-18 14:40:02,915 - WARNING - Got exception in ping_to_ip:argument of type 'NoneType' is not iterable 2025-04-18 14:40:03,917 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)', host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:40:03,917 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)' 2025-04-18 14:42:15,131 - ERROR - Unable to run command python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)': ChannelException(2, 'Connect failed') Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 455, in connect sock = get_gateway(host, port, cache, replace=tries > 0) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 95, in get_gateway sock = direct_tcpip(dict.__getitem__(cache, gateway), host, port) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 41, in direct_tcpip ('', 0) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1061, in open_channel raise e paramiko.ssh_exception.ChannelException: ChannelException(2, 'Connect failed') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 416, in _open_session transport = connections[env.host_string].get_transport() File "/contrail-test/tcutils/fabutils.py", line 47, in __getitem__ self.connect(key) File "/contrail-test/tcutils/fabutils.py", line 34, in connect user, host, port, cache=self, seek_gateway=seek_gateway) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 508, in connect raise NetworkError(msg, e) fabric.exceptions.NetworkError: ChannelException(2, 'Connect failed') 2025-04-18 14:42:20,132 - DEBUG - Running remote_cmd, Cmd : ping6 -s 56 -c 3 -W 1 ctest-vm2-test-34316544, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:42:20,133 - DEBUG - ping6 -s 56 -c 3 -W 1 ctest-vm2-test-34316544 2025-04-18 14:44:30,298 - ERROR - Unable to run command ping6 -s 56 -c 3 -W 1 ctest-vm2-test-34316544: ChannelException(2, 'Connect failed') Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 455, in connect sock = get_gateway(host, port, cache, replace=tries > 0) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 95, in get_gateway sock = direct_tcpip(dict.__getitem__(cache, gateway), host, port) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 41, in direct_tcpip ('', 0) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1061, in open_channel raise e paramiko.ssh_exception.ChannelException: ChannelException(2, 'Connect failed') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 416, in _open_session transport = connections[env.host_string].get_transport() File "/contrail-test/tcutils/fabutils.py", line 47, in __getitem__ self.connect(key) File "/contrail-test/tcutils/fabutils.py", line 34, in connect user, host, port, cache=self, seek_gateway=seek_gateway) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 508, in connect raise NetworkError(msg, e) fabric.exceptions.NetworkError: ChannelException(2, 'Connect failed') 2025-04-18 14:44:35,299 - DEBUG - None 2025-04-18 14:44:35,300 - WARNING - Got exception in ping_to_ip:argument of type 'NoneType' is not iterable 2025-04-18 14:44:36,301 - DEBUG - Running remote_cmd, Cmd : python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)', host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:44:36,301 - DEBUG - python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)' 2025-04-18 14:46:47,514 - ERROR - Unable to run command python -c 'import socket;socket.getaddrinfo("ctest-vm2-test-34316544", None, socket.AF_INET6)': ChannelException(2, 'Connect failed') Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 455, in connect sock = get_gateway(host, port, cache, replace=tries > 0) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 95, in get_gateway sock = direct_tcpip(dict.__getitem__(cache, gateway), host, port) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 41, in direct_tcpip ('', 0) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1061, in open_channel raise e paramiko.ssh_exception.ChannelException: ChannelException(2, 'Connect failed') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 416, in _open_session transport = connections[env.host_string].get_transport() File "/contrail-test/tcutils/fabutils.py", line 47, in __getitem__ self.connect(key) File "/contrail-test/tcutils/fabutils.py", line 34, in connect user, host, port, cache=self, seek_gateway=seek_gateway) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 508, in connect raise NetworkError(msg, e) fabric.exceptions.NetworkError: ChannelException(2, 'Connect failed') 2025-04-18 14:46:52,516 - DEBUG - Running remote_cmd, Cmd : ping6 -s 56 -c 3 -W 1 ctest-vm2-test-34316544, host_string: cirros@169.254.0.3, password: cubswin:)gateway: ubuntu@10.0.0.50, gateway password: c0ntrail123 2025-04-18 14:46:52,516 - DEBUG - ping6 -s 56 -c 3 -W 1 ctest-vm2-test-34316544 2025-04-18 14:49:02,682 - ERROR - Unable to run command ping6 -s 56 -c 3 -W 1 ctest-vm2-test-34316544: ChannelException(2, 'Connect failed') Traceback (most recent call last): File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 455, in connect sock = get_gateway(host, port, cache, replace=tries > 0) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 95, in get_gateway sock = direct_tcpip(dict.__getitem__(cache, gateway), host, port) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 41, in direct_tcpip ('', 0) File "/usr/local/lib/python3.6/site-packages/paramiko/transport.py", line 1061, in open_channel raise e paramiko.ssh_exception.ChannelException: ChannelException(2, 'Connect failed') During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/contrail-test/tcutils/fabutils.py", line 169, in remote_cmd output = _run(cmd, timeout=timeout, pty=not as_daemon, shell=shell) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 692, in host_prompting_wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 1153, in sudo capture_buffer_size=capture_buffer_size, File "/usr/local/lib/python3.6/site-packages/fabric/operations.py", line 935, in _run_command channel=default_channel(), command=wrapped_command, pty=pty, File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 435, in default_channel chan = _open_session() File "/usr/local/lib/python3.6/site-packages/fabric/state.py", line 416, in _open_session transport = connections[env.host_string].get_transport() File "/contrail-test/tcutils/fabutils.py", line 47, in __getitem__ self.connect(key) File "/contrail-test/tcutils/fabutils.py", line 34, in connect user, host, port, cache=self, seek_gateway=seek_gateway) File "/usr/local/lib/python3.6/site-packages/fabric/network.py", line 508, in connect raise NetworkError(msg, e) fabric.exceptions.NetworkError: ChannelException(2, 'Connect failed') 2025-04-18 14:49:07,683 - DEBUG - None 2025-04-18 14:49:07,684 - WARNING - Got exception in ping_to_ip:argument of type 'NoneType' is not iterable 2025-04-18 14:49:07,693 - INFO - Deleting VM ctest-vm2-test-34316544 2025-04-18 14:49:07,873 - INFO - Deleting VM ctest-vm1-test-51610155 2025-04-18 14:49:07,965 - INFO - Deleting VN ctest-vn1-vdns-59114339 2025-04-18 14:49:08,048 - DEBUG - VN 669fe2aa-4d8d-46f5-9919-213db367e3d3 still in use: Unable to complete operation on network 669fe2aa-4d8d-46f5-9919-213db367e3d3. There are one or more ports still in use on the network. Neutron server returns request_ids: ['req-1697cc01-8adc-4115-b0d7-78a8bf99cc16'] 2025-04-18 14:49:08,048 - WARNING - Deleting VN ctest-vn1-vdns-59114339 failed..Will retry 2025-04-18 14:49:10,354 - DEBUG - Response for deleting network () 2025-04-18 14:49:10,436 - DEBUG - Deleting VDNS Entry: ctest-vdns1-69557331 2025-04-18 14:49:10,521 - INFO - VDNS info: ['default-domain', 'ctest-vdns1-69557331'] deleted successfully. 2025-04-18 14:49:10,522 - DEBUG - Requesting: http://10.0.0.50:8082/domains 2025-04-18 14:49:10,561 - DEBUG - Requesting: http://10.0.0.50:8082/domain/163811d2-a944-42ca-b519-e54badd96edd 2025-04-18 14:49:10,579 - DEBUG - VDNS information not found in API server 2025-04-18 14:49:10,579 - INFO - VDNS information ctest-vdns1-69557331 removed from the API Server 2025-04-18 14:49:10,587 - INFO - VDNS information ctest-vdns1-69557331 removed in the Control node 2025-04-18 14:49:10,587 - DEBUG - Skipping the deletion of Project ['default-domain', 'ctest-TestvDNSBasic0-61161941'] 2025-04-18 14:49:10,845 - ERROR - AssertionError Python 3.6.8: /usr/bin/python3 Fri Apr 18 14:49:07 2025 A problem occurred in a Python script. Here is the sequence of function calls leading up to the error, in the order they occurred. /contrail-test/tcutils/wrappers.py in wrapper(self=, *args=(), **kwargs={}) 78 log.info('Initial checks done. Running the testcase now') 79 log.info('') 80 result = function(self, *args, **kwargs) 81 if self.inputs.upgrade: 82 pid = os.getpid() result = None function = self = args = () kwargs = {} /contrail-test/scripts/vdns/test_vdns_basic.py in test_vdns_ping_same_vn(self=) 117 # ping between two vms which are in same subnets by using name. 118 self.assertTrue(vm_fixture[vm1_name] 119 .ping_with_certainty(ip=vm_list[1])) 120 # delete VDNS with ipam as back refrence. 121 self.logger.info( global ip = vm_list = ['ctest-vm1-test-51610155', 'ctest-vm2-test-34316544'] /usr/local/lib/python3.6/site-packages/unittest2/case.py in assertTrue(self=, expr=False, msg='False is not true') 700 if not expr: 701 msg = self._formatMessage(msg, "%s is not true" % safe_repr(expr)) 702 raise self.failureException(msg) 703 704 def _formatMessage(self, msg, standardMsg): self = self.failureException = msg = 'False is not true' AssertionError: False is not true __cause__ = None __class__ = __context__ = None __delattr__ = __dict__ = {} __dir__ = __doc__ = 'Assertion failed.' __eq__ = __format__ = __ge__ = __getattribute__ = __gt__ = __hash__ = __init__ = __init_subclass__ = __le__ = __lt__ = __ne__ = __new__ = __reduce__ = __reduce_ex__ = __repr__ = __setattr__ = __setstate__ = __sizeof__ = __str__ = __subclasshook__ = __suppress_context__ = False __traceback__ = args = ('False is not true',) with_traceback = The above is a description of an error in a Python program. Here is the original traceback: Traceback (most recent call last): File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper result = function(self, *args, **kwargs) File "/contrail-test/scripts/vdns/test_vdns_basic.py", line 119, in test_vdns_ping_same_vn .ping_with_certainty(ip=vm_list[1])) File "/usr/local/lib/python3.6/site-packages/unittest2/case.py", line 702, in assertTrue raise self.failureException(msg) AssertionError: False is not true 2025-04-18 14:49:10,854 - DEBUG - No XMPP flaps were noticed during the test 2025-04-18 14:49:10,854 - INFO -
2025-04-18 14:49:10,854 - INFO - END TEST : test_vdns_ping_same_vn : FAILED[0:34:27]
2025-04-18 14:49:10,854 - INFO - -------------------------------------------------------------------------------- 2025-04-18 14:49:11,675 - INFO - Deleted project: ctest-TestvDNSBasic0-61161941, ID : b2c0039a-7dc9-460a-acc6-1c5c1efdf850