Test Results

Designed for use with JUnit and Ant.

Properties


Summary

TestsFailuresErrorsSkippedSuccess rateTime
2730486.96%575.951
Note: failures are anticipated and checked for with assertions while errors are unanticipated.

Packages

Note: package statistics are not computed recursively, they only sum up all of its testsuites numbers.
NameTestsErrorsFailuresSkippedTime(s)
27034575.951

Package

NameTestsErrorsFailuresSkippedTime(s)
20031459.343
7003116.608
Back to top


TestCase

NameStatusTypeTime(s)LogFile
test_contrail_status[cb_sanity,ci_sanity,dev_sanity_dpdk,sanity]Success0.675
test_verify_object_logs[ci_sanity,dev_sanity_dpdk,sanity,suite1]Success24.469
test_db_manage[cb_sanity,ci_sanity,dev_sanity_dpdk,sanity]Success4.978
test_floating_ip[cb_sanity,ci_contrail_go_kolla_ocata_sanity,ci_sanity,quick_sanity,sanity,suite1,vrouter_gw]Success25.568
test_heat_stacks_list[cb_sanity,ci_contrail_go_kolla_ocata_sanity,ci_sanity]Success0.672
test_router_crud[ci_sanity,dev_sanity_dpdk,sanity]Success6.859
test_ports_bindings[ci_sanity,dev_sanity_dpdk,sanity]Success2.610
test_ports_specific_subnet_ip[ci_sanity,dev_sanity_dpdk,sanity]Success23.709
test_basic_router_behavior[ci_sanity,dev_sanity_dpdk,sanity]Success39.570
test_basic_snat_behavior_without_external_connectivity[ci_sanity,dev_sanity_dpdk,sanity,suite1]Success26.465
test_basic_policy_allow_deny[cb_sanity,ci_contrail_go_kolla_ocata_sanity,ci_sanity,quick_sanity,sanity,suite1]SkippedDisabling v6 tests for CI6.538
test_remove_policy_with_ref[ci_sanity,sanity]Success4.904
test_basic_policy_allow_deny[cb_sanity,ci_contrail_go_kolla_ocata_sanity,ci_sanity,quick_sanity,sanity,suite1]Success30.741
test_rp_interface[ci_sanity,sanity]Success25.237
test_svc_in_network_datapath[ci_sanity]Success77.024
test_vdns_ping_same_vn[ci_sanity,sanity,suite1]Success56.525
test_vm_file_trf_scp_tests[ci_contrail_go_kolla_ocata_sanity,ci_sanity,quick_sanity,vrouter_gw]Success24.927
test_generic_link_local_service[cb_sanity,ci_contrail_go_kolla_ocata_sanity,ci_sanity,dev_sanity_dpdk,sanity,suite1]FailureDetails

Traceback (most recent call last):
testtools.testresult.real._StringException: Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 176, in wrapper
raise TestFailed("\n ".join(errmsg))
tcutils.cores.TestFailed: Test failed: <pre>Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 290, in test_generic_link_local_service
compute_user = self.inputs.host_data[vm1_fixture.vm_node_ip]['username']
File "/contrail-test/fixtures/vm_test.py", line 386, in vm_node_ip
self.get_host_of_vm(refresh=True))
File "/contrail-test/fixtures/vm_test.py", line 400, in get_host_of_vm
assert self.wait_till_vm_is_active()
AssertionError
</pre>

3.331 Log File
test_metadata_service[cb_sanity,ci_sanity,sanity,suite1]FailureDetails

Traceback (most recent call last):
testtools.testresult.real._StringException: Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 176, in wrapper
raise TestFailed("\n ".join(errmsg))
tcutils.cores.TestFailed: Test failed: AssertionError
Python 3.6.8: /usr/bin/python3
Thu Aug 21 11:27:10 2025

A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.

/contrail-test/tcutils/wrappers.py in wrapper(self=<scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7f0e9b146630>, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function = <function TestBasicVMVN.test_metadata_service>
self = <scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7f0e9b146630>
args = ()
kwargs = {}

/contrail-test/scripts/vm_regression/test_vm_basic.py in test_metadata_service(self=<scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7f0e9b146630>)
55 image_name='cirros',
56 userdata='/tmp/metadata_script.txt')
57 assert vm1_fixture.wait_till_vm_is_up()
58
59 cmd = 'cat /tmp/output.txt'
vm1_fixture = <VMFixture: ctest-TestBasicVMVN-80441926-35376694>
vm1_fixture.wait_till_vm_is_up = <bound method VMFixture.wait_till_vm_is_up of <VMFixture: ctest-TestBasicVMVN-80441926-35376694>>
AssertionError:
__cause__ = None
__class__ = <class 'AssertionError'>
__context__ = None
__delattr__ = <method-wrapper '__delattr__' of AssertionError object>
__dict__ = {}
__dir__ = <built-in method __dir__ of AssertionError object>
__doc__ = 'Assertion failed.'
__eq__ = <method-wrapper '__eq__' of AssertionError object>
__format__ = <built-in method __format__ of AssertionError object>
__ge__ = <method-wrapper '__ge__' of AssertionError object>
__getattribute__ = <method-wrapper '__getattribute__' of AssertionError object>
__gt__ = <method-wrapper '__gt__' of AssertionError object>
__hash__ = <method-wrapper '__hash__' of AssertionError object>
__init__ = <method-wrapper '__init__' of AssertionError object>
__init_subclass__ = <built-in method __init_subclass__ of type object>
__le__ = <method-wrapper '__le__' of AssertionError object>
__lt__ = <method-wrapper '__lt__' of AssertionError object>
__ne__ = <method-wrapper '__ne__' of AssertionError object>
__new__ = <built-in method __new__ of type object>
__reduce__ = <built-in method __reduce__ of AssertionError object>
__reduce_ex__ = <built-in method __reduce_ex__ of AssertionError object>
__repr__ = <method-wrapper '__repr__' of AssertionError object>
__setattr__ = <method-wrapper '__setattr__' of AssertionError object>
__setstate__ = <built-in method __setstate__ of AssertionError object>
__sizeof__ = <built-in method __sizeof__ of AssertionError object>
__str__ = <method-wrapper '__str__' of AssertionError object>
__subclasshook__ = <built-in method __subclasshook__ of type object>
__suppress_context__ = False
__traceback__ = <traceback object>
args = ()
with_traceback = <built-in method with_traceback of AssertionError object>

The above is a description of an error in a Python program. Here is
the original traceback:

Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 57, in test_metadata_service
assert vm1_fixture.wait_till_vm_is_up()
AssertionError

8.111 Log File
test_ping_within_vn_two_vms_two_different_subnets[ci_contrail_go_kolla_ocata_sanity,ci_sanity,sanity,suite1]FailureDetails

Traceback (most recent call last):
testtools.testresult.real._StringException: Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 176, in wrapper
raise TestFailed("\n ".join(errmsg))
tcutils.cores.TestFailed: Test failed: AssertionError
Python 3.6.8: /usr/bin/python3
Thu Aug 21 11:27:16 2025

A problem occurred in a Python script. Here is the sequence of
function calls leading up to the error, in the order they occurred.

/contrail-test/tcutils/wrappers.py in wrapper(self=<scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7f0e9b146908>, *args=(), **kwargs={})
78 log.info('Initial checks done. Running the testcase now')
79 log.info('')
80 result = function(self, *args, **kwargs)
81 if self.inputs.upgrade:
82 pid = os.getpid()
result = None
function = <function TestBasicVMVN.test_ping_within_vn_two_vms_two_different_subnets>
self = <scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7f0e9b146908>
args = ()
kwargs = {}

/contrail-test/scripts/vm_regression/test_vm_basic.py in test_ping_within_vn_two_vms_two_different_subnets(self=<scripts.vm_regression.test_vm_basic.TestBasicVM...anity,ci_sanity,sanity,suite1] id=0x7f0e9b146908>)
145 assert ipam_obj.verify_on_setup()
146 assert vn1_fixture.verify_on_setup()
147 assert vm1.wait_till_vm_is_up()
148 assert vm2.wait_till_vm_is_up()
149 assert vm3.wait_till_vm_is_up()
vm1 = <VMFixture: ctest-TestBasicVMVN-80441926-23375426>
vm1.wait_till_vm_is_up = <bound method VMFixture.wait_till_vm_is_up of <VMFixture: ctest-TestBasicVMVN-80441926-23375426>>
AssertionError:
__cause__ = None
__class__ = <class 'AssertionError'>
__context__ = None
__delattr__ = <method-wrapper '__delattr__' of AssertionError object>
__dict__ = {}
__dir__ = <built-in method __dir__ of AssertionError object>
__doc__ = 'Assertion failed.'
__eq__ = <method-wrapper '__eq__' of AssertionError object>
__format__ = <built-in method __format__ of AssertionError object>
__ge__ = <method-wrapper '__ge__' of AssertionError object>
__getattribute__ = <method-wrapper '__getattribute__' of AssertionError object>
__gt__ = <method-wrapper '__gt__' of AssertionError object>
__hash__ = <method-wrapper '__hash__' of AssertionError object>
__init__ = <method-wrapper '__init__' of AssertionError object>
__init_subclass__ = <built-in method __init_subclass__ of type object>
__le__ = <method-wrapper '__le__' of AssertionError object>
__lt__ = <method-wrapper '__lt__' of AssertionError object>
__ne__ = <method-wrapper '__ne__' of AssertionError object>
__new__ = <built-in method __new__ of type object>
__reduce__ = <built-in method __reduce__ of AssertionError object>
__reduce_ex__ = <built-in method __reduce_ex__ of AssertionError object>
__repr__ = <method-wrapper '__repr__' of AssertionError object>
__setattr__ = <method-wrapper '__setattr__' of AssertionError object>
__setstate__ = <built-in method __setstate__ of AssertionError object>
__sizeof__ = <built-in method __sizeof__ of AssertionError object>
__str__ = <method-wrapper '__str__' of AssertionError object>
__subclasshook__ = <built-in method __subclasshook__ of type object>
__suppress_context__ = False
__traceback__ = <traceback object>
args = ()
with_traceback = <built-in method with_traceback of AssertionError object>

The above is a description of an error in a Python program. Here is
the original traceback:

Traceback (most recent call last):
File "/contrail-test/tcutils/wrappers.py", line 80, in wrapper
result = function(self, *args, **kwargs)
File "/contrail-test/scripts/vm_regression/test_vm_basic.py", line 147, in test_ping_within_vn_two_vms_two_different_subnets
assert vm1.wait_till_vm_is_up()
AssertionError

6.811 Log File
Properties »

Back to top

TestCase

NameStatusTypeTime(s)LogFile
test_perms2_global_share[ci_sanity,sanity]Success72.654
test_perms2_owner[ci_sanity,sanity,suite1]Success9.923
test_rbac_acl_different_roles[ci_sanity,sanity,suite1]Success10.739
test_contrail_status[cb_sanity,ci_sanity,dev_sanity_dpdk,sanity]Success0.463
test_communication_between_two_sriov_vm[ci_sanity]SkippedSkipped as test is not supported if sriov_cluster=False 0.005
test_communication_between_two_sriov_vm_with_large_mtu[ci_sanity]SkippedSkipped as test is not supported if sriov_cluster=False 0.003
test_virtual_function_exhaustion_and_resue[ci_sanity]SkippedSkipped as test is not supported if sriov_cluster=False 0.003
Properties »

Back to top