2025-08-03 00:20:39,623 - INFO - Domain Default found not creating
2025-08-03 00:20:39,777 - INFO - Project ctest-FatFlowAggr-07712140 not found, creating it
2025-08-03 00:20:40,455 - INFO - Created Project:ctest-FatFlowAggr-07712140, ID : 4810d878-43d8-4703-ae32-fd3109603968
2025-08-03 00:20:41,966 - INFO - ================================================================================
2025-08-03 00:20:41,967 - INFO - STARTING TEST : test_fat_flow_aggr_dest_icmp_intra_vn_inter_node
2025-08-03 00:20:41,967 - INFO - TEST DESCRIPTION : :
Description: Verify fat flow prefix aggr dest (IPv4) for intra-vn inter-node
Steps:
1. Create 1 VN and launch 3 VMs.2 client VMs on same node and server VM on different node.
Client 1 in subnet 1, Client 2 in the next subnet.
2. On server VM, config fat flow aggr prefix dest len 25 for ICMP port 0.
3. From both the client VMs, send ICMP traffic to the server VM twice with diff. src ports
Pass criteria:
1. On the remote CN, expect 2 pairs ( 1 for client 1, 1 for client 2)
of fat flows with prefix aggregated for the src IPs
(VM to fabric, Prefix Aggr Dest: Aggregation happens for SRC IPs)
2. On client VM compute nodes, expect 4 pairs of flows and on server compute,
expect 2 pairs of flows
3. On server compute node, flow's source port should be 0 for fat flows
Maintainer: Ankitja@juniper.net
2025-08-03 00:20:43,335 - DEBUG - Nothing to compare xmpp stats {'10.0.0.48': {'10.20.0.17': '0', '10.20.0.14': '0'}, '10.0.0.49': {'10.20.0.17': '0', '10.20.0.14': '0'}} with
2025-08-03 00:20:43,335 - INFO - Initial checks done. Running the testcase now
2025-08-03 00:20:43,335 - INFO -
2025-08-03 00:20:43,363 - DEBUG - Services list from nova: [, , , ]
2025-08-03 00:20:43,363 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']}
2025-08-03 00:20:44,226 - DEBUG - Response for create_network : {'network': {'id': '539ada5c-3af4-40ad-b78a-d312b132de3b', 'name': 'ctest-vn-54934743', 'tenant_id': '4810d87843d84703ae32fd3109603968', 'project_id': '4810d87843d84703ae32fd3109603968', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FatFlowAggr-07712140', 'ctest-vn-54934743'], 'port_security_enabled': True, 'description': ''}}
2025-08-03 00:20:44,745 - DEBUG - Response for create_subnet : {'subnet': {'id': '858ffd21-516d-4beb-9adf-37d68be1ab7a', 'name': '', 'tenant_id': '4810d87843d84703ae32fd3109603968', 'network_id': '539ada5c-3af4-40ad-b78a-d312b132de3b', 'ip_version': 4, 'cidr': '90.20.0.64/26', 'allocation_pools': [{'start': '90.20.0.66', 'end': '90.20.0.126'}], 'gateway_ip': '90.20.0.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '90.20.0.66', 'tags': [], 'project_id': '4810d87843d84703ae32fd3109603968'}}
2025-08-03 00:20:44,772 - INFO - Created VN ctest-vn-54934743
2025-08-03 00:20:44,797 - DEBUG - VN ctest-vn-54934743 UUID is 539ada5c-3af4-40ad-b78a-d312b132de3b
2025-08-03 00:20:45,180 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-03 00:20:45,510 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-03 00:20:45,548 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028
2025-08-03 00:20:45,575 - DEBUG - Requesting: http://10.0.0.38:8082/project/4810d878-43d8-4703-ae32-fd3109603968
2025-08-03 00:20:45,690 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/539ada5c-3af4-40ad-b78a-d312b132de3b
2025-08-03 00:20:45,708 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/539ada5c-3af4-40ad-b78a-d312b132de3b
2025-08-03 00:20:45,721 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/7e7f08ee-22db-4fa4-8e40-546942287dc9
2025-08-03 00:20:45,733 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/7e7f08ee-22db-4fa4-8e40-546942287dc9
2025-08-03 00:20:45,743 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/5b3c0f50-b772-41f9-baa4-0fb37c0a119f
2025-08-03 00:20:45,753 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/ca613b40-7d55-44d7-96fc-8e95e3d247f0
2025-08-03 00:20:45,763 - DEBUG - Route Targets: ['target:64512:8000005', 'target:64512:10000']
2025-08-03 00:20:45,763 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/539ada5c-3af4-40ad-b78a-d312b132de3b
2025-08-03 00:20:45,777 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/7e7f08ee-22db-4fa4-8e40-546942287dc9
2025-08-03 00:20:45,798 - INFO - Verified VN network id 12 for VN 539ada5c-3af4-40ad-b78a-d312b132de3b
2025-08-03 00:20:45,799 - INFO - Verifications in API Server for VN ctest-vn-54934743 passed
2025-08-03 00:20:45,799 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/539ada5c-3af4-40ad-b78a-d312b132de3b
2025-08-03 00:20:45,815 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/7e7f08ee-22db-4fa4-8e40-546942287dc9
2025-08-03 00:20:45,826 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/7e7f08ee-22db-4fa4-8e40-546942287dc9
2025-08-03 00:20:45,840 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/5b3c0f50-b772-41f9-baa4-0fb37c0a119f
2025-08-03 00:20:45,850 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/ca613b40-7d55-44d7-96fc-8e95e3d247f0
2025-08-03 00:20:45,871 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggr-07712140', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6024367541222391981', 'uuid-lslong': '13225615332962655803'}, 'enable': 'true', 'created': '2025-08-03T00:20:44', 'last-modified': '2025-08-03T00:20:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.881820'}
2025-08-03 00:20:45,881 - DEBUG - Route Targets: ['target:64512:8000005', 'target:64512:10000']
2025-08-03 00:20:45,891 - DEBUG - Control-node 10.0.0.254 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggr-07712140', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6024367541222391981', 'uuid-lslong': '13225615332962655803'}, 'enable': 'true', 'created': '2025-08-03T00:20:44', 'last-modified': '2025-08-03T00:20:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.878752'}
2025-08-03 00:20:45,901 - DEBUG - Route Targets: ['target:64512:8000005', 'target:64512:10000']
2025-08-03 00:20:45,913 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggr-07712140', 'owner-access': '7', 'group': 'member', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '6024367541222391981', 'uuid-lslong': '13225615332962655803'}, 'enable': 'true', 'created': '2025-08-03T00:20:44', 'last-modified': '2025-08-03T00:20:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.929265'}
2025-08-03 00:20:45,926 - DEBUG - Route Targets: ['target:64512:8000005', 'target:64512:10000']
2025-08-03 00:20:45,926 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-54934743 passed
2025-08-03 00:20:45,927 - DEBUG - ====Verifying policy data for ctest-vn-54934743 in API_Server ======
2025-08-03 00:20:45,927 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-03 00:20:45,935 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028
2025-08-03 00:20:45,956 - DEBUG - Requesting: http://10.0.0.38:8082/project/4810d878-43d8-4703-ae32-fd3109603968
2025-08-03 00:20:46,075 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/539ada5c-3af4-40ad-b78a-d312b132de3b
2025-08-03 00:20:46,092 - DEBUG - =>VN ctest-vn-54934743 has no policy to be verified
2025-08-03 00:20:46,092 - DEBUG - Verifying the vn in opserver
2025-08-03 00:20:46,092 - DEBUG - Verifying the default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743 virtual network link through opserver 10.0.0.38
2025-08-03 00:20:46,092 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-03 00:20:46,389 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-03 00:20:46,455 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743?flat'}
2025-08-03 00:20:46,455 - DEBUG - Verifying the default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743 virtual network link through opserver 10.0.0.254
2025-08-03 00:20:46,455 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-08-03 00:20:46,766 - DEBUG - Requesting: http://10.0.0.254:8081/analytics/uves/virtual-networks
2025-08-03 00:20:46,840 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743', 'href': 'http://10.0.0.254:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743?flat'}
2025-08-03 00:20:46,840 - DEBUG - Verifying the default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743 virtual network link through opserver 10.0.0.50
2025-08-03 00:20:46,840 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-08-03 00:20:47,139 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2025-08-03 00:20:47,230 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743?flat'}
2025-08-03 00:20:47,230 - INFO - Validated that VN default-domain:ctest-FatFlowAggr-07712140:ctest-vn-54934743 is found in opserver
2025-08-03 00:20:47,259 - DEBUG - Do not have enough data to verify VN in agent
2025-08-03 00:20:47,271 - DEBUG - VRF ids for VN ctest-vn-54934743: {}
2025-08-03 00:20:47,333 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3743-2', 'an-jenkins-deploy-platform-ansible-os-3743-1']}
2025-08-03 00:20:47,405 - DEBUG - Image by name ubuntu not found
2025-08-03 00:20:47,405 - DEBUG - Installing image ubuntu
2025-08-03 00:20:47,405 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-08-03 00:20:47,405 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz
2025-08-03 00:20:47,406 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz
2025-08-03 00:20:47,406 - DEBUG - Unzip image
2025-08-03 00:20:47,406 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz
2025-08-03 00:20:47,429 - INFO - image /contrail-test/images/ubuntu.vmdk is not found
2025-08-03 00:20:47,429 - DEBUG - Deleting RT for VN ctest-vn-54934743
2025-08-03 00:20:47,646 - INFO - Deleting VN ctest-vn-54934743
2025-08-03 00:20:47,797 - DEBUG - Response for deleting network ()
2025-08-03 00:20:47,797 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/7e7f08ee-22db-4fa4-8e40-546942287dc9
2025-08-03 00:20:47,804 - DEBUG - Response Code: 404
2025-08-03 00:20:47,804 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2025-08-03 00:20:47,811 - DEBUG - Requesting: http://10.0.0.38:8082/domain/e48a4202-dd3d-4b87-9406-48f7b2154028
2025-08-03 00:20:47,824 - DEBUG - Requesting: http://10.0.0.38:8082/project/4810d878-43d8-4703-ae32-fd3109603968
2025-08-03 00:20:47,917 - INFO - Validated that VN ctest-vn-54934743 is not found in API Server
2025-08-03 00:20:47,931 - DEBUG - VN ctest-vn-54934743 is not present in Agent 10.0.0.48
2025-08-03 00:20:47,945 - DEBUG - VN ctest-vn-54934743 is not present in Agent 10.0.0.49
2025-08-03 00:20:47,945 - INFO - Validated that VN ctest-vn-54934743 is not in any agent
2025-08-03 00:20:47,981 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-54934743 info
2025-08-03 00:20:49,280 - DEBUG - No XMPP flaps were noticed during the test
2025-08-03 00:20:49,280 - INFO -
2025-08-03 00:20:49,280 - INFO - END TEST : test_fat_flow_aggr_dest_icmp_intra_vn_inter_node : SKIPPED[0:00:08]
2025-08-03 00:20:49,280 - INFO - --------------------------------------------------------------------------------
2025-08-03 00:20:50,118 - INFO - Deleted project: ctest-FatFlowAggr-07712140, ID : 4810d878-43d8-4703-ae32-fd3109603968