2025-08-04 03:45:02,721 - INFO - Domain Default found not creating 2025-08-04 03:45:02,886 - INFO - Project ctest-FatFlowAggr-38379963 not found, creating it 2025-08-04 03:45:03,613 - INFO - Created Project:ctest-FatFlowAggr-38379963, ID : 3a45dc2b-bd80-4710-82ea-ae2eec2e6bc3 2025-08-04 03:45:07,358 - INFO - ================================================================================ 2025-08-04 03:45:07,359 - INFO - STARTING TEST : test_fat_flow_aggr_dest_icmp_intra_vn_inter_node 2025-08-04 03:45:07,359 - INFO - TEST DESCRIPTION : : Description: Verify fat flow prefix aggr dest (IPv4) for intra-vn inter-node Steps: 1. Create 1 VN and launch 3 VMs.2 client VMs on same node and server VM on different node. Client 1 in subnet 1, Client 2 in the next subnet. 2. On server VM, config fat flow aggr prefix dest len 25 for ICMP port 0. 3. From both the client VMs, send ICMP traffic to the server VM twice with diff. src ports Pass criteria: 1. On the remote CN, expect 2 pairs ( 1 for client 1, 1 for client 2) of fat flows with prefix aggregated for the src IPs (VM to fabric, Prefix Aggr Dest: Aggregation happens for SRC IPs) 2. On client VM compute nodes, expect 4 pairs of flows and on server compute, expect 2 pairs of flows 3. On server compute node, flow's source port should be 0 for fat flows Maintainer: Ankitja@juniper.net 2025-08-04 03:45:08,651 - DEBUG - Nothing to compare xmpp stats {'10.0.0.41': {'10.20.0.18': '0', '10.20.0.129': '0'}, '10.0.0.57': {'10.20.0.193': '0', '10.20.0.18': '0'}} with 2025-08-04 03:45:08,651 - INFO - Initial checks done. Running the testcase now 2025-08-04 03:45:08,651 - INFO - 2025-08-04 03:45:08,683 - DEBUG - Services list from nova: [, , , ] 2025-08-04 03:45:08,683 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3750-2', 'an-jenkins-deploy-platform-ansible-os-3750-1']} 2025-08-04 03:45:09,371 - DEBUG - Response for create_network : {'network': {'id': 'b3495f20-418c-4d5b-a943-df8b2886f8c8', 'name': 'ctest-vn-79481846', 'tenant_id': '3a45dc2bbd80471082eaae2eec2e6bc3', 'project_id': '3a45dc2bbd80471082eaae2eec2e6bc3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FatFlowAggr-38379963', 'ctest-vn-79481846'], 'port_security_enabled': True, 'description': ''}} 2025-08-04 03:45:09,654 - DEBUG - Response for create_subnet : {'subnet': {'id': 'f56f1abf-1c1b-4b27-a88c-5c50c6bbbbe9', 'name': '', 'tenant_id': '3a45dc2bbd80471082eaae2eec2e6bc3', 'network_id': 'b3495f20-418c-4d5b-a943-df8b2886f8c8', 'ip_version': 4, 'cidr': '63.50.146.64/26', 'allocation_pools': [{'start': '63.50.146.66', 'end': '63.50.146.126'}], 'gateway_ip': '63.50.146.65', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '63.50.146.66', 'tags': [], 'project_id': '3a45dc2bbd80471082eaae2eec2e6bc3'}} 2025-08-04 03:45:09,683 - INFO - Created VN ctest-vn-79481846 2025-08-04 03:45:09,699 - DEBUG - VN ctest-vn-79481846 UUID is b3495f20-418c-4d5b-a943-df8b2886f8c8 2025-08-04 03:45:09,992 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-04 03:45:10,297 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-04 03:45:10,334 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1 2025-08-04 03:45:10,360 - DEBUG - Requesting: http://10.0.0.27:8082/project/3a45dc2b-bd80-4710-82ea-ae2eec2e6bc3 2025-08-04 03:45:10,483 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b3495f20-418c-4d5b-a943-df8b2886f8c8 2025-08-04 03:45:10,501 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b3495f20-418c-4d5b-a943-df8b2886f8c8 2025-08-04 03:45:10,514 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4b3a928a-7dec-4bca-8d9f-bd3ffda7dd15 2025-08-04 03:45:10,525 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4b3a928a-7dec-4bca-8d9f-bd3ffda7dd15 2025-08-04 03:45:10,537 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/473df267-fe19-4404-bbb1-d171961bf14a 2025-08-04 03:45:10,547 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/d6d8d097-3f84-4e09-a879-9e5d958ad137 2025-08-04 03:45:10,556 - DEBUG - Route Targets: ['target:64512:8000005', 'target:64512:10000'] 2025-08-04 03:45:10,556 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b3495f20-418c-4d5b-a943-df8b2886f8c8 2025-08-04 03:45:10,573 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4b3a928a-7dec-4bca-8d9f-bd3ffda7dd15 2025-08-04 03:45:10,599 - INFO - Verified VN network id 13 for VN b3495f20-418c-4d5b-a943-df8b2886f8c8 2025-08-04 03:45:10,599 - INFO - Verifications in API Server for VN ctest-vn-79481846 passed 2025-08-04 03:45:10,599 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b3495f20-418c-4d5b-a943-df8b2886f8c8 2025-08-04 03:45:10,613 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4b3a928a-7dec-4bca-8d9f-bd3ffda7dd15 2025-08-04 03:45:10,625 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4b3a928a-7dec-4bca-8d9f-bd3ffda7dd15 2025-08-04 03:45:10,642 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/473df267-fe19-4404-bbb1-d171961bf14a 2025-08-04 03:45:10,655 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/d6d8d097-3f84-4e09-a879-9e5d958ad137 2025-08-04 03:45:10,686 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggr-38379963', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12918961598232284507', 'uuid-lslong': '12196838004622817480'}, 'enable': 'true', 'created': '2025-08-04T03:45:09', 'last-modified': '2025-08-04T03:45:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.830267'} 2025-08-04 03:45:10,702 - DEBUG - Route Targets: ['target:64512:8000005', 'target:64512:10000'] 2025-08-04 03:45:10,711 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggr-38379963', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12918961598232284507', 'uuid-lslong': '12196838004622817480'}, 'enable': 'true', 'created': '2025-08-04T03:45:09', 'last-modified': '2025-08-04T03:45:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.866825'} 2025-08-04 03:45:10,720 - DEBUG - Route Targets: ['target:64512:8000005', 'target:64512:10000'] 2025-08-04 03:45:10,728 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowAggr-38379963', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '12918961598232284507', 'uuid-lslong': '12196838004622817480'}, 'enable': 'true', 'created': '2025-08-04T03:45:09', 'last-modified': '2025-08-04T03:45:09', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.876406'} 2025-08-04 03:45:10,741 - DEBUG - Route Targets: ['target:64512:8000005', 'target:64512:10000'] 2025-08-04 03:45:10,741 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-79481846 passed 2025-08-04 03:45:10,741 - DEBUG - ====Verifying policy data for ctest-vn-79481846 in API_Server ====== 2025-08-04 03:45:10,741 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-04 03:45:10,750 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1 2025-08-04 03:45:10,768 - DEBUG - Requesting: http://10.0.0.27:8082/project/3a45dc2b-bd80-4710-82ea-ae2eec2e6bc3 2025-08-04 03:45:10,877 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/b3495f20-418c-4d5b-a943-df8b2886f8c8 2025-08-04 03:45:10,888 - DEBUG - =>VN ctest-vn-79481846 has no policy to be verified 2025-08-04 03:45:10,888 - DEBUG - Verifying the vn in opserver 2025-08-04 03:45:10,889 - DEBUG - Verifying the default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846 virtual network link through opserver 10.0.0.27 2025-08-04 03:45:10,889 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-04 03:45:11,203 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks 2025-08-04 03:45:11,270 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846?flat'} 2025-08-04 03:45:11,270 - DEBUG - Verifying the default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846 virtual network link through opserver 10.0.0.38 2025-08-04 03:45:11,270 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-04 03:45:11,587 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks 2025-08-04 03:45:11,659 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846?flat'} 2025-08-04 03:45:11,659 - DEBUG - Verifying the default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846 virtual network link through opserver 10.0.0.61 2025-08-04 03:45:11,659 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-08-04 03:45:11,959 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks 2025-08-04 03:45:12,023 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846?flat'} 2025-08-04 03:45:12,023 - INFO - Validated that VN default-domain:ctest-FatFlowAggr-38379963:ctest-vn-79481846 is found in opserver 2025-08-04 03:45:12,049 - DEBUG - Do not have enough data to verify VN in agent 2025-08-04 03:45:12,061 - DEBUG - VRF ids for VN ctest-vn-79481846: {} 2025-08-04 03:45:12,107 - DEBUG - Hosts: {'nova': ['an-jenkins-deploy-platform-ansible-os-3750-2', 'an-jenkins-deploy-platform-ansible-os-3750-1']} 2025-08-04 03:45:12,185 - DEBUG - Image by name ubuntu not found 2025-08-04 03:45:12,185 - DEBUG - Installing image ubuntu 2025-08-04 03:45:12,185 - DEBUG - Image info {'name': 'ubuntu.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'ubuntu', 'password': 'ubuntu', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'} 2025-08-04 03:45:12,186 - DEBUG - Image build path file:///contrail-test/images/ubuntu.vmdk.gz 2025-08-04 03:45:12,186 - DEBUG - Download image from local file file:///contrail-test/images/ubuntu.vmdk.gz 2025-08-04 03:45:12,186 - DEBUG - Unzip image 2025-08-04 03:45:12,186 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/ubuntu.vmdk.gz 2025-08-04 03:45:12,209 - INFO - image /contrail-test/images/ubuntu.vmdk is not found 2025-08-04 03:45:12,209 - DEBUG - Deleting RT for VN ctest-vn-79481846 2025-08-04 03:45:12,336 - INFO - Deleting VN ctest-vn-79481846 2025-08-04 03:45:12,522 - DEBUG - Response for deleting network () 2025-08-04 03:45:12,522 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/4b3a928a-7dec-4bca-8d9f-bd3ffda7dd15 2025-08-04 03:45:12,529 - DEBUG - Response Code: 404 2025-08-04 03:45:12,529 - DEBUG - Requesting: http://10.0.0.27:8082/domains 2025-08-04 03:45:12,537 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1 2025-08-04 03:45:12,595 - DEBUG - Requesting: http://10.0.0.27:8082/project/3a45dc2b-bd80-4710-82ea-ae2eec2e6bc3 2025-08-04 03:45:12,693 - INFO - Validated that VN ctest-vn-79481846 is not found in API Server 2025-08-04 03:45:12,709 - DEBUG - VN ctest-vn-79481846 is not present in Agent 10.0.0.41 2025-08-04 03:45:12,722 - DEBUG - VN ctest-vn-79481846 is not present in Agent 10.0.0.57 2025-08-04 03:45:12,722 - INFO - Validated that VN ctest-vn-79481846 is not in any agent 2025-08-04 03:45:12,765 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn-79481846 info 2025-08-04 03:45:14,066 - DEBUG - No XMPP flaps were noticed during the test 2025-08-04 03:45:14,066 - INFO - 2025-08-04 03:45:14,066 - INFO - END TEST : test_fat_flow_aggr_dest_icmp_intra_vn_inter_node : SKIPPED[0:00:07] 2025-08-04 03:45:14,066 - INFO - -------------------------------------------------------------------------------- 2025-08-04 03:45:14,852 - INFO - Deleted project: ctest-FatFlowAggr-38379963, ID : 3a45dc2b-bd80-4710-82ea-ae2eec2e6bc3