2025-08-04 04:47:40,072 - INFO - Domain Default found not creating
2025-08-04 04:47:40,251 - INFO - Project ctest-FatFlowSerialIpv6-90074200 not found, creating it
2025-08-04 04:47:40,856 - INFO - Created Project:ctest-FatFlowSerialIpv6-90074200, ID : 1ff426d4-22fb-44d7-83f0-beb0188912c3
2025-08-04 04:47:42,376 - INFO - ================================================================================
2025-08-04 04:47:42,376 - INFO - STARTING TEST : test_fat_flow_intra_vn_inter_node
2025-08-04 04:47:42,376 - INFO - TEST DESCRIPTION :
Description: Verify Fat flow for intra-VN inter-Node traffic
Steps:
1. create 1 VN and launch 3 VMs in it.client VMs on same node and server VM on different node.
2. on server VM, config Fat flow for udp port 53.
3. from both client VM, send UDP traffic to server on port 53 twice with diff. src ports
Pass criteria:
1. on client VMs compute, 4 set of flows and on server compute, 2 set of flows should be created
2. on server compute, flow's source port should be 0 for Fat flow
2025-08-04 04:47:43,636 - DEBUG - Skipping xmpp flap check
2025-08-04 04:47:43,637 - INFO - Initial checks done. Running the testcase now
2025-08-04 04:47:43,637 - INFO -
2025-08-04 04:47:44,331 - DEBUG - Response for create_network : {'network': {'id': '1387ace7-8a56-4de5-a042-561b143536e4', 'name': 'ctest-vn-26556175', 'tenant_id': '1ff426d422fb44d783f0beb0188912c3', 'project_id': '1ff426d422fb44d783f0beb0188912c3', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FatFlowSerialIpv6-90074200', 'ctest-vn-26556175'], 'port_security_enabled': True, 'description': ''}}
2025-08-04 04:47:44,582 - DEBUG - Response for create_subnet : {'subnet': {'id': '83dba9ab-e28f-4a0d-9421-06b3e84bc614', 'name': '', 'tenant_id': '1ff426d422fb44d783f0beb0188912c3', 'network_id': '1387ace7-8a56-4de5-a042-561b143536e4', 'ip_version': 4, 'cidr': '177.175.215.0/26', 'allocation_pools': [{'start': '177.175.215.2', 'end': '177.175.215.62'}], 'gateway_ip': '177.175.215.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '177.175.215.2', 'tags': [], 'project_id': '1ff426d422fb44d783f0beb0188912c3'}}
2025-08-04 04:47:44,834 - DEBUG - Response for create_subnet : {'subnet': {'id': 'da7d3ab5-8684-46e9-9c13-f906eb724a26', 'name': '', 'tenant_id': '1ff426d422fb44d783f0beb0188912c3', 'network_id': '1387ace7-8a56-4de5-a042-561b143536e4', 'ip_version': 6, 'cidr': '25c3:7475:a388:c441:ce93:54ad::/96', 'allocation_pools': [{'start': '25c3:7475:a388:c441:ce93:54ad:0:2', 'end': '25c3:7475:a388:c441:ce93:54ad:ffff:fffe'}], 'gateway_ip': '25c3:7475:a388:c441:ce93:54ad:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '25c3:7475:a388:c441:ce93:54ad:0:2', 'tags': [], 'project_id': '1ff426d422fb44d783f0beb0188912c3'}}
2025-08-04 04:47:44,865 - INFO - Created VN ctest-vn-26556175
2025-08-04 04:47:44,887 - DEBUG - VN ctest-vn-26556175 UUID is 1387ace7-8a56-4de5-a042-561b143536e4
2025-08-04 04:47:44,999 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 04:47:45,318 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 04:47:45,353 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 04:47:45,373 - DEBUG - Requesting: http://10.0.0.27:8082/project/1ff426d4-22fb-44d7-83f0-beb0188912c3
2025-08-04 04:47:45,478 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1387ace7-8a56-4de5-a042-561b143536e4
2025-08-04 04:47:45,494 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1387ace7-8a56-4de5-a042-561b143536e4
2025-08-04 04:47:45,508 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/56ac317b-7e94-4702-8153-c90edc407afa
2025-08-04 04:47:45,521 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/56ac317b-7e94-4702-8153-c90edc407afa
2025-08-04 04:47:45,546 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/f50dfe07-300a-4a49-91f9-043c09f0c8da
2025-08-04 04:47:45,560 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 04:47:45,560 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1387ace7-8a56-4de5-a042-561b143536e4
2025-08-04 04:47:45,573 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/56ac317b-7e94-4702-8153-c90edc407afa
2025-08-04 04:47:45,593 - INFO - Verified VN network id 6 for VN 1387ace7-8a56-4de5-a042-561b143536e4
2025-08-04 04:47:45,594 - INFO - Verifications in API Server for VN ctest-vn-26556175 passed
2025-08-04 04:47:45,594 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1387ace7-8a56-4de5-a042-561b143536e4
2025-08-04 04:47:45,607 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/56ac317b-7e94-4702-8153-c90edc407afa
2025-08-04 04:47:45,621 - DEBUG - Requesting: http://10.0.0.27:8082/routing-instance/56ac317b-7e94-4702-8153-c90edc407afa
2025-08-04 04:47:45,633 - DEBUG - Requesting: http://10.0.0.27:8082/route-target/f50dfe07-300a-4a49-91f9-043c09f0c8da
2025-08-04 04:47:45,650 - DEBUG - Control-node 10.0.0.27 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowSerialIpv6-90074200', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1407283519034904037', 'uuid-lslong': '11547887068834510564'}, 'enable': 'true', 'created': '2025-08-04T04:47:44', 'last-modified': '2025-08-04T04:47:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.864602'}
2025-08-04 04:47:45,660 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 04:47:45,668 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowSerialIpv6-90074200', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1407283519034904037', 'uuid-lslong': '11547887068834510564'}, 'enable': 'true', 'created': '2025-08-04T04:47:44', 'last-modified': '2025-08-04T04:47:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.886526'}
2025-08-04 04:47:45,677 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 04:47:45,687 - DEBUG - Control-node 10.0.0.61 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowSerialIpv6-90074200', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '1407283519034904037', 'uuid-lslong': '11547887068834510564'}, 'enable': 'true', 'created': '2025-08-04T04:47:44', 'last-modified': '2025-08-04T04:47:44', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.909157'}
2025-08-04 04:47:45,698 - DEBUG - Route Targets: ['target:64512:8000005']
2025-08-04 04:47:45,698 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-26556175 passed
2025-08-04 04:47:45,698 - DEBUG - ====Verifying policy data for ctest-vn-26556175 in API_Server ======
2025-08-04 04:47:45,698 - DEBUG - Requesting: http://10.0.0.27:8082/domains
2025-08-04 04:47:45,706 - DEBUG - Requesting: http://10.0.0.27:8082/domain/8d00e278-1e00-4abc-a644-cc23d080d5d1
2025-08-04 04:47:45,722 - DEBUG - Requesting: http://10.0.0.27:8082/project/1ff426d4-22fb-44d7-83f0-beb0188912c3
2025-08-04 04:47:45,825 - DEBUG - Requesting: http://10.0.0.27:8082/virtual-network/1387ace7-8a56-4de5-a042-561b143536e4
2025-08-04 04:47:45,842 - DEBUG - =>VN ctest-vn-26556175 has no policy to be verified
2025-08-04 04:47:45,843 - DEBUG - Verifying the vn in opserver
2025-08-04 04:47:45,843 - DEBUG - Verifying the default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175 virtual network link through opserver 10.0.0.27
2025-08-04 04:47:45,843 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 04:47:46,163 - DEBUG - Requesting: http://10.0.0.27:8081/analytics/uves/virtual-networks
2025-08-04 04:47:46,230 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175', 'href': 'http://10.0.0.27:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175?flat'}
2025-08-04 04:47:46,230 - DEBUG - Verifying the default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175 virtual network link through opserver 10.0.0.38
2025-08-04 04:47:46,230 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 04:47:46,541 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2025-08-04 04:47:46,611 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175?flat'}
2025-08-04 04:47:46,611 - DEBUG - Verifying the default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175 virtual network link through opserver 10.0.0.61
2025-08-04 04:47:46,611 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 04:47:46,908 - DEBUG - Requesting: http://10.0.0.61:8081/analytics/uves/virtual-networks
2025-08-04 04:47:46,976 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175', 'href': 'http://10.0.0.61:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175?flat'}
2025-08-04 04:47:46,976 - INFO - Validated that VN default-domain:ctest-FatFlowSerialIpv6-90074200:ctest-vn-26556175 is found in opserver
2025-08-04 04:47:47,014 - DEBUG - Do not have enough data to verify VN in agent
2025-08-04 04:47:47,036 - DEBUG - VRF ids for VN ctest-vn-26556175: {}
2025-08-04 04:47:47,071 - DEBUG - Services list from nova: [