2026-01-22 03:30:50,612 - INFO - Domain Default found not creating
2026-01-22 03:30:50,789 - INFO - Project ctest-FatFlowSerialIpv6-91873717 not found, creating it
2026-01-22 03:30:51,311 - INFO - Created Project:ctest-FatFlowSerialIpv6-91873717, ID : 5c5ce578-7bdd-499a-be95-c6cda8b7eea6
2026-01-22 03:30:52,885 - INFO - ================================================================================
2026-01-22 03:30:52,885 - INFO - STARTING TEST : test_fat_flow_intra_vn_inter_node
2026-01-22 03:30:52,885 - INFO - TEST DESCRIPTION :
Description: Verify Fat flow for intra-VN inter-Node traffic
Steps:
1. create 1 VN and launch 3 VMs in it.client VMs on same node and server VM on different node.
2. on server VM, config Fat flow for udp port 53.
3. from both client VM, send UDP traffic to server on port 53 twice with diff. src ports
Pass criteria:
1. on client VMs compute, 4 set of flows and on server compute, 2 set of flows should be created
2. on server compute, flow's source port should be 0 for Fat flow
2026-01-22 03:30:53,520 - DEBUG - Skipping xmpp flap check
2026-01-22 03:30:53,521 - INFO - Initial checks done. Running the testcase now
2026-01-22 03:30:53,521 - INFO -
2026-01-22 03:30:54,256 - DEBUG - Response for create_network : {'network': {'id': '7cfcfb0a-8333-4a22-867e-dcb1cd4f25d7', 'name': 'ctest-vn-42482309', 'tenant_id': '5c5ce5787bdd499abe95c6cda8b7eea6', 'project_id': '5c5ce5787bdd499abe95c6cda8b7eea6', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-FatFlowSerialIpv6-91873717', 'ctest-vn-42482309'], 'port_security_enabled': True, 'description': ''}}
2026-01-22 03:30:54,560 - DEBUG - Response for create_subnet : {'subnet': {'id': '4ca858d1-bc43-4580-88de-c6b212d6d347', 'name': '', 'tenant_id': '5c5ce5787bdd499abe95c6cda8b7eea6', 'network_id': '7cfcfb0a-8333-4a22-867e-dcb1cd4f25d7', 'ip_version': 4, 'cidr': '17.106.8.0/26', 'allocation_pools': [{'start': '17.106.8.2', 'end': '17.106.8.62'}], 'gateway_ip': '17.106.8.1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '17.106.8.2', 'tags': [], 'project_id': '5c5ce5787bdd499abe95c6cda8b7eea6'}}
2026-01-22 03:30:54,778 - DEBUG - Response for create_subnet : {'subnet': {'id': '21deffe1-132c-4f7e-b662-84f25b95522f', 'name': '', 'tenant_id': '5c5ce5787bdd499abe95c6cda8b7eea6', 'network_id': '7cfcfb0a-8333-4a22-867e-dcb1cd4f25d7', 'ip_version': 6, 'cidr': '2cd4:8b9c:e3f4:ebb4:dc97:f547::/96', 'allocation_pools': [{'start': '2cd4:8b9c:e3f4:ebb4:dc97:f547:0:2', 'end': '2cd4:8b9c:e3f4:ebb4:dc97:f547:ffff:fffe'}], 'gateway_ip': '2cd4:8b9c:e3f4:ebb4:dc97:f547:0:1', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '2cd4:8b9c:e3f4:ebb4:dc97:f547:0:2', 'tags': [], 'project_id': '5c5ce5787bdd499abe95c6cda8b7eea6'}}
2026-01-22 03:30:54,802 - INFO - Created VN ctest-vn-42482309
2026-01-22 03:30:54,815 - DEBUG - VN ctest-vn-42482309 UUID is 7cfcfb0a-8333-4a22-867e-dcb1cd4f25d7
2026-01-22 03:30:54,918 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:30:55,239 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:30:55,273 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:30:55,291 - DEBUG - Requesting: http://10.0.0.38:8082/project/5c5ce578-7bdd-499a-be95-c6cda8b7eea6
2026-01-22 03:30:55,392 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7cfcfb0a-8333-4a22-867e-dcb1cd4f25d7
2026-01-22 03:30:55,409 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7cfcfb0a-8333-4a22-867e-dcb1cd4f25d7
2026-01-22 03:30:55,419 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ab2d9817-054c-43b6-9b86-d3bfa6102f24
2026-01-22 03:30:55,427 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ab2d9817-054c-43b6-9b86-d3bfa6102f24
2026-01-22 03:30:55,433 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/7746a7b9-67fb-4c59-a56c-72d06dc84274
2026-01-22 03:30:55,440 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:30:55,440 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7cfcfb0a-8333-4a22-867e-dcb1cd4f25d7
2026-01-22 03:30:55,455 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ab2d9817-054c-43b6-9b86-d3bfa6102f24
2026-01-22 03:30:55,471 - INFO - Verified VN network id 14 for VN 7cfcfb0a-8333-4a22-867e-dcb1cd4f25d7
2026-01-22 03:30:55,471 - INFO - Verifications in API Server for VN ctest-vn-42482309 passed
2026-01-22 03:30:55,471 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7cfcfb0a-8333-4a22-867e-dcb1cd4f25d7
2026-01-22 03:30:55,485 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ab2d9817-054c-43b6-9b86-d3bfa6102f24
2026-01-22 03:30:55,492 - DEBUG - Requesting: http://10.0.0.38:8082/routing-instance/ab2d9817-054c-43b6-9b86-d3bfa6102f24
2026-01-22 03:30:55,499 - DEBUG - Requesting: http://10.0.0.38:8082/route-target/7746a7b9-67fb-4c59-a56c-72d06dc84274
2026-01-22 03:30:55,512 - DEBUG - Control-node 10.0.0.38 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowSerialIpv6-91873717', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9006349377403570722', 'uuid-lslong': '9691426104359724503'}, 'enable': 'true', 'created': '2026-01-22T03:30:54', 'last-modified': '2026-01-22T03:30:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.802276'}
2026-01-22 03:30:55,518 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:30:55,525 - DEBUG - Control-node 10.0.0.50 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowSerialIpv6-91873717', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9006349377403570722', 'uuid-lslong': '9691426104359724503'}, 'enable': 'true', 'created': '2026-01-22T03:30:54', 'last-modified': '2026-01-22T03:30:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.815971'}
2026-01-22 03:30:55,531 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:30:55,536 - DEBUG - Control-node 10.0.0.131 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-FatFlowSerialIpv6-91873717', 'owner-access': '7', 'group': 'admin', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '9006349377403570722', 'uuid-lslong': '9691426104359724503'}, 'enable': 'true', 'created': '2026-01-22T03:30:54', 'last-modified': '2026-01-22T03:30:54', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.826680'}
2026-01-22 03:30:55,542 - DEBUG - Route Targets: ['target:64512:8000006']
2026-01-22 03:30:55,542 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn-42482309 passed
2026-01-22 03:30:55,542 - DEBUG - ====Verifying policy data for ctest-vn-42482309 in API_Server ======
2026-01-22 03:30:55,542 - DEBUG - Requesting: http://10.0.0.38:8082/domains
2026-01-22 03:30:55,549 - DEBUG - Requesting: http://10.0.0.38:8082/domain/43eea14e-faa6-4579-85d2-09c8cc682740
2026-01-22 03:30:55,565 - DEBUG - Requesting: http://10.0.0.38:8082/project/5c5ce578-7bdd-499a-be95-c6cda8b7eea6
2026-01-22 03:30:55,663 - DEBUG - Requesting: http://10.0.0.38:8082/virtual-network/7cfcfb0a-8333-4a22-867e-dcb1cd4f25d7
2026-01-22 03:30:55,675 - DEBUG - =>VN ctest-vn-42482309 has no policy to be verified
2026-01-22 03:30:55,675 - DEBUG - Verifying the vn in opserver
2026-01-22 03:30:55,675 - DEBUG - Verifying the default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309 virtual network link through opserver 10.0.0.38
2026-01-22 03:30:55,675 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:30:55,991 - DEBUG - Requesting: http://10.0.0.38:8081/analytics/uves/virtual-networks
2026-01-22 03:30:56,074 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309', 'href': 'http://10.0.0.38:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309?flat'}
2026-01-22 03:30:56,074 - DEBUG - Verifying the default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309 virtual network link through opserver 10.0.0.50
2026-01-22 03:30:56,075 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:30:56,377 - DEBUG - Requesting: http://10.0.0.50:8081/analytics/uves/virtual-networks
2026-01-22 03:30:56,445 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309', 'href': 'http://10.0.0.50:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309?flat'}
2026-01-22 03:30:56,445 - DEBUG - Verifying the default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309 virtual network link through opserver 10.0.0.131
2026-01-22 03:30:56,445 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:30:56,748 - DEBUG - Requesting: http://10.0.0.131:8081/analytics/uves/virtual-networks
2026-01-22 03:30:56,814 - DEBUG - vn link and name as {'name': 'default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309', 'href': 'http://10.0.0.131:8081/analytics/uves/virtual-network/default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309?flat'}
2026-01-22 03:30:56,815 - INFO - Validated that VN default-domain:ctest-FatFlowSerialIpv6-91873717:ctest-vn-42482309 is found in opserver
2026-01-22 03:30:56,839 - DEBUG - Do not have enough data to verify VN in agent
2026-01-22 03:30:56,850 - DEBUG - VRF ids for VN ctest-vn-42482309: {}
2026-01-22 03:30:56,878 - DEBUG - Services list from nova: [