2025-04-08 14:17:02,592 - INFO - Domain Default found not creating
2025-04-08 14:17:02,775 - INFO - Project ctest-AnalyticsBasicTestSanity-22466207 not found, creating it
2025-04-08 14:17:03,298 - INFO - Created Project:ctest-AnalyticsBasicTestSanity-22466207, ID : 6fd251bc-71e9-44a7-9abe-f31ac64604d5
2025-04-08 14:17:04,770 - INFO - ================================================================================
2025-04-08 14:17:04,770 - INFO - STARTING TEST : test_verify_object_logs
2025-04-08 14:17:04,770 - INFO - TEST DESCRIPTION :
Description: Test to validate object logs
1.Create vn/vm and verify object log tables updated with
those vn, vm and routing-instance - fails otherwise
Maintainer: sandipd@juniper.net
2025-04-08 14:17:04,903 - DEBUG - Nothing to compare xmpp stats {'10.0.0.24': {'10.20.0.18': '0'}} with
2025-04-08 14:17:04,903 - INFO - Initial checks done. Running the testcase now
2025-04-08 14:17:04,903 - INFO -
2025-04-08 14:17:05,812 - DEBUG - Response for create_network : {'network': {'id': 'd2c61757-2505-47f0-bbd3-22807e930d3e', 'name': 'ctest-vn22-06564921', 'tenant_id': '6fd251bc71e944a79abef31ac64604d5', 'project_id': '6fd251bc71e944a79abef31ac64604d5', 'admin_state_up': True, 'shared': False, 'status': 'ACTIVE', 'router:external': False, 'mtu': 0, 'subnets': [], 'fq_name': ['default-domain', 'ctest-AnalyticsBasicTestSanity-22466207', 'ctest-vn22-06564921'], 'port_security_enabled': True, 'description': ''}}
2025-04-08 14:17:05,998 - DEBUG - Response for create_subnet : {'subnet': {'id': '277eebd7-c8ac-470b-b604-15d1a034f2ad', 'name': '', 'tenant_id': '6fd251bc71e944a79abef31ac64604d5', 'network_id': 'd2c61757-2505-47f0-bbd3-22807e930d3e', 'ip_version': 4, 'cidr': '38.242.157.192/26', 'allocation_pools': [{'start': '38.242.157.194', 'end': '38.242.157.254'}], 'gateway_ip': '38.242.157.193', 'enable_dhcp': True, 'ipv6_ra_mode': None, 'ipv6_address_mode': None, 'dns_nameservers': [], 'host_routes': [], 'dns_server_address': '38.242.157.194', 'tags': [], 'project_id': '6fd251bc71e944a79abef31ac64604d5'}}
2025-04-08 14:17:06,020 - INFO - Created VN ctest-vn22-06564921
2025-04-08 14:17:06,074 - DEBUG - VN ctest-vn22-06564921 UUID is d2c61757-2505-47f0-bbd3-22807e930d3e
2025-04-08 14:17:06,190 - DEBUG - Requesting: http://10.0.0.24:8082/domains
2025-04-08 14:17:06,490 - DEBUG - Requesting: http://10.0.0.24:8082/domains
2025-04-08 14:17:06,521 - DEBUG - Requesting: http://10.0.0.24:8082/domain/93f3ea46-34ad-47d8-aeea-c2b4e3e1152f
2025-04-08 14:17:06,542 - DEBUG - Requesting: http://10.0.0.24:8082/project/6fd251bc-71e9-44a7-9abe-f31ac64604d5
2025-04-08 14:17:06,626 - DEBUG - Requesting: http://10.0.0.24:8082/virtual-network/d2c61757-2505-47f0-bbd3-22807e930d3e
2025-04-08 14:17:06,640 - DEBUG - Requesting: http://10.0.0.24:8082/virtual-network/d2c61757-2505-47f0-bbd3-22807e930d3e
2025-04-08 14:17:06,651 - DEBUG - Requesting: http://10.0.0.24:8082/routing-instance/d1c57562-7184-4605-a31d-74fbe8ce0a91
2025-04-08 14:17:06,661 - DEBUG - Requesting: http://10.0.0.24:8082/routing-instance/d1c57562-7184-4605-a31d-74fbe8ce0a91
2025-04-08 14:17:06,669 - DEBUG - Requesting: http://10.0.0.24:8082/route-target/05cee253-8f76-4384-b9f0-eb3e602f6558
2025-04-08 14:17:06,678 - DEBUG - Route Targets: ['target:64512:8000004']
2025-04-08 14:17:06,678 - DEBUG - Requesting: http://10.0.0.24:8082/virtual-network/d2c61757-2505-47f0-bbd3-22807e930d3e
2025-04-08 14:17:06,688 - DEBUG - Requesting: http://10.0.0.24:8082/routing-instance/d1c57562-7184-4605-a31d-74fbe8ce0a91
2025-04-08 14:17:06,707 - INFO - Verified VN network id 5 for VN d2c61757-2505-47f0-bbd3-22807e930d3e
2025-04-08 14:17:06,707 - INFO - Verifications in API Server for VN ctest-vn22-06564921 passed
2025-04-08 14:17:06,707 - DEBUG - Requesting: http://10.0.0.24:8082/virtual-network/d2c61757-2505-47f0-bbd3-22807e930d3e
2025-04-08 14:17:06,719 - DEBUG - Requesting: http://10.0.0.24:8082/routing-instance/d1c57562-7184-4605-a31d-74fbe8ce0a91
2025-04-08 14:17:06,728 - DEBUG - Requesting: http://10.0.0.24:8082/routing-instance/d1c57562-7184-4605-a31d-74fbe8ce0a91
2025-04-08 14:17:06,737 - DEBUG - Requesting: http://10.0.0.24:8082/route-target/05cee253-8f76-4384-b9f0-eb3e602f6558
2025-04-08 14:17:06,745 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921
2025-04-08 14:17:06,751 - DEBUG - Control-node 10.0.0.24 : VN object is : {'node_name': 'virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'interests': '-', 'advertised': '-', 'dbentryflags': None, 'obj_info': {'sequence_number': '0', 'origin': 'Cassandra', 'data': {'id-perms': {'permissions': {'owner': 'ctest-AnalyticsBasicTestSanity-22466207', 'owner-access': '7', 'group': 'reader', 'group-access': '7', 'other-access': '7'}, 'uuid': {'uuid-mslong': '15187852456404273136', 'uuid-lslong': '13534199240453197118'}, 'enable': 'true', 'created': '2025-04-08T14:17:05', 'last-modified': '2025-04-08T14:17:05', 'description': None, 'user-visible': 'true', 'creator': None}}}, 'neighbors': None, 'last_modified': '00:00:00.789102'}
2025-04-08 14:17:06,751 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921
2025-04-08 14:17:06,758 - DEBUG - Route Targets: ['target:64512:8000004']
2025-04-08 14:17:06,758 - INFO - On all control nodes, Config, RI and RT verification for VN ctest-vn22-06564921 passed
2025-04-08 14:17:06,759 - DEBUG - ====Verifying policy data for ctest-vn22-06564921 in API_Server ======
2025-04-08 14:17:06,759 - DEBUG - Requesting: http://10.0.0.24:8082/domains
2025-04-08 14:17:06,769 - DEBUG - Requesting: http://10.0.0.24:8082/domain/93f3ea46-34ad-47d8-aeea-c2b4e3e1152f
2025-04-08 14:17:06,782 - DEBUG - Requesting: http://10.0.0.24:8082/project/6fd251bc-71e9-44a7-9abe-f31ac64604d5
2025-04-08 14:17:06,862 - DEBUG - Requesting: http://10.0.0.24:8082/virtual-network/d2c61757-2505-47f0-bbd3-22807e930d3e
2025-04-08 14:17:06,873 - DEBUG - =>VN ctest-vn22-06564921 has no policy to be verified
2025-04-08 14:17:06,873 - DEBUG - Verifying the vn in opserver
2025-04-08 14:17:06,874 - DEBUG - Verifying the default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921 virtual network link through opserver 10.0.0.24
2025-04-08 14:17:06,874 - DEBUG - Requesting: http://10.0.0.24:8081/analytics/uves/virtual-networks
2025-04-08 14:17:07,169 - DEBUG - Requesting: http://10.0.0.24:8081/analytics/uves/virtual-networks
2025-04-08 14:17:07,230 - DEBUG - vn link and name as {'name': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'href': 'http://10.0.0.24:8081/analytics/uves/virtual-network/default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921?flat'}
2025-04-08 14:17:07,230 - INFO - Validated that VN default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921 is found in opserver
2025-04-08 14:17:07,243 - DEBUG - Do not have enough data to verify VN in agent
2025-04-08 14:17:07,248 - DEBUG - VRF ids for VN ctest-vn22-06564921: {}
2025-04-08 14:17:07,351 - DEBUG - Services list from nova: [<Service: 1>, <Service: 1>, <Service: 2>]
2025-04-08 14:17:07,463 - DEBUG - Image by name cirros not found
2025-04-08 14:17:07,463 - DEBUG - Installing image cirros
2025-04-08 14:17:07,463 - DEBUG - Image info {'name': 'cirros-0.3.0-x86_64-disk.vmdk.gz', 'webserver': '', 'location': '/images/converts/', 'username': 'cirros', 'password': 'cubswin:)', 'type': 'os', 'flavor': 'contrail_flavor_tiny', 'params': '--container-format bare --disk-format vmdk --property vmware_disktype="sparse" --property vmware_adaptertype="ide" --property hw_scsi_model=virtio-scsi --property hw_disk_bus_model=virtio-scsi --property hw_disk_bus=virtio', 'name_docker': 'phusion-baseimage-enablesshd'}
2025-04-08 14:17:07,464 - DEBUG - Image build path http://nexus.opensdn.io/repository///images/converts//cirros-0.3.0-x86_64-disk.vmdk.gz
2025-04-08 14:17:07,464 - DEBUG - Download image from web http://nexus.opensdn.io/repository///images/converts//cirros-0.3.0-x86_64-disk.vmdk.gz
2025-04-08 14:17:07,474 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: wget -nv http://nexus.opensdn.io/repository///images/converts//cirros-0.3.0-x86_64-disk.vmdk.gz -O /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk.gz
2025-04-08 14:17:07,630 - DEBUG - Image has been downloaded to /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk.gz
2025-04-08 14:17:07,631 - DEBUG - Unzip image
2025-04-08 14:17:07,631 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: gunzip -f /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk.gz
2025-04-08 14:17:07,757 - DEBUG - Try to create image in user context
2025-04-08 14:17:07,981 - DEBUG - Image has been created in user context
2025-04-08 14:17:07,981 - DEBUG - Image download (local=True) (proxy=None): Execute cmd: rm -f /contrail-test/images/cirros-0.3.0-x86_64-disk.vmdk
2025-04-08 14:17:07,996 - DEBUG - Downloaded image has been removed
2025-04-08 14:17:08,018 - DEBUG - Uploaded image status = active
2025-04-08 14:17:10,503 - INFO - VM ([<Server: ctest-AnalyticsBasicTestSanity-22466207-60228321>]) created on node: (cn-jenkins-deploy-platform-ansible-os-3053-1), Zone: (nova:cn-jenkins-deploy-platform-ansible-os-3053-1)
2025-04-08 14:17:10,545 - DEBUG - VM <Server: ctest-AnalyticsBasicTestSanity-22466207-60228321> is still in BUILD state, Expected: ACTIVE
2025-04-08 14:17:15,676 - DEBUG - VM <Server: ctest-AnalyticsBasicTestSanity-22466207-60228321> is still in BUILD state, Expected: ACTIVE
2025-04-08 14:17:20,763 - DEBUG - VM <Server: ctest-AnalyticsBasicTestSanity-22466207-60228321> is in ACTIVE state now
2025-04-08 14:17:20,763 - DEBUG - Verifying ObjectVNTable for vn default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921 on analytics node 10.0.0.24
2025-04-08 14:17:20,767 - DEBUG - Posting: http://10.0.0.24:8081/analytics/query, payload {'table': 'ObjectVNTable', 'start_time': 1744121824903480, 'end_time': 1744121840767002, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'Messagetype', 'ModuleId', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'op': 1, 'value2': None}]]}
2025-04-08 14:17:21,791 - DEBUG - Query output : [{'MessageTS': 1744121825730604, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<ContrailConfigTrace type="sandesh"><data type="struct"><ContrailConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><elements type="map"><map key="string" value="string" size="13"><element>display_name</element><element>"ctest-vn22-06564921"</element><element>fq_name</element><element>["default-domain", "ctest-AnalyticsBasicTestSanity-22466207", "ctest-vn22-06564921"]</element><element>id_perms</element><element>{"permissions": {"owner": "ctest-AnalyticsBasicTestSanity-22466207", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 15187852456404273136, "uuid_lslong": 13534199240453197118}, "enable": true, "created": "2025-04-08T14:17:05.722516", "last_modified": "2025-04-08T14:17:05.722516", "description": "", "user_visible": true, "creator": null}</element><element>is_shared</element><element>false</element><element>mtu</element><element>0</element><element>network_policy_refs</element><element>[]</element><element>parent_type</element><element>"project"</element><element>parent_uuid</element><element>"6fd251bc-71e9-44a7-9abe-f31ac64604d5"</element><element>perms2</element><element>{"owner": "6fd251bc71e944a79abef31ac64604d5", "owner_access": 7, "global_access": 0, "share": []}</element><element>port_security_enabled</element><element>true</element><element>router_external</element><element>false</element><element>uuid</element><element>"d2c61757-2505-47f0-bbd3-22807e930d3e"</element><element>virtual_network_network_id</element><element>5</element></map></elements><deleted type="bool">false</deleted></ContrailConfig></data></ContrailConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121825740891, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="0" /></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121825741318, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="0" /></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121825769587, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<RoutingInstanceCollector type="sandesh"><routing_instance type="struct"><RoutingInstanceInfo><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><instance_name type="string">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</instance_name><operation type="string" /><add_import_rt type="list"><list type="string" size="2"><element>target:10.20.0.18:6</element><element>target:64512:7999999</element></list></add_import_rt><hostname type="string">cn-jenkins-deploy-platform-ansible-os-3053-1</hostname></RoutingInstanceInfo></routing_instance><file type="string">controller/src/bgp/routing-instance/routing_instance.cc</file><line type="i32">1238</line></RoutingInstanceCollector>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}, {'MessageTS': 1744121825769611, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<RoutingInstanceCollector type="sandesh"><routing_instance type="struct"><RoutingInstanceInfo><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><instance_name type="string">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</instance_name><operation type="string">Add</operation><family type="string">inet</family><hostname type="string">cn-jenkins-deploy-platform-ansible-os-3053-1</hostname></RoutingInstanceInfo></routing_instance><file type="string">controller/src/bgp/routing-instance/routing_instance.cc</file><line type="i32">1718</line></RoutingInstanceCollector>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}, {'MessageTS': 1744121825769739, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<RoutingInstanceCollector type="sandesh"><routing_instance type="struct"><RoutingInstanceInfo><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><instance_name type="string">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</instance_name><operation type="string">Add</operation><family type="string">inet6</family><hostname type="string">cn-jenkins-deploy-platform-ansible-os-3053-1</hostname></RoutingInstanceInfo></routing_instance><file type="string">controller/src/bgp/routing-instance/routing_instance.cc</file><line type="i32">1718</line></RoutingInstanceCollector>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}, {'MessageTS': 1744121825769867, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<RoutingInstanceCollector type="sandesh"><routing_instance type="struct"><RoutingInstanceInfo><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><instance_name type="string">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</instance_name><operation type="string">Add</operation><family type="string">erm-vpn</family><hostname type="string">cn-jenkins-deploy-platform-ansible-os-3053-1</hostname></RoutingInstanceInfo></routing_instance><file type="string">controller/src/bgp/routing-instance/routing_instance.cc</file><line type="i32">1718</line></RoutingInstanceCollector>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}, {'MessageTS': 1744121825769970, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<RoutingInstanceCollector type="sandesh"><routing_instance type="struct"><RoutingInstanceInfo><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><instance_name type="string">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</instance_name><operation type="string">Add</operation><family type="string">e-vpn</family><hostname type="string">cn-jenkins-deploy-platform-ansible-os-3053-1</hostname></RoutingInstanceInfo></routing_instance><file type="string">controller/src/bgp/routing-instance/routing_instance.cc</file><line type="i32">1718</line></RoutingInstanceCollector>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}, {'MessageTS': 1744121825770070, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<RoutingInstanceCollector type="sandesh"><routing_instance type="struct"><RoutingInstanceInfo><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><instance_name type="string">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</instance_name><operation type="string">Add</operation><family type="string">inet-mvpn</family><hostname type="string">cn-jenkins-deploy-platform-ansible-os-3053-1</hostname></RoutingInstanceInfo></routing_instance><file type="string">controller/src/bgp/routing-instance/routing_instance.cc</file><line type="i32">1718</line></RoutingInstanceCollector>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}, {'MessageTS': 1744121825828600, 'Messagetype': 'RoutingInstanceCollector', 'ModuleId': 'contrail-control', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<RoutingInstanceCollector type="sandesh"><routing_instance type="struct"><RoutingInstanceInfo><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><instance_name type="string">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</instance_name><route_distinguisher type="string">10.20.0.18:6</route_distinguisher><operation type="string" /><add_import_rt type="list"><list type="string" size="1"><element>target:64512:8000004</element></list></add_import_rt><add_export_rt type="list"><list type="string" size="1"><element>target:64512:8000004</element></list></add_export_rt><hostname type="string">cn-jenkins-deploy-platform-ansible-os-3053-1</hostname></RoutingInstanceInfo></routing_instance><file type="string">controller/src/bgp/routing-instance/routing_instance.cc</file><line type="i32">1390</line></RoutingInstanceCollector>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}, {'MessageTS': 1744121825862779, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="1"><element>default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</element></list></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121825863244, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="1"><element>default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</element></list></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121825958236, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="1"><element>default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</element></list></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121825958623, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="1"><element>default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</element></list></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121825961840, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<ContrailConfigTrace type="sandesh"><data type="struct"><ContrailConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><elements type="map"><map key="string" value="string" size="13"><element>display_name</element><element>"ctest-vn22-06564921"</element><element>fq_name</element><element>["default-domain", "ctest-AnalyticsBasicTestSanity-22466207", "ctest-vn22-06564921"]</element><element>id_perms</element><element>{"permissions": {"owner": "ctest-AnalyticsBasicTestSanity-22466207", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 15187852456404273136, "uuid_lslong": 13534199240453197118}, "enable": true, "created": "2025-04-08T14:17:05.722516", "last_modified": "2025-04-08T14:17:05.950527", "description": "", "user_visible": true, "creator": null}</element><element>is_shared</element><element>false</element><element>mtu</element><element>0</element><element>network_ipam_refs</element><element>[{"to": ["default-domain", "default-project", "default-network-ipam"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "38.242.157.192", "ip_prefix_len": 26}, "default_gateway": "38.242.157.193", "dns_server_address": "38.242.157.194", "subnet_uuid": "277eebd7-c8ac-470b-b604-15d1a034f2ad", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": "", "alloc_unit": 1, "created": "2025-04-08T14:17:05.936196", "last_modified": "2025-04-08T14:17:05.936196", "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "b24f010f-9fdd-4d09-a075-75efd8cc58e0"}]</element><element>parent_type</element><element>"project"</element><element>parent_uuid</element><element>"6fd251bc-71e9-44a7-9abe-f31ac64604d5"</element><element>perms2</element><element>{"owner": "6fd251bc71e944a79abef31ac64604d5", "owner_access": 7, "global_access": 0, "share": []}</element><element>port_security_enabled</element><element>true</element><element>router_external</element><element>false</element><element>uuid</element><element>"d2c61757-2505-47f0-bbd3-22807e930d3e"</element><element>virtual_network_network_id</element><element>5</element></map></elements><deleted type="bool">false</deleted></ContrailConfig></data></ContrailConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121831659427, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="1"><element>default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</element></list></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121831659662, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="1"><element>default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</element></list></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121831675831, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="1"><element>default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</element></list></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121831676088, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="1"><element>default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</element></list></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121831751295, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="1"><element>default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</element></list></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121831751533, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="1"><element>default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</element></list></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121832250390, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="1"><element>default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</element></list></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121832250675, 'Messagetype': 'UveVirtualNetworkConfigTrace', 'ModuleId': 'contrail-schema', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<UveVirtualNetworkConfigTrace type="sandesh"><data type="struct"><UveVirtualNetworkConfig><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><connected_networks type="list" aggtype="union"><list type="string" size="0" /></connected_networks><partially_connected_networks type="list" aggtype="union"><list type="string" size="0" /></partially_connected_networks><routing_instance_list type="list" aggtype="union"><list type="string" size="1"><element>default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</element></list></routing_instance_list><total_acl_rules type="i32">0</total_acl_rules></UveVirtualNetworkConfig></data></UveVirtualNetworkConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121835163518, 'Messagetype': 'VnObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<VnObjectLog type="sandesh"><vn type="struct"><VnObjectLogInfo><event type="string">Addition </event><uuid type="string">d2c61757-2505-47f0-bbd3-22807e930d3e</uuid><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><ipam_list type="list"><list type="struct" size="1"><VnObjectLogIpam><ip_prefix type="string">38.242.157.192</ip_prefix><prefix_len type="i32">26</prefix_len><gateway_ip type="string">38.242.157.193</gateway_ip><ipam_name type="string">default-domain:default-project:default-network-ipam</ipam_name><dhcp_enable type="string">true</dhcp_enable><dns_server type="string">38.242.157.194</dns_server><dhcp_enable_v6 type="string">true</dhcp_enable_v6></VnObjectLogIpam></list></ipam_list><ipv4_forwarding type="bool">true</ipv4_forwarding><bridging type="bool">true</bridging><admin_state type="bool">true</admin_state></VnObjectLogInfo></vn><file type="string">controller/src/vnsw/agent/oper/vn.cc</file><line type="i32">1391</line></VnObjectLog>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}, {'MessageTS': 1744121835169956, 'Messagetype': 'VnObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921', 'ObjectLog': '<VnObjectLog type="sandesh"><vn type="struct"><VnObjectLogInfo><event type="string">Modification </event><uuid type="string">d2c61757-2505-47f0-bbd3-22807e930d3e</uuid><name type="string" key="ObjectVNTable">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921</name><vrf type="string">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</vrf><ipam_list type="list"><list type="struct" size="1"><VnObjectLogIpam><ip_prefix type="string">38.242.157.192</ip_prefix><prefix_len type="i32">26</prefix_len><gateway_ip type="string">38.242.157.193</gateway_ip><ipam_name type="string">default-domain:default-project:default-network-ipam</ipam_name><dhcp_enable type="string">true</dhcp_enable><dns_server type="string">38.242.157.194</dns_server><dhcp_enable_v6 type="string">true</dhcp_enable_v6></VnObjectLogIpam></list></ipam_list><ipv4_forwarding type="bool">true</ipv4_forwarding><bridging type="bool">true</bridging><admin_state type="bool">true</admin_state></VnObjectLogInfo></vn><file type="string">controller/src/vnsw/agent/oper/vn.cc</file><line type="i32">1391</line></VnObjectLog>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}]
2025-04-08 14:17:21,791 - DEBUG - Verifying ObjectVMTable for vm 983b5d7f-36ea-41f8-85e7-b65618501af1 on analytics node 10.0.0.24
2025-04-08 14:17:21,791 - DEBUG - Posting: http://10.0.0.24:8081/analytics/query, payload {'table': 'ObjectVMTable', 'start_time': 1744121824903480, 'end_time': 1744121841791543, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': '983b5d7f-36ea-41f8-85e7-b65618501af1', 'op': 1, 'value2': None}]]}
2025-04-08 14:17:22,818 - DEBUG - Query output : [{'MessageTS': 1744121831568884, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': '983b5d7f-36ea-41f8-85e7-b65618501af1', 'ObjectLog': '<ContrailConfigTrace type="sandesh"><data type="struct"><ContrailConfig><name type="string" key="ObjectVMTable">983b5d7f-36ea-41f8-85e7-b65618501af1</name><elements type="map"><map key="string" value="string" size="6"><element>display_name</element><element>"983b5d7f-36ea-41f8-85e7-b65618501af1"</element><element>fq_name</element><element>["983b5d7f-36ea-41f8-85e7-b65618501af1"]</element><element>id_perms</element><element>{"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 10969464118354526712, "uuid_lslong": 9648881207555922673}, "enable": true, "created": "2025-04-08T14:17:11.562376", "last_modified": "2025-04-08T14:17:11.562376", "description": null, "user_visible": true, "creator": null}</element><element>perms2</element><element>{"owner": "6fd251bc-71e9-44a7-9abe-f31ac64604d5", "owner_access": 7, "global_access": 0, "share": []}</element><element>server_type</element><element>"virtual-server"</element><element>uuid</element><element>"983b5d7f-36ea-41f8-85e7-b65618501af1"</element></map></elements><deleted type="bool">false</deleted></ContrailConfig></data></ContrailConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121835122330, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '983b5d7f-36ea-41f8-85e7-b65618501af1', 'ObjectLog': '<VmObjectLog type="sandesh"><vm type="struct"><VmObjectLogInfo><event type="string">Addition </event><uuid type="string" key="ObjectVMTable">983b5d7f-36ea-41f8-85e7-b65618501af1</uuid><ref_count type="i32">0</ref_count></VmObjectLogInfo></vm><file type="string">controller/src/vnsw/agent/oper/vm.cc</file><line type="i32">141</line></VmObjectLog>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}, {'MessageTS': 1744121835133260, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '983b5d7f-36ea-41f8-85e7-b65618501af1', 'ObjectLog': '<VmObjectLog type="sandesh"><vm type="struct"><VmObjectLogInfo><event type="string">Modification </event><uuid type="string" key="ObjectVMTable">983b5d7f-36ea-41f8-85e7-b65618501af1</uuid><ref_count type="i32">1</ref_count></VmObjectLogInfo></vm><file type="string">controller/src/vnsw/agent/oper/vm.cc</file><line type="i32">141</line></VmObjectLog>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}]
2025-04-08 14:17:22,818 - DEBUG - Verifying ObjectRoutingInstance for RI default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921 on analytics node 10.0.0.24
2025-04-08 14:17:22,818 - DEBUG - Posting: http://10.0.0.24:8081/analytics/query, payload {'table': 'ObjectRoutingInstance', 'start_time': 1744121824903480, 'end_time': 1744121842818255, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921', 'op': 1, 'value2': None}]]}
2025-04-08 14:17:23,837 - DEBUG - Query output : [{'MessageTS': 1744121835163597, 'Messagetype': 'VrfObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921', 'ObjectLog': '<VrfObjectLog type="sandesh"><vrf type="struct"><VrfObjectLogInfo><event type="string">Addition </event><name type="string" key="ObjectRoutingInstance">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</name><index type="i32">2</index></VrfObjectLogInfo></vrf><file type="string">controller/src/vnsw/agent/oper/vrf.cc</file><line type="i32">414</line></VrfObjectLog>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}]
2025-04-08 14:17:23,837 - DEBUG - Verifying ObjectVMTable for vm 983b5d7f-36ea-41f8-85e7-b65618501af1 on analytics node 10.0.0.24
2025-04-08 14:17:23,837 - DEBUG - Posting: http://10.0.0.24:8081/analytics/query, payload {'table': 'ObjectVMTable', 'start_time': 1744121824903480, 'end_time': 1744121843837283, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': '983b5d7f-36ea-41f8-85e7-b65618501af1', 'op': 1, 'value2': None}]]}
2025-04-08 14:17:24,867 - DEBUG - Query output : [{'MessageTS': 1744121831568884, 'Messagetype': 'ContrailConfigTrace', 'ModuleId': 'contrail-api', 'ObjectId': '983b5d7f-36ea-41f8-85e7-b65618501af1', 'ObjectLog': '<ContrailConfigTrace type="sandesh"><data type="struct"><ContrailConfig><name type="string" key="ObjectVMTable">983b5d7f-36ea-41f8-85e7-b65618501af1</name><elements type="map"><map key="string" value="string" size="6"><element>display_name</element><element>"983b5d7f-36ea-41f8-85e7-b65618501af1"</element><element>fq_name</element><element>["983b5d7f-36ea-41f8-85e7-b65618501af1"]</element><element>id_perms</element><element>{"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 10969464118354526712, "uuid_lslong": 9648881207555922673}, "enable": true, "created": "2025-04-08T14:17:11.562376", "last_modified": "2025-04-08T14:17:11.562376", "description": null, "user_visible": true, "creator": null}</element><element>perms2</element><element>{"owner": "6fd251bc-71e9-44a7-9abe-f31ac64604d5", "owner_access": 7, "global_access": 0, "share": []}</element><element>server_type</element><element>"virtual-server"</element><element>uuid</element><element>"983b5d7f-36ea-41f8-85e7-b65618501af1"</element></map></elements><deleted type="bool">false</deleted></ContrailConfig></data></ContrailConfigTrace>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1.', 'SystemLog': None}, {'MessageTS': 1744121835122330, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '983b5d7f-36ea-41f8-85e7-b65618501af1', 'ObjectLog': '<VmObjectLog type="sandesh"><vm type="struct"><VmObjectLogInfo><event type="string">Addition </event><uuid type="string" key="ObjectVMTable">983b5d7f-36ea-41f8-85e7-b65618501af1</uuid><ref_count type="i32">0</ref_count></VmObjectLogInfo></vm><file type="string">controller/src/vnsw/agent/oper/vm.cc</file><line type="i32">141</line></VmObjectLog>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}, {'MessageTS': 1744121835133260, 'Messagetype': 'VmObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': '983b5d7f-36ea-41f8-85e7-b65618501af1', 'ObjectLog': '<VmObjectLog type="sandesh"><vm type="struct"><VmObjectLogInfo><event type="string">Modification </event><uuid type="string" key="ObjectVMTable">983b5d7f-36ea-41f8-85e7-b65618501af1</uuid><ref_count type="i32">1</ref_count></VmObjectLogInfo></vm><file type="string">controller/src/vnsw/agent/oper/vm.cc</file><line type="i32">141</line></VmObjectLog>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}]
2025-04-08 14:17:24,867 - DEBUG - Verifying ObjectRoutingInstance for RI default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921 on analytics node 10.0.0.24
2025-04-08 14:17:24,867 - DEBUG - Posting: http://10.0.0.24:8081/analytics/query, payload {'table': 'ObjectRoutingInstance', 'start_time': 1744121824903480, 'end_time': 1744121844867836, 'select_fields': ['ObjectId', 'Source', 'ObjectLog', 'SystemLog', 'ModuleId', 'Messagetype', 'MessageTS'], 'where': [[{'name': 'ObjectId', 'value': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921', 'op': 1, 'value2': None}]]}
2025-04-08 14:17:25,892 - DEBUG - Query output : [{'MessageTS': 1744121835163597, 'Messagetype': 'VrfObjectLog', 'ModuleId': 'contrail-vrouter-agent', 'ObjectId': 'default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921', 'ObjectLog': '<VrfObjectLog type="sandesh"><vrf type="struct"><VrfObjectLogInfo><event type="string">Addition </event><name type="string" key="ObjectRoutingInstance">default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921</name><index type="i32">2</index></VrfObjectLogInfo></vrf><file type="string">controller/src/vnsw/agent/oper/vrf.cc</file><line type="i32">414</line></VrfObjectLog>', 'Source': 'cn-jenkins-deploy-platform-ansible-os-3053-1', 'SystemLog': None}]
2025-04-08 14:17:25,892 - INFO - Validated ObjectVNTable, ObjectRoutingInstance, ObjectVMTable logs
2025-04-08 14:17:25,892 - INFO - Deleting VM ctest-AnalyticsBasicTestSanity-22466207-60228321
2025-04-08 14:17:26,040 - INFO - Deleting VN ctest-vn22-06564921
2025-04-08 14:17:26,087 - DEBUG - VN d2c61757-2505-47f0-bbd3-22807e930d3e still in use: Unable to complete operation on network d2c61757-2505-47f0-bbd3-22807e930d3e. There are one or more ports still in use on the network.
Neutron server returns request_ids: ['req-e5010fe5-fdb1-49f8-ae37-f4feda26149c']
2025-04-08 14:17:26,087 - WARNING - Deleting VN ctest-vn22-06564921 failed..Will retry
2025-04-08 14:17:28,216 - DEBUG - Response for deleting network ()
2025-04-08 14:17:28,216 - DEBUG - Requesting: http://10.0.0.24:8082/routing-instance/d1c57562-7184-4605-a31d-74fbe8ce0a91
2025-04-08 14:17:28,225 - DEBUG - Response Code: 404
2025-04-08 14:17:28,226 - DEBUG - Requesting: http://10.0.0.24:8082/domains
2025-04-08 14:17:28,235 - DEBUG - Requesting: http://10.0.0.24:8082/domain/93f3ea46-34ad-47d8-aeea-c2b4e3e1152f
2025-04-08 14:17:28,292 - DEBUG - Requesting: http://10.0.0.24:8082/project/6fd251bc-71e9-44a7-9abe-f31ac64604d5
2025-04-08 14:17:28,373 - INFO - Validated that VN ctest-vn22-06564921 is not found in API Server
2025-04-08 14:17:28,388 - DEBUG - VN ctest-vn22-06564921 is not present in Agent 10.0.0.24
2025-04-08 14:17:28,388 - INFO - Validated that VN ctest-vn22-06564921 is not in any agent
2025-04-08 14:17:28,395 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921:ctest-vn22-06564921
2025-04-08 14:17:28,403 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-22466207:ctest-vn22-06564921
2025-04-08 14:17:28,412 - INFO - Validated that Routing instances and Config db in Control-nodes does not have VN ctest-vn22-06564921 info
2025-04-08 14:17:28,542 - DEBUG - No XMPP flaps were noticed during the test
2025-04-08 14:17:28,542 - INFO - END TEST : test_verify_object_logs : PASSED[0:00:24]
2025-04-08 14:17:28,542 - INFO - --------------------------------------------------------------------------------
2025-04-08 14:17:29,265 - INFO - Deleted project: ctest-AnalyticsBasicTestSanity-22466207, ID : 6fd251bc-71e9-44a7-9abe-f31ac64604d5
2025-04-08 14:17:35,252 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-FloatingipBasicTestSanity-44610156:ctest-fvn-57498652
2025-04-08 14:17:35,258 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-FloatingipBasicTestSanity-44610156:ctest-fvn-57498652:ctest-fvn-57498652
2025-04-08 14:17:36,636 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-FloatingipBasicTestSanity-44610156:ctest-vn1-96529925
2025-04-08 14:17:36,642 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-FloatingipBasicTestSanity-44610156:ctest-vn1-96529925:ctest-vn1-96529925
2025-04-08 14:17:39,920 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-44610156:ctest-fvn-57498652:ctest-some-pool-80340513
2025-04-08 14:17:52,966 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRtGroupReq?x=target:64512:8000004
2025-04-08 14:17:56,213 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=floating-ip-pool&search_string=floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-44610156:ctest-fvn-57498652:ctest-some-pool-80340513
2025-04-08 14:17:58,735 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-FloatingipBasicTestSanity-44610156:ctest-vn1-96529925:ctest-vn1-96529925
2025-04-08 14:17:58,741 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-FloatingipBasicTestSanity-44610156:ctest-vn1-96529925
2025-04-08 14:17:59,047 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-FloatingipBasicTestSanity-44610156:ctest-fvn-57498652:ctest-fvn-57498652
2025-04-08 14:17:59,054 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-FloatingipBasicTestSanity-44610156:ctest-fvn-57498652
2025-04-08 14:18:38,889 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-32829311:ctest-vn-65086112
2025-04-08 14:18:38,895 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-32829311:ctest-vn-65086112:ctest-vn-65086112
2025-04-08 14:18:39,599 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-32829311:ctest-vn-80776007
2025-04-08 14:18:39,606 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-32829311:ctest-vn-80776007:ctest-vn-80776007
2025-04-08 14:18:40,382 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-32829311:ctest-vn-80776007:ctest-vn-80776007
2025-04-08 14:18:40,388 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-32829311:ctest-vn-80776007
2025-04-08 14:18:40,679 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicyIpv4v6-32829311:ctest-vn-65086112:ctest-vn-65086112
2025-04-08 14:18:40,685 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicyIpv4v6-32829311:ctest-vn-65086112
2025-04-08 14:18:46,965 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicy-91290993:ctest-vn-87852813
2025-04-08 14:18:46,972 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicy-91290993:ctest-vn-87852813:ctest-vn-87852813
2025-04-08 14:18:47,684 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicy-91290993:ctest-vn-44952289
2025-04-08 14:18:47,690 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicy-91290993:ctest-vn-44952289:ctest-vn-44952289
2025-04-08 14:19:13,528 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicy-91290993:ctest-vn-44952289:ctest-vn-44952289
2025-04-08 14:19:13,534 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicy-91290993:ctest-vn-44952289
2025-04-08 14:19:13,830 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicPolicy-91290993:ctest-vn-87852813:ctest-vn-87852813
2025-04-08 14:19:13,836 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicPolicy-91290993:ctest-vn-87852813
2025-04-08 14:19:18,951 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-56318067:ctest-mgmt_vn-97494781
2025-04-08 14:19:18,960 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-56318067:ctest-mgmt_vn-97494781:ctest-mgmt_vn-97494781
2025-04-08 14:19:20,259 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-56318067:ctest-left_vn-94512919
2025-04-08 14:19:20,267 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-56318067:ctest-left_vn-94512919:ctest-left_vn-94512919
2025-04-08 14:19:21,226 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-56318067:ctest-right_vn-77031633
2025-04-08 14:19:21,234 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-56318067:ctest-right_vn-77031633:ctest-right_vn-77031633
2025-04-08 14:20:31,424 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-56318067:ctest-right_vn-77031633:ctest-right_vn-77031633
2025-04-08 14:20:31,430 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-56318067:ctest-right_vn-77031633
2025-04-08 14:20:31,706 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-56318067:ctest-left_vn-94512919:ctest-left_vn-94512919
2025-04-08 14:20:31,712 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-56318067:ctest-left_vn-94512919
2025-04-08 14:20:31,995 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestSvcRegr-56318067:ctest-mgmt_vn-97494781:ctest-mgmt_vn-97494781
2025-04-08 14:20:32,001 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestSvcRegr-56318067:ctest-mgmt_vn-97494781
2025-04-08 14:20:37,086 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-DNS&search_string=virtual-DNS:default-domain:ctest-vdns1-48316408
2025-04-08 14:21:15,108 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-DNS-record&search_string=virtual-DNS-record:default-domain:ctest-vdns1-48316408:test-rec
2025-04-08 14:21:23,129 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-DNS&search_string=virtual-DNS:default-domain:ctest-vdns1-48316408
2025-04-08 14:22:43,660 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=network-ipam&search_string=network-ipam:default-domain:ctest-TestBasicVMVN-40422831:ctest-ipam-78902876
2025-04-08 14:22:44,059 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicVMVN-40422831:ctest-vn-51410915
2025-04-08 14:22:44,090 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicVMVN-40422831:ctest-vn-51410915:ctest-vn-51410915
2025-04-08 14:23:17,314 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicVMVN-40422831:ctest-vn-51410915:ctest-vn-51410915
2025-04-08 14:23:17,320 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=virtual-network&search_string=virtual-network:default-domain:ctest-TestBasicVMVN-40422831:ctest-vn-51410915
2025-04-08 14:23:17,402 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_ShowRoutingInstanceReq?name=default-domain:ctest-TestBasicVMVN-40422831:ctest-ipam-78902876:ctest-ipam-78902876
2025-04-08 14:23:17,408 - DEBUG - Requesting: http://10.0.0.24:8083/Snh_IFMapTableShowReq?table_name=network-ipam&search_string=network-ipam:default-domain:ctest-TestBasicVMVN-40422831:ctest-ipam-78902876