2025-01-27 Mon 02:08:59:814.882 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.18:49792 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-27 Mon 02:09:21:872.837 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:37790::10.0.0.37:8086(-1) OnSessionEvent TCP Connection Closed 2025-01-27 Mon 02:09:21:872.871 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:37790::10.0.0.37:8086(-1):EvTcpClose 2025-01-27 Mon 02:09:21:872.923 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Processing scm::EvTcpClose in state Established 2025-01-27 Mon 02:09:21:872.936 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Established : EvTcpClose 2025-01-27 Mon 02:09:21:873.232 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Connect : Start Connect timer 10.0.0.22:8086 2025-01-27 Mon 02:09:21:873.329 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:21:873.580 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: SANDESH: Send FAILED: 1737943761873060 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Established successful_connections = 1 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = cn-jenkins-deploy-platform-ansible-os-2660-1. collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 183600 calls = 16 average_bytes = 11475 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16, _iter59->first = sent _iter59->second = 19, ] ] ] 2025-01-27 Mon 02:09:21:873.606 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:21:873.618 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:21:873.642 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: SANDESH: Send FAILED: 1737943761873098 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Established : EvTcpClose -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:21:873.650 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:09:21:873.658 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Processing scm::EvTcpDeleteSession in state Connect 2025-01-27 Mon 02:09:21:873.693 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:21:873.912 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: SANDESH: Send FAILED: 1737943761873314 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 1 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 183600 calls = 16 average_bytes = 11475 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16, _iter59->first = sent _iter59->second = 19, ] ] ] 2025-01-27 Mon 02:09:21:873.929 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:21:876.752 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.32:34896::10.0.0.22:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-27 Mon 02:09:21:876.773 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:34896::10.0.0.22:8086(-1) OnSessionEvent TCP Connected 2025-01-27 Mon 02:09:21:876.781 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:34896::10.0.0.22:8086(-1):EvTcpConnected 2025-01-27 Mon 02:09:21:878.888 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvTcpConnected in state Connect 2025-01-27 Mon 02:09:21:878.933 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-27 Mon 02:09:21:879.002 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ClientInit 2025-01-27 Mon 02:09:21:879.041 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2660-2:contrail-dns:0:Control count 2 2025-01-27 Mon 02:09:21:879.211 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:21:879.222 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-27 Mon 02:09:21:879.251 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: SANDESH: Send FAILED: 1737943761878987 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:21:879.260 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Received UVE message in wrong state : NodeStatusUVE 2025-01-27 Mon 02:09:21:879.269 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:21:879.276 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-27 Mon 02:09:21:879.290 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:21:879.296 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-27 Mon 02:09:21:879.561 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: SANDESH: Send FAILED: 1737943761879191 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 2 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 183600 calls = 16 average_bytes = 11475 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 19, _iter59->first = sent _iter59->second = 19, ] ] ] 2025-01-27 Mon 02:09:21:879.588 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-27 Mon 02:09:21:950.872 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: OnMessage control in state: ClientInit 2025-01-27 Mon 02:09:21:950.925 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-01-27 Mon 02:09:21:950.935 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: ClientInit : EvSandeshMessageRecv 2025-01-27 Mon 02:09:21:950.960 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Received Ctrl Message with size 0 2025-01-27 Mon 02:09:21:950.979 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2660-2 start_time = 1737943610590515 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-23 00:10:21.736348","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7558-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.37:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.8, ] ] proxy seq 1 2025-01-27 Mon 02:09:21:950.992 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-01-27 Mon 02:09:21:951.315 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 2 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 183600 calls = 16 average_bytes = 11475 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 33 dequeues = 33 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 37 dequeues = 37 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Established state_since = 1737943648954064 last_state = Established last_event = scm::EvSandeshSend last_event_at = 1737943708831239 ] session_stats= [ num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 17 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] session_tx_socket_stats= [ bytes = 148295 calls = 14 average_bytes = 10592 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 8 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 19, _iter59->first = sent _iter59->second = 19, ] ] max_sm_queue_count = 5 proxy seq 17 2025-01-27 Mon 02:09:21:951.359 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-01-27 Mon 02:09:21:951.385 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 14 2025-01-27 Mon 02:09:21:951.398 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-01-27 Mon 02:09:21:951.410 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-01-27 Mon 02:09:21:951.418 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-01-27 Mon 02:09:21:951.427 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-01-27 Mon 02:09:21:951.461 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Established 2025-01-27 Mon 02:09:22:081.477 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.32:34896::10.0.0.22:8086(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-27 Mon 02:09:22:081.525 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:34896::10.0.0.22:8086(-1) OnSessionEvent TCP Connection Closed 2025-01-27 Mon 02:09:22:081.534 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:34896::10.0.0.22:8086(-1):EvTcpClose 2025-01-27 Mon 02:09:22:081.585 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Processing scm::EvTcpClose in state Established 2025-01-27 Mon 02:09:22:081.596 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Established : EvTcpClose 2025-01-27 Mon 02:09:22:081.883 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Connect : Start Connect timer 10.0.0.32:8086 2025-01-27 Mon 02:09:22:081.972 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:22:082.231 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: SANDESH: Send FAILED: 1737943762081704 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Established successful_connections = 2 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = cn-jenkins-deploy-platform-ansible-os-2660-3. collector_ip = 10.0.0.32:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 259471 calls = 22 average_bytes = 11794 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1441, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 21, _iter59->first = sent _iter59->second = 26, ] ] ] 2025-01-27 Mon 02:09:22:082.253 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:22:082.267 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:22:082.291 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: SANDESH: Send FAILED: 1737943762081738 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Established : EvTcpClose -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:22:082.298 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:09:22:082.307 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Processing scm::EvTcpDeleteSession in state Connect 2025-01-27 Mon 02:09:22:082.335 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:22:082.570 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: SANDESH: Send FAILED: 1737943762081956 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 2 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.32:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 259471 calls = 22 average_bytes = 11794 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1441, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 21, _iter59->first = sent _iter59->second = 26, ] ] ] 2025-01-27 Mon 02:09:22:082.590 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:22:084.724 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.32:48032::10.0.0.32:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-27 Mon 02:09:22:084.742 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:48032::10.0.0.32:8086(-1) OnSessionEvent TCP Connected 2025-01-27 Mon 02:09:22:084.750 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:48032::10.0.0.32:8086(-1):EvTcpConnected 2025-01-27 Mon 02:09:22:086.176 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvTcpConnected in state Connect 2025-01-27 Mon 02:09:22:086.192 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-27 Mon 02:09:22:086.242 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ClientInit 2025-01-27 Mon 02:09:22:086.256 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2660-2:contrail-dns:0:Control count 3 2025-01-27 Mon 02:09:22:086.400 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:22:086.412 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-27 Mon 02:09:22:086.449 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943762086234 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.32:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:22:086.463 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Received UVE message in wrong state : NodeStatusUVE 2025-01-27 Mon 02:09:22:086.473 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:22:086.480 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-27 Mon 02:09:22:086.506 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:22:086.514 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-27 Mon 02:09:22:086.825 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943762086386 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 3 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.32:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 259471 calls = 22 average_bytes = 11794 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1442, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 24, _iter59->first = sent _iter59->second = 26, ] ] ] 2025-01-27 Mon 02:09:22:086.847 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-27 Mon 02:09:22:092.514 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:48032::10.0.0.32:8086(-1) OnSessionEvent TCP Connection Closed 2025-01-27 Mon 02:09:22:092.535 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:48032::10.0.0.32:8086(-1):EvTcpClose 2025-01-27 Mon 02:09:22:092.987 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvTcpClose in state ClientInit 2025-01-27 Mon 02:09:22:092.998 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ClientInit : EvTcpClose 2025-01-27 Mon 02:09:22:093.148 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Return to idle with 5000 2025-01-27 Mon 02:09:22:093.158 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Idle 2025-01-27 Mon 02:09:22:093.238 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:22:093.505 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943762093089 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 3 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 261081 calls = 23 average_bytes = 11351 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1442, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 26, _iter59->first = sent _iter59->second = 27, ] ] ] 2025-01-27 Mon 02:09:22:093.527 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:22:093.538 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:22:093.561 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943762093127 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.32:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:22:093.568 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:09:22:093.576 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-27 Mon 02:09:22:093.585 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:22:093.818 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943762093228 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 3 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 261081 calls = 23 average_bytes = 11351 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1442, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 26, _iter59->first = sent _iter59->second = 27, ] ] ] 2025-01-27 Mon 02:09:22:093.834 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:27:093.311 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-27 Mon 02:09:27:093.646 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: Connect : Start Connect timer 10.0.0.37:8086 2025-01-27 Mon 02:09:27:093.854 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:27:093.898 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: SANDESH: Send FAILED: 1737943767093414 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:27:093.912 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:09:27:093.925 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:27:094.257 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: SANDESH: Send FAILED: 1737943767093826 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 3 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 261081 calls = 23 average_bytes = 11351 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 12 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1442, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 29, _iter59->first = sent _iter59->second = 27, ] ] ] 2025-01-27 Mon 02:09:27:094.285 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:27:232.942 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.32:55636::10.0.0.37:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-27 Mon 02:09:27:232.990 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:55636::10.0.0.37:8086(-1) OnSessionEvent TCP Connected 2025-01-27 Mon 02:09:27:232.999 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:55636::10.0.0.37:8086(-1):EvTcpConnected 2025-01-27 Mon 02:09:27:233.113 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Processing scm::EvTcpConnected in state Connect 2025-01-27 Mon 02:09:27:233.152 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-27 Mon 02:09:27:233.197 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ClientInit 2025-01-27 Mon 02:09:27:233.211 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2660-2:contrail-dns:0:Control count 4 2025-01-27 Mon 02:09:27:233.381 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:27:233.393 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-27 Mon 02:09:27:233.420 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: SANDESH: Send FAILED: 1737943767233187 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:27:233.439 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Received UVE message in wrong state : NodeStatusUVE 2025-01-27 Mon 02:09:27:233.449 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:27:233.455 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-27 Mon 02:09:27:233.654 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:27:233.662 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-27 Mon 02:09:27:233.900 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: SANDESH: Send FAILED: 1737943767233365 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 4 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 261081 calls = 23 average_bytes = 11351 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1443, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 31, _iter59->first = sent _iter59->second = 27, ] ] ] 2025-01-27 Mon 02:09:27:233.922 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-27 Mon 02:09:28:831.737 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:28:831.782 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-27 Mon 02:09:28:831.864 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: SANDESH: Send FAILED: 1737943768831599 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 61 dequeues = 61 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 76 dequeues = 76 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = ClientInit state_since = 1737943767233195 last_state = ClientInit last_event = scm::EvSandeshSend last_event_at = 1737943767233651 ] session_stats= [ num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 1 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] session_tx_socket_stats= [ bytes = 1610 calls = 1 average_bytes = 1610 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] max_sm_queue_count = 6 ] 2025-01-27 Mon 02:09:28:831.877 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-27 Mon 02:09:28:831.887 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:28:831.894 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-27 Mon 02:09:28:832.153 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: SANDESH: Send FAILED: 1737943768831711 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 4 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 262691 calls = 24 average_bytes = 10945 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1443, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33, _iter59->first = sent _iter59->second = 28, ] ] ] 2025-01-27 Mon 02:09:28:832.187 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-27 Mon 02:09:29:233.589 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: 10.0.0.37:8086 EvConnectTimerExpired in state ClientInit 2025-01-27 Mon 02:09:29:233.808 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvConnectTimerExpired in state ClientInit 2025-01-27 Mon 02:09:29:233.832 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ClientInit : EvConnectTimerExpired 2025-01-27 Mon 02:09:29:234.126 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Return to idle with 5000 2025-01-27 Mon 02:09:29:234.149 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Idle 2025-01-27 Mon 02:09:29:234.254 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:29:234.512 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943769233955 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 4 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 262691 calls = 24 average_bytes = 10945 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1443, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35, _iter59->first = sent _iter59->second = 28, ] ] ] 2025-01-27 Mon 02:09:29:234.537 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:29:234.548 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:29:234.571 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943769233989 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Down description = ClientInit : EvConnectTimerExpired ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:29:234.578 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:09:29:234.587 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-27 Mon 02:09:29:234.618 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:29:234.950 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943769234242 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 262691 calls = 24 average_bytes = 10945 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1443, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 35, _iter59->first = sent _iter59->second = 28, ] ] ] 2025-01-27 Mon 02:09:29:234.977 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:34:234.403 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-27 Mon 02:09:34:234.801 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Connect : Start Connect timer 10.0.0.22:8086 2025-01-27 Mon 02:09:34:234.940 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:34:234.971 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943774234495 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:34:234.980 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:09:34:234.990 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:34:235.359 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943774234925 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 262691 calls = 24 average_bytes = 10945 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1443, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 38, _iter59->first = sent _iter59->second = 28, ] ] ] 2025-01-27 Mon 02:09:34:235.414 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:34:237.197 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.32:40008::10.0.0.22:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-27 Mon 02:09:34:237.241 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:40008::10.0.0.22:8086(-1) OnSessionEvent TCP Connected 2025-01-27 Mon 02:09:34:237.250 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:40008::10.0.0.22:8086(-1):EvTcpConnected 2025-01-27 Mon 02:09:34:237.330 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvTcpConnected in state Connect 2025-01-27 Mon 02:09:34:237.343 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-27 Mon 02:09:34:237.387 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: ClientInit 2025-01-27 Mon 02:09:34:237.410 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2660-2:contrail-dns:0:Control count 5 2025-01-27 Mon 02:09:34:237.559 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:34:237.576 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-27 Mon 02:09:34:237.613 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: SANDESH: Send FAILED: 1737943774237379 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:34:237.624 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Received UVE message in wrong state : NodeStatusUVE 2025-01-27 Mon 02:09:34:237.639 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:34:237.649 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-27 Mon 02:09:34:237.667 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:09:34:237.676 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-27 Mon 02:09:34:237.966 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: SANDESH: Send FAILED: 1737943774237539 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 262691 calls = 24 average_bytes = 10945 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1444, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 40, _iter59->first = sent _iter59->second = 28, ] ] ] 2025-01-27 Mon 02:09:34:237.997 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-27 Mon 02:09:34:464.435 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.32:40008::10.0.0.22:8086(-1) < Read failed due to error system 104 : Connection reset by peer src/contrail-common/io/tcp_session.cc 507 2025-01-27 Mon 02:09:34:464.490 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.32:40008::10.0.0.22:8086(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-27 Mon 02:09:34:464.530 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:40008::10.0.0.22:8086(-1) OnSessionEvent TCP Connection Closed 2025-01-27 Mon 02:09:34:464.540 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:40008::10.0.0.22:8086(-1):EvTcpClose 2025-01-27 Mon 02:09:34:464.609 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvTcpClose in state ClientInit 2025-01-27 Mon 02:09:34:464.638 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ClientInit : EvTcpClose 2025-01-27 Mon 02:09:34:464.794 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Return to idle with 5000 2025-01-27 Mon 02:09:34:464.804 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Idle 2025-01-27 Mon 02:09:34:465.722 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:34:466.002 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: SANDESH: Send FAILED: 1737943774464743 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.32:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1446, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 42, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:09:34:466.033 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:34:466.046 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:34:466.070 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: SANDESH: Send FAILED: 1737943774464779 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:34:466.078 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:09:34:466.088 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-27 Mon 02:09:34:466.142 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:34:466.359 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: SANDESH: Send FAILED: 1737943774465698 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.32:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1446, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 42, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:09:34:466.378 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:39:464.892 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-27 Mon 02:09:39:465.074 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Connect : Start Connect timer 10.0.0.32:8086 2025-01-27 Mon 02:09:39:465.208 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:39:465.238 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SANDESH: Send FAILED: 1737943779464960 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.32:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:39:465.255 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:09:39:465.264 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:39:465.531 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SANDESH: Send FAILED: 1737943779465192 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.32:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1446, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:09:39:465.554 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:39:465.601 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-27 Mon 02:09:39:465.610 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: -(-1):EvTcpConnectFail 2025-01-27 Mon 02:09:39:465.637 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvTcpConnectFail in state Connect 2025-01-27 Mon 02:09:39:465.647 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Connect : EvTcpConnectFail 2025-01-27 Mon 02:09:39:465.768 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-27 Mon 02:09:39:465.799 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Idle 2025-01-27 Mon 02:09:39:465.866 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:39:466.118 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: SANDESH: Send FAILED: 1737943779465725 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1446, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 47, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:09:39:466.141 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:39:466.152 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:39:466.173 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: SANDESH: Send FAILED: 1737943779465751 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:39:466.180 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:09:39:466.189 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-27 Mon 02:09:39:466.210 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:39:466.449 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: SANDESH: Send FAILED: 1737943779465854 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1447, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 47, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:09:39:466.473 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:47:465.919 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-27 Mon 02:09:47:466.243 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Connect : Start Connect timer 10.0.0.37:8086 2025-01-27 Mon 02:09:47:466.422 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:47:466.468 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: SANDESH: Send FAILED: 1737943787466023 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:47:466.495 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:09:47:466.508 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:09:47:466.721 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-27 Mon 02:09:47:466.788 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: -(-1):EvTcpConnectFail 2025-01-27 Mon 02:09:47:466.995 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: SANDESH: Send FAILED: 1737943787466401 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1447, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 50, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:09:47:467.043 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:47:467.064 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Processing scm::EvTcpConnectFail in state Connect 2025-01-27 Mon 02:09:47:467.078 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Connect : EvTcpConnectFail 2025-01-27 Mon 02:09:47:467.269 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-27 Mon 02:09:47:467.321 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Idle 2025-01-27 Mon 02:09:47:467.424 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:47:467.847 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: SANDESH: Send FAILED: 1737943787467194 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1447, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:09:47:467.884 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:47:467.903 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:47:467.938 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: SANDESH: Send FAILED: 1737943787467231 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:09:47:467.950 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:09:47:467.965 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-27 Mon 02:09:47:467.996 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:47:468.443 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: SANDESH: Send FAILED: 1737943787467407 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1448, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:09:47:468.583 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:58:831.948 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:58:832.054 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: SANDESH: Send FAILED: 1737943798831806 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 84 dequeues = 84 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 111 dequeues = 111 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737943787467317 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737943787467992 ] max_sm_queue_count = 6 ] 2025-01-27 Mon 02:09:58:832.078 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:09:58:832.088 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:09:58:832.324 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: SANDESH: Send FAILED: 1737943798831923 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1448, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 55, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:09:58:832.343 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:10:03:467.483 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-27 Mon 02:10:03:467.754 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: Connect : Start Connect timer 10.0.0.22:8086 2025-01-27 Mon 02:10:03:467.896 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:10:03:467.925 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: SANDESH: Send FAILED: 1737943803467569 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:10:03:467.934 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:10:03:467.944 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:10:03:468.188 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: SANDESH: Send FAILED: 1737943803467877 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1448, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 57, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:10:03:468.220 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:10:03:468.209 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-27 Mon 02:10:03:468.260 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: -(-1):EvTcpConnectFail 2025-01-27 Mon 02:10:03:468.308 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvTcpConnectFail in state Connect 2025-01-27 Mon 02:10:03:468.348 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Connect : EvTcpConnectFail 2025-01-27 Mon 02:10:03:468.484 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-27 Mon 02:10:03:468.521 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Idle 2025-01-27 Mon 02:10:03:468.587 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:10:03:468.820 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: SANDESH: Send FAILED: 1737943803468436 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.32:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 33 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 18 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1448, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:10:03:468.844 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:10:03:468.855 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:10:03:468.877 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: SANDESH: Send FAILED: 1737943803468463 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:10:03:468.883 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:10:03:468.892 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-27 Mon 02:10:03:468.916 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:10:03:469.141 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: SANDESH: Send FAILED: 1737943803468577 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.32:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 33 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 19 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1449, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 59, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:10:03:469.160 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:10:28:832.179 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:10:28:832.280 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: SANDESH: Send FAILED: 1737943828832027 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 91 dequeues = 91 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 121 dequeues = 121 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737943803468519 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737943803468914 ] max_sm_queue_count = 6 ] 2025-01-27 Mon 02:10:28:832.305 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:10:28:832.315 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:10:28:832.538 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: SANDESH: Send FAILED: 1737943828832151 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.32:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 19 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1449, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 62, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:10:28:832.560 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:10:33:468.617 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-27 Mon 02:10:33:468.890 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Connect : Start Connect timer 10.0.0.32:8086 2025-01-27 Mon 02:10:33:469.014 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:10:33:469.043 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: SANDESH: Send FAILED: 1737943833468732 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.32:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:10:33:469.052 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:10:33:469.062 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:10:33:469.314 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: SANDESH: Send FAILED: 1737943833468995 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.32:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 37 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 19 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1449, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 64, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:10:33:469.341 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:10:33:469.386 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-27 Mon 02:10:33:469.394 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: -(-1):EvTcpConnectFail 2025-01-27 Mon 02:10:33:469.423 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Processing scm::EvTcpConnectFail in state Connect 2025-01-27 Mon 02:10:33:469.433 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Connect : EvTcpConnectFail 2025-01-27 Mon 02:10:33:469.549 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-27 Mon 02:10:33:469.580 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Idle 2025-01-27 Mon 02:10:33:469.646 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:10:33:469.876 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SANDESH: Send FAILED: 1737943833469507 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 38 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 19 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1449, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 66, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:10:33:469.898 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:10:33:469.909 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:10:33:469.930 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SANDESH: Send FAILED: 1737943833469533 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:10:33:469.939 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:10:33:469.947 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-27 Mon 02:10:33:469.966 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:10:33:470.190 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: SANDESH: Send FAILED: 1737943833469633 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 644 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 38 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1450, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 66, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:10:33:470.207 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:10:40:492.769 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:40:779.167 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:40:915.407 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:41:241.927 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:41:543.052 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:41:568.701 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:41:701.676 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992145987328, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:41:958.812 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:42:178.353 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:48:572.841 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:54:017.112 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:54:148.957 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:54:157.804 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:55:768.415 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:55:800.310 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:55:829.373 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:55:956.656 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:55:967.000 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:033.531 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:163.121 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:194.203 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:226.831 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:367.922 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:411.137 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:429.843 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:561.348 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:603.728 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:625.816 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:761.240 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:800.863 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:851.129 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992145987328, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:945.630 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:56:983.625 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:57:031.600 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:57:157.886 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:57:195.437 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:57:377.068 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:57:606.394 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:57:705.954 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:57:739.822 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:57:826.883 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:57:903.795 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:57:930.476 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992145987328, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:001.962 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:092.466 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:108.084 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:197.167 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:320.771 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:344.230 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:410.651 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:501.420 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992145987328, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:532.964 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:645.174 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:715.757 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:748.069 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:833.131 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:10:58:833.219 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: SANDESH: Send FAILED: 1737943858832961 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 98 dequeues = 98 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 131 dequeues = 131 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737943833469579 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737943833469965 ] max_sm_queue_count = 6 ] 2025-01-27 Mon 02:10:58:833.232 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:10:58:833.241 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:10:58:833.475 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: SANDESH: Send FAILED: 1737943858833096 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 699 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1505, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 69, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:10:58:833.495 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:10:58:845.447 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:894.830 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:58:940.532 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:038.549 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:065.849 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:153.595 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:211.899 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:260.496 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992145987328, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:265.878 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.13:51384 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-27 Mon 02:10:59:271.615 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.18:36718 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-27 Mon 02:10:59:337.966 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:398.873 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:420.883 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:504.956 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:591.021 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:612.531 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:620.370 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.8:40532 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-27 Mon 02:10:59:682.334 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:768.300 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:802.166 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992137590528, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:878.808 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:10:59:959.770 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:00:009.017 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:00:067.773 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:00:137.718 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:00:186.345 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992116598528, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:00:245.174 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992145987328, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:00:319.057 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:00:414.876 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:00:596.497 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:03:469.678 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-27 Mon 02:11:03:469.917 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Connect : Start Connect timer 10.0.0.37:8086 2025-01-27 Mon 02:11:03:470.045 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:11:03:470.075 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: SANDESH: Send FAILED: 1737943863469752 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:11:03:470.093 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:11:03:470.102 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:11:03:470.341 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: SANDESH: Send FAILED: 1737943863470028 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 726 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 42 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 23 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1535, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 71, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:11:03:470.361 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:11:03:470.407 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: -(-1) OnSessionEvent TCP Connect Failed 2025-01-27 Mon 02:11:03:470.416 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: -(-1):EvTcpConnectFail 2025-01-27 Mon 02:11:03:470.448 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvTcpConnectFail in state Connect 2025-01-27 Mon 02:11:03:470.458 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Connect : EvTcpConnectFail 2025-01-27 Mon 02:11:03:471.007 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-01-27 Mon 02:11:03:471.045 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Idle 2025-01-27 Mon 02:11:03:471.132 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:11:03:471.418 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943863470952 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 726 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 43 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 23 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1535, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 73, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:11:03:471.445 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:11:03:471.457 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:11:03:471.481 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943863470982 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:11:03:471.488 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:11:03:471.497 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvTcpDeleteSession in state Idle 2025-01-27 Mon 02:11:03:471.523 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:11:03:471.757 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SANDESH: Send FAILED: 1737943863471121 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 726 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 43 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 24 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1536, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 73, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:11:03:471.775 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:11:12:345.661 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992145987328, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:12:663.155 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992034694912, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:12:965.560 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:17:874.467 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:17:908.338 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992124995328, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:17:926.470 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:19:332.744 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992141788928, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:19:365.723 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992150185728, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:19:434.720 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:11:25:539.066 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.13:34534 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-27 Mon 02:11:26:606.613 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.8:57626 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-27 Mon 02:11:27:088.203 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.18:49650 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-01-27 Mon 02:11:28:833.358 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:11:28:833.458 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: SANDESH: Send FAILED: 1737943888833218 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 105 dequeues = 105 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 141 dequeues = 141 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737943863471044 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737943863471522 ] max_sm_queue_count = 6 ] 2025-01-27 Mon 02:11:28:833.484 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:11:28:833.494 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: Processing scm::EvSandeshSend in state Idle 2025-01-27 Mon 02:11:28:833.721 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: SANDESH: Send FAILED: 1737943888833333 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 735 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 45 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 27 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1548, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 76, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:11:28:833.739 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:11:33:471.671 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-01-27 Mon 02:11:33:471.849 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Connect : Start Connect timer 10.0.0.22:8086 2025-01-27 Mon 02:11:33:471.980 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:11:33:472.012 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: SANDESH: Send FAILED: 1737943893471739 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:11:33:472.022 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:11:33:472.030 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:11:33:472.272 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: SANDESH: Send FAILED: 1737943893471964 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 735 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 47 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 27 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1548, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 78, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:11:33:472.293 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992038893312, Pid 83115]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:11:33:476.000 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.32:51242::10.0.0.22:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-01-27 Mon 02:11:33:476.021 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:51242::10.0.0.22:8086(-1) OnSessionEvent TCP Connected 2025-01-27 Mon 02:11:33:476.030 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992306112640, Pid 83115]: 10.0.0.32:51242::10.0.0.22:8086(-1):EvTcpConnected 2025-01-27 Mon 02:11:33:479.022 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: Processing scm::EvTcpConnected in state Connect 2025-01-27 Mon 02:11:33:479.047 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-27 Mon 02:11:33:479.091 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: ClientInit 2025-01-27 Mon 02:11:33:479.111 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2660-2:contrail-dns:0:Control count 6 2025-01-27 Mon 02:11:33:479.240 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:11:33:479.250 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-27 Mon 02:11:33:479.276 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: SANDESH: Send FAILED: 1737943893479083 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:11:33:479.287 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: Received UVE message in wrong state : NodeStatusUVE 2025-01-27 Mon 02:11:33:479.296 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:11:33:479.303 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-27 Mon 02:11:33:479.314 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:11:33:479.320 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-27 Mon 02:11:33:479.553 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: SANDESH: Send FAILED: 1737943893479226 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 6 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 735 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 48 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 28 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1549, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 80, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-01-27 Mon 02:11:33:479.572 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992043091712, Pid 83115]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-27 Mon 02:11:33:487.097 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: OnMessage control in state: ClientInit 2025-01-27 Mon 02:11:33:487.148 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-01-27 Mon 02:11:33:487.158 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: ClientInit : EvSandeshMessageRecv 2025-01-27 Mon 02:11:33:487.182 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Received Ctrl Message with size 0 2025-01-27 Mon 02:11:33:487.198 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2660-2 start_time = 1737943610590515 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-01-23 00:10:21.736348","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7558-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.37:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.8, ] ] proxy seq 1 2025-01-27 Mon 02:11:33:487.211 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-01-27 Mon 02:11:33:487.517 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 6 pid = 83115 http_port = 8092 start_time = 1737943609975534 collector_name = collector_ip = 10.0.0.22:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 264301 calls = 25 average_bytes = 10572 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 105 dequeues = 105 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 141 dequeues = 141 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1737943863471044 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1737943863471522 ] session_stats= [ num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 1 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] session_tx_socket_stats= [ bytes = 1610 calls = 1 average_bytes = 1610 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 735 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 48 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 28 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1549, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 80, _iter59->first = sent _iter59->second = 29, ] ] max_sm_queue_count = 6 proxy seq 58 2025-01-27 Mon 02:11:33:487.553 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-01-27 Mon 02:11:33:487.576 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.22:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 37 2025-01-27 Mon 02:11:33:487.588 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-01-27 Mon 02:11:33:487.596 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-01-27 Mon 02:11:33:487.604 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-01-27 Mon 02:11:33:487.611 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-01-27 Mon 02:11:33:487.643 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992133392128, Pid 83115]: Established 2025-01-27 Mon 02:12:24:773.434 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992030496512, Pid 83115]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-01-27 Mon 02:12:37:107.516 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 139992120796928, Pid 83115]: DnsAgent [SYS_NOTICE]: DnsOperational: BIND named down; DNS is not operational controller/src/dns/mgr/dns_mgr.cc 747 2025-01-27 Mon 02:13:04:290.332 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_INFO]: VersionInfoLog: {"build-info":[{"build-version":"nightly","build-time":"2025-01-27 00:22:22.658808","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-7560-1.novalocal","build-id":"unknown","build-number":"unknown"}]} src/contrail-common/base/misc_utils.cc 41 2025-01-27 Mon 02:13:04:290.428 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: SANDESH: ROLE : Generator 2025-01-27 Mon 02:13:04:290.438 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: SANDESH: MODULE : contrail-dns 2025-01-27 Mon 02:13:04:290.444 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-2660-2 2025-01-27 Mon 02:13:04:290.449 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: SANDESH: NODE TYPE : Control 2025-01-27 Mon 02:13:04:290.455 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: SANDESH: INSTANCE ID : 0 2025-01-27 Mon 02:13:04:290.461 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: SANDESH: HTTP SERVER PORT : 8092 2025-01-27 Mon 02:13:04:290.467 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-01-27 Mon 02:13:04:290.743 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: HTTP Introspect Init 2025-01-27 Mon 02:13:04:290.850 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8092 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-01-27 Mon 02:13:04:290.907 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: Sandesh Http Server Port: 8092 2025-01-27 Mon 02:13:04:290.949 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: SANDESH: NOT Writing http_port 8092TO : /tmp/contrail-dns.116243.http_port 2025-01-27 Mon 02:13:04:290.957 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: SANDESH: CONNECT TO COLLECTOR: 1 2025-01-27 Mon 02:13:04:291.031 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: Idle 2025-01-27 Mon 02:13:04:291.203 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: SANDESH: No Client: 1737943984291125 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 116400 http_port = 8092 start_time = 1737943984291040 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-27 Mon 02:13:04:300.210 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: SANDESH: Logging: DISABLED -> ENABLED 2025-01-27 Mon 02:13:04:300.236 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-01-27 Mon 02:13:04:313.953 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: Processing scm::EvStart in state Idle 2025-01-27 Mon 02:13:04:317.921 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: Disconnect 2025-01-27 Mon 02:13:04:318.189 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: Processing scm::EvCollectorUpdate in state Disconnect 2025-01-27 Mon 02:13:04:318.487 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: Connect : Start Connect timer 10.0.0.37:8086 2025-01-27 Mon 02:13:04:318.604 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:13:04:318.851 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: SANDESH: Send FAILED: 1737943984318120 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 116400 http_port = 8092 start_time = 1737943984291040 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-27 Mon 02:13:04:318.886 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:13:04:318.902 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:13:04:319.051 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: SANDESH: Send FAILED: 1737943984318281 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 116400 http_port = 8092 start_time = 1737943984291040 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-27 Mon 02:13:04:319.072 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:13:04:319.088 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:13:04:319.204 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: SANDESH: Send FAILED: 1737943984318586 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 116400 http_port = 8092 start_time = 1737943984291040 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-27 Mon 02:13:04:319.231 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-01-27 Mon 02:13:04:413.199 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: Applying named configuration failed 2025-01-27 Mon 02:13:04:413.555 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.20.0.8:8093 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-01-27 Mon 02:13:04:413.633 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been started controller/src/dns/main.cc 384 2025-01-27 Mon 02:13:04:413.725 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Start RabbitMqReader and init Database src/contrail-common/config-client-mgr/config_client_manager.cc 303 2025-01-27 Mon 02:13:04:413.850 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-01-27 Mon 02:13:04:413.869 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-01-27 Mon 02:13:04:414.002 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:13:04:414.034 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: SANDESH: Send FAILED: 1737943984413828 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-01-27 Mon 02:13:04:414.043 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:13:04:474.633 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-01-27 Mon 02:13:04:475.570 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Init Database src/contrail-common/config-client-mgr/config_client_manager.cc 307 2025-01-27 Mon 02:13:04:475.629 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Lost Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 580 2025-01-27 Mon 02:13:04:475.640 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-01-27 Mon 02:13:04:474.699 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:13:04:477.165 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: SANDESH: Send FAILED: 1737943984474598 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-01-27 Mon 02:13:04:477.176 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:13:04:477.188 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:13:04:477.213 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: SANDESH: Send FAILED: 1737943984475619 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down ], ] ] ] 2025-01-27 Mon 02:13:04:477.220 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:13:04:550.873 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 95 2025-01-27 Mon 02:13:04:551.479 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily uuidTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 104 2025-01-27 Mon 02:13:04:551.524 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily fqnTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 110 2025-01-27 Mon 02:13:04:551.591 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:551.603 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkDataSync Started src/contrail-common/config-client-mgr/config_cassandra_client.cc 393 2025-01-27 Mon 02:13:04:551.701 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:13:04:551.751 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: SANDESH: Send FAILED: 1737943984551563 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:13:04:551.763 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:13:04:553.810 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:555.051 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:557.764 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:560.068 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:561.109 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:567.000 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:569.285 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:570.757 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:572.091 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:578.834 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:579.738 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:584.353 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:585.352 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:586.364 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:587.237 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:588.138 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:593.298 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:594.694 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:599.463 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:603.153 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:603.971 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:605.345 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:611.180 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:612.863 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:619.410 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:620.957 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:622.063 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:624.223 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:625.817 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:627.175 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:638.957 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:639.985 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:642.868 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:646.008 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:647.058 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:649.394 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:655.888 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:662.328 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:664.031 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:671.622 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:672.847 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:674.741 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:678.851 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:691.196 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:702.786 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:722.770 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:732.204 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:743.618 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:748.301 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:749.345 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:750.357 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:752.886 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:754.608 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:757.896 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:761.846 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:762.728 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:763.557 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:771.815 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:772.890 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:774.005 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:786.601 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:790.180 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:791.557 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:800.297 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:810.563 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:815.712 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:820.225 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:821.424 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:823.249 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:832.246 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:835.696 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:836.854 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:841.952 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:854.763 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:856.782 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:865.030 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:870.962 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:874.652 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:882.120 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:904.646 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:912.233 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:917.449 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:920.001 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:922.041 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:941.868 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:951.370 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:952.971 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:969.162 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:976.079 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:981.216 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:04:996.038 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:005.312 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:008.239 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:037.726 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:058.435 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:067.339 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:074.467 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:077.085 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:083.594 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:090.891 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:094.798 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:104.466 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:111.462 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:116.168 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:129.277 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:141.032 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:152.876 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:155.893 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:164.307 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:166.519 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:167.808 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:190.918 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:192.253 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:194.362 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:206.949 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:215.492 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:232.456 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:262.006 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:262.080 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-27 Mon 02:13:05:262.344 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-27 Mon 02:13:05:262.498 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-27 Mon 02:13:05:262.711 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-27 Mon 02:13:05:262.847 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-27 Mon 02:13:05:263.018 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-27 Mon 02:13:05:263.162 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-01-27 Mon 02:13:05:263.304 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkSyncDone by all readers src/contrail-common/config-client-mgr/config_cassandra_client.cc 554 2025-01-27 Mon 02:13:05:263.334 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: End of RIB computed and notification sent src/contrail-common/config-client-mgr/config_client_manager.cc 197 2025-01-27 Mon 02:13:05:263.399 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 225 2025-01-27 Mon 02:13:05:263.575 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:13:05:263.608 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: SANDESH: Send FAILED: 1737943985263388 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:13:05:263.617 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:13:05:272.485 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:272.740 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Leaf-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:272.817 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:default-project controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:272.836 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:272.856 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:272.871 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:272.886 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating fabric:default-global-system-config:default-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:272.905 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-system-config:default-global-system-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:272.917 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-fabric controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:272.933 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Spine-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:272.959 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:272.975 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:272.986 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.002 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:port-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.020 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.033 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-aa controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.048 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4200 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.059 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:rma_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.143 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.184 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-compute controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.214 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.230 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.250 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.280 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:ip-fabric:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.308 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.326 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.349 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:container_cleanup_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.376 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.390 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:server_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.423 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.438 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_server_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.459 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.475 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.502 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.517 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2020 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.530 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:analyzer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.555 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating domain:default-domain controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.569 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.581 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.599 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.622 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.652 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.666 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:default-project:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.690 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.705 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.722 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.737 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dci-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.760 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.897 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.920 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.936 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.947 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.964 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:273.985 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-48y controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:273.997 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.011 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.022 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.039 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.050 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.064 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.074 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.089 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.099 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.120 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.133 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.149 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.160 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.175 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5210-64c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.186 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.201 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.212 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.227 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.238 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.252 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-32c-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.266 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.280 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.291 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.305 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.316 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.330 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.342 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.360 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.370 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.387 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.398 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.410 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating snmp-profile:default-domain:default-project:snmp-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.428 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.441 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.468 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.485 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.505 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.522 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.535 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:role_assignment_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.556 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.569 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-management-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.585 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:label controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.596 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.608 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-72q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.619 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-ebgp-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.635 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.648 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-fabric-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.674 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.688 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.704 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.719 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:274.731 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:274.749 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:278.774 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:278.918 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-policy-management:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:278.972 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating policy-management:default-policy-management controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:278.991 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating policy-management-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.010 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-vrouter-config:default-global-system-config:default-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.023 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating application-policy-set-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.040 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:infra-bms-access controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.059 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.074 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.092 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.120 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.142 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.157 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:node_profile_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.185 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.206 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.223 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.240 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.258 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:overlay-bgp controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.270 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.283 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.294 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.311 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:telemetry controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.322 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.346 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.357 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.373 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.396 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.410 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.426 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.445 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.459 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:underlay-ip-clos controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.472 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.488 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.503 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.520 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:route-reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.532 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.547 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.564 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vqfx-10000 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.584 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.601 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:default-project:__no_rule__ controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.620 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.638 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.654 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.669 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:pnf-service-chaining controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.680 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.699 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:pnf-servicechain controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.709 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.728 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.752 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.768 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.784 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.799 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.821 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.836 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.849 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l2-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.859 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.875 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:vn-interconnect controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.882 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile c89a5d0d-b34a-4236-b06d-cdce8e8a1fd8 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-27 Mon 02:13:05:279.886 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:279.966 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:firewall controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:279.982 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.000 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.020 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:280.050 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.070 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:280.094 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.128 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.143 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:280.161 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.178 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.203 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.232 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.247 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.264 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.280 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.295 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.308 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:280.324 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.339 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.355 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.371 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-peer-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:280.421 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.454 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating api-access-list:default-global-system-config:default-api-access-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:280.474 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-api-access-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.489 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx240 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:280.501 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-incorrect controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:280.519 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.539 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-node-status controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:280.559 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.572 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_role_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:280.593 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.607 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:erb-ucast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:280.623 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:280.859 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:281.090 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.161 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.179 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:cli_sync_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.206 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.225 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5800 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.238 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-3 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.256 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.281 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-access-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.294 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.308 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:haproxy-loadbalancer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.327 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.344 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vmx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.358 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-all-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.378 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.393 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.409 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.421 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.438 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:_internal_ipam_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.458 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.472 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx1500 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.537 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_ops_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.567 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.582 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.599 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.620 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.638 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.656 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.675 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.694 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.711 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.728 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.746 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.772 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.788 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.803 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.822 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.836 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:tier controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.861 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.884 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.903 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.917 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating discovery-service-assignment:default-discovery-service-assignment controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.930 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:281.946 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.964 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:281.980 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.245 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.263 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.278 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.294 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.310 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_device_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:282.335 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.349 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4100 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:282.362 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating namespace:default-domain:default-namespace controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:282.376 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-namespace controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.390 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-critical controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:282.416 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.439 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.455 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_chassis_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:282.476 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.491 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:erb-leaf:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:282.505 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:erb-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:282.516 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.730 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile c89a5d0d-b34a-4236-b06d-cdce8e8a1fd8 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-27 Mon 02:13:05:282.850 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.889 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-48s-4c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:282.903 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.929 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:282.941 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:282.962 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:283.256 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-srx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:283.285 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-srx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:283.299 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:283.754 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:283.838 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:283.862 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:283.878 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:deployment controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:283.901 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:283.918 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:283.937 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:283.954 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:283.972 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:283.987 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:vcenter_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.016 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.031 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.052 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.067 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.085 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.159 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:existing_fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.190 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.227 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.251 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.265 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.283 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.315 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.333 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.352 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.370 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.390 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.411 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.426 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.442 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.457 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.476 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.493 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.505 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.521 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.536 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.553 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.567 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.586 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.589 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 872efd2e-1c1b-4278-af94-8b6503e9e420 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:13:05:284.604 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-36q controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.617 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.643 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.666 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.681 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.692 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.712 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:docker-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.732 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.747 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.759 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.774 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5600 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.786 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-6 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.803 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.821 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating netconf-profile:default-domain:default-project:netconf-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.833 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.846 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48y-8c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.857 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-overlay-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.878 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.942 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:284.968 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:284.982 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:nat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:285.003 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:285.018 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Lean-Spine-with-Route-Reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:285.038 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:285.057 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:285.074 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-5 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:285.092 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:285.117 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:285.135 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:285.153 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance b2c1a112-91a5-4e15-ad27-30b529d6dc8a controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:13:05:285.304 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router cfaa0391-071e-4baa-aaf3-46b642754a6a controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:13:05:285.316 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router cfaa0391-071e-4baa-aaf3-46b642754a6a controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:13:05:285.714 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:285.161 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.058 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-access controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.090 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.126 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:device-functional-group controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.147 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.167 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.185 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:opencontrail controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.202 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.216 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.234 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.257 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.275 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.301 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-4 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.322 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.338 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating grpc-profile:default-domain:default-project:grpc-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.349 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.371 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.392 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.408 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4600 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.421 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.443 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.457 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_deactivate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.478 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.492 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.511 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.529 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.546 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.563 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.582 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.598 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.613 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.630 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hardware_inventory_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.654 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.668 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.703 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.732 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.750 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-pending-cassandra-compaction-tasks controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.773 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.787 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.802 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.821 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.837 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.853 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.866 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-client controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.880 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.897 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.911 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-storage-cluster-state controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.927 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.951 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.965 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48t-6c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:291.981 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:291.998 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.013 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.029 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.045 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.064 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.080 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.095 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.118 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.135 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.153 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.170 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.187 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Storage-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.204 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.222 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.237 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_interface_details_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.261 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.275 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5400 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.287 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-60c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.309 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.326 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.341 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.359 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.374 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.389 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.404 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.422 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.437 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.451 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.466 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.486 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.508 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.523 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-spine:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.540 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.552 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.571 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.588 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bgp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.605 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.620 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-table-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.635 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.655 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.673 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.694 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.708 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.729 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.742 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:test_overlay_connectivity_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.765 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.783 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.798 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.815 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx480 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.827 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5120:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.841 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5120 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.852 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.868 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_fwaas controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.881 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-partial-sysinfo controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.897 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.909 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:292.927 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.943 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.959 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.977 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:292.993 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:293.009 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:293.025 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:293.040 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_tag controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:302.795 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:303.159 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 0f1554fe-8324-4d10-8e89-7bc5879d9fb1 controller/src/ifmap/client/config_json_parser.cc 217 2025-01-27 Mon 02:13:05:304.018 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:304.070 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:304.126 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:304.147 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-mx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:304.173 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:304.201 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2008 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:304.214 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:304.235 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:304.251 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2010 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:304.263 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:304.282 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:304.297 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx960 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:304.315 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:304.330 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx204 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:304.341 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:304.359 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:304.375 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx10003 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:304.386 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:304.393 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance d12e05bb-f26d-4da7-be5f-a1f2f3c08fe3 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:13:05:304.499 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router e1d6465c-964a-4cec-adc1-ebf1df82e7a8 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:13:05:304.511 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router e1d6465c-964a-4cec-adc1-ebf1df82e7a8 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:13:05:306.950 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:304.405 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:307.831 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:307.848 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:307.867 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:307.883 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:307.896 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:307.918 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:307.938 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:307.954 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:307.978 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.001 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.021 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.040 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.059 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.076 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.093 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.120 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.140 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.160 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.178 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.195 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.215 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.234 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.252 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_os_computes_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.294 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.313 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.332 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.348 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hitless_upgrade_strategy_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.369 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.384 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-tsn-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.406 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.421 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.437 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.454 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-interface controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.473 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.492 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.506 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:check_multicast_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.529 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.549 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-control controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.566 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.582 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.597 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.614 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.630 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.648 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.659 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.677 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.700 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.719 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.736 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.754 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.770 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.786 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.801 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.818 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Gateway-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.840 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.858 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.876 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5220:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.890 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5220 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.902 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.915 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.936 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.950 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:search_ip_mac_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:308.973 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:308.989 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-32c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:309.000 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2660-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:309.017 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:309.032 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:309.047 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:309.061 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-status controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:309.079 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:309.095 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:309.118 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:309.135 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:309.137 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:05:309.646 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 55a6c3d5-da32-422d-a51c-8f4d8a804660 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:13:05:310.158 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 92aa2ae7-f95d-40d8-9327-6b0e411ed0de controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:13:05:310.303 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router aa1da18f-6868-4b2d-8239-6aa578be992c controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:13:05:310.315 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router aa1da18f-6868-4b2d-8239-6aa578be992c controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:13:05:309.151 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.134 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.538 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.567 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.595 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.619 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.642 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.660 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.683 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.701 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:311.723 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.742 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.760 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:native controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:311.781 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.796 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2660-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:311.817 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.837 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.852 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bottle-request-size-limit controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:311.869 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.888 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:site controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:311.903 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:ztp_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:311.926 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.946 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L2-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:311.963 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:311.979 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.013 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:default-network-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.030 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.056 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:service-chain-flat-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.072 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.086 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.113 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.135 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.152 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.167 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.182 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.200 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.215 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.230 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.248 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.267 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-mcast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.281 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.297 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.314 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.329 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.351 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.366 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.385 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.400 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.414 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.429 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.446 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.465 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.481 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.499 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:topology_discovery_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.521 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.538 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-leaf:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.556 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.576 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-pnf-servicechain-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.595 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.617 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.635 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.652 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.668 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-close-reason controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.689 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.723 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.743 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.762 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.783 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.797 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.821 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.836 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.857 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.887 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.906 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.924 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.939 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.959 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:312.973 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-package-version-mismatch controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:312.991 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.010 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.026 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.043 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-128c controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.058 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.075 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.088 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-32cd controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.100 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:_internal_vn_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.132 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.152 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:default-project:_internal_ipam_ipv6_link_local,default-domain:default-project:_internal_vn_ipv6_link_local) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.164 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.183 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.212 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vsrx controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.229 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-high controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.254 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.282 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.304 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.329 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.359 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.381 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.404 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.426 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.450 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:netns-snat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.475 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.511 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.549 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.568 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.583 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.598 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.616 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.630 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.646 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.664 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.684 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.701 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.721 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.737 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.750 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.767 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.784 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.802 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.822 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.838 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.857 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.872 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.887 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.902 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.921 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.938 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.954 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:313.973 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:313.988 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.004 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.020 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.038 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.053 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.067 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.082 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.111 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.127 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.141 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.159 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.176 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.189 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:314.208 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.224 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_mac_mob_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:314.247 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.265 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-elements-inconsistency controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:314.287 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.304 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-mx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:314.320 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.345 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.363 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.379 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.397 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.419 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.441 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.458 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx240h-poe controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:314.477 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.493 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.508 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.527 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.541 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.556 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.570 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.588 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.602 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.616 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.634 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:314.647 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-qos-config:default-global-system-config:default-global-qos-config controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:331.238 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-qos-config controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:331.305 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-core-files controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:331.354 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:331.374 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2660-2:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:331.401 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:331.425 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:331.443 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:image_upgrade_template controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:331.471 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:331.500 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:331.516 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-properties:default-global-system-config:config_property controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:331.535 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-properties controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:331.551 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:application controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:332.233 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.274 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2660-1:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:332.300 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.323 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.350 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:332.368 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.389 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.407 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.424 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.439 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.455 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.471 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.486 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.505 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.523 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.540 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.555 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2660-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:13:05:332.573 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:332.594 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:13:05:333.250 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: EndOfRib point was reached, IF-MAP objects have been created controller/src/dns/main.cc 86 2025-01-27 Mon 02:13:05:333.270 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS.0, counting 0 elements controller/src/dns/main.cc 98 2025-01-27 Mon 02:13:05:333.285 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS_record.0, counting 0 elements controller/src/dns/main.cc 98 2025-01-27 Mon 02:13:05:333.295 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.network_ipam.0, counting 3 elements controller/src/dns/main.cc 98 2025-01-27 Mon 02:13:05:333.305 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_network_network_ipam.0, counting 1 elements controller/src/dns/main.cc 98 2025-01-27 Mon 02:13:05:333.314 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.global_qos_config.0, counting 1 elements controller/src/dns/main.cc 98 2025-01-27 Mon 02:13:05:333.323 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: VnniConfig has been updated after the bulk sync, the number of elements: 1 controller/src/dns/main.cc 109 2025-01-27 Mon 02:13:05:333.332 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: IpamConfig has been updated after the bulk sync, the number of elements: 3 controller/src/dns/main.cc 120 2025-01-27 Mon 02:13:05:333.340 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 131 2025-01-27 Mon 02:13:05:333.348 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsRecordConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 142 2025-01-27 Mon 02:13:05:333.356 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: GlobalQosConfig has been updated after the bulk sync controller/src/dns/main.cc 152 2025-01-27 Mon 02:13:05:333.405 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-01-27 Mon 02:13:05:333.419 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-01-27 Mon 02:13:05:333.408 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:13:05:333.752 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: SANDESH: Send FAILED: 1737943985333386 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-01-27 Mon 02:13:05:333.766 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:13:05:400.238 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-01-27 Mon 02:13:05:400.328 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: Processing scm::EvSandeshSend in state Connect 2025-01-27 Mon 02:13:05:400.543 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: SANDESH: Send FAILED: 1737943985400201 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:13:05:400.560 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-01-27 Mon 02:13:05:400.579 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 225 2025-01-27 Mon 02:13:05:402.348 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.32:46384::10.0.0.37:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-01-27 Mon 02:13:05:402.369 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: 10.0.0.32:46384::10.0.0.37:8086(-1) OnSessionEvent TCP Connected 2025-01-27 Mon 02:13:05:402.380 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: 10.0.0.32:46384::10.0.0.37:8086(-1):EvTcpConnected 2025-01-27 Mon 02:13:05:402.587 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: BIND named up; DNS is operational controller/src/dns/mgr/dns_mgr.cc 737 2025-01-27 Mon 02:13:05:402.605 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: Processing scm::EvTcpConnected in state Connect 2025-01-27 Mon 02:13:05:402.614 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: Connect : EvTcpConnected : Cancelling Connect timer 2025-01-27 Mon 02:13:05:402.644 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ClientInit 2025-01-27 Mon 02:13:05:402.671 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2660-2:contrail-dns:0:Control count 1 2025-01-27 Mon 02:13:05:402.768 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:13:05:402.783 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-01-27 Mon 02:13:05:402.806 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: SANDESH: Send FAILED: 1737943985402637 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-01-27 Mon 02:13:05:402.814 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: Received UVE message in wrong state : NodeStatusUVE 2025-01-27 Mon 02:13:05:402.822 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:13:05:402.829 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-01-27 Mon 02:13:05:402.841 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: Processing scm::EvSandeshSend in state ClientInit 2025-01-27 Mon 02:13:05:402.848 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-01-27 Mon 02:13:05:402.990 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: SANDESH: Send FAILED: 1737943985402757 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 116400 http_port = 8092 start_time = 1737943984291040 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 922, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-01-27 Mon 02:13:05:403.006 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-01-27 Mon 02:13:05:405.362 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: OnMessage control in state: ClientInit 2025-01-27 Mon 02:13:05:405.395 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-01-27 Mon 02:13:05:405.404 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ClientInit : EvSandeshMessageRecv 2025-01-27 Mon 02:13:05:405.426 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: Received Ctrl Message with size 0 2025-01-27 Mon 02:13:05:405.435 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 0 2025-01-27 Mon 02:13:05:407.219 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2660-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 116400 http_port = 8092 start_time = 1737943984291040 collector_name = collector_ip = 10.0.0.37:8086 collector_list= [ [ (*_iter40) = 10.0.0.37:8086, (*_iter40) = 10.0.0.22:8086, (*_iter40) = 10.0.0.32:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 922, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] proxy seq 5 2025-01-27 Mon 02:13:05:407.283 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-01-27 Mon 02:13:05:407.313 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2660-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.37:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.37:9041, (*_iter6) = 10.0.0.32:9041, (*_iter6) = 10.0.0.22:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.37:5673, (*_iter6) = 10.0.0.32:5673, (*_iter6) = 10.0.0.22:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 8 2025-01-27 Mon 02:13:05:407.324 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-01-27 Mon 02:13:05:407.359 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-01-27 Mon 02:13:05:407.366 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-01-27 Mon 02:13:05:407.375 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-01-27 Mon 02:13:05:407.427 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: Established 2025-01-27 Mon 02:13:06:499.012 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: Applying named configuration failed 2025-01-27 Mon 02:13:06:499.098 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been done (the DB has been synced with named) controller/src/dns/mgr/dns_mgr.cc 455 2025-01-27 Mon 02:13:06:612.076 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:13:27:042.798 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.6 SEND Xmpp creating dynamic channel 10.20.0.8:8093::10.20.0.6:38817 controller/src/xmpp/xmpp_server.cc 586 2025-01-27 Mon 02:13:27:042.899 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.6 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2660-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-01-27 Mon 02:13:27:042.944 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8093::10.20.0.6:38817 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:13:27:043.090 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.6 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.6 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-01-27 Mon 02:13:27:043.184 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.6 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:13:27:043.256 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.6 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 38817 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:13:27:045.130 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.6 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2660-2/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:13:27:645.266 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.14 SEND Xmpp creating dynamic channel 10.20.0.8:8093::10.20.0.14:43053 controller/src/xmpp/xmpp_server.cc 586 2025-01-27 Mon 02:13:27:645.341 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.14 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2660-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-01-27 Mon 02:13:27:645.380 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8093::10.20.0.14:43053 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:13:27:645.506 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.14 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.14 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-01-27 Mon 02:13:27:645.700 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:13:27:645.768 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 43053 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:13:27:646.539 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2660-1/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:13:50:256.577 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:14:15:405.439 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.37:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-01-27 Mon 02:14:15:417.733 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-01-27 Mon 02:14:15:417.793 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-01-27 Mon 02:14:15:418.289 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.37:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-01-27 Mon 02:14:15:649.360 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-01-27 Mon 02:15:46:765.853 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.32:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-01-27 Mon 02:15:46:769.885 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-01-27 Mon 02:15:46:769.917 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-01-27 Mon 02:15:46:770.035 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.32:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-01-27 Mon 02:15:46:833.864 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-01-27 Mon 02:15:59:268.709 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.13:50906 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:15:59:274.057 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.18:49644 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:15:59:619.641 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.8:45868 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:16:25:526.210 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.13:42054 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:16:26:592.782 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.8:60648 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:16:27:076.851 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.18:53274 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:17:18:662.564 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.22:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-01-27 Mon 02:17:18:664.252 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-01-27 Mon 02:17:18:664.274 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-01-27 Mon 02:17:18:664.659 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.22:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-01-27 Mon 02:17:18:871.150 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082886203136, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-01-27 Mon 02:20:59:274.204 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.13:38862 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:20:59:280.539 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.18:47546 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:20:59:624.913 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.8:58226 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:21:25:530.056 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.13:41300 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:21:26:592.233 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.8:56938 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:21:27:082.328 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.18:33292 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:25:59:274.955 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.13:45998 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:25:59:278.919 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.18:45614 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:25:59:631.508 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.8:53602 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:26:25:534.979 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.13:51088 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:26:26:595.368 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.8:48992 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:26:27:079.679 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.18:33464 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:29:23:822.779 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.6 RECV Mode Server: Event: Tcp Connection Closed peer ip: 10.20.0.6 ( an-jenkins-deploy-platform-ansible-os-2660-2/dns ) controller/src/xmpp/xmpp_state_machine.cc 1310 2025-01-27 Mon 02:29:23:822.928 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.6 state = Established next_state = Idle event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:29:23:822.952 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: XMPP [SYS_INFO]: XmppConnectionDelete: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.6 Deleted Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2660-2 To : an-jenkins-deploy-platform-ansible-os-2660-2/dns controller/src/xmpp/xmpp_connection.cc 734 2025-01-27 Mon 02:29:23:823.008 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.6 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:29:23:827.386 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.14 RECV Mode Server: Event: Tcp Connection Closed peer ip: 10.20.0.14 ( an-jenkins-deploy-platform-ansible-os-2660-1/dns ) controller/src/xmpp/xmpp_state_machine.cc 1310 2025-01-27 Mon 02:29:23:827.571 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Established next_state = Idle event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:29:23:827.646 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:29:23:827.705 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: XMPP [SYS_INFO]: XmppConnectionDelete: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.14 Deleted Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2660-2 To : an-jenkins-deploy-platform-ansible-os-2660-1/dns controller/src/xmpp/xmpp_connection.cc 734 2025-01-27 Mon 02:30:59:282.616 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.13:56864 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:30:59:286.789 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.18:51716 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:30:59:632.411 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.8:54978 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:31:13:814.873 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.14 SEND Xmpp creating dynamic channel 10.20.0.8:8093::10.20.0.14:45951 controller/src/xmpp/xmpp_server.cc 586 2025-01-27 Mon 02:31:13:814.945 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.14 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2660-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-01-27 Mon 02:31:13:814.983 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8093::10.20.0.14:45951 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:31:13:815.052 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.14 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.14 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-01-27 Mon 02:31:13:815.141 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:31:13:815.255 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 45951 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:31:14:025.810 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2660-1/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:31:14:234.590 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.6 SEND Xmpp creating dynamic channel 10.20.0.8:8093::10.20.0.6:46549 controller/src/xmpp/xmpp_server.cc 586 2025-01-27 Mon 02:31:14:234.651 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.6 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2660-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-01-27 Mon 02:31:14:234.701 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8093::10.20.0.6:46549 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:31:14:234.763 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2660-2:10.20.0.6 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.6 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-01-27 Mon 02:31:14:234.858 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.6 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:31:14:234.930 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.6 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 46549 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:31:14:453.006 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.6 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2660-2/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-01-27 Mon 02:31:16:726.821 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:31:16:767.809 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:31:16:940.526 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:31:17:022.637 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:31:25:539.441 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.13:44396 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:31:26:599.297 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.8:37962 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:31:27:081.178 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.8:8092::10.20.0.18:51574 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:33:04:575.217 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:04:575.357 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:admin controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:04:575.394 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:04:651.871 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:04:652.025 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:admin:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:04:652.062 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:04:721.996 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:04:722.194 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:04:840.240 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:04:840.504 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:admin:default controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:04:840.542 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:04:958.871 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:04:959.039 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:admin:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:04:959.076 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:05:027.252 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:05:108.940 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:05:109.168 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:admin:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:05:109.233 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:06:172.157 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083191081088, Pid 116400]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.32:8092::10.0.0.37:37928 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-01-27 Mon 02:33:07:604.540 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:07:604.674 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-AnalyticsBasicTestSanity-99997421 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:07:604.708 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:08:155.298 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:08:155.441 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:08:155.476 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:08:218.924 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:08:219.097 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:08:391.396 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:08:391.591 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:08:391.635 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:08:475.394 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:08:475.566 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:08:475.605 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:08:549.671 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:08:549.896 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:08:549.948 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:08:596.893 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:11:435.094 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:12:080.914 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:12:182.327 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:12:182.488 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-99997421:ctest-vn22-05230849 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:12:182.530 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:12:299.358 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:12:382.214 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:12:435.031 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:12:435.191 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 1d3be64a-1bad-4735-af23-cdc1ac40cbad controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:33:12:627.723 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:12:627.908 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-99997421:ctest-vn22-05230849,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:12:627.932 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:12:627.952 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:12:713.085 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:13:384.787 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:13:760.998 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:17:357.236 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:19:751.087 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:19:795.499 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:19:795.674 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:aaafb063-05ab-4ee1-952d-bbef14a80b9f controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:19:884.648 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:19:884.885 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-99997421:daed497c-d61f-4216-a8b5-38ae522ab5f0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:19:884.945 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:19:884.973 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:19:885.005 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:19:885.026 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:19:942.485 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:20:062.548 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:20:062.720 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:9be9d766-be38-478c-899b-4913a40a13b0 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:20:062.769 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:20:062.800 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:20:645.707 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:20:696.446 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:34:658.210 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:34:658.264 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:34:658.285 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:9be9d766-be38-478c-899b-4913a40a13b0 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:33:34:658.309 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:9be9d766-be38-478c-899b-4913a40a13b0 - virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-99997421:daed497c-d61f-4216-a8b5-38ae522ab5f0 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:34:658.330 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:9be9d766-be38-478c-899b-4913a40a13b0 - virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-99997421:ctest-vn22-05230849 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:34:745.246 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:34:795.757 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:34:795.809 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:34:795.828 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:34:795.846 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:34:795.857 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-99997421:daed497c-d61f-4216-a8b5-38ae522ab5f0 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:33:34:795.878 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-99997421:daed497c-d61f-4216-a8b5-38ae522ab5f0 - project:default-domain:ctest-AnalyticsBasicTestSanity-99997421 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:34:795.897 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-99997421:daed497c-d61f-4216-a8b5-38ae522ab5f0 - security-group:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:34:795.921 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-99997421:daed497c-d61f-4216-a8b5-38ae522ab5f0 - virtual-machine:aaafb063-05ab-4ee1-952d-bbef14a80b9f , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:34:795.935 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-99997421:daed497c-d61f-4216-a8b5-38ae522ab5f0 - virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-99997421:ctest-vn22-05230849 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:34:841.383 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:aaafb063-05ab-4ee1-952d-bbef14a80b9f controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:33:36:114.950 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:36:115.025 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:36:115.053 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:36:115.072 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-99997421:ctest-vn22-05230849 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:33:36:115.089 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-99997421:ctest-vn22-05230849,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:33:36:115.126 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-99997421:ctest-vn22-05230849 - project:default-domain:ctest-AnalyticsBasicTestSanity-99997421 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:36:115.159 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-99997421:ctest-vn22-05230849 - virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-99997421:ctest-vn22-05230849,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:36:115.184 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-99997421:ctest-vn22-05230849,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:36:177.282 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 1d3be64a-1bad-4735-af23-cdc1ac40cbad controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:33:36:367.767 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:37:191.327 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:37:268.337 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:37:383.756 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:37:476.536 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:38:487.389 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:38:487.537 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-FloatingipBasicTestSanity-46069121 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:38:487.592 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:38:553.329 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:38:553.469 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-FloatingipBasicTestSanity-46069121:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:38:553.506 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:38:609.901 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:38:610.094 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:38:736.309 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:38:736.543 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-FloatingipBasicTestSanity-46069121:default controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:38:736.601 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:38:810.263 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:38:810.447 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-FloatingipBasicTestSanity-46069121:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:38:810.488 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:38:871.784 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:38:871.963 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-FloatingipBasicTestSanity-46069121:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:38:872.006 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:38:982.907 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:40:481.897 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:41:313.865 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:41:521.848 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:41:570.033 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:41:613.823 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:42:711.641 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:42:932.718 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:43:031.056 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:43:031.391 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:43:031.456 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:43:132.246 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:43:209.226 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:43:250.546 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:43:250.684 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 0dac1271-6745-470d-a039-99b56f6f6b97 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:33:43:397.444 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:43:397.741 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:43:397.774 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:43:397.796 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:43:436.742 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:44:047.746 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:44:398.251 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:45:643.539 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:45:803.941 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:45:902.002 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:45:902.178 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-vn1-50968984 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:45:902.225 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:45:967.134 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:46:138.776 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:46:138.954 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-vn1-50968984,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:46:138.979 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:46:138.997 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:46:179.309 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:46:254.892 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:46:320.923 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:46:321.022 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 785bd4ea-f255-423b-b4a1-7abde244b386 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:33:46:538.184 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:46:848.139 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:48:091.690 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:48:959.841 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:49:009.223 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:49:009.341 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:ec2e0a17-d377-4318-98bb-4eef080750b8 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:49:155.721 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:49:155.923 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:85503e51-a55d-4200-a253-e4981f3a7391 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:49:155.985 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:49:156.018 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:49:156.038 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:49:156.067 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:49:259.701 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:49:364.612 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:49:364.765 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:fcbf6a23-9a6e-4a08-ad94-cdeaeaa66475 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:49:364.813 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:49:364.837 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:49:603.578 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:49:638.945 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:49:704.025 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:50:150.391 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:50:399.742 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:50:399.889 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296:ctest-some-pool-17155786 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:50:399.924 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:50:451.748 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:50:451.978 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:50:620.602 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:50:787.878 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:51:076.191 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:51:238.074 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:51:238.363 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:c91aa826-fab4-4a97-baf4-9b3d2203173b controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:51:360.051 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:51:360.265 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:ea54bbbf-83c3-4125-a77b-6f1c35960c58 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:51:360.308 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:51:360.339 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:51:360.362 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:51:360.381 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:51:423.094 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:51:521.599 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:51:521.814 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:374494e4-f02b-4d7f-ad6a-a6dfc00463b4 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:33:51:521.859 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:51:521.905 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:33:51:866.076 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:51:918.754 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:52:022.103 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:52:022.177 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove security-group:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default - project:default-domain:ctest-AnalyticsBasicTestSanity-99997421 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:52:102.694 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:52:102.778 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:33:52:102.824 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default:ingress-access-control-list - security-group:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:52:143.362 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:52:219.261 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:52:219.297 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:33:52:219.307 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting security-group:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:33:52:219.337 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default:egress-access-control-list - security-group:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:52:281.370 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:52:281.567 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:52:281.619 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-AnalyticsBasicTestSanity-99997421 - application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default-application-policy-set , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:52:330.898 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:52:330.933 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:33:52:330.955 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-99997421:default-application-policy-set - project:default-domain:ctest-AnalyticsBasicTestSanity-99997421 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:52:382.331 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:33:52:382.374 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting project:default-domain:ctest-AnalyticsBasicTestSanity-99997421 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:33:52:382.396 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-AnalyticsBasicTestSanity-99997421 - domain:default-domain , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:33:52:413.632 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:33:52:457.947 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:02:280.513 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:02:383.875 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:02:384.042 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296:ctest-some-pool-17155786:44e4ffa4-0d64-4f4a-85e8-61db8314a251 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:02:384.084 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating floating-ip-pool-floating-ip controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:02:384.126 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating floating-ip-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:02:544.796 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:02:544.962 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating floating-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:11:710.760 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:11:711.032 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:11:711.081 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296:ctest-some-pool-17155786:44e4ffa4-0d64-4f4a-85e8-61db8314a251 - virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:85503e51-a55d-4200-a253-e4981f3a7391 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:11:790.876 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:11:790.919 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:11:790.941 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting floating-ip:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296:ctest-some-pool-17155786:44e4ffa4-0d64-4f4a-85e8-61db8314a251 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:34:11:790.964 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296:ctest-some-pool-17155786:44e4ffa4-0d64-4f4a-85e8-61db8314a251 - floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296:ctest-some-pool-17155786 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:11:790.984 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296:ctest-some-pool-17155786:44e4ffa4-0d64-4f4a-85e8-61db8314a251 - project:default-domain:ctest-FloatingipBasicTestSanity-46069121 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:11:881.588 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:11:881.753 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:11:881.783 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-FloatingipBasicTestSanity-46069121 - floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296:ctest-some-pool-17155786 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:11:956.994 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:11:957.035 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296:ctest-some-pool-17155786 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:34:11:957.057 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296:ctest-some-pool-17155786 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:12:783.097 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:12:783.190 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:12:783.223 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:fcbf6a23-9a6e-4a08-ad94-cdeaeaa66475 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:34:12:783.257 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:fcbf6a23-9a6e-4a08-ad94-cdeaeaa66475 - virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:85503e51-a55d-4200-a253-e4981f3a7391 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:12:783.288 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:fcbf6a23-9a6e-4a08-ad94-cdeaeaa66475 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-vn1-50968984 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:12:856.456 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:12:937.991 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:12:938.041 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:12:938.062 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:12:938.081 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:12:938.092 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:85503e51-a55d-4200-a253-e4981f3a7391 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:34:12:938.121 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:85503e51-a55d-4200-a253-e4981f3a7391 - project:default-domain:ctest-FloatingipBasicTestSanity-46069121 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:12:938.143 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:85503e51-a55d-4200-a253-e4981f3a7391 - security-group:default-domain:ctest-FloatingipBasicTestSanity-46069121:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:12:938.171 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:85503e51-a55d-4200-a253-e4981f3a7391 - virtual-machine:ec2e0a17-d377-4318-98bb-4eef080750b8 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:12:938.186 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:85503e51-a55d-4200-a253-e4981f3a7391 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-vn1-50968984 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:13:006.359 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:ec2e0a17-d377-4318-98bb-4eef080750b8 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:34:13:153.562 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:13:153.608 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:13:153.621 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:374494e4-f02b-4d7f-ad6a-a6dfc00463b4 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:34:13:153.644 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:374494e4-f02b-4d7f-ad6a-a6dfc00463b4 - virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:ea54bbbf-83c3-4125-a77b-6f1c35960c58 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:13:153.665 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:374494e4-f02b-4d7f-ad6a-a6dfc00463b4 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:13:225.219 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:13:283.087 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:13:283.150 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:13:283.183 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:13:283.200 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:13:283.212 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:ea54bbbf-83c3-4125-a77b-6f1c35960c58 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:34:13:283.234 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:ea54bbbf-83c3-4125-a77b-6f1c35960c58 - project:default-domain:ctest-FloatingipBasicTestSanity-46069121 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:13:283.254 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:ea54bbbf-83c3-4125-a77b-6f1c35960c58 - security-group:default-domain:ctest-FloatingipBasicTestSanity-46069121:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:13:283.269 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:ea54bbbf-83c3-4125-a77b-6f1c35960c58 - virtual-machine:c91aa826-fab4-4a97-baf4-9b3d2203173b , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:13:283.283 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-46069121:ea54bbbf-83c3-4125-a77b-6f1c35960c58 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:13:340.779 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:c91aa826-fab4-4a97-baf4-9b3d2203173b controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:34:14:291.051 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:14:291.128 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:14:291.165 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:14:291.178 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-vn1-50968984 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:34:14:291.189 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-vn1-50968984,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:34:14:291.214 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-vn1-50968984 - project:default-domain:ctest-FloatingipBasicTestSanity-46069121 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:14:291.240 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-vn1-50968984 - virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-vn1-50968984,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:14:291.257 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-vn1-50968984,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:14:377.144 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 785bd4ea-f255-423b-b4a1-7abde244b386 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:34:14:619.984 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:14:821.394 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:14:821.468 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:14:821.488 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-01-27 Mon 02:34:14:821.513 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296 controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:34:14:821.525 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-01-27 Mon 02:34:14:821.552 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296 - project:default-domain:ctest-FloatingipBasicTestSanity-46069121 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:14:821.578 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296 - virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:14:821.595 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-46069121:ctest-fvn-18271296,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-01-27 Mon 02:34:14:889.511 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 0dac1271-6745-470d-a039-99b56f6f6b97 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:34:15:059.295 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:16:504.561 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:16:581.201 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:16:685.625 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:16:791.105 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:17:786.244 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:17:786.374 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-TestHeat-66730410 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:17:786.411 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:17:857.785 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:17:857.990 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-TestHeat-66730410:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:17:858.048 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:17:900.765 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:17:901.008 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:18:017.649 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:18:017.859 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-TestHeat-66730410:default controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:18:017.899 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:18:102.818 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:18:102.982 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestHeat-66730410:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:18:103.023 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:18:177.721 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:18:177.928 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestHeat-66730410:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:18:177.970 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:18:230.228 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:22:461.546 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:22:516.364 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:22:614.322 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:22:709.196 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:23:796.493 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:23:796.633 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-TestRoutersBasic-35410512 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:23:796.669 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:23:860.308 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:23:860.521 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-TestRoutersBasic-35410512:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:23:860.582 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:23:905.985 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:23:906.207 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:24:041.748 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:24:041.966 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-TestRoutersBasic-35410512:default controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:24:042.005 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:24:130.909 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:24:131.095 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestRoutersBasic-35410512:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:24:131.160 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:24:223.013 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:24:223.229 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestRoutersBasic-35410512:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:24:223.284 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:24:223.452 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:27:758.591 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:27:968.835 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:28:171.215 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:28:244.123 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:28:289.585 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:28:381.602 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:28:571.063 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:28:645.503 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:28:645.706 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestRoutersBasic-35410512:ctest-vn-88074529 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:28:645.779 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:28:716.130 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:29:444.517 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:29:502.376 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:29:502.497 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 4c10f479-3996-4366-a745-abc45d4c22f4 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:34:29:502.682 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-35410512:ctest-vn-88074529,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:29:502.709 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:29:502.731 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:29:576.013 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:29:811.342 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:29:969.547 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:30:035.258 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:30:035.411 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestRoutersBasic-35410512:ctest-ext_vn-22303717 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:30:035.458 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:30:095.389 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:30:169.556 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:30:169.707 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip-pool:default-domain:ctest-TestRoutersBasic-35410512:ctest-ext_vn-22303717:floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:30:169.746 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:30:194.589 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:30:241.532 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:30:241.658 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 5ba1346e-d011-4bb4-a091-761dc0a48eba controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:34:30:418.000 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:30:418.203 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-35410512:ctest-ext_vn-22303717,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:30:418.240 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:30:418.266 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:30:473.369 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:31:585.540 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:32:619.314 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:32:651.836 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:32:651.958 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:92bb3995-c0bf-4b34-ae72-93ffc1db0fee controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:32:759.009 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:32:759.217 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-35410512:81eb2b8e-cf1b-4703-9169-455e2ec92eec controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:32:759.264 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:32:759.292 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:32:759.315 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:32:759.336 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:32:833.039 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:32:904.124 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:32:904.296 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:c96ca047-e8bc-4629-bd4d-6ace6a88b506 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:32:904.337 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:32:904.360 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:33:163.211 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:33:238.453 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:33:263.423 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:33:817.161 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:33:887.068 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:33:887.411 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating logical-router:default-domain:ctest-TestRoutersBasic-35410512:ctest-router1-23987053 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:33:887.477 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-logical-router controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:33:974.642 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:108.510 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083016222464, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:139.515 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:182.569 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:182.709 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083020420864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:1fae119d-dee4-41cc-a21a-595cf1406fe4 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:34:360.657 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:360.854 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-35410512:63102004-a908-48be-a1a7-f8c710dda409 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:34:360.897 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:360.929 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:360.954 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:360.974 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083007825664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:452.000 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083003627264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:470.860 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:471.011 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating logical-router-virtual-network:attr(default-domain:ctest-TestRoutersBasic-35410512:ctest-ext_vn-22303717,default-domain:ctest-TestRoutersBasic-35410512:ctest-router1-23987053) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:34:471.038 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:471.058 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083024619264, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:576.714 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:576.884 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:1fe90b90-00d5-4f1d-b5ae-7553f3174f60 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:34:576.929 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:576.961 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:619.870 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082904295168, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:729.036 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:729.240 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-35410512:2c856a2b-29ec-41c9-88e9-658443ec8c23 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:34:729.283 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:729.313 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:769.782 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:769.949 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestRoutersBasic-35410512:snat-si-left_snat_70b028e2-ab3c-4ad1-b240-da1759333e99_92fbbd8d-feaa-4dc3-8fc1-4a51dac39913 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:34:769.990 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:770.015 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-35410512:snat-si-left_snat_70b028e2-ab3c-4ad1-b240-da1759333e99_92fbbd8d-feaa-4dc3-8fc1-4a51dac39913,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:34:770.031 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:770.051 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:790.440 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:888.028 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:917.729 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:917.893 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:7897f30d-b17f-4231-9f7e-1273a181a182 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:34:917.932 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:917.954 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:34:958.625 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083028817664, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:34:989.241 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083033016064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:35:025.626 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140083012024064, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:35:069.531 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082908493568, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:35:077.475 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:35:077.568 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance bcf7b81d-d760-4e4f-88c1-067dc957ffc9 controller/src/ifmap/client/config_json_parser.cc 223 2025-01-27 Mon 02:34:35:085.376 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-01-27 Mon 02:34:35:085.527 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-instance:default-domain:ctest-TestRoutersBasic-35410512:snat_70b028e2-ab3c-4ad1-b240-da1759333e99_92fbbd8d-feaa-4dc3-8fc1-4a51dac39913 controller/src/ifmap/ifmap_server_table.cc 95 2025-01-27 Mon 02:34:35:085.566 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:35:085.593 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082999428864, Pid 116400]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating service-instance-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-01-27 Mon 02:34:35:159.754 UTC cn-jenkins-deploy-platform-ansible-os-2660-2 [Thread 140082890401536, Pid 116400]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573