2025-03-20 Thu 01:55:46:019.232 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:55:46:019.294 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:55:46:019.330 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: SANDESH: Send FAILED: 1742435746009423 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Established : EvTcpClose -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:55:46:019.338 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:55:46:019.349 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: Processing scm::EvTcpDeleteSession in state Connect 2025-03-20 Thu 01:55:46:019.389 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:55:46:019.637 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: SANDESH: Send FAILED: 1742435746009648 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 1 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 218909 calls = 18 average_bytes = 12161 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 10 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 6 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1438, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 16, _iter59->first = sent _iter59->second = 21, ] ] ] 2025-03-20 Thu 01:55:46:019.658 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:55:46:022.084 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:35108::10.0.0.47:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-03-20 Thu 01:55:46:022.111 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:35108::10.0.0.47:8086(-1) OnSessionEvent TCP Connected 2025-03-20 Thu 01:55:46:022.121 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:35108::10.0.0.47:8086(-1):EvTcpConnected 2025-03-20 Thu 01:55:46:022.662 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Processing scm::EvTcpConnected in state Connect 2025-03-20 Thu 01:55:46:022.687 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Connect : EvTcpConnected : Cancelling Connect timer 2025-03-20 Thu 01:55:46:022.734 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ClientInit 2025-03-20 Thu 01:55:46:022.763 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2923-2:contrail-dns:0:Control count 2 2025-03-20 Thu 01:55:46:022.927 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:55:46:022.940 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-03-20 Thu 01:55:46:022.979 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SANDESH: Send FAILED: 1742435746022722 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.47:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:55:46:022.994 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Received UVE message in wrong state : NodeStatusUVE 2025-03-20 Thu 01:55:46:023.003 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:55:46:023.009 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-03-20 Thu 01:55:46:023.021 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:55:46:023.027 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-03-20 Thu 01:55:46:023.270 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SANDESH: Send FAILED: 1742435746022909 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 2 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 218909 calls = 18 average_bytes = 12161 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 19, _iter59->first = sent _iter59->second = 21, ] ] ] 2025-03-20 Thu 01:55:46:023.288 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-03-20 Thu 01:55:46:093.384 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: OnMessage control in state: ClientInit 2025-03-20 Thu 01:55:46:093.433 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-03-20 Thu 01:55:46:093.443 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ClientInit : EvSandeshMessageRecv 2025-03-20 Thu 01:55:46:093.467 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Received Ctrl Message with size 0 2025-03-20 Thu 01:55:46:093.486 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2923-2 start_time = 1742435574455554 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-03-17 00:10:33.884380","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-8139-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.42:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.23, ] ] proxy seq 1 2025-03-20 Thu 01:55:46:093.500 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-03-20 Thu 01:55:46:093.808 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 2 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 218909 calls = 18 average_bytes = 12161 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 35 dequeues = 35 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 39 dequeues = 39 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Established state_since = 1742435611880522 last_state = Established last_event = scm::EvSandeshSend last_event_at = 1742435701831530 ] session_stats= [ num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 19 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] session_tx_socket_stats= [ bytes = 183604 calls = 16 average_bytes = 11475 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 10 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 8 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 1 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 19, _iter59->first = sent _iter59->second = 21, ] ] max_sm_queue_count = 5 proxy seq 19 2025-03-20 Thu 01:55:46:093.840 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-03-20 Thu 01:55:46:093.865 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.47:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 14 2025-03-20 Thu 01:55:46:093.881 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-03-20 Thu 01:55:46:093.893 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:55:46:093.900 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:55:46:093.907 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:55:46:093.942 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Established 2025-03-20 Thu 01:55:46:197.270 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:35108::10.0.0.47:8086(-1) OnSessionEvent TCP Connection Closed 2025-03-20 Thu 01:55:46:197.303 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:35108::10.0.0.47:8086(-1):EvTcpClose 2025-03-20 Thu 01:55:46:197.367 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Processing scm::EvTcpClose in state Established 2025-03-20 Thu 01:55:46:197.379 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Established : EvTcpClose 2025-03-20 Thu 01:55:46:197.680 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Connect : Start Connect timer 10.0.0.12:8086 2025-03-20 Thu 01:55:46:197.878 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:55:46:198.135 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: SANDESH: Send FAILED: 1742435746197489 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Established successful_connections = 2 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = cn-jenkins-deploy-platform-ansible-os-2923-3. collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 294781 calls = 24 average_bytes = 12282 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 21, _iter59->first = sent _iter59->second = 28, ] ] ] 2025-03-20 Thu 01:55:46:198.160 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:55:46:198.171 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:55:46:198.197 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: SANDESH: Send FAILED: 1742435746197548 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.47:8086, ] ] status = Initializing description = Established : EvTcpClose -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:55:46:198.203 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:55:46:198.215 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Processing scm::EvTcpDeleteSession in state Connect 2025-03-20 Thu 01:55:46:198.260 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:55:46:198.543 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: SANDESH: Send FAILED: 1742435746197853 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 2 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 294781 calls = 24 average_bytes = 12282 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 9 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 8 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1439, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 21, _iter59->first = sent _iter59->second = 28, ] ] ] 2025-03-20 Thu 01:55:46:198.564 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:55:46:201.112 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:49158::10.0.0.12:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-03-20 Thu 01:55:46:201.140 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:49158::10.0.0.12:8086(-1) OnSessionEvent TCP Connected 2025-03-20 Thu 01:55:46:201.152 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:49158::10.0.0.12:8086(-1):EvTcpConnected 2025-03-20 Thu 01:55:46:202.494 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Processing scm::EvTcpConnected in state Connect 2025-03-20 Thu 01:55:46:202.514 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Connect : EvTcpConnected : Cancelling Connect timer 2025-03-20 Thu 01:55:46:202.556 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: ClientInit 2025-03-20 Thu 01:55:46:202.568 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2923-2:contrail-dns:0:Control count 3 2025-03-20 Thu 01:55:46:202.685 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:55:46:202.694 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-03-20 Thu 01:55:46:202.763 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: SANDESH: Send FAILED: 1742435746202547 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:55:46:202.771 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Received UVE message in wrong state : NodeStatusUVE 2025-03-20 Thu 01:55:46:202.780 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:55:46:202.786 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-03-20 Thu 01:55:46:202.796 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:55:46:202.802 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-03-20 Thu 01:55:46:203.061 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: SANDESH: Send FAILED: 1742435746202670 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 3 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 294781 calls = 24 average_bytes = 12282 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 13 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 11 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 24, _iter59->first = sent _iter59->second = 28, ] ] ] 2025-03-20 Thu 01:55:46:203.085 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-03-20 Thu 01:55:46:303.820 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:49158::10.0.0.12:8086(-1) OnSessionEvent TCP Connection Closed 2025-03-20 Thu 01:55:46:303.850 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:49158::10.0.0.12:8086(-1):EvTcpClose 2025-03-20 Thu 01:55:46:305.413 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Processing scm::EvTcpClose in state ClientInit 2025-03-20 Thu 01:55:46:305.439 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: ClientInit : EvTcpClose 2025-03-20 Thu 01:55:46:305.599 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Return to idle with 5000 2025-03-20 Thu 01:55:46:305.608 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Idle 2025-03-20 Thu 01:55:46:305.743 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:55:46:306.070 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: SANDESH: Send FAILED: 1742435746305538 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 3 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 296391 calls = 25 average_bytes = 11855 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 26, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-03-20 Thu 01:55:46:306.099 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:55:46:306.111 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:55:46:306.135 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: SANDESH: Send FAILED: 1742435746305574 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:55:46:306.142 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:55:46:306.150 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-20 Thu 01:55:46:306.160 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:55:46:306.397 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: SANDESH: Send FAILED: 1742435746305669 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 3 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 296391 calls = 25 average_bytes = 11855 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 12 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 26, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-03-20 Thu 01:55:46:306.416 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:55:51:305.732 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-20 Thu 01:55:51:306.004 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Connect : Start Connect timer 10.0.0.42:8086 2025-03-20 Thu 01:55:51:306.139 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:55:51:306.169 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: SANDESH: Send FAILED: 1742435751305821 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:55:51:306.177 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:55:51:306.193 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:55:51:306.447 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: SANDESH: Send FAILED: 1742435751306121 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 3 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 296391 calls = 25 average_bytes = 11855 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 14 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 9 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1440, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 29, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-03-20 Thu 01:55:51:306.469 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:55:51:308.522 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:45148::10.0.0.42:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-03-20 Thu 01:55:51:308.552 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:45148::10.0.0.42:8086(-1) OnSessionEvent TCP Connected 2025-03-20 Thu 01:55:51:308.560 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:45148::10.0.0.42:8086(-1):EvTcpConnected 2025-03-20 Thu 01:55:51:308.629 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Processing scm::EvTcpConnected in state Connect 2025-03-20 Thu 01:55:51:308.661 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Connect : EvTcpConnected : Cancelling Connect timer 2025-03-20 Thu 01:55:51:308.707 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: ClientInit 2025-03-20 Thu 01:55:51:308.730 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2923-2:contrail-dns:0:Control count 4 2025-03-20 Thu 01:55:51:308.824 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:55:51:308.833 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-03-20 Thu 01:55:51:308.856 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: SANDESH: Send FAILED: 1742435751308696 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:55:51:308.863 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Received UVE message in wrong state : NodeStatusUVE 2025-03-20 Thu 01:55:51:308.871 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:55:51:308.877 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-03-20 Thu 01:55:51:308.887 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:55:51:308.893 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-03-20 Thu 01:55:51:309.158 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: SANDESH: Send FAILED: 1742435751308812 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 4 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 296391 calls = 25 average_bytes = 11855 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 3 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 15 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1441, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 31, _iter59->first = sent _iter59->second = 29, ] ] ] 2025-03-20 Thu 01:55:51:309.185 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-03-20 Thu 01:55:53:308.867 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: 10.0.0.42:8086 EvConnectTimerExpired in state ClientInit 2025-03-20 Thu 01:55:53:308.953 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: Processing scm::EvConnectTimerExpired in state ClientInit 2025-03-20 Thu 01:55:53:308.993 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: ClientInit : EvConnectTimerExpired 2025-03-20 Thu 01:55:53:309.236 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: Return to idle with 5000 2025-03-20 Thu 01:55:53:309.259 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: Idle 2025-03-20 Thu 01:55:53:309.332 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:55:53:309.582 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: SANDESH: Send FAILED: 1742435753309115 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 4 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 298001 calls = 26 average_bytes = 11461 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1441, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33, _iter59->first = sent _iter59->second = 30, ] ] ] 2025-03-20 Thu 01:55:53:309.607 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:55:53:309.617 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:55:53:309.640 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: SANDESH: Send FAILED: 1742435753309152 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Down description = ClientInit : EvConnectTimerExpired ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:55:53:309.646 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:55:53:309.654 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-20 Thu 01:55:53:309.706 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:55:53:309.931 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: SANDESH: Send FAILED: 1742435753309319 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 4 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 298001 calls = 26 average_bytes = 11461 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 17 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 16 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1441, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 33, _iter59->first = sent _iter59->second = 30, ] ] ] 2025-03-20 Thu 01:55:53:309.949 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:55:58:309.540 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-20 Thu 01:55:58:309.784 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Connect : Start Connect timer 10.0.0.47:8086 2025-03-20 Thu 01:55:58:310.091 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:55:58:310.133 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SANDESH: Send FAILED: 1742435758309632 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.47:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:55:58:310.142 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:55:58:310.151 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:55:58:310.469 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SANDESH: Send FAILED: 1742435758309898 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 4 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 298001 calls = 26 average_bytes = 11461 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 18 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 10 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1441, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 36, _iter59->first = sent _iter59->second = 30, ] ] ] 2025-03-20 Thu 01:55:58:310.496 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:55:58:312.970 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:35516::10.0.0.47:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-03-20 Thu 01:55:58:313.010 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:35516::10.0.0.47:8086(-1) OnSessionEvent TCP Connected 2025-03-20 Thu 01:55:58:313.018 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:35516::10.0.0.47:8086(-1):EvTcpConnected 2025-03-20 Thu 01:55:58:313.072 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Processing scm::EvTcpConnected in state Connect 2025-03-20 Thu 01:55:58:313.084 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Connect : EvTcpConnected : Cancelling Connect timer 2025-03-20 Thu 01:55:58:313.118 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ClientInit 2025-03-20 Thu 01:55:58:313.133 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2923-2:contrail-dns:0:Control count 5 2025-03-20 Thu 01:55:58:313.239 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:55:58:313.264 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-03-20 Thu 01:55:58:313.294 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SANDESH: Send FAILED: 1742435758313111 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.47:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:55:58:313.301 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Received UVE message in wrong state : NodeStatusUVE 2025-03-20 Thu 01:55:58:313.311 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:55:58:313.317 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-03-20 Thu 01:55:58:313.327 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:55:58:313.333 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-03-20 Thu 01:55:58:313.574 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: SANDESH: Send FAILED: 1742435758313221 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 298001 calls = 26 average_bytes = 11461 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 4 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 19 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 11 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1442, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 38, _iter59->first = sent _iter59->second = 30, ] ] ] 2025-03-20 Thu 01:55:58:313.601 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-03-20 Thu 01:55:58:786.888 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.12:35516::10.0.0.47:8086(-1) < Read failed due to error system 104 : Connection reset by peer src/contrail-common/io/tcp_session.cc 507 2025-03-20 Thu 01:55:58:786.943 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_ERR]: TcpSessionMessageLog: Session 10.0.0.12:35516::10.0.0.47:8086(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-20 Thu 01:55:58:787.012 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:35516::10.0.0.47:8086(-1) OnSessionEvent TCP Connection Closed 2025-03-20 Thu 01:55:58:787.031 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:35516::10.0.0.47:8086(-1):EvTcpClose 2025-03-20 Thu 01:55:58:787.084 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvTcpClose in state ClientInit 2025-03-20 Thu 01:55:58:787.096 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: ClientInit : EvTcpClose 2025-03-20 Thu 01:55:58:787.275 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Return to idle with 5000 2025-03-20 Thu 01:55:58:787.284 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Idle 2025-03-20 Thu 01:55:58:787.357 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:55:58:787.606 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: SANDESH: Send FAILED: 1742435758787211 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1444, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 40, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:55:58:787.627 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:55:58:787.637 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:55:58:787.661 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: SANDESH: Send FAILED: 1742435758787260 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.47:8086, ] ] status = Down description = ClientInit : EvTcpClose ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:55:58:787.668 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:55:58:787.676 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-20 Thu 01:55:58:787.703 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:55:58:787.966 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: SANDESH: Send FAILED: 1742435758787338 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 20 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1444, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 40, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:55:58:787.986 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:01:835.516 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:01:835.641 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SANDESH: Send FAILED: 1742435761835200 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 74 dequeues = 74 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 95 dequeues = 95 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1742435758787283 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1742435758787702 ] max_sm_queue_count = 6 ] 2025-03-20 Thu 01:56:01:835.670 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:01:835.681 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:01:835.960 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SANDESH: Send FAILED: 1742435761835455 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1444, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 43, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:01:835.982 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:03:787.416 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-20 Thu 01:56:03:787.780 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Connect : Start Connect timer 10.0.0.12:8086 2025-03-20 Thu 01:56:03:788.002 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:56:03:788.050 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: SANDESH: Send FAILED: 1742435763787533 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:56:03:788.064 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:56:03:788.079 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:56:03:788.549 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: SANDESH: Send FAILED: 1742435763787978 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 21 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1444, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 45, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:03:788.600 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:03:788.987 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-20 Thu 01:56:03:790.271 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: -(-1):EvTcpConnectFail 2025-03-20 Thu 01:56:03:793.876 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Processing scm::EvTcpConnectFail in state Connect 2025-03-20 Thu 01:56:03:793.914 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Connect : EvTcpConnectFail 2025-03-20 Thu 01:56:03:794.087 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-20 Thu 01:56:03:794.129 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Idle 2025-03-20 Thu 01:56:03:795.352 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:03:795.610 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: SANDESH: Send FAILED: 1742435763794020 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1444, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 47, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:03:795.638 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:03:795.648 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:03:795.672 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: SANDESH: Send FAILED: 1742435763794059 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:56:03:795.681 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:56:03:795.689 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-20 Thu 01:56:03:795.725 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:03:795.954 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: SANDESH: Send FAILED: 1742435763795336 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 22 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1445, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 47, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:03:795.974 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:11:794.289 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-20 Thu 01:56:11:794.517 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Connect : Start Connect timer 10.0.0.42:8086 2025-03-20 Thu 01:56:11:794.695 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:56:11:794.741 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: SANDESH: Send FAILED: 1742435771794362 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:56:11:794.754 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:56:11:794.765 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:56:11:794.905 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-20 Thu 01:56:11:794.931 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: -(-1):EvTcpConnectFail 2025-03-20 Thu 01:56:11:795.199 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: SANDESH: Send FAILED: 1742435771794669 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 23 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1445, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 50, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:11:795.369 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:11:795.390 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvTcpConnectFail in state Connect 2025-03-20 Thu 01:56:11:795.401 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Connect : EvTcpConnectFail 2025-03-20 Thu 01:56:11:795.570 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-20 Thu 01:56:11:795.616 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Idle 2025-03-20 Thu 01:56:11:795.720 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:11:796.146 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: SANDESH: Send FAILED: 1742435771795497 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1445, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:11:796.172 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:11:796.189 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:11:796.220 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: SANDESH: Send FAILED: 1742435771795537 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:56:11:796.229 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:56:11:796.241 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-20 Thu 01:56:11:796.286 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:11:796.686 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: SANDESH: Send FAILED: 1742435771795704 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 24 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1446, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 52, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:11:796.722 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:27:795.769 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-20 Thu 01:56:27:796.023 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Connect : Start Connect timer 10.0.0.47:8086 2025-03-20 Thu 01:56:27:796.162 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:56:27:796.193 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: SANDESH: Send FAILED: 1742435787795870 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.47:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:56:27:796.203 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:56:27:796.211 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:56:27:796.412 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-20 Thu 01:56:27:796.459 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: -(-1):EvTcpConnectFail 2025-03-20 Thu 01:56:27:796.464 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: SANDESH: Send FAILED: 1742435787796146 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 25 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1446, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 55, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:27:796.508 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:27:796.520 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvTcpConnectFail in state Connect 2025-03-20 Thu 01:56:27:796.528 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Connect : EvTcpConnectFail 2025-03-20 Thu 01:56:27:796.640 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-20 Thu 01:56:27:796.670 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Idle 2025-03-20 Thu 01:56:27:796.732 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:27:796.960 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: SANDESH: Send FAILED: 1742435787796589 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 15 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1446, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 57, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:27:796.981 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:27:796.991 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:27:797.012 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: SANDESH: Send FAILED: 1742435787796613 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:56:27:797.019 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:56:27:797.026 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-20 Thu 01:56:27:797.046 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:27:797.279 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: SANDESH: Send FAILED: 1742435787796721 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 26 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1447, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 57, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:27:797.300 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:31:836.059 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:31:836.230 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: SANDESH: Send FAILED: 1742435791835852 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 91 dequeues = 91 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 3 dequeues = 3 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 8 dequeues = 8 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 121 dequeues = 121 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1742435787796668 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1742435787797044 ] max_sm_queue_count = 6 ] 2025-03-20 Thu 01:56:31:836.267 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:31:836.300 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:31:836.716 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: SANDESH: Send FAILED: 1742435791836022 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 33 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1447, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 60, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:31:836.756 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:57:796.782 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-20 Thu 01:56:57:796.990 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Connect : Start Connect timer 10.0.0.12:8086 2025-03-20 Thu 01:56:57:797.022 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-20 Thu 01:56:57:797.054 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: -(-1):EvTcpConnectFail 2025-03-20 Thu 01:56:57:797.121 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:56:57:797.151 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: SANDESH: Send FAILED: 1742435817796851 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.12:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:56:57:797.160 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:56:57:797.169 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvTcpConnectFail in state Connect 2025-03-20 Thu 01:56:57:797.176 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Connect : EvTcpConnectFail 2025-03-20 Thu 01:56:57:797.472 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-20 Thu 01:56:57:797.509 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Idle 2025-03-20 Thu 01:56:57:797.595 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:57:797.922 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: SANDESH: Send FAILED: 1742435817797102 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.12:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 27 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1447, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 62, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:57:797.958 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:57:797.972 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:57:798.256 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: SANDESH: Send FAILED: 1742435817797254 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 16 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1447, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 63, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:57:798.279 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:56:57:798.291 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:57:798.320 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: SANDESH: Send FAILED: 1742435817797445 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:56:57:798.333 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:56:57:798.345 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-20 Thu 01:56:57:798.370 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:56:57:798.801 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: SANDESH: Send FAILED: 1742435817797572 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 28 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 35 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1448, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 63, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:56:57:798.834 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:57:01:837.196 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:57:01:837.312 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: SANDESH: Send FAILED: 1742435821837041 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 6 dequeues = 6 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 98 dequeues = 98 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 9 dequeues = 9 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 131 dequeues = 131 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1742435817797508 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1742435817798368 ] max_sm_queue_count = 6 ] 2025-03-20 Thu 01:57:01:837.326 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:57:01:837.335 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:57:01:837.568 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: SANDESH: Send FAILED: 1742435821837168 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 645 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 38 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1448, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 67, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:57:01:837.593 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:57:04:929.281 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:05:535.654 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:05:836.797 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:06:091.038 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:06:367.366 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:06:435.286 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:07:230.111 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471239370496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:07:632.510 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:07:843.715 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:13:268.450 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:18:728.362 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:18:763.366 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:18:788.544 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471239370496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:20:356.003 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:20:412.266 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:20:430.677 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:20:542.388 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:20:635.619 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:20:639.461 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:20:743.193 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:20:807.091 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:20:819.418 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:20:925.212 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:20:981.811 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:20:991.903 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:095.809 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:174.919 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:187.438 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471239370496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:299.426 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471239370496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:385.535 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:393.130 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:528.833 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:583.652 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471239370496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:588.803 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471239370496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:693.526 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:754.720 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471239370496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:765.286 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:895.708 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:960.756 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:21:996.942 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:081.620 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:158.210 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:192.342 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:267.607 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:350.628 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:380.968 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:444.689 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:533.623 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:566.326 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:697.721 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:730.573 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:777.963 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:866.340 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:888.082 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:22:968.543 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:029.752 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:062.068 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471239370496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:165.842 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:212.394 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470931945216, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:241.681 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:341.046 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471239370496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:430.974 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:442.869 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:550.883 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:624.660 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:650.584 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:741.839 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:799.985 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:830.145 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:914.280 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:23:963.977 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:24:002.713 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:24:083.339 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:24:132.612 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:24:182.789 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471239370496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:24:271.916 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:24:343.895 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:24:354.832 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471226775296, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:24:453.891 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:24:504.012 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.11:34412 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-20 Thu 01:57:24:515.157 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:24:519.838 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470927746816, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:24:619.966 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:24:708.306 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.5:39000 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-20 Thu 01:57:24:732.570 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.23:46484 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-20 Thu 01:57:27:797.647 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-20 Thu 01:57:27:798.016 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Connect : Start Connect timer 10.0.0.42:8086 2025-03-20 Thu 01:57:27:798.165 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:57:27:798.197 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: SANDESH: Send FAILED: 1742435847797715 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:57:27:798.213 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:57:27:798.222 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:57:27:798.479 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: SANDESH: Send FAILED: 1742435847798146 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 727 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 29 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 40 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1533, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 69, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:57:27:798.500 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:57:27:798.778 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: -(-1) OnSessionEvent TCP Connect Failed 2025-03-20 Thu 01:57:27:798.801 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: -(-1):EvTcpConnectFail 2025-03-20 Thu 01:57:27:798.873 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Processing scm::EvTcpConnectFail in state Connect 2025-03-20 Thu 01:57:27:798.905 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Connect : EvTcpConnectFail 2025-03-20 Thu 01:57:27:799.117 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: TCP [SYS_ERR]: TcpSessionMessageLog: Session -(-1) > Shutdown failed due to error: Transport endpoint is not connected src/contrail-common/io/tcp_session.cc 312 2025-03-20 Thu 01:57:27:799.161 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Idle 2025-03-20 Thu 01:57:27:799.270 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:57:27:799.517 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: SANDESH: Send FAILED: 1742435847799060 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 727 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 41 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 20 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1533, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 71, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:57:27:799.543 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:57:27:799.553 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:57:27:799.575 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: SANDESH: Send FAILED: 1742435847799091 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 0.0.0.0:0, ] ] status = Down description = Connect : EvTcpConnectFail ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:57:27:799.581 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:57:27:799.589 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Processing scm::EvTcpDeleteSession in state Idle 2025-03-20 Thu 01:57:27:799.614 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:57:27:799.828 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: SANDESH: Send FAILED: 1742435847799258 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 727 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 30 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 41 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1534, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 71, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:57:27:799.846 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471235172096, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:57:31:837.556 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:57:31:837.707 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SANDESH: Send FAILED: 1742435851837362 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 105 dequeues = 105 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 141 dequeues = 141 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1742435847799159 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1742435847799612 ] max_sm_queue_count = 6 ] 2025-03-20 Thu 01:57:31:837.738 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:57:31:837.749 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: Processing scm::EvSandeshSend in state Idle 2025-03-20 Thu 01:57:31:838.002 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SANDESH: Send FAILED: 1742435851837507 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 727 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 43 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 21 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1534, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 74, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:57:31:838.019 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: Wrong state: Idle for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:57:36:207.535 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:36:531.321 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471230973696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:36:557.359 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:42:905.002 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:42:943.407 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:42:950.759 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471243568896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:44:315.755 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:44:331.867 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:44:346.329 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471222576896, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:57:50:867.037 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.5:59540 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-20 Thu 01:57:50:879.281 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.23:48094 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-20 Thu 01:57:51:992.469 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.11:50644 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 254 2025-03-20 Thu 01:57:57:800.889 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Processing scm::EvIdleHoldTimerExpired in state Idle 2025-03-20 Thu 01:57:57:801.053 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Connect : Start Connect timer 10.0.0.47:8086 2025-03-20 Thu 01:57:57:801.273 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:57:57:801.318 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: SANDESH: Send FAILED: 1742435877800950 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.47:8086, ] ] status = Initializing description = Idle : EvIdleHoldTimerExpired -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:57:57:801.329 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:57:57:801.341 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:57:57:801.567 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: SANDESH: Send FAILED: 1742435877801255 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 5 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 736 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 31 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 45 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 24 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1546, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 76, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:57:57:801.639 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471205783296, Pid 76904]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:57:57:804.177 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:56158::10.0.0.47:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 280 2025-03-20 Thu 01:57:57:804.202 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:56158::10.0.0.47:8086(-1) OnSessionEvent TCP Connected 2025-03-20 Thu 01:57:57:804.210 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471399495808, Pid 76904]: 10.0.0.12:56158::10.0.0.47:8086(-1):EvTcpConnected 2025-03-20 Thu 01:57:57:804.259 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Processing scm::EvTcpConnected in state Connect 2025-03-20 Thu 01:57:57:804.269 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Connect : EvTcpConnected : Cancelling Connect timer 2025-03-20 Thu 01:57:57:804.308 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ClientInit 2025-03-20 Thu 01:57:57:804.324 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2923-2:contrail-dns:0:Control count 6 2025-03-20 Thu 01:57:57:804.487 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:57:57:804.508 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-03-20 Thu 01:57:57:804.542 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: SANDESH: Send FAILED: 1742435877804301 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.47:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:57:57:804.551 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Received UVE message in wrong state : NodeStatusUVE 2025-03-20 Thu 01:57:57:804.562 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:57:57:804.570 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-03-20 Thu 01:57:57:804.585 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:57:57:804.592 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-03-20 Thu 01:57:57:804.997 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: SANDESH: Send FAILED: 1742435877804463 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 6 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 736 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 46 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1547, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 78, _iter59->first = sent _iter59->second = 31, ] ] ] 2025-03-20 Thu 01:57:57:805.025 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471218378496, Pid 76904]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-03-20 Thu 01:57:57:880.505 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: OnMessage control in state: ClientInit 2025-03-20 Thu 01:57:57:880.552 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-03-20 Thu 01:57:57:880.562 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ClientInit : EvSandeshMessageRecv 2025-03-20 Thu 01:57:57:880.586 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: Received Ctrl Message with size 0 2025-03-20 Thu 01:57:57:880.602 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2923-2 start_time = 1742435574455554 build_info = {"build-info":[{"build-version":"nightly.r24.1.centos","build-time":"2025-03-17 00:10:33.884380","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-8139-1.novalocal","build-id":"nightly.r24.1.centos-nightly_r24.1_centos.el7@contrail","build-number":"unknown"}]} collector = 10.0.0.42:8086 self_ip_list= [ [ (*_iter12) = 10.20.0.23, ] ] proxy seq 1 2025-03-20 Thu 01:57:57:880.615 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 1 2025-03-20 Thu 01:57:57:886.563 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 6 pid = 76904 http_port = 8092 start_time = 1742435573852474 collector_name = collector_ip = 10.0.0.47:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 2034 calls = 4 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 299611 calls = 27 average_bytes = 11096 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] sm_queue_count = 0 sm_stats= [ ev_stats= [ [ [ event = scm::EvCollectorUpdate enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvConnectTimerExpired enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvIdleHoldTimerExpired enqueues = 7 dequeues = 7 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshMessageRecv enqueues = 2 dequeues = 2 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvSandeshSend enqueues = 105 dequeues = 105 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvStart enqueues = 1 dequeues = 1 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpClose enqueues = 4 dequeues = 4 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnectFail enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpConnected enqueues = 5 dequeues = 5 enqueue_fails = 0 dequeue_fails = 0 ], [ event = scm::EvTcpDeleteSession enqueues = 10 dequeues = 10 enqueue_fails = 0 dequeue_fails = 0 ], [ event = enqueues = 141 dequeues = 141 enqueue_fails = 0 dequeue_fails = 0 ], ] ] state = Idle state_since = 1742435847799159 last_state = Idle last_event = scm::EvSandeshSend last_event_at = 1742435847799612 ] session_stats= [ num_recv_msg = 0 num_recv_msg_fail = 0 num_recv_fail = 0 num_send_msg = 19 num_send_msg_fail = 0 num_send_buffer_fail = 0 num_wait_msgq_enqueue = 0 num_wait_msgq_dequeue = 0 num_write_ready_cb_error = 0 ] session_rx_socket_stats= [ bytes = 1017 calls = 2 average_bytes = 508 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] session_tx_socket_stats= [ bytes = 183604 calls = 16 average_bytes = 11475 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] msg_type_agg= [ [ _iter58->first = ConfigClientGetRowError [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 7 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 736 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 17 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 32 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlClientToServer [ messages_sent = 5 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshCtrlServerToClient [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 12 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 46 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 25 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = UveDnsInfo [ messages_sent = 2 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionCreate [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppConnectionLog [ messages_sent = 6 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppCreateConnection [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = XmppEventLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1547, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 78, _iter59->first = sent _iter59->second = 31, ] ] max_sm_queue_count = 6 proxy seq 58 2025-03-20 Thu 01:57:57:886.657 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-03-20 Thu 01:57:57:886.704 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.47:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 37 2025-03-20 Thu 01:57:57:886.719 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-03-20 Thu 01:57:57:886.727 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:57:57:886.733 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:57:57:886.740 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:57:57:886.798 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: Established 2025-03-20 Thu 01:57:58:301.226 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: OnMessage control in state: Established 2025-03-20 Thu 01:57:58:301.295 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: Processing scm::EvSandeshMessageRecv in state Established 2025-03-20 Thu 01:57:58:301.309 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: Established : EvSandeshMessageRecv 2025-03-20 Thu 01:57:58:301.368 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: Received Ctrl Message with size 3 2025-03-20 Thu 01:57:58:301.387 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: SyncAllMaps for DnsState:0 period 0 cycle 0 with seqno 1, total = 0 2025-03-20 Thu 01:57:58:301.400 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 with seqno 59, total = 0 2025-03-20 Thu 01:57:58:301.413 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 with seqno 39, total = 0 2025-03-20 Thu 01:57:58:301.435 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:57:58:301.446 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:57:58:301.453 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140470913713920, Pid 76904]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:58:46:879.204 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140471209981696, Pid 76904]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 571 2025-03-20 Thu 01:59:30:950.134 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_INFO]: VersionInfoLog: {"build-info":[{"build-version":"nightly","build-time":"2025-03-20 00:20:54.177385","build-user":"root","build-hostname":"jenkins-build-prepare-sandbox-8220-1.novalocal","build-id":"unknown","build-number":"unknown"}]} src/contrail-common/base/misc_utils.cc 41 2025-03-20 Thu 01:59:30:950.307 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: SANDESH: ROLE : Generator 2025-03-20 Thu 01:59:30:950.317 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: SANDESH: MODULE : contrail-dns 2025-03-20 Thu 01:59:30:950.323 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: SANDESH: SOURCE : cn-jenkins-deploy-platform-ansible-os-2923-2 2025-03-20 Thu 01:59:30:950.361 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: SANDESH: NODE TYPE : Control 2025-03-20 Thu 01:59:30:950.366 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: SANDESH: INSTANCE ID : 0 2025-03-20 Thu 01:59:30:950.373 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: SANDESH: HTTP SERVER PORT : 8092 2025-03-20 Thu 01:59:30:950.385 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: SANDESH: System Log Send Rate Limit: 0 -> 0 2025-03-20 Thu 01:59:30:951.381 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: HTTP Introspect Init 2025-03-20 Thu 01:59:30:951.600 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 0.0.0.0:8092 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-03-20 Thu 01:59:30:951.698 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: Sandesh Http Server Port: 8092 2025-03-20 Thu 01:59:30:951.798 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: SANDESH: NOT Writing http_port 8092TO : /tmp/contrail-dns.106754.http_port 2025-03-20 Thu 01:59:30:951.809 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: SANDESH: CONNECT TO COLLECTOR: 1 2025-03-20 Thu 01:59:30:952.117 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: Idle 2025-03-20 Thu 01:59:30:952.493 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: SANDESH: No Client: 1742435970952289 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Idle successful_connections = 0 pid = 106900 http_port = 8092 start_time = 1742435970952134 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 0, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-20 Thu 01:59:30:953.757 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: SANDESH: Logging: DISABLED -> ENABLED 2025-03-20 Thu 01:59:30:953.789 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: SANDESH: Logging: LEVEL: [ INVALID ] -> [ SYS_DEBUG ] log4level: [ NOTSET ] -> [ DEBUG ] 2025-03-20 Thu 01:59:30:961.732 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: Processing scm::EvStart in state Idle 2025-03-20 Thu 01:59:30:962.651 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: Disconnect 2025-03-20 Thu 01:59:30:962.792 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: Processing scm::EvCollectorUpdate in state Disconnect 2025-03-20 Thu 01:59:30:963.125 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: Connect : Start Connect timer 10.0.0.42:8086 2025-03-20 Thu 01:59:30:963.665 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:59:30:963.810 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: SANDESH: Send FAILED: 1742435970962775 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 106900 http_port = 8092 start_time = 1742435970952134 collector_name = collector_ip = 0.0.0.0:0 collector_list= [ [ ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-20 Thu 01:59:30:963.830 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:59:30:963.840 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:59:30:963.950 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: SANDESH: Send FAILED: 1742435970962863 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Disconnect successful_connections = 0 pid = 106900 http_port = 8092 start_time = 1742435970952134 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-20 Thu 01:59:30:963.964 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:59:30:963.976 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:59:30:964.065 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: SANDESH: Send FAILED: 1742435970963627 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = Connect successful_connections = 0 pid = 106900 http_port = 8092 start_time = 1742435970952134 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 1, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 0, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-20 Thu 01:59:30:964.102 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: Wrong state: Connect for event: EvSandeshSend message: SandeshModuleClientTrace 2025-03-20 Thu 01:59:31:049.475 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: Applying named configuration failed 2025-03-20 Thu 01:59:31:050.319 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpServerMessageLog: Server 10.20.0.23:8093 Initialization complete src/contrail-common/io/tcp_server.cc 137 2025-03-20 Thu 01:59:31:050.434 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been started controller/src/dns/main.cc 384 2025-03-20 Thu 01:59:31:050.544 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Start RabbitMqReader and init Database src/contrail-common/config-client-mgr/config_client_manager.cc 303 2025-03-20 Thu 01:59:31:050.661 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-03-20 Thu 01:59:31:050.673 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-03-20 Thu 01:59:31:050.800 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:59:31:050.846 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: SANDESH: Send FAILED: 1742435971050639 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-03-20 Thu 01:59:31:050.859 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:59:31:124.984 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-03-20 Thu 01:59:31:125.036 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: Init Database src/contrail-common/config-client-mgr/config_client_manager.cc 307 2025-03-20 Thu 01:59:31:125.091 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Lost Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 580 2025-03-20 Thu 01:59:31:125.102 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db Init src/contrail-common/config-client-mgr/config_cassandra_client.cc 87 2025-03-20 Thu 01:59:31:126.720 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:59:31:126.775 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: SANDESH: Send FAILED: 1742435971124944 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Number of connections:2, Expected:3 Missing: Database:Cassandra ], ] ] ] 2025-03-20 Thu 01:59:31:126.786 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:59:31:126.797 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:59:31:126.816 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: SANDESH: Send FAILED: 1742435971125083 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Down description = Lost Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector, Database:Cassandra connection down ], ] ] ] 2025-03-20 Thu 01:59:31:126.822 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:59:31:164.174 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db SetTableSpace src/contrail-common/config-client-mgr/config_cassandra_client.cc 95 2025-03-20 Thu 01:59:31:164.703 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily uuidTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 104 2025-03-20 Thu 01:59:31:164.747 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Db UseColumnFamily fqnTableName src/contrail-common/config-client-mgr/config_cassandra_client.cc 110 2025-03-20 Thu 01:59:31:164.817 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:164.828 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkDataSync Started src/contrail-common/config-client-mgr/config_cassandra_client.cc 393 2025-03-20 Thu 01:59:31:164.860 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:59:31:164.891 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: SANDESH: Send FAILED: 1742435971164788 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:59:31:164.900 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:59:31:181.033 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:184.370 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:213.158 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:215.932 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:217.654 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:226.429 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:229.664 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:233.184 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:244.152 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:246.517 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:248.687 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:255.200 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:261.785 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:263.095 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:265.113 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:266.053 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:268.725 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:276.831 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:280.821 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:283.579 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:291.163 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:292.334 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:293.954 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:296.659 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:299.591 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:302.475 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:335.116 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:338.172 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:425.075 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:451.130 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:454.532 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:456.924 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:467.108 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:474.991 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:477.539 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:481.024 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:485.054 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:499.556 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:503.568 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:505.505 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:507.466 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:508.967 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:510.788 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:513.155 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:518.849 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:520.902 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:544.776 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:564.413 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:565.777 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:568.008 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:569.364 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:570.343 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:572.858 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:574.379 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:576.337 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:577.694 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:579.174 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:580.158 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:581.147 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:582.553 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:583.500 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:584.529 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:596.466 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:600.232 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:602.342 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:607.025 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:611.373 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:612.799 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:615.912 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:641.608 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:644.357 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:646.905 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:648.872 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:653.755 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:656.704 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:658.809 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:660.233 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:661.603 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:662.621 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:664.754 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:666.568 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:667.734 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:668.992 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:672.513 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:707.086 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:752.313 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:754.087 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:759.191 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:770.833 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:788.348 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:791.414 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:792.822 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:794.398 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:803.438 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:806.062 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:807.407 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:812.982 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:817.303 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:818.831 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:822.031 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:830.183 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:833.541 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:835.672 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:837.139 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:838.732 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:839.922 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:846.172 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:849.333 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:852.135 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:853.378 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:854.627 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:855.892 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:856.992 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:868.437 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:877.683 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:879.263 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:882.302 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:884.216 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:884.308 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-03-20 Thu 01:59:31:884.554 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-03-20 Thu 01:59:31:884.624 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-03-20 Thu 01:59:31:884.759 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-03-20 Thu 01:59:31:884.925 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-03-20 Thu 01:59:31:884.970 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-03-20 Thu 01:59:31:885.257 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: One reader finished BulkSync src/contrail-common/config-client-mgr/config_cassandra_client.cc 558 2025-03-20 Thu 01:59:31:885.283 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: BulkSyncDone by all readers src/contrail-common/config-client-mgr/config_cassandra_client.cc 554 2025-03-20 Thu 01:59:31:885.337 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Config Client Mgr SM: End of RIB computed and notification sent src/contrail-common/config-client-mgr/config_client_manager.cc 197 2025-03-20 Thu 01:59:31:885.371 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 225 2025-03-20 Thu 01:59:31:885.454 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:59:31:885.506 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: SANDESH: Send FAILED: 1742435971885374 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:59:31:885.518 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:59:31:897.005 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:897.410 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:897.923 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-system-config:default-global-system-config controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:897.961 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:897.995 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:netns-snat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:898.017 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating domain:default-domain controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:898.031 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:898.046 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:docker-template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:898.064 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:898.078 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:898.091 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:erb-leaf:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:898.109 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:erb-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:898.121 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:898.858 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:898.913 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:default-project controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:898.931 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:898.946 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-table-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:898.979 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:898.996 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:899.013 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:899.039 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:underlay-ip-clos controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:899.050 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:899.065 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:infra-bms-access controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:899.076 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:899.090 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:telemetry controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:899.101 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:899.364 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:lean controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:899.376 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:899.390 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:899.400 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:899.412 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:maintenance_mode_deactivate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:899.445 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:899.459 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:default-project:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:899.475 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:899.489 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48t-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:899.500 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vqfx-10000 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:900.202 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-status controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:900.249 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:900.264 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating netconf-profile:default-domain:default-project:netconf-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:900.285 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:900.301 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:service-chain-flat-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:900.318 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:900.332 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-72q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:900.344 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:vn-interconnect controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:900.359 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:901.153 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:901.186 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:901.202 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-high controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:901.220 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:901.464 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:901.478 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:opencontrail controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:901.495 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:902.130 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:902.151 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:902.166 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-32c-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:902.177 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:server_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:902.199 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:902.216 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-aa controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:902.227 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:902.253 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:902.270 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:overlay-bgp controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:902.284 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:903.548 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:903.592 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:903.607 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:903.619 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:903.636 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:903.648 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:903.671 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:903.685 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Spine-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:903.707 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:903.733 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:904.343 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:904.749 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:904.778 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:904.892 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:904.905 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:904.919 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:check_multicast_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:904.942 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:904.965 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:904.979 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2008 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:904.990 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:search_ip_mac_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:905.018 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:905.032 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:905.056 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:905.073 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:905.087 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5220:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:905.100 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5220 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:905.111 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:906.452 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 392cd136-94c1-46e8-8573-1d3de7439890 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 01:59:31:907.193 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.223 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:label controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.249 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.267 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.289 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.306 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hardware_inventory_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.329 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.342 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:site controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.355 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.380 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.396 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:pnf-service-chaining controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.407 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.421 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:pnf-servicechain controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.434 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.449 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:pnf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.459 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.471 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.492 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.507 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-fabric-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.518 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.533 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-partial-sysinfo controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.563 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.582 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:nat-template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.610 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.644 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.666 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:device-functional-group controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.685 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.699 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.721 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:907.734 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4200 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.745 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:907.763 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:911.681 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:912.277 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 570d268f-da98-44de-afbe-9bf0aad35ec1 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 01:59:31:912.295 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 570d268f-da98-44de-afbe-9bf0aad35ec1 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 01:59:31:913.907 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:913.976 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 1484d1b9-162e-46af-9c90-c6a8a15d25d8 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 01:59:31:915.387 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:915.862 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 557b482a-6c12-443b-b5a1-f18f713a3a87 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 01:59:31:916.275 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile b8524210-90b0-4ce2-9c1b-52650b85ec84 controller/src/ifmap/client/config_json_parser.cc 217 2025-03-20 Thu 01:59:31:916.824 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router fe1793f3-c106-4fc5-a5e2-8348694b80e5 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 01:59:31:916.838 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router fe1793f3-c106-4fc5-a5e2-8348694b80e5 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 01:59:31:919.809 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance f043d151-fc6e-4ee6-9b95-bc5bacade44c controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 01:59:31:920.207 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.232 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating policy-management:default-policy-management controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.282 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-mx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.301 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-mx controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.314 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.326 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.341 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.351 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.365 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48t-6c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.377 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:ip-fabric:ip-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.406 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.429 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.456 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.471 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:test_overlay_connectivity_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.507 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.522 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.535 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:cli_sync_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.553 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.566 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-management-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.586 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.599 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-pnf-servicechain-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.616 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.629 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating grpc-profile:default-domain:default-project:grpc-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.651 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.664 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l2-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.679 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.692 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:container_cleanup_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.724 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.737 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-close-reason controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.754 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.769 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx10003 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.786 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.804 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.819 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx204 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.830 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.842 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.853 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.867 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx80-48t controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.877 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-properties:default-global-system-config:config_property controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.892 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-properties controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.911 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.924 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-package-version-mismatch controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.940 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.952 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:920.977 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:920.993 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.006 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.017 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.032 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.042 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.057 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.070 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48th-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.081 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.093 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afo controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.103 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.117 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.130 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48sh-afi controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.140 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.155 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.167 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.179 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.198 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.210 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.220 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.232 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5200-48y controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.256 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.269 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-24q-2p controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.278 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.290 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5210-64c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.299 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.329 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100e-96s-8q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.340 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.353 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5100-48s-6q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.362 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.378 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:fabric_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.388 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.400 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_config_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.424 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.441 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-access-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.458 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.471 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-incorrect controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.488 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.508 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.521 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating fabric:default-global-system-config:default-fabric controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.537 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-fabric controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.553 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_server_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.572 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.585 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.602 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.620 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.633 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:firewall controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.643 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.658 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.679 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.694 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.708 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.722 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.737 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:l3-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.747 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.762 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-mcast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.772 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.790 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.802 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-srx:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.815 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-srx controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.825 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.840 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-tsn-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.856 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.868 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bgp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.885 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.900 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2010 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.913 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating api-access-list:default-global-system-config:default-api-access-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.930 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-api-access-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.943 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.957 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:921.968 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-48s-4c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:921.985 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Gateway-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.012 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.033 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.051 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-prouter-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.079 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.093 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vsrx controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.109 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.125 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.141 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.154 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-mcast-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.172 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.191 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.208 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.222 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.252 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.268 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.282 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.296 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.313 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.328 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.345 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.357 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.391 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.407 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.422 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.436 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.454 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.470 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature:default-global-system-config:port-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.480 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.494 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.512 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.525 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-access controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.535 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.550 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.566 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_interface_details_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.588 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.602 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:haproxy-loadbalancer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.624 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.637 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-compute controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.654 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.670 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_mac_mob_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.691 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.703 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_ops_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.725 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.743 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.765 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.783 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:vcenter_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.813 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.828 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:_internal_vn_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.850 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.868 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:_internal_ipam_ipv6_link_local controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.878 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:default-project:_internal_ipam_ipv6_link_local,default-domain:default-project:_internal_vn_ipv6_link_local) controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.890 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.903 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.921 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-vmx controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.935 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-spine:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.948 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:922.971 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:922.991 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx1500 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.002 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating physical-role:default-global-system-config:superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.016 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.032 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.051 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.069 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.082 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-32c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.097 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.112 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.131 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.154 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.180 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.202 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.224 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.262 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.283 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.306 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.321 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dci-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.335 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.351 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.365 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.382 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.401 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:ar-client controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.415 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.447 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx10k-lean controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.470 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.489 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.502 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_device_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.527 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.541 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.556 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.569 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4100 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.588 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.603 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.623 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.640 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.654 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.668 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating sflow-profile:default-domain:default-project:sflow-all-interfaces controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.686 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.712 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.734 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.760 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-60c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.772 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.787 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.802 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.815 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10002-36q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.829 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.849 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.871 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx10016 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:923.885 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.906 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.944 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.969 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:923.991 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.015 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx480 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.029 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.043 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx240 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.053 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.070 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.084 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.097 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx2020 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.107 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.121 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.139 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.154 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.172 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.187 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-mx960 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.198 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.211 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-jnp10008 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.221 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.247 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.266 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-core-files controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.286 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.299 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-limit-exceeded controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.319 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.335 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:__link_local__ controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.366 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.382 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:erb-ucast-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.397 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.411 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.424 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.445 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.464 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.478 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.511 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.529 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:route-reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.540 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.556 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.577 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-policy-management:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.602 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating policy-management-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.624 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-vrouter-config:default-global-system-config:default-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.640 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating application-policy-set-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.672 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.695 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-overlay-loopback-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:924.716 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.744 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.771 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.795 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.817 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.838 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.859 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.879 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.900 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.927 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.949 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.967 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:924.982 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.000 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_fwaas controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:925.018 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-process-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:925.044 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.068 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-1:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:925.089 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:925.101 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.124 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.143 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-replicator-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:925.159 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.175 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.192 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.207 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.221 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.250 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.270 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.287 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dci-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:925.302 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.322 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.338 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.352 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.366 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.383 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.397 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.411 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.429 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.446 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.462 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.492 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.517 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:role_assignment_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:925.545 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.578 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:925.597 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.612 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.627 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.642 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.660 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:925.676 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:default-project:__no_rule__ controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:925.687 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.700 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:925.718 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.741 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.765 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.787 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.810 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.825 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.839 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.859 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.876 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.898 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.918 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:crb-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:925.938 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:925.962 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:931.144 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-bottle-request-size-limit controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:931.207 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:931.257 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:931.279 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5400 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:931.300 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:931.316 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:931.329 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx4600 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:931.343 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:931.358 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:931.372 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:931.385 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5800 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:931.394 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:931.896 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:931.946 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:932.111 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 1fef0d31-ed15-4749-b838-f111e6008e33 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 01:59:31:932.135 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: bgp_peering No entry in metadata map bgp_router 1fef0d31-ed15-4749-b838-f111e6008e33 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 01:59:31:932.414 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: overlay_role Link name is empty node_profile 4164eb8f-2292-46fc-a598-6109c75e61ee controller/src/ifmap/client/config_json_parser.cc 217 2025-03-20 Thu 01:59:31:932.431 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: physical_role Link name is empty node_profile 4164eb8f-2292-46fc-a598-6109c75e61ee controller/src/ifmap/client/config_json_parser.cc 217 2025-03-20 Thu 01:59:31:934.479 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:31:935.222 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.279 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx240h-poe controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:935.298 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.321 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-srx5600 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:935.343 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.371 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.401 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:935.443 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.471 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.491 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.508 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.525 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.545 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.561 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.576 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.591 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.609 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating overlay-role:default-global-system-config:dc-gateway controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:935.626 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:935.643 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:936.555 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 6199da6c-d44f-4b97-a989-a63782b4267b controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 01:59:31:936.739 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-6 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:936.768 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:936.790 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-netconf-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:936.805 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating network-ipam:default-domain:default-project:default-network-ipam controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:936.825 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:936.839 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:936.857 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:936.873 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L2-Server-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:936.894 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:936.912 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:936.941 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-xmpp-connectivity controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:936.969 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:936.985 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx10k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.008 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.022 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5k-lean:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.040 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.055 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating feature-config:default-global-system-config:ar-client-leaf:assisted-replicator controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.069 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:ar-client-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.080 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.096 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:L3-Storage-Leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.113 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.130 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.146 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5120-48y-8c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.157 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-1 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.173 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.191 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.213 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:dci-network controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.256 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.279 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.300 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.315 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-conf-elements-inconsistency controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.332 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.356 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.373 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:show_chassis_info_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.397 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.414 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating database-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.430 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-database-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.451 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.482 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.498 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5110-32q controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.509 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.524 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.545 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.559 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.580 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.599 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.619 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.636 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.651 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.667 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.686 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.699 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-128c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.710 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating global-qos-config:default-global-system-config:default-global-qos-config controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.727 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-qos-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:937.740 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:937.755 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:939.563 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:939.602 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:939.710 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:939.738 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:939.863 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:939.920 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating hardware:juniper-qfx5220-32cd controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:939.936 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:939.955 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:939.993 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:940.010 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:default-project:default-virtual-network controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:940.032 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:940.067 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:image_upgrade_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:940.092 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:940.108 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:topology_discovery_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:940.148 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:940.169 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:existing_fabric_onboard_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:940.967 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.009 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating snmp-profile:default-domain:default-project:snmp-default-profile controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:941.037 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.076 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-node-status controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:941.106 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.145 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-access-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:941.165 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.187 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.224 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.258 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.297 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.315 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.337 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.370 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.391 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.409 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.443 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:application controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:941.459 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating node-profile:default-global-system-config:juniper-qfx5120 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:941.479 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-node-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.518 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.540 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.591 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-hardware controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.618 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.659 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating config-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-2. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:941.680 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-config-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.703 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.740 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:rma_activate_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:941.770 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.804 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-5 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:941.823 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.862 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-snmp-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.883 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_role_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:941.900 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.952 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:941.974 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.005 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:pnf-servicechain-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:942.025 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.049 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.084 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.102 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.120 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-router:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-2 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:942.155 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.171 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-pending-cassandra-compaction-tasks controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:942.194 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.246 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-template:default-domain:analyzer-template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:942.279 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.325 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_import_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:942.347 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Centrally-Routed-Border-Spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:942.402 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.429 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.480 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.533 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.553 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:default-project:__no_rule__:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:942.595 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.610 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:942.629 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.667 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.682 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-appliance-set:default-global-system-config:native controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:942.700 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-service-appliance-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.724 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:dc-gateway-leaf controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:942.751 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.768 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.785 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.822 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.838 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.854 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.886 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.905 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.920 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:942.954 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.002 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.017 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:tier controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:943.047 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:943.069 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.085 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-vrouter-interface controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:943.117 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.146 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Border-Leaf-in-Edge-Routed controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:943.165 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.198 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.220 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.269 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:collapsed-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:943.296 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.341 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.364 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.384 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.425 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.441 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:943.458 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.274 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.298 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.314 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.333 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.349 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.363 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-disk-usage-critical controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:944.383 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.420 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.439 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-config:default-global-system-config:juniper-qfx5120:basic controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:944.471 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating node-profile-role-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.513 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.546 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:discover_os_computes_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:944.589 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.616 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating discovery-service-assignment:default-discovery-service-assignment controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:944.634 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:node_profile_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:944.666 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.680 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:944.702 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.717 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:device_deletion_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:944.740 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.759 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.772 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-alarm-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:944.791 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-alarm-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.805 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-3 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:944.820 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.837 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-sflow-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.865 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.891 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.916 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.943 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.961 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.977 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:944.992 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-peer-ip controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.016 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.029 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-1. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.046 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.074 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-global-vrouter-config controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.115 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:ztp_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.138 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.157 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating job-template:default-global-system-config:hitless_upgrade_strategy_template controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.179 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-job-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.193 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:rr-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.207 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.227 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.257 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.281 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.296 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.315 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.331 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.344 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:neutron_tag controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.360 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag-type:deployment controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.375 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating telemetry-profile:default-domain:default-project:default-telemetry-profile-4 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.390 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-telemetry-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.410 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating telemetry-profile-grpc-profile controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.423 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating analytics-snmp-node:default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2923-3. controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.438 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-analytics-snmp-node controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.452 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:lean-superspine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.470 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.485 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.500 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.515 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.536 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.551 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.566 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating device-functional-group:default-domain:default-project:Lean-Spine-with-Route-Reflector controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.586 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-device-functional-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.604 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating device-functional-group-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.645 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-storage-cluster-state controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.666 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.680 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating role-definition:default-global-system-config:crb-gateway-spine controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.699 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.718 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.738 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.760 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.786 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.810 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.828 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.843 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.861 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.880 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.896 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.917 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.931 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-global-system-config:an-jenkins-deploy-platform-ansible-os-2923-2:vhost0 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:945.954 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.979 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:945.999 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:946.021 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-role-definition controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:946.041 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:946.057 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:946.072 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-feature controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:946.088 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-overlay-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:946.106 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating role-definition-physical-role controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:946.120 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating tag:label=fabric-ebgp-as-number controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:946.138 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating tag-tag-type controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:946.232 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-virtual-router controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:946.264 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating namespace:default-domain:default-namespace controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:946.280 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-namespace controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:946.295 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating alarm:default-global-system-config:system-defined-address-mismatch-control controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 01:59:31:946.598 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating global-system-config-alarm controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 01:59:31:948.314 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: EndOfRib point was reached, IF-MAP objects have been created controller/src/dns/main.cc 86 2025-03-20 Thu 01:59:31:948.352 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS.0, counting 0 elements controller/src/dns/main.cc 98 2025-03-20 Thu 01:59:31:948.362 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_DNS_record.0, counting 0 elements controller/src/dns/main.cc 98 2025-03-20 Thu 01:59:31:948.374 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.network_ipam.0, counting 3 elements controller/src/dns/main.cc 98 2025-03-20 Thu 01:59:31:948.387 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.virtual_network_network_ipam.0, counting 1 elements controller/src/dns/main.cc 98 2025-03-20 Thu 01:59:31:948.400 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: The IF-MAP database table has been updated: __ifmap__.global_qos_config.0, counting 1 elements controller/src/dns/main.cc 98 2025-03-20 Thu 01:59:31:948.413 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: VnniConfig has been updated after the bulk sync, the number of elements: 1 controller/src/dns/main.cc 109 2025-03-20 Thu 01:59:31:948.425 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: IpamConfig has been updated after the bulk sync, the number of elements: 3 controller/src/dns/main.cc 120 2025-03-20 Thu 01:59:31:948.437 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 131 2025-03-20 Thu 01:59:31:948.447 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: VirtualDnsRecordConfig has been updated after the bulk sync, the number of elements: 0 controller/src/dns/main.cc 142 2025-03-20 Thu 01:59:31:948.456 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: GlobalQosConfig has been updated after the bulk sync controller/src/dns/main.cc 152 2025-03-20 Thu 01:59:31:948.521 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-03-20 Thu 01:59:31:948.532 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete TRUE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-03-20 Thu 01:59:31:948.657 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:59:31:948.694 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: SANDESH: Send FAILED: 1742435971948497 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Down description = RabbitMQ connection down ], ] ] flag_infos= [ [ ] ] description = Collector, Database:RabbitMQ connection down ], ] ] ] 2025-03-20 Thu 01:59:31:948.702 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:59:32:023.588 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-03-20 Thu 01:59:32:025.835 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:43846::10.0.0.42:8086(-1) < Active session connection complete src/contrail-common/io/tcp_session.cc 282 2025-03-20 Thu 01:59:32:025.872 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: 10.0.0.12:43846::10.0.0.42:8086(-1) OnSessionEvent TCP Connected 2025-03-20 Thu 01:59:32:025.884 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: 10.0.0.12:43846::10.0.0.42:8086(-1):EvTcpConnected 2025-03-20 Thu 01:59:32:026.004 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: Processing scm::EvSandeshSend in state Connect 2025-03-20 Thu 01:59:32:026.077 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: TRUE src/contrail-common/config-client-mgr/config_client_manager.cc 225 2025-03-20 Thu 01:59:32:026.157 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: BIND named up; DNS is operational controller/src/dns/mgr/dns_mgr.cc 737 2025-03-20 Thu 01:59:32:026.185 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: SANDESH: Send FAILED: 1742435972023548 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Disconnect : EvCollectorUpdate -> Connect ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:59:32:026.214 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: Wrong state: Connect for event: EvSandeshSend message: NodeStatusUVE 2025-03-20 Thu 01:59:32:026.227 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: Processing scm::EvTcpConnected in state Connect 2025-03-20 Thu 01:59:32:026.246 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: Connect : EvTcpConnected : Cancelling Connect timer 2025-03-20 Thu 01:59:32:026.284 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ClientInit 2025-03-20 Thu 01:59:32:026.299 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: Sending Ctrl Message for cn-jenkins-deploy-platform-ansible-os-2923-2:contrail-dns:0:Control count 1 2025-03-20 Thu 01:59:32:026.408 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:59:32:026.418 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ClientInit : EvSandeshSend : NodeStatusUVE 2025-03-20 Thu 01:59:32:026.438 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: SANDESH: Send FAILED: 1742435972026277 [SYS_NOTICE]: NodeStatusUVE: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] ] 2025-03-20 Thu 01:59:32:026.444 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: Received UVE message in wrong state : NodeStatusUVE 2025-03-20 Thu 01:59:32:026.452 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:59:32:026.458 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ClientInit : EvSandeshSend : SandeshCtrlClientToServer 2025-03-20 Thu 01:59:32:026.471 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: Processing scm::EvSandeshSend in state ClientInit 2025-03-20 Thu 01:59:32:026.477 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ClientInit : EvSandeshSend : SandeshModuleClientTrace 2025-03-20 Thu 01:59:32:026.636 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: SANDESH: Send FAILED: 1742435972026396 [SYS_NOTICE]: SandeshModuleClientTrace: data= [ name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 106900 http_port = 8092 start_time = 1742435970952134 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 922, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] ] 2025-03-20 Thu 01:59:32:026.655 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: Received UVE message in wrong state : SandeshModuleClientTrace 2025-03-20 Thu 01:59:32:028.735 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: OnMessage control in state: ClientInit 2025-03-20 Thu 01:59:32:028.785 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: Processing scm::EvSandeshMessageRecv in state ClientInit 2025-03-20 Thu 01:59:32:028.794 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ClientInit : EvSandeshMessageRecv 2025-03-20 Thu 01:59:32:028.817 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: Received Ctrl Message with size 0 2025-03-20 Thu 01:59:32:028.826 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: SyncAllMaps for DnsState:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:59:32:029.007 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: SyncUVE Syncing ObjectGeneratorInfo val name = cn-jenkins-deploy-platform-ansible-os-2923-2:Control:contrail-dns:0 client_info= [ status = ClientInit successful_connections = 1 pid = 106900 http_port = 8092 start_time = 1742435970952134 collector_name = collector_ip = 10.0.0.42:8086 collector_list= [ [ (*_iter40) = 10.0.0.42:8086, (*_iter40) = 10.0.0.47:8086, (*_iter40) = 10.0.0.12:8086, ] ] rx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] tx_socket_stats= [ bytes = 0 calls = 0 average_bytes = 0 blocked_duration = 00:00:00 blocked_count = 0 average_blocked_duration = errors = 0 ] ] msg_type_agg= [ [ _iter58->first = ConfigClientMgrDebug [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 152 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = ConfigurationMalformedReferenceWarningLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 14 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = DnsOperational [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 13 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapLinkOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 469 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = IFMapNodeOperation [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 271 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = NodeStatusUVE [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 7 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = SandeshModuleClientTrace [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 1 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 3 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 0 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpServerMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 2 messages_sent_dropped_sending_to_syslog = 0 ], _iter58->first = TcpSessionMessageLog [ messages_sent = 0 messages_sent_dropped_no_queue = 0 messages_sent_dropped_no_client = 0 messages_sent_dropped_no_session = 0 messages_sent_dropped_queue_level = 0 messages_sent_dropped_client_send_failed = 0 messages_sent_dropped_session_not_connected = 0 messages_sent_dropped_header_write_failed = 0 messages_sent_dropped_write_failed = 0 messages_sent_dropped_wrong_client_sm_state = 0 messages_sent_dropped_validation_failed = 0 messages_sent_dropped_rate_limited = 0 messages_sent_dropped_sending_disabled = 1 messages_sent_dropped_sending_to_syslog = 0 ], ] ] tx_msg_agg= [ [ _iter59->first = dropped_client_send_failed _iter59->second = 0, _iter59->first = dropped_header_write_failed _iter59->second = 0, _iter59->first = dropped_no_client _iter59->second = 1, _iter59->first = dropped_no_queue _iter59->second = 0, _iter59->first = dropped_no_session _iter59->second = 0, _iter59->first = dropped_queue_level _iter59->second = 0, _iter59->first = dropped_rate_limited _iter59->second = 0, _iter59->first = dropped_sending_disabled _iter59->second = 922, _iter59->first = dropped_sending_to_syslog _iter59->second = 0, _iter59->first = dropped_session_not_connected _iter59->second = 0, _iter59->first = dropped_validation_failed _iter59->second = 0, _iter59->first = dropped_write_failed _iter59->second = 0, _iter59->first = dropped_wrong_client_sm_state _iter59->second = 10, _iter59->first = sent _iter59->second = 0, ] ] proxy seq 5 2025-03-20 Thu 01:59:32:029.042 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: SyncAllMaps for ModuleClientState:0 period 0 cycle 0 without seqno , total = 1 2025-03-20 Thu 01:59:32:029.078 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: SyncUVE Syncing ObjectDns val name = cn-jenkins-deploy-platform-ansible-os-2923-2 process_status= [ [ [ module_id = contrail-dns instance_id = 0 state = Non-Functional connection_infos= [ [ [ type = Collector name = server_addrs= [ [ (*_iter6) = 10.0.0.42:8086, ] ] status = Initializing description = Connect : EvTcpConnected ], [ type = Database name = Cassandra server_addrs= [ [ (*_iter6) = 10.0.0.42:9041, (*_iter6) = 10.0.0.12:9041, (*_iter6) = 10.0.0.47:9041, ] ] status = Up description = Established Cassandra connection ], [ type = Database name = RabbitMQ server_addrs= [ [ (*_iter6) = 10.0.0.42:5673, (*_iter6) = 10.0.0.12:5673, (*_iter6) = 10.0.0.47:5673, ] ] status = Up description = RabbitMQ connection established ], ] ] flag_infos= [ [ ] ] description = Collector connection down ], ] ] proxy seq 8 2025-03-20 Thu 01:59:32:029.092 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: SyncAllMaps for NodeStatus:0 period 0 cycle 0 without seqno , total = 1 2025-03-20 Thu 01:59:32:029.107 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: SyncAllMaps for PeerFlapData:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:59:32:029.121 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: SyncAllMaps for PeerStatsData:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:59:32:029.130 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: SyncAllMaps for XmppPeerInfoData:0 period 0 cycle 0 without seqno , total = 0 2025-03-20 Thu 01:59:32:029.172 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: Established 2025-03-20 Thu 01:59:33:081.554 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: Applying named configuration failed 2025-03-20 Thu 01:59:33:081.677 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: DnsAgent [SYS_NOTICE]: DnsOperational: Bulk sync has been done (the DB has been synced with named) controller/src/dns/mgr/dns_mgr.cc 455 2025-03-20 Thu 01:59:33:351.936 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 01:59:53:575.824 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.14 SEND Xmpp creating dynamic channel 10.20.0.23:8093::10.20.0.14:45155 controller/src/xmpp/xmpp_server.cc 586 2025-03-20 Thu 01:59:53:575.944 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.14 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2923-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-03-20 Thu 01:59:53:575.990 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8093::10.20.0.14:45155 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 01:59:53:576.268 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.14 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.14 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-03-20 Thu 01:59:53:576.343 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 01:59:53:576.587 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 45155 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 01:59:53:579.965 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.12 SEND Xmpp creating dynamic channel 10.20.0.23:8093::10.20.0.12:39833 controller/src/xmpp/xmpp_server.cc 586 2025-03-20 Thu 01:59:53:580.016 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.12 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2923-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-03-20 Thu 01:59:53:580.187 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.12 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 01:59:53:580.206 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.12 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.12 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-03-20 Thu 01:59:53:580.667 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.12 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 39833 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 01:59:53:581.263 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8093::10.20.0.12:39833 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 01:59:53:582.326 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.12 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2923-1/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 01:59:53:582.428 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2923-2/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 02:00:17:022.796 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:00:41:118.736 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.42:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-03-20 Thu 02:00:41:118.991 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-03-20 Thu 02:00:41:119.014 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-03-20 Thu 02:00:41:120.303 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.42:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-03-20 Thu 02:00:41:175.012 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-03-20 Thu 02:02:17:227.497 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.12:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-03-20 Thu 02:02:17:230.787 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-03-20 Thu 02:02:17:230.829 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-03-20 Thu 02:02:17:230.986 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.12:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-03-20 Thu 02:02:17:294.198 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-03-20 Thu 02:02:24:502.096 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.11:47454 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:02:24:706.945 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.5:33474 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:02:24:738.630 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.23:38190 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:02:50:851.808 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.5:35070 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:02:50:858.539 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.23:34688 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:02:51:968.183 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.11:49000 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:03:56:286.636 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while receiving messages from RabbitMQ: 10.0.0.47:5673 : connection error: 320: CONNECTION_FORCED - broker forced connection closure with reason 'shutdown' src/contrail-common/config-client-mgr/config_amqp_client.cc 366 2025-03-20 Thu 02:03:56:286.768 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection down src/contrail-common/config-client-mgr/config_amqp_client.cc 158 2025-03-20 Thu 02:03:56:286.784 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: Connect to Rabbit MQ with queue_delete FALSE src/contrail-common/config-client-mgr/config_amqp_client.cc 167 2025-03-20 Thu 02:03:56:288.409 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_WARN]: ConfigClientMgrWarning: RabbitMQ SM: Caught exception while connecting to RabbitMQ: 10.0.0.47:5673 : a socket error occurred src/contrail-common/config-client-mgr/config_amqp_client.cc 220 2025-03-20 Thu 02:03:56:528.945 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236888291072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: RabbitMQ SM: RabbitMQ connection established src/contrail-common/config-client-mgr/config_amqp_client.cc 151 2025-03-20 Thu 02:07:24:505.886 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.11:34658 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:07:24:714.329 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.5:36776 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:07:24:741.383 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.23:53906 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:07:50:852.525 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.5:50534 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:07:50:855.552 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.23:38658 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:07:51:968.623 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.11:35300 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:12:24:506.552 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.11:52992 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:12:24:717.832 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.5:46518 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:12:24:743.567 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.23:38696 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:12:50:858.635 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.5:44530 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:12:50:861.726 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.23:47112 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:12:51:972.670 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.11:54848 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:16:07:842.267 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.12 RECV Mode Server: Event: Tcp Connection Closed peer ip: 10.20.0.12 ( an-jenkins-deploy-platform-ansible-os-2923-1/dns ) controller/src/xmpp/xmpp_state_machine.cc 1310 2025-03-20 Thu 02:16:07:842.501 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.12 state = Established next_state = Idle event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 02:16:07:842.624 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.12 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 02:16:07:842.508 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: XMPP [SYS_INFO]: XmppConnectionDelete: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.12 Deleted Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2923-2 To : an-jenkins-deploy-platform-ansible-os-2923-1/dns controller/src/xmpp/xmpp_connection.cc 734 2025-03-20 Thu 02:16:07:993.774 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.14 RECV Mode Server: Event: Tcp Connection Closed peer ip: 10.20.0.14 ( an-jenkins-deploy-platform-ansible-os-2923-2/dns ) controller/src/xmpp/xmpp_state_machine.cc 1310 2025-03-20 Thu 02:16:07:994.026 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Established next_state = Idle event = EvTcpClose ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 02:16:07:994.106 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 02:16:07:994.137 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: XMPP [SYS_INFO]: XmppConnectionDelete: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.14 Deleted Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2923-2 To : an-jenkins-deploy-platform-ansible-os-2923-2/dns controller/src/xmpp/xmpp_connection.cc 734 2025-03-20 Thu 02:17:24:508.891 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.11:50560 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:17:24:722.381 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.5:60054 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:17:24:749.781 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.23:33304 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:17:50:865.522 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.5:39330 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:17:50:871.629 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.23:36410 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:17:51:979.222 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8092::10.20.0.11:39028 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:17:55:822.913 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.14 SEND Xmpp creating dynamic channel 10.20.0.23:8093::10.20.0.14:33851 controller/src/xmpp/xmpp_server.cc 586 2025-03-20 Thu 02:17:55:823.029 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.14 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2923-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-03-20 Thu 02:17:55:823.154 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.14 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.14 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-03-20 Thu 02:17:55:823.160 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 02:17:55:823.361 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 33851 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 02:17:55:823.487 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8093::10.20.0.14:33851 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:17:56:041.733 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.14 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2923-2/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 02:17:58:799.193 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:17:59:035.421 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:18:01:044.148 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:18:01:065.064 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: XMPP [SYS_DEBUG]: XmppCreateConnection: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.12 SEND Xmpp creating dynamic channel 10.20.0.23:8093::10.20.0.12:32781 controller/src/xmpp/xmpp_server.cc 586 2025-03-20 Thu 02:18:01:065.139 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: XMPP [SYS_INFO]: XmppConnectionCreate: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.12 RECV Created Xmpp Server connection from cn-jenkins-deploy-platform-ansible-os-2923-2 To : controller/src/xmpp/xmpp_connection.cc 727 2025-03-20 Thu 02:18:01:065.198 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.20.0.23:8093::10.20.0.12:32781 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:18:01:065.287 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: XMPP [SYS_NOTICE]: XmppEventLog: XMPP Peer cn-jenkins-deploy-platform-ansible-os-2923-2:10.20.0.12 RECV Mode Server: PassiveOpen in state: Idle peer ip: 10.20.0.12 ( ) controller/src/xmpp/xmpp_state_machine.cc 1325 2025-03-20 Thu 02:18:01:065.304 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.12 state = Idle next_state = Active event = Start ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 02:18:01:065.599 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.12 state = Active event = EvTcpPassiveOpen local_port = 8093 remote_port = 32781 ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 02:18:01:067.004 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: [SYS_INFO]: XmppConnectionLog: connection= [ ip_address = 10.20.0.12 state = Active next_state = Established event = EvXmppOpen identifier = an-jenkins-deploy-platform-ansible-os-2923-1/dns ] file = controller/src/xmpp/xmpp_state_machine.cc line = 1709 2025-03-20 Thu 02:18:01:307.338 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:19:59:802.652 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:19:59:802.798 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:admin controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:19:59:802.855 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:19:59:884.064 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:19:59:884.453 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:admin:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:19:59:884.512 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:19:59:939.758 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:19:59:939.915 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:00:151.833 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:00:152.130 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:admin:default controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:00:152.180 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:00:318.407 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:00:318.620 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:admin:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:00:318.668 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:00:343.061 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:00:461.597 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:00:461.770 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:admin:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:00:461.818 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:01:613.778 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140237063149696, Pid 106900]: TCP [SYS_DEBUG]: TcpSessionMessageLog: Session 10.0.0.12:8092::10.0.0.42:51392 > Passive session Accept complete src/contrail-common/io/tcp_session.cc 256 2025-03-20 Thu 02:20:03:167.718 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:03:167.898 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-AnalyticsBasicTestSanity-41612179 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:03:167.937 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:03:257.614 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:03:257.764 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:03:257.808 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:03:307.883 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:03:308.035 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:03:449.441 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:03:449.668 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:03:449.707 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:03:552.584 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:03:552.777 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:03:552.829 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:03:626.087 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:03:682.450 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:03:682.742 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:03:682.789 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:06:275.589 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:06:739.431 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:06:845.316 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:06:845.601 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-41612179:ctest-vn22-97468500 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:06:845.683 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:06:935.671 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:07:009.963 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:07:076.201 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:07:076.324 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance f1fb993d-6087-405e-8ec0-913e5268b1bb controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 02:20:07:196.327 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:07:196.563 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-41612179:ctest-vn22-97468500,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:07:196.601 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:07:196.629 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:07:285.632 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:07:933.837 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:08:270.733 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:12:018.082 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:14:117.653 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:14:194.086 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:14:194.356 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:87d6e16b-1ec1-45c8-b000-792372cbfae7 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:14:343.959 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:14:344.562 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-41612179:195621e8-b4a7-45cf-aa7a-8a59bd5818b9 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:14:344.620 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:14:344.659 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:14:344.688 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:14:344.714 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:14:427.395 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:14:580.918 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:14:581.136 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:6bc17a5a-d767-42c5-81e6-58f8e74e3551 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:14:581.187 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:14:581.222 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:15:256.171 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:15:318.927 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:29:456.507 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:20:29:456.567 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:20:29:456.584 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:6bc17a5a-d767-42c5-81e6-58f8e74e3551 controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:20:29:456.614 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:6bc17a5a-d767-42c5-81e6-58f8e74e3551 - virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-41612179:195621e8-b4a7-45cf-aa7a-8a59bd5818b9 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:20:29:456.645 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:6bc17a5a-d767-42c5-81e6-58f8e74e3551 - virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-41612179:ctest-vn22-97468500 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:20:29:562.985 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:29:639.499 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:20:29:639.560 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:20:29:639.585 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:20:29:639.609 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:20:29:639.634 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-41612179:195621e8-b4a7-45cf-aa7a-8a59bd5818b9 controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:20:29:639.662 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-41612179:195621e8-b4a7-45cf-aa7a-8a59bd5818b9 - project:default-domain:ctest-AnalyticsBasicTestSanity-41612179 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:20:29:639.690 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-41612179:195621e8-b4a7-45cf-aa7a-8a59bd5818b9 - security-group:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:20:29:639.712 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-41612179:195621e8-b4a7-45cf-aa7a-8a59bd5818b9 - virtual-machine:87d6e16b-1ec1-45c8-b000-792372cbfae7 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:20:29:639.732 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-AnalyticsBasicTestSanity-41612179:195621e8-b4a7-45cf-aa7a-8a59bd5818b9 - virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-41612179:ctest-vn22-97468500 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:20:29:686.871 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:87d6e16b-1ec1-45c8-b000-792372cbfae7 controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:20:30:941.589 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:20:30:941.642 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:20:30:941.658 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:20:30:941.669 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-41612179:ctest-vn22-97468500 controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:20:30:941.690 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-41612179:ctest-vn22-97468500,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:20:30:941.712 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-41612179:ctest-vn22-97468500 - project:default-domain:ctest-AnalyticsBasicTestSanity-41612179 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:20:30:941.732 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-AnalyticsBasicTestSanity-41612179:ctest-vn22-97468500 - virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-41612179:ctest-vn22-97468500,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:20:30:941.747 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-AnalyticsBasicTestSanity-41612179:ctest-vn22-97468500,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:20:31:026.875 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance f1fb993d-6087-405e-8ec0-913e5268b1bb controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 02:20:31:239.648 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:32:061.653 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:32:156.139 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:32:283.743 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:32:387.385 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:33:397.732 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:33:397.870 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-FloatingipBasicTestSanity-18305788 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:33:397.930 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:33:456.431 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:33:456.613 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-FloatingipBasicTestSanity-18305788:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:33:456.655 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:33:521.441 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:33:521.609 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:33:659.612 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:33:659.847 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-FloatingipBasicTestSanity-18305788:default controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:33:659.903 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:33:745.194 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:33:745.430 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-FloatingipBasicTestSanity-18305788:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:33:745.491 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:33:823.361 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:33:858.927 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:33:859.127 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-FloatingipBasicTestSanity-18305788:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:33:859.182 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:35:331.926 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:36:181.158 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:36:423.873 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:36:476.133 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:36:522.935 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:37:602.486 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:37:786.177 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:37:867.918 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:37:868.104 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:37:868.153 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:37:938.113 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:37:998.555 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:38:046.756 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:38:046.879 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 7cf1439e-b1c0-4f09-88b6-29d9ea783bf7 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 02:20:38:219.731 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:38:219.960 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:38:220.010 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:38:220.037 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:38:267.096 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:38:924.726 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:39:250.314 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:40:481.204 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:40:658.754 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:40:767.406 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:40:767.627 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-vn1-31495344 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:40:767.701 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:40:827.867 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:40:898.320 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:40:949.478 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:40:949.638 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 8165a1ef-3586-4256-b263-931ceaabc40c controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 02:20:41:014.733 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:41:014.941 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-vn1-31495344,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:41:014.996 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:41:015.029 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:41:086.996 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:41:440.793 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:41:772.561 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:42:910.576 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:43:702.550 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:43:760.309 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:43:760.436 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:7a1b3948-58ea-45e8-8c49-fa88113d1d13 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:43:920.555 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:43:920.760 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:dda895f6-91ba-4335-8717-f2723b5cfa2c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:43:920.812 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:43:920.845 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:43:920.873 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:43:920.901 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:43:987.472 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:44:092.869 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:44:093.027 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:30c0e24d-62ba-4e7e-b51a-144f0bcdacab controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:44:093.063 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:44:093.087 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:44:217.472 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:44:444.952 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:44:467.464 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:44:859.903 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:45:066.419 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:45:066.760 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980:ctest-some-pool-57490617 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:45:066.829 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:45:132.123 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:45:132.307 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:45:320.781 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:45:505.077 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:45:542.905 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:45:583.980 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:45:584.109 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:bb867a7d-c6f0-4470-ae9b-5a3531dc8624 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:45:730.212 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:45:730.426 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:2035ac8e-88d2-4271-9a36-a70b7e07350e controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:45:730.467 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:45:730.495 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:45:730.527 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:45:730.548 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:45:815.068 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:45:895.897 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:45:896.076 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:c688bea5-0e33-44ce-a7fc-69c8ca693e1c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:20:45:896.120 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:45:896.150 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:20:46:563.439 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:20:46:627.707 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:02:098.491 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:02:243.389 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:02:243.539 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980:ctest-some-pool-57490617:da22a5f4-a1cc-4570-a713-81e9780449b2 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:02:243.575 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating floating-ip-pool-floating-ip controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:02:243.602 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating floating-ip-project controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:02:414.602 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:02:414.808 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating floating-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:07:602.583 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:07:602.799 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:07:602.858 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980:ctest-some-pool-57490617:da22a5f4-a1cc-4570-a713-81e9780449b2 - virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:dda895f6-91ba-4335-8717-f2723b5cfa2c , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:07:685.318 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:07:685.377 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:07:685.396 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting floating-ip:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980:ctest-some-pool-57490617:da22a5f4-a1cc-4570-a713-81e9780449b2 controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:07:685.427 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980:ctest-some-pool-57490617:da22a5f4-a1cc-4570-a713-81e9780449b2 - floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980:ctest-some-pool-57490617 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:07:685.457 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980:ctest-some-pool-57490617:da22a5f4-a1cc-4570-a713-81e9780449b2 - project:default-domain:ctest-FloatingipBasicTestSanity-18305788 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:07:767.431 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:07:767.643 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:07:767.699 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-FloatingipBasicTestSanity-18305788 - floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980:ctest-some-pool-57490617 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:07:833.385 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:07:833.432 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980:ctest-some-pool-57490617 controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:07:833.456 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove floating-ip-pool:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980:ctest-some-pool-57490617 - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:08:654.032 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:08:654.084 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:08:654.135 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:c688bea5-0e33-44ce-a7fc-69c8ca693e1c controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:08:654.159 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:c688bea5-0e33-44ce-a7fc-69c8ca693e1c - virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:2035ac8e-88d2-4271-9a36-a70b7e07350e , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:08:654.180 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:c688bea5-0e33-44ce-a7fc-69c8ca693e1c - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:08:738.380 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:08:790.304 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:08:790.371 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:08:790.384 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting instance-ip:30c0e24d-62ba-4e7e-b51a-144f0bcdacab controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:08:790.407 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:30c0e24d-62ba-4e7e-b51a-144f0bcdacab - virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:dda895f6-91ba-4335-8717-f2723b5cfa2c , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:08:790.432 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove instance-ip:30c0e24d-62ba-4e7e-b51a-144f0bcdacab - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-vn1-31495344 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:08:844.403 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:08:844.470 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:08:844.490 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:08:844.509 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:08:844.519 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:2035ac8e-88d2-4271-9a36-a70b7e07350e controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:08:844.540 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:2035ac8e-88d2-4271-9a36-a70b7e07350e - project:default-domain:ctest-FloatingipBasicTestSanity-18305788 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:08:844.576 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:2035ac8e-88d2-4271-9a36-a70b7e07350e - security-group:default-domain:ctest-FloatingipBasicTestSanity-18305788:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:08:844.599 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:2035ac8e-88d2-4271-9a36-a70b7e07350e - virtual-machine:bb867a7d-c6f0-4470-ae9b-5a3531dc8624 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:08:844.616 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:2035ac8e-88d2-4271-9a36-a70b7e07350e - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:08:903.441 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:08:931.846 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:bb867a7d-c6f0-4470-ae9b-5a3531dc8624 controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:08:994.838 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:08:994.897 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:08:994.917 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:08:994.934 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:08:994.945 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:dda895f6-91ba-4335-8717-f2723b5cfa2c controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:08:994.988 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:dda895f6-91ba-4335-8717-f2723b5cfa2c - project:default-domain:ctest-FloatingipBasicTestSanity-18305788 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:08:995.020 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:dda895f6-91ba-4335-8717-f2723b5cfa2c - security-group:default-domain:ctest-FloatingipBasicTestSanity-18305788:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:08:995.056 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:dda895f6-91ba-4335-8717-f2723b5cfa2c - virtual-machine:7a1b3948-58ea-45e8-8c49-fa88113d1d13 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:08:995.071 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-machine-interface:default-domain:ctest-FloatingipBasicTestSanity-18305788:dda895f6-91ba-4335-8717-f2723b5cfa2c - virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-vn1-31495344 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:09:041.381 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-machine:7a1b3948-58ea-45e8-8c49-fa88113d1d13 controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:10:221.374 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:10:221.446 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:10:221.472 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:10:221.490 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-vn1-31495344 controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:10:221.506 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-vn1-31495344,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:10:221.534 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-vn1-31495344 - project:default-domain:ctest-FloatingipBasicTestSanity-18305788 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:10:221.571 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-vn1-31495344 - virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-vn1-31495344,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:10:221.609 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-vn1-31495344,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:10:294.581 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 8165a1ef-3586-4256-b263-931ceaabc40c controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 02:21:10:522.333 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:10:717.595 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:10:717.664 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:10:717.680 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:10:717.693 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980 controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:10:717.706 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:10:717.734 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980 - project:default-domain:ctest-FloatingipBasicTestSanity-18305788 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:10:717.764 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network:default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980 - virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980,default-domain:default-project:default-network-ipam) , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:10:717.802 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove virtual-network-network-ipam:attr(default-domain:ctest-FloatingipBasicTestSanity-18305788:ctest-fvn-05730980,default-domain:default-project:default-network-ipam) - network-ipam:default-domain:default-project:default-network-ipam , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:10:802.859 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance 7cf1439e-b1c0-4f09-88b6-29d9ea783bf7 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 02:21:11:030.007 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:12:550.813 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:12:662.431 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:12:788.421 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:12:917.902 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:13:944.081 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:13:944.217 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-TestHeat-59573273 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:13:944.300 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:14:008.558 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:14:008.738 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-TestHeat-59573273:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:14:008.780 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:14:069.405 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:14:069.774 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:14:243.151 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:14:243.392 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-TestHeat-59573273:default controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:14:243.438 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:14:337.371 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:14:337.556 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestHeat-59573273:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:14:337.598 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:14:416.886 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:14:437.275 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:14:437.460 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestHeat-59573273:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:14:437.501 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:17:770.838 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:17:772.325 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:17:911.731 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:17:914.851 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:17:921.408 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:17:952.154 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:18:060.365 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:18:088.139 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:18:111.017 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:18:111.073 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove security-group:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default - project:default-domain:ctest-AnalyticsBasicTestSanity-41612179 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:18:223.419 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:18:223.483 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove security-group:default-domain:ctest-FloatingipBasicTestSanity-18305788:default - project:default-domain:ctest-FloatingipBasicTestSanity-18305788 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:18:245.653 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:18:272.914 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:18:272.960 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:18:272.983 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default:ingress-access-control-list - security-group:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:18:312.815 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:18:337.196 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:18:382.839 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:18:396.034 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:18:396.096 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-AnalyticsBasicTestSanity-41612179 - application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default-application-policy-set , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:18:431.386 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:18:462.015 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:18:462.067 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:18:462.083 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting security-group:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:18:462.114 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default:egress-access-control-list - security-group:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:18:509.527 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:18:516.912 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:18:562.741 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:18:562.802 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:18:562.825 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove application-policy-set:default-domain:ctest-AnalyticsBasicTestSanity-41612179:default-application-policy-set - project:default-domain:ctest-AnalyticsBasicTestSanity-41612179 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:18:600.981 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:18:601.029 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-FloatingipBasicTestSanity-18305788:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:18:601.058 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-FloatingipBasicTestSanity-18305788:default:ingress-access-control-list - security-group:default-domain:ctest-FloatingipBasicTestSanity-18305788:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:18:639.643 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:18:639.696 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting project:default-domain:ctest-AnalyticsBasicTestSanity-41612179 controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:18:639.725 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-AnalyticsBasicTestSanity-41612179 - domain:default-domain , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:18:652.312 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:18:652.501 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:18:652.537 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-FloatingipBasicTestSanity-18305788 - application-policy-set:default-domain:ctest-FloatingipBasicTestSanity-18305788:default-application-policy-set , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:18:742.217 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:18:742.279 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting access-control-list:default-domain:ctest-FloatingipBasicTestSanity-18305788:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:18:742.291 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting security-group:default-domain:ctest-FloatingipBasicTestSanity-18305788:default controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:18:742.314 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove access-control-list:default-domain:ctest-FloatingipBasicTestSanity-18305788:default:egress-access-control-list - security-group:default-domain:ctest-FloatingipBasicTestSanity-18305788:default , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:18:771.633 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:18:771.679 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting application-policy-set:default-domain:ctest-FloatingipBasicTestSanity-18305788:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:18:771.711 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove application-policy-set:default-domain:ctest-FloatingipBasicTestSanity-18305788:default-application-policy-set - project:default-domain:ctest-FloatingipBasicTestSanity-18305788 , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:18:848.906 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Deleting link controller/src/ifmap/ifmap_server_table.cc 145 2025-03-20 Thu 02:21:18:849.071 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Deleting project:default-domain:ctest-FloatingipBasicTestSanity-18305788 controller/src/ifmap/ifmap_server_table.cc 164 2025-03-20 Thu 02:21:18:849.098 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: LinkOper: LinkRemove project:default-domain:ctest-FloatingipBasicTestSanity-18305788 - domain:default-domain , lhs: , rhs: controller/src/ifmap/ifmap_exporter.cc 574 2025-03-20 Thu 02:21:18:878.099 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:18:960.589 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:19:080.332 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:19:188.642 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:20:297.688 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:20:297.866 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating project:default-domain:ctest-TestRoutersBasic-22951247 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:20:297.929 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating domain-project controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:20:361.499 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:20:361.701 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating application-policy-set:default-domain:ctest-TestRoutersBasic-22951247:default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:20:361.768 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:20:416.182 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:20:416.389 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-default-application-policy-set controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:20:564.698 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:20:564.957 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating security-group:default-domain:ctest-TestRoutersBasic-22951247:default controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:20:565.009 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:20:660.725 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:20:660.960 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestRoutersBasic-22951247:default:ingress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:20:661.015 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:20:746.615 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:20:746.837 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating access-control-list:default-domain:ctest-TestRoutersBasic-22951247:default:egress-access-control-list controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:20:746.904 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating security-group-access-control-list controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:20:787.879 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:24:354.453 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:24:533.484 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:24:733.463 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:24:792.070 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:24:835.779 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:24:949.861 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:25:137.731 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:25:239.557 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:25:239.725 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestRoutersBasic-22951247:ctest-vn-48715222 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:25:239.780 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:25:313.621 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:25:381.574 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:25:422.671 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:25:422.783 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance bcadeb79-30e9-4f09-98bf-d04dafae46f9 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 02:21:25:559.765 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:25:559.995 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-22951247:ctest-vn-48715222,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:25:560.039 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:25:560.061 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:25:621.384 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:25:873.310 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:26:027.386 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:26:110.091 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:26:110.279 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestRoutersBasic-22951247:ctest-ext_vn-75741494 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:26:110.340 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:26:183.639 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:26:262.795 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:26:288.042 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:26:288.187 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating floating-ip-pool:default-domain:ctest-TestRoutersBasic-22951247:ctest-ext_vn-75741494:floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:26:288.236 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-floating-ip-pool controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:26:335.664 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:26:335.784 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance e5f8681e-e1af-4ed4-bcfd-5695be7d245d controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 02:21:26:489.964 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:26:490.164 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-22951247:ctest-ext_vn-75741494,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:26:490.190 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:26:490.211 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:26:564.689 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:27:787.160 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:28:513.381 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:28:571.834 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:28:572.055 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:4790a680-bbe3-4d9d-92ad-ef492e336aa7 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:28:715.715 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:28:715.915 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-22951247:f3e9ef5a-1128-4eb5-968e-465ab654900a controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:28:715.962 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:28:715.988 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:28:716.140 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:28:716.162 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:28:773.790 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:28:921.781 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:28:922.009 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:50146a23-dc7e-4a51-8ba6-b8017c31b8c6 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:28:922.071 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:28:922.096 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:29:183.825 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:29:200.339 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:29:283.634 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:29:711.511 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:29:810.708 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:29:810.928 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating logical-router:default-domain:ctest-TestRoutersBasic-22951247:ctest-router1-93241608 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:29:811.010 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-logical-router controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:29:887.665 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:29:946.053 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:29:946.287 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating logical-router-virtual-network:attr(default-domain:ctest-TestRoutersBasic-22951247:ctest-ext_vn-75741494,default-domain:ctest-TestRoutersBasic-22951247:ctest-router1-93241608) controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:29:946.322 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:29:946.350 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:29:965.794 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:155.842 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:207.885 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236884092672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:262.869 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:263.089 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:e99d3d78-85d3-483b-a271-d542c5382be4 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:30:328.362 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:328.533 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-22951247:85f0de99-8d42-4d94-9f0e-8da6d1eed12c controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:30:328.573 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:328.606 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:389.778 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:389.994 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network:default-domain:ctest-TestRoutersBasic-22951247:snat-si-left_snat_8ed5f7bd-9160-4f74-bcdd-6baa030dada2_cda32bc8-1d0e-4a69-8cd0-cb79959f1568 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:30:390.038 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:390.062 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-network-network-ipam:attr(default-domain:ctest-TestRoutersBasic-22951247:snat-si-left_snat_8ed5f7bd-9160-4f74-bcdd-6baa030dada2_cda32bc8-1d0e-4a69-8cd0-cb79959f1568,default-domain:default-project:default-network-ipam) controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:30:390.085 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:390.104 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-network-network-ipam controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:401.865 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:448.569 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:448.934 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-22951247:93f975f8-13f0-480f-8812-6ba01374b620 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:30:449.021 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:449.062 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:449.090 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:449.109 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:508.281 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:564.621 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:617.965 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:618.126 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:31bcdd77-c13b-4213-a52f-33e226b8f189 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:30:618.163 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:618.184 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:673.113 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:686.826 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:687.064 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:d0013561-f7aa-4aff-b039-b9da88330a6f controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:30:687.118 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:687.430 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:729.908 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:759.133 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:759.322 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance d2e178dc-f535-45b2-b102-4c2b7a01d82d controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 02:21:30:804.368 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:804.546 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating service-instance:default-domain:ctest-TestRoutersBasic-22951247:snat_8ed5f7bd-9160-4f74-bcdd-6baa030dada2_cda32bc8-1d0e-4a69-8cd0-cb79959f1568 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:30:804.584 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:804.611 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating service-instance-service-template controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:836.095 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:836.318 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:30:927.725 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:927.845 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance bcadeb79-30e9-4f09-98bf-d04dafae46f9 controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 02:21:30:943.388 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:30:943.574 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating route-table:default-domain:ctest-TestRoutersBasic-22951247:rt_8ed5f7bd-9160-4f74-bcdd-6baa030dada2 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:30:943.633 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236252247808, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-route-table controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:31:046.227 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:31:046.431 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:31:143.022 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:31:159.675 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:31:159.884 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating logical-router-route-table controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:31:210.273 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:31:382.095 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:31:382.280 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:default-domain__ctest-TestRoutersBasic-22951247__snat_8ed5f7bd-9160-4f74-bcdd-6baa030dada2_cda32bc8-1d0e-4a69-8cd0-cb79959f1568__1 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:31:382.324 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:31:539.853 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:31:540.144 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-22951247:default-domain__ctest-TestRoutersBasic-22951247__snat_8ed5f7bd-9160-4f74-bcdd-6baa030dada2_cda32bc8-1d0e-4a69-8cd0-cb79959f1568__1__right__1 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:31:540.220 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:31:540.279 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:31:540.314 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:31:540.672 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:31:596.308 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:31:659.757 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:31:752.659 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:31:752.853 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:default-domain__ctest-TestRoutersBasic-22951247__snat_8ed5f7bd-9160-4f74-bcdd-6baa030dada2_cda32bc8-1d0e-4a69-8cd0-cb79959f1568-right controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:31:752.919 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:31:825.496 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:31:875.750 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:31:937.150 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:004.389 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:004.570 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:110.297 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:110.495 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-22951247:default-domain__ctest-TestRoutersBasic-22951247__snat_8ed5f7bd-9160-4f74-bcdd-6baa030dada2_cda32bc8-1d0e-4a69-8cd0-cb79959f1568__1__left__2 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:32:110.540 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:110.578 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:110.610 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:110.634 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:206.350 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:260.346 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236892489472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:363.324 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:363.509 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating instance-ip:default-domain__ctest-TestRoutersBasic-22951247__snat_8ed5f7bd-9160-4f74-bcdd-6baa030dada2_cda32bc8-1d0e-4a69-8cd0-cb79959f1568-left controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:32:363.583 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236867299072, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:430.716 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:490.002 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236896687872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:547.753 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236871497472, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:606.093 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:606.280 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating instance-ip-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:661.158 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:661.402 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236863100672, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-router-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:701.166 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:701.373 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236875695872, Pid 106900]: IFMap [SYS_WARN]: ConfigurationMalformedReferenceWarningLog: instance_target No entry in metadata map routing_instance d2e178dc-f535-45b2-b102-4c2b7a01d82d controller/src/ifmap/client/config_json_parser.cc 223 2025-03-20 Thu 02:21:32:742.913 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236248049408, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:764.500 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:764.649 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine:default-domain__ctest-TestRoutersBasic-22951247__snat_8ed5f7bd-9160-4f74-bcdd-6baa030dada2_cda32bc8-1d0e-4a69-8cd0-cb79959f1568__2 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:32:764.684 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236879894272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-service-instance controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:886.908 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573 2025-03-20 Thu 02:21:32:887.164 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapNodeOperation: Creating virtual-machine-interface:default-domain:ctest-TestRoutersBasic-22951247:default-domain__ctest-TestRoutersBasic-22951247__snat_8ed5f7bd-9160-4f74-bcdd-6baa030dada2_cda32bc8-1d0e-4a69-8cd0-cb79959f1568__2__right__1 controller/src/ifmap/ifmap_server_table.cc 95 2025-03-20 Thu 02:21:32:887.221 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating project-virtual-machine-interface controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:887.285 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-security-group controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:887.318 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-machine controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:887.351 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236900886272, Pid 106900]: IFMap [SYS_DEBUG]: IFMapLinkOperation: Creating virtual-machine-interface-virtual-network controller/src/ifmap/ifmap_server_table.cc 130 2025-03-20 Thu 02:21:32:961.983 UTC cn-jenkins-deploy-platform-ansible-os-2923-2 [Thread 140236905084672, Pid 106900]: ConfigClientManager [SYS_DEBUG]: ConfigClientMgrDebug: Cassandra SM: Established Cassandra connection src/contrail-common/config-client-mgr/config_cassandra_client.cc 573