09/11/2025 04:16:05.633 7f6e23451448 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 09/11/2025 04:16:05.633 7f6e23451448 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 09/11/2025 04:16:05.633 7f6e23451448 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 09/11/2025 04:16:05.633 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.254:2181,10.0.0.22:2181,10.0.0.48:2181 09/11/2025 04:16:05.634 7f6e23451448 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 09/11/2025 04:16:05.635 7f6e1a1fbeb8 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 09/11/2025 04:16:05.635 7f6e1a1fbeb8 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 09/11/2025 04:16:05.635 7f6e1a201828 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 09/11/2025 04:16:05.635 7f6e1a201828 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/11/2025 04:16:05.635 7f6e1a201828 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 09/11/2025 04:16:05.636 7f6e1a201828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.636 7f6e1a201828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 09/11/2025 04:16:05.636 7f6e1a201828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.636 7f6e1a201828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.636 7f6e1a201828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/11/2025 04:16:05.636 7f6e1a201828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.636 7f6e1a201828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.636 7f6e1a201828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 09/11/2025 04:16:05.636 7f6e1a201828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.643 7f6e1a226438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.643 7f6e1a226438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 09/11/2025 04:16:05.643 7f6e1a226438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.720 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.254:9041', '10.0.0.22:9041', '10.0.0.48:9041'] 09/11/2025 04:16:05.720 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 09/11/2025 04:16:05.720 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 09/11/2025 04:16:05.720 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 09/11/2025 04:16:05.721 7f6e199c9780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.721 7f6e199c9780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 09/11/2025 04:16:05.721 7f6e199c9780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.722 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 09/11/2025 04:16:05.799 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 09/11/2025 04:16:05.801 7f6e199c6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.801 7f6e199c6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 09/11/2025 04:16:05.801 7f6e199c6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.807 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 09/11/2025 04:16:05.807 7f6e199e0828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.807 7f6e199e0828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 09/11/2025 04:16:05.808 7f6e199e0828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:05.852 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 09/11/2025 04:16:06.958 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'config_db_uuid', created 09/11/2025 04:16:06.966 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 09/11/2025 04:16:08.119 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 09/11/2025 04:16:09.190 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'config_db_uuid' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 09/11/2025 04:16:09.195 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 09/11/2025 04:16:09.636 7f6e199e2a20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:09.638 7f6e199e2a20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:09.638 7f6e199e2a20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:09.638 7f6e199e2a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:09.638 7f6e199e2a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 09/11/2025 04:16:09.638 7f6e199e2a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:09.638 7f6e199e2a20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:09.638 7f6e199e2a20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:09.638 7f6e199e2a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:09.639 7f6e199e2a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/11/2025 04:16:09.639 7f6e199e2a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:09.639 7f6e199e2a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:09.639 7f6e199e2a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/11/2025 04:16:09.639 7f6e199e2a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:10.258 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 09/11/2025 04:16:11.131 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'useragent', created 09/11/2025 04:16:11.140 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 09/11/2025 04:16:13.013 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 09/11/2025 04:16:13.479 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'useragent' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 09/11/2025 04:16:13.484 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 09/11/2025 04:16:13.484 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 09/11/2025 04:16:13.552 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 09/11/2025 04:16:13.638 7f6e199e2780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:13.640 7f6e199e2780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:13.640 7f6e199e2780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:13.640 7f6e199e2780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:13.640 7f6e199e2780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 09/11/2025 04:16:13.640 7f6e199e2780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:13.640 7f6e199e2780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:13.640 7f6e199e2780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:13.641 7f6e199e2780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:13.641 7f6e199e2780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/11/2025 04:16:13.641 7f6e199e2780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:13.641 7f6e199e2780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:13.641 7f6e199e2780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/11/2025 04:16:13.641 7f6e199e2780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:15.006 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 09/11/2025 04:16:15.571 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_shared_table', created 09/11/2025 04:16:15.576 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 09/11/2025 04:16:16.513 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 09/11/2025 04:16:17.239 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 09/11/2025 04:16:17.244 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 09/11/2025 04:16:17.640 7f6e1991d240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:17.642 7f6e1991d240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:17.642 7f6e1991d240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:17.642 7f6e1991d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:17.642 7f6e1991d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 09/11/2025 04:16:17.643 7f6e1991d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:17.643 7f6e1991d240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:17.643 7f6e1991d240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:17.643 7f6e1991d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:17.643 7f6e1991d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 09/11/2025 04:16:17.643 7f6e1991d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:17.643 7f6e1991d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:17.643 7f6e1991d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/11/2025 04:16:17.643 7f6e1991d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:18.286 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 09/11/2025 04:16:19.021 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'useragent_keyval_table', created 09/11/2025 04:16:19.026 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 09/11/2025 04:16:20.248 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 09/11/2025 04:16:20.938 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'useragent_keyval_table' fixed with properties {'gc_grace_seconds': 864000} 09/11/2025 04:16:20.943 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 09/11/2025 04:16:20.944 7f6e1989e198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:20.944 7f6e1989e198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:20.944 7f6e1989e198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.057 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.254:5673//', 'pyamqp://guest:guest@10.0.0.22:5673//', 'pyamqp://guest:guest@10.0.0.48:5673//'] 09/11/2025 04:16:21.069 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 09/11/2025 04:16:21.071 7f6e19781240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.071 7f6e19781240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/11/2025 04:16:21.072 7f6e19781240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.072 7f6e19781240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.072 7f6e19781240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/11/2025 04:16:21.072 7f6e19781240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.081 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 09/11/2025 04:16:21.081 7f6e1970a828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.081 7f6e1970a828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:21.081 7f6e1970a828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.137 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 09/11/2025 04:16:21.138 7f6e19781240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.138 7f6e19781240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/11/2025 04:16:21.139 7f6e19781240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.146 7f6e23451448 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 09/11/2025 04:16:21.147 7f6e19781048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.147 7f6e19781048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:21.147 7f6e19781048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.148 7f6e19781438 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 09/11/2025 04:16:21.149 7f6e1970c780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.149 7f6e1970c780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 09/11/2025 04:16:21.149 7f6e1970c780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.154 7f6e19781438 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 09/11/2025 04:16:21.154 7f6e197f98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.154 7f6e197f98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:21.155 7f6e197f98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.642 7f6e20f0c780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:21.644 7f6e20f0c780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:21.644 7f6e20f0c780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:21.644 7f6e20f0c780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:21.645 7f6e20f0c780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:16:21.645 7f6e20f0c780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:21.645 7f6e20f0c780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:21.645 7f6e20f0c780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:21.646 7f6e20f0c780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.646 7f6e20f0c780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:21.646 7f6e20f0c780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.646 7f6e20f0c780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:21.646 7f6e20f0c780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 09/11/2025 04:16:21.646 7f6e20f0c780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:22.978 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Executing db_resync on api-server instance 10.0.0.254_0 09/11/2025 04:16:22.983 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Contrail Version is(nightly-r24.1-centos) 09/11/2025 04:16:23.029 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: zk_sync_node data (None) 09/11/2025 04:16:23.029 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DBERESYNC: running dbe-resync 09/11/2025 04:16:23.062 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type virtual_network len 4 09/11/2025 04:16:23.062 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for virtual_network 09/11/2025 04:16:23.123 7f6e20db0ac8 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 09/11/2025 04:16:23.125 7f6e20a31f60 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 09/11/2025 04:16:23.125 7f6e20a806d8 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 09/11/2025 04:16:23.126 7f6e195fbac8 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 09/11/2025 04:16:23.126 7f6e199134e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.127 7f6e199134e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:ip-fabric elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "ip-fabric"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 9300941901518818415, "uuid_lslong": 13188501647778251873}, "enable": true, "created": "2025-09-11T04:16:21.789471", "last_modified": "2025-09-11T04:16:23.087490", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : trueis_shared : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"parent_uuid : "6b83acaf-67eb-4c3b-aba7-8727560a43c6"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "81139561-8493-4c6f-b706-f85f7b7a0461"virtual_network_category : "tenant"virtual_network_network_id : 2 } deleted = False >> 09/11/2025 04:16:23.127 7f6e199134e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.127 7f6e199134e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.127 7f6e199134e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:__link_local__ elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "__link_local__"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 751520471447784554, "uuid_lslong": 11291927622221754252}, "enable": true, "created": "2025-09-11T04:16:21.962102", "last_modified": "2025-09-11T04:16:23.083762", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : falseis_shared : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"parent_uuid : "6b83acaf-67eb-4c3b-aba7-8727560a43c6"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "0a6defe3-1614-4c6a-9cb4-fc585ff2ef8c"virtual_network_category : "tenant"virtual_network_network_id : 3 } deleted = False >> 09/11/2025 04:16:23.127 7f6e199134e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.127 7f6e199134e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.128 7f6e199134e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:dci-network elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "dci-network"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3845361039500134705, "uuid_lslong": 11600657699076203326}, "enable": true, "created": "2025-09-11T04:16:22.105821", "last_modified": "2025-09-11T04:16:23.084449", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : falseis_shared : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"parent_uuid : "6b83acaf-67eb-4c3b-aba7-8727560a43c6"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "355d777d-e888-4931-a0fd-d0b6e256633e"virtual_network_category : "tenant"virtual_network_network_id : 4 } deleted = False >> 09/11/2025 04:16:23.128 7f6e199134e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.128 7f6e199134e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.128 7f6e199134e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:default-virtual-network elements = { fq_name : ["default-domain", "default-project", "default-virtual-network"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 1379431263234179212, "uuid_lslong": 9549916215350800521}, "enable": true, "created": "2025-09-11T04:16:21.550342", "last_modified": "2025-09-11T04:16:23.091205", "description": null, "user_visible": true, "creator": null}is_shared : falseparent_type : "project"parent_uuid : "6b83acaf-67eb-4c3b-aba7-8727560a43c6"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "1324b96c-e524-408c-8488-1e3342ba3089"virtual_network_network_id : 1 } deleted = False >> 09/11/2025 04:16:23.128 7f6e199134e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.128 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for virtual_network 09/11/2025 04:16:23.128 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type tag_type len 7 09/11/2025 04:16:23.129 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for tag_type 09/11/2025 04:16:23.149 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for tag_type 09/11/2025 04:16:23.149 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type project len 1 09/11/2025 04:16:23.149 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for project 09/11/2025 04:16:23.220 7f6e19834c18 [contrail-api] [DEBUG]: Add uve in the [ObjectProjectTable:ContrailConfigTrace] map 09/11/2025 04:16:23.220 7f6e199c1828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.220 7f6e199c1828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7747225653370113083, "uuid_lslong": 12369003504613344198}, "enable": true, "created": "2025-09-11T04:16:21.451462", "last_modified": "2025-09-11T04:16:21.451462", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "7134262f-1ffb-453e-aad9-fbdd9a7a2b72"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "6b83acaf-67eb-4c3b-aba7-8727560a43c6" } deleted = False >> 09/11/2025 04:16:23.220 7f6e199c1828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.221 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for project 09/11/2025 04:16:23.221 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type policy_management len 1 09/11/2025 04:16:23.221 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for policy_management 09/11/2025 04:16:23.225 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for policy_management 09/11/2025 04:16:23.225 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type routing_instance len 6 09/11/2025 04:16:23.225 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for routing_instance 09/11/2025 04:16:23.240 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for routing_instance 09/11/2025 04:16:23.240 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type global_vrouter_config len 1 09/11/2025 04:16:23.240 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for global_vrouter_config 09/11/2025 04:16:23.246 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for global_vrouter_config 09/11/2025 04:16:23.246 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type application_policy_set len 1 09/11/2025 04:16:23.247 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for application_policy_set 09/11/2025 04:16:23.252 7f6e19781588 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 09/11/2025 04:16:23.252 7f6e1992b8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.252 7f6e1992b8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "b6b25520-beae-4e43-885e-8e9d517df70c"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6987890995231803791, "uuid_lslong": 13516756148607366418}, "enable": true, "created": "2025-09-11T04:16:21.671952", "last_modified": "2025-09-11T04:16:21.701632", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "44d63150-6907-438f-96ea-1a3ba3a7e9cc"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "60f9f9d6-33f1-498f-bb95-2a1a3151b512" } deleted = False >> 09/11/2025 04:16:23.252 7f6e1992b8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.252 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for application_policy_set 09/11/2025 04:16:23.252 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type network_ipam len 2 09/11/2025 04:16:23.252 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for network_ipam 09/11/2025 04:16:23.262 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for network_ipam 09/11/2025 04:16:23.262 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type security_group len 1 09/11/2025 04:16:23.262 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for security_group 09/11/2025 04:16:23.266 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for security_group 09/11/2025 04:16:23.266 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type global_qos_config len 1 09/11/2025 04:16:23.266 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for global_qos_config 09/11/2025 04:16:23.272 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for global_qos_config 09/11/2025 04:16:23.272 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type namespace len 1 09/11/2025 04:16:23.273 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for namespace 09/11/2025 04:16:23.284 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for namespace 09/11/2025 04:16:23.284 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type alarm len 1 09/11/2025 04:16:23.284 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for alarm 09/11/2025 04:16:23.288 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for alarm 09/11/2025 04:16:23.288 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type discovery_service_assignment len 1 09/11/2025 04:16:23.288 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for discovery_service_assignment 09/11/2025 04:16:23.295 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for discovery_service_assignment 09/11/2025 04:16:23.295 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type fabric len 1 09/11/2025 04:16:23.295 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for fabric 09/11/2025 04:16:23.307 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for fabric 09/11/2025 04:16:23.307 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type global_system_config len 1 09/11/2025 04:16:23.308 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for global_system_config 09/11/2025 04:16:23.315 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for global_system_config 09/11/2025 04:16:23.315 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type domain len 1 09/11/2025 04:16:23.315 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Start DB Resync for domain 09/11/2025 04:16:23.348 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Finished DB Resync for domain 09/11/2025 04:16:23.354 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DBERESYNC: Completed successfully 09/11/2025 04:16:23.361 7f6e198032e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Cassandra DB walk completed. 09/11/2025 04:16:23.402 7f6e198032e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Time elapsed in resyncing db: 0:00:00.419364 09/11/2025 04:16:23.404 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'obj_dict': {'autonomous_system': 64512, 'config_version': '1.0', 'enable_4byte_as': False, 'enable_security_policy_draft': False, 'fq_name': ['default-global-system-config'], 'ibgp_auto_mesh': True, 'id_perms': {'created': '2025-09-11T04:16:21.224287', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.224287', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13004686594477651387, 'uuid_mslong': 1837157719362388303}}, 'igmp_enable': False, 'mac_aging_time': 300, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb'}, 'oper': 'CREATE', 'request-id': 'req-0212f65c-04eb-4d61-a0b1-901ad54ba125', 'type': 'global_system_config', 'uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb'} 09/11/2025 04:16:23.407 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'obj_dict': {'enable_security_logging': True, 'encryption_mode': 'none', 'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'id_perms': {'created': '2025-09-11T04:16:21.302382', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.302382', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9826448243297220364, 'uuid_mslong': 13164678259883789891}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b6b25520-beae-4e43-885e-8e9d517df70c'}, 'oper': 'CREATE', 'request-id': 'req-506d3be9-0a2f-42fa-b61e-079f3b2dc916', 'type': 'global_vrouter_config', 'uuid': 'b6b25520-beae-4e43-885e-8e9d517df70c'} 09/11/2025 04:16:23.409 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain'], 'obj_dict': {'fq_name': ['default-domain'], 'id_perms': {'created': '2025-09-11T04:16:21.337755', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.337755', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12311147985592003442, 'uuid_mslong': 8157186808916690238}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7134262f-1ffb-453e-aad9-fbdd9a7a2b72'}, 'oper': 'CREATE', 'request-id': 'req-09043af3-4d91-42d1-8709-be295cc5d3fa', 'type': 'domain', 'uuid': '7134262f-1ffb-453e-aad9-fbdd9a7a2b72'} 09/11/2025 04:16:23.410 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-namespace'], 'obj_dict': {'_type': 'namespace', '_uuid': None, 'fq_name': ['default-domain', 'default-namespace'], 'id_perms': {'created': '2025-09-11T04:16:21.399729', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.399729', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11611326995186215868, 'uuid_mslong': 10711593278124935417}}, 'name': 'default-namespace', 'parent_type': 'domain', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '94a73955-8119-48f9-a123-b861f6fa6bbc'}, 'oper': 'CREATE', 'request-id': 'req-0c825364-3e18-416e-89cb-5665c9be3ba2', 'type': 'namespace', 'uuid': '94a73955-8119-48f9-a123-b861f6fa6bbc'} 09/11/2025 04:16:23.412 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'obj_dict': {'_enable_security_policy_draft': False, '_type': 'project', '_uuid': None, 'fq_name': ['default-domain', 'default-project'], 'id_perms': {'created': '2025-09-11T04:16:21.451462', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.451462', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12369003504613344198, 'uuid_mslong': 7747225653370113083}}, 'name': 'default-project', 'parent_type': 'domain', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6b83acaf-67eb-4c3b-aba7-8727560a43c6'}, 'oper': 'CREATE', 'request-id': 'req-36cd44c7-f549-4713-852f-c256c7d54ecd', 'type': 'project', 'uuid': '6b83acaf-67eb-4c3b-aba7-8727560a43c6'} 09/11/2025 04:16:23.414 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'obj_dict': {'_type': 'network-ipam', '_uuid': None, 'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'id_perms': {'created': '2025-09-11T04:16:21.499432', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.499432', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11482507502811039952, 'uuid_mslong': 3225709497367282375}}, 'name': 'default-network-ipam', 'parent_type': 'project', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2cc405b2-832e-42c7-9f5a-0fbca3cf48d0'}, 'oper': 'CREATE', 'request-id': 'req-9455fc35-a2e9-4aee-9f36-df9aaf86ba31', 'type': 'network_ipam', 'uuid': '2cc405b2-832e-42c7-9f5a-0fbca3cf48d0'} 09/11/2025 04:16:23.416 7f6e19913c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.416 7f6e19913c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { _enable_security_policy_draft : false_type : "project"_uuid : nullfq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7747225653370113083, "uuid_lslong": 12369003504613344198}, "enable": true, "created": "2025-09-11T04:16:21.451462", "last_modified": "2025-09-11T04:16:21.451462", "description": null, "user_visible": true, "creator": null}name : "default-project"parent_type : "domain"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "6b83acaf-67eb-4c3b-aba7-8727560a43c6" } deleted = False >> 09/11/2025 04:16:23.416 7f6e19913c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.418 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network'], 'obj_dict': {'_fabric_snat': False, '_flood_unknown_unicast': False, '_igmp_enable': False, '_is_provider_network': False, '_layer2_control_word': False, '_mac_aging_time': 300, '_mac_ip_learning_enable': False, '_mac_learning_enabled': False, '_pbb_etree_enable': False, '_pbb_evpn_enable': False, '_port_security_enabled': True, '_type': 'virtual-network', '_uuid': None, '_virtual_network_category': 'tenant', 'fq_name': ['default-domain', 'default-project', 'default-virtual-network'], 'id_perms': {'created': '2025-09-11T04:16:21.550342', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.550342', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9549916215350800521, 'uuid_mslong': 1379431263234179212}}, 'name': 'default-virtual-network', 'parent_type': 'project', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1324b96c-e524-408c-8488-1e3342ba3089', 'virtual_network_network_id': 1}, 'oper': 'CREATE', 'request-id': 'req-d967c293-ff8c-4a3c-bdcf-0e2a1d28e098', 'type': 'virtual_network', 'uuid': '1324b96c-e524-408c-8488-1e3342ba3089'} 09/11/2025 04:16:23.419 7f6e1a226390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.419 7f6e1a226390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:default-virtual-network elements = { _fabric_snat : false_flood_unknown_unicast : false_igmp_enable : false_is_provider_network : false_layer2_control_word : false_mac_aging_time : 300_mac_ip_learning_enable : false_mac_learning_enabled : false_pbb_etree_enable : false_pbb_evpn_enable : false_port_security_enabled : true_type : "virtual-network"_uuid : null_virtual_network_category : "tenant"fq_name : ["default-domain", "default-project", "default-virtual-network"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 1379431263234179212, "uuid_lslong": 9549916215350800521}, "enable": true, "created": "2025-09-11T04:16:21.550342", "last_modified": "2025-09-11T04:16:21.550342", "description": null, "user_visible": true, "creator": null}name : "default-virtual-network"parent_type : "project"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "1324b96c-e524-408c-8488-1e3342ba3089"virtual_network_network_id : 1 } deleted = False >> 09/11/2025 04:16:23.419 7f6e1a226390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.427 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-fabric'], 'obj_dict': {'disable_vlan_vn_uniqueness_check': False, 'fabric_enterprise_style': True, 'fq_name': ['default-global-system-config', 'default-fabric'], 'id_perms': {'created': '2025-09-11T04:16:21.607629', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.607629', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10315080212537409586, 'uuid_mslong': 14180974910221076731}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c4ccf18b-fc74-48fb-8f26-86cd39f40032'}, 'oper': 'CREATE', 'request-id': 'req-4e22e564-7e22-4fff-9f25-44ebc1214cbc', 'type': 'fabric', 'uuid': 'c4ccf18b-fc74-48fb-8f26-86cd39f40032'} 09/11/2025 04:16:23.428 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management'], 'obj_dict': {'fq_name': ['default-policy-management'], 'id_perms': {'created': '2025-09-11T04:16:21.629747', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.629747', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10874533093690567116, 'uuid_mslong': 4960206261024408463}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '44d63150-6907-438f-96ea-1a3ba3a7e9cc'}, 'oper': 'CREATE', 'request-id': 'req-87f47100-e703-4ccc-991d-3e6381b6ccfc', 'type': 'policy_management', 'uuid': '44d63150-6907-438f-96ea-1a3ba3a7e9cc'} 09/11/2025 04:16:23.428 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'fq_name': ['default-policy-management', 'default-application-policy-set'], 'id_perms': {'created': '2025-09-11T04:16:21.671952', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.671952', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13516756148607366418, 'uuid_mslong': 6987890995231803791}}, 'parent_type': 'policy-management', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '60f9f9d6-33f1-498f-bb95-2a1a3151b512'}, 'oper': 'CREATE', 'request-id': 'req-7278a31c-9b9b-446d-9dcd-2fbf80e40a6c', 'type': 'application_policy_set', 'uuid': '60f9f9d6-33f1-498f-bb95-2a1a3151b512'} 09/11/2025 04:16:23.438 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-d542f507-3d70-41da-b006-6b3cb971a188', 'type': 'application_policy_set', 'uuid': '60f9f9d6-33f1-498f-bb95-2a1a3151b512'} 09/11/2025 04:16:23.438 7f6e1a200588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.438 7f6e1a200588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6987890995231803791, "uuid_lslong": 13516756148607366418}, "enable": true, "created": "2025-09-11T04:16:21.671952", "last_modified": "2025-09-11T04:16:21.671952", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "60f9f9d6-33f1-498f-bb95-2a1a3151b512" } deleted = False >> 09/11/2025 04:16:23.438 7f6e1a200588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.446 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric'], 'obj_dict': {'fabric_snat': False, 'flood_unknown_unicast': False, 'fq_name': ['default-domain', 'default-project', 'ip-fabric'], 'id_perms': {'created': '2025-09-11T04:16:21.789471', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.789471', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13188501647778251873, 'uuid_mslong': 9300941901518818415}}, 'igmp_enable': False, 'is_provider_network': True, 'layer2_control_word': False, 'mac_aging_time': 300, 'mac_ip_learning_enable': False, 'mac_learning_enabled': False, 'parent_type': 'project', 'pbb_etree_enable': False, 'pbb_evpn_enable': False, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'uuid': '81139561-8493-4c6f-b706-f85f7b7a0461', 'virtual_network_category': 'tenant', 'virtual_network_network_id': 2}, 'oper': 'CREATE', 'request-id': 'req-d4ada89e-1bde-4689-9cb3-590ec745197b', 'type': 'virtual_network', 'uuid': '81139561-8493-4c6f-b706-f85f7b7a0461'} 09/11/2025 04:16:23.447 7f6e19830588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.447 7f6e19830588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "b6b25520-beae-4e43-885e-8e9d517df70c"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6987890995231803791, "uuid_lslong": 13516756148607366418}, "enable": true, "created": "2025-09-11T04:16:21.671952", "last_modified": "2025-09-11T04:16:21.701632", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "44d63150-6907-438f-96ea-1a3ba3a7e9cc"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "60f9f9d6-33f1-498f-bb95-2a1a3151b512" } deleted = False >> 09/11/2025 04:16:23.447 7f6e19830588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.447 7f6e19830588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.447 7f6e19830588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:ip-fabric elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "ip-fabric"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 9300941901518818415, "uuid_lslong": 13188501647778251873}, "enable": true, "created": "2025-09-11T04:16:21.789471", "last_modified": "2025-09-11T04:16:21.789471", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : truelayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "81139561-8493-4c6f-b706-f85f7b7a0461"virtual_network_category : "tenant"virtual_network_network_id : 2 } deleted = False >> 09/11/2025 04:16:23.447 7f6e19830588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.453 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2025-09-11T04:16:21.855109', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.855109', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12297807839617922788, 'uuid_mslong': 75575354575310657}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '010c7f62-733c-4f41-aaaa-9712d470b6e4'}, 'oper': 'CREATE', 'request-id': 'req-06c074b4-51f4-4f2d-be3f-1a5ddfb67b36', 'type': 'routing_instance', 'uuid': '010c7f62-733c-4f41-aaaa-9712d470b6e4'} 09/11/2025 04:16:23.454 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__'], 'id_perms': {'created': '2025-09-11T04:16:21.896080', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.896080', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13629000191878838323, 'uuid_mslong': 14877129202279335129}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': False, 'uuid': 'ce762e2f-e373-44d9-bd23-ef7708ab3833'}, 'oper': 'CREATE', 'request-id': 'req-6b8a0a8e-28c4-4a04-a082-56609137a8f4', 'type': 'routing_instance', 'uuid': 'ce762e2f-e373-44d9-bd23-ef7708ab3833'} 09/11/2025 04:16:23.455 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__link_local__'], 'obj_dict': {'fabric_snat': False, 'flood_unknown_unicast': False, 'fq_name': ['default-domain', 'default-project', '__link_local__'], 'id_perms': {'created': '2025-09-11T04:16:21.962102', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:21.962102', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11291927622221754252, 'uuid_mslong': 751520471447784554}}, 'igmp_enable': False, 'is_provider_network': False, 'layer2_control_word': False, 'mac_aging_time': 300, 'mac_ip_learning_enable': False, 'mac_learning_enabled': False, 'parent_type': 'project', 'pbb_etree_enable': False, 'pbb_evpn_enable': False, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'uuid': '0a6defe3-1614-4c6a-9cb4-fc585ff2ef8c', 'virtual_network_category': 'tenant', 'virtual_network_network_id': 3}, 'oper': 'CREATE', 'request-id': 'req-7b44b80b-fcb0-4a0d-b0bf-fb9fc6ca4d41', 'type': 'virtual_network', 'uuid': '0a6defe3-1614-4c6a-9cb4-fc585ff2ef8c'} 09/11/2025 04:16:23.456 7f6e20f0c780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.456 7f6e20f0c780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:__link_local__ elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "__link_local__"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 751520471447784554, "uuid_lslong": 11291927622221754252}, "enable": true, "created": "2025-09-11T04:16:21.962102", "last_modified": "2025-09-11T04:16:21.962102", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "0a6defe3-1614-4c6a-9cb4-fc585ff2ef8c"virtual_network_category : "tenant"virtual_network_network_id : 3 } deleted = False >> 09/11/2025 04:16:23.456 7f6e20f0c780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.462 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__link_local__', '__link_local__'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', '__link_local__', '__link_local__'], 'id_perms': {'created': '2025-09-11T04:16:22.010267', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.010267', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11397453369214743462, 'uuid_mslong': 1556324734895211737}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '15992d19-c295-44d9-9e2b-e373f81fb3a6'}, 'oper': 'CREATE', 'request-id': 'req-2a5f9cd3-d2cd-4b71-8c2b-60789640ddc5', 'type': 'routing_instance', 'uuid': '15992d19-c295-44d9-9e2b-e373f81fb3a6'} 09/11/2025 04:16:23.463 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network'], 'obj_dict': {'fabric_snat': False, 'flood_unknown_unicast': False, 'fq_name': ['default-domain', 'default-project', 'dci-network'], 'id_perms': {'created': '2025-09-11T04:16:22.105821', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.105821', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11600657699076203326, 'uuid_mslong': 3845361039500134705}}, 'igmp_enable': False, 'is_provider_network': False, 'layer2_control_word': False, 'mac_aging_time': 300, 'mac_ip_learning_enable': False, 'mac_learning_enabled': False, 'parent_type': 'project', 'pbb_etree_enable': False, 'pbb_evpn_enable': False, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'uuid': '355d777d-e888-4931-a0fd-d0b6e256633e', 'virtual_network_category': 'tenant', 'virtual_network_network_id': 4}, 'oper': 'CREATE', 'request-id': 'req-fb41b8fa-f6a1-46d2-8723-1c91ac5dee3e', 'type': 'virtual_network', 'uuid': '355d777d-e888-4931-a0fd-d0b6e256633e'} 09/11/2025 04:16:23.463 7f6e195fbeb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.463 7f6e195fbeb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:dci-network elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "dci-network"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3845361039500134705, "uuid_lslong": 11600657699076203326}, "enable": true, "created": "2025-09-11T04:16:22.105821", "last_modified": "2025-09-11T04:16:22.105821", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "355d777d-e888-4931-a0fd-d0b6e256633e"virtual_network_category : "tenant"virtual_network_network_id : 4 } deleted = False >> 09/11/2025 04:16:23.463 7f6e195fbeb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.466 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'id_perms': {'created': '2025-09-11T04:16:22.168116', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.168116', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13526327748498791651, 'uuid_mslong': 12075932599370335479}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': 'a79654b7-d507-44f7-bbb7-2b6bf4c79ce3'}, 'oper': 'CREATE', 'request-id': 'req-5ad262e0-5cd3-4e7d-8eb7-f54c6d6fa787', 'type': 'routing_instance', 'uuid': 'a79654b7-d507-44f7-bbb7-2b6bf4c79ce3'} 09/11/2025 04:16:23.467 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'id_perms': {'created': '2025-09-11T04:16:22.217490', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.217490', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9663084537626914961, 'uuid_mslong': 3323593017156649957}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': False, 'uuid': '2e1fc63d-6d97-43e5-861a-2c3093d27091'}, 'oper': 'CREATE', 'request-id': 'req-3b3e8909-5481-4351-89c7-b2971b74ee3b', 'type': 'routing_instance', 'uuid': '2e1fc63d-6d97-43e5-861a-2c3093d27091'} 09/11/2025 04:16:23.468 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bottle-request-size-limit'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'UveConfigReq.err_info.*.', 'operand2': {'json_value': 'True'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'fq_name': ['default-global-system-config', 'system-defined-bottle-request-size-limit'], 'id_perms': {'created': '2025-09-11T04:16:22.264170', 'description': 'Bottle request size limit exceeded.', 'last_modified': '2025-09-11T04:16:22.264170', 'uuid': {'uuid_lslong': 13060448923376407651, 'uuid_mslong': 6979651837606841082}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '60dcb45d-d475-4afa-b540-09193cfbd463', 'uve_keys': {'uve_key': ['config-node']}}, 'oper': 'CREATE', 'request-id': 'req-669c3052-fbbf-4d05-a6a8-faa35c9107b5', 'type': 'alarm', 'uuid': '60dcb45d-d475-4afa-b540-09193cfbd463'} 09/11/2025 04:16:23.470 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'id_perms': {'created': '2025-09-11T04:16:22.326946', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.326946', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13737512307192748859, 'uuid_mslong': 9606779539845366909}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '85522317-b3f9-447d-bea5-72a8afc7db3b'}, 'oper': 'CREATE', 'request-id': 'req-07553f8e-4780-40ec-84c6-335474291f77', 'type': 'routing_instance', 'uuid': '85522317-b3f9-447d-bea5-72a8afc7db3b'} 09/11/2025 04:16:23.472 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__'], 'obj_dict': {'configured_security_group_id': 0, 'fq_name': ['default-domain', 'default-project', '__no_rule__'], 'id_perms': {'created': '2025-09-11T04:16:22.474670', 'creator': None, 'description': 'Security group with no rules', 'enable': True, 'last_modified': '2025-09-11T04:16:22.474670', 'permissions': None, 'user_visible': True, 'uuid': {'uuid_lslong': 9849700947275204790, 'uuid_mslong': 15837042204658322109}}, 'parent_type': 'project', 'perms2': {'global_access': 5, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': []}, 'security_group_id': 8000001, 'uuid': 'dbc879fa-1587-4abd-88b1-2ad35a2ac8b6'}, 'oper': 'CREATE', 'request-id': 'req-643be50d-4818-4431-87be-956a92e32a4a', 'type': 'security_group', 'uuid': 'dbc879fa-1587-4abd-88b1-2ad35a2ac8b6'} 09/11/2025 04:16:23.478 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-discovery-service-assignment'], 'obj_dict': {'fq_name': ['default-discovery-service-assignment'], 'id_perms': {'created': '2025-09-11T04:16:22.517158', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.517158', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11548102663425017073, 'uuid_mslong': 16541823170830551050}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e5905c88-12ae-480a-a043-1a301b30c4f1'}, 'oper': 'CREATE', 'request-id': 'req-5f4f759c-6948-492a-9f68-cd81ba508dce', 'type': 'discovery_service_assignment', 'uuid': 'e5905c88-12ae-480a-a043-1a301b30c4f1'} 09/11/2025 04:16:23.479 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-qos-config'], 'obj_dict': {'fq_name': ['default-global-system-config', 'default-global-qos-config'], 'id_perms': {'created': '2025-09-11T04:16:22.564068', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.564068', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11559686602972000332, 'uuid_mslong': 17073005153497858710}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ecef7fba-fea7-4296-a06c-41b834fcf04c'}, 'oper': 'CREATE', 'request-id': 'req-4fb66363-e613-4259-8139-60425622e06f', 'type': 'global_qos_config', 'uuid': 'ecef7fba-fea7-4296-a06c-41b834fcf04c'} 09/11/2025 04:16:23.481 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'service-chain-flat-ipam'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'service-chain-flat-ipam'], 'id_perms': {'created': '2025-09-11T04:16:22.639929', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.639929', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11605501720640942123, 'uuid_mslong': 446665790419845167}}, 'ipam_subnet_method': 'flat-subnet', 'ipam_subnets': {'subnets': [{'addr_from_start': None, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': None, 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': None, 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 8}, 'subnet_name': None, 'subnet_uuid': None, 'subscriber_tag': None, 'vlan_tag': None}, {'addr_from_start': None, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': None, 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': None, 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': '::ffff', 'ip_prefix_len': 104}, 'subnet_name': None, 'subnet_uuid': None, 'subscriber_tag': None, 'vlan_tag': None}]}, 'parent_type': 'project', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0632e02b-7b4b-402f-a10f-06538afcf02b'}, 'oper': 'CREATE', 'request-id': 'req-7482961e-71f4-414a-aa5f-3c7d2fdbeaaa', 'type': 'network_ipam', 'uuid': '0632e02b-7b4b-402f-a10f-06538afcf02b'} 09/11/2025 04:16:23.487 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label'], 'obj_dict': {'display_name': 'label', 'fq_name': ['label'], 'id_perms': {'created': '2025-09-11T04:16:22.677381', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.677381', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 13652829229128766236, 'uuid_mslong': 3918485207369862560}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0000', 'uuid': '36614188-fae7-4da0-bd78-97d91d4a531c'}, 'oper': 'CREATE', 'request-id': 'req-903ca08f-67b0-46f0-b293-0b18d3564f14', 'type': 'tag_type', 'uuid': '36614188-fae7-4da0-bd78-97d91d4a531c'} 09/11/2025 04:16:23.494 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['application'], 'obj_dict': {'display_name': 'application', 'fq_name': ['application'], 'id_perms': {'created': '2025-09-11T04:16:22.733946', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.733946', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 10387012100290372868, 'uuid_mslong': 1134571722398060098}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0001', 'uuid': '0fbecef8-65bd-4e42-9026-1478f37de504'}, 'oper': 'CREATE', 'request-id': 'req-99c6592e-be3b-4c10-aaf8-291f3e70bd7f', 'type': 'tag_type', 'uuid': '0fbecef8-65bd-4e42-9026-1478f37de504'} 09/11/2025 04:16:23.498 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['tier'], 'obj_dict': {'display_name': 'tier', 'fq_name': ['tier'], 'id_perms': {'created': '2025-09-11T04:16:22.776641', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.776641', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 11659923853126291375, 'uuid_mslong': 8200055602958715073}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0002', 'uuid': '71cc7320-08ce-48c1-a1d0-5ef7adb24faf'}, 'oper': 'CREATE', 'request-id': 'req-b7f27eb8-bc7b-4ada-8a5c-7dbaa6281c84', 'type': 'tag_type', 'uuid': '71cc7320-08ce-48c1-a1d0-5ef7adb24faf'} 09/11/2025 04:16:23.502 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['deployment'], 'obj_dict': {'display_name': 'deployment', 'fq_name': ['deployment'], 'id_perms': {'created': '2025-09-11T04:16:22.833511', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.833511', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 10452860812194781297, 'uuid_mslong': 10943131191678355287}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0003', 'uuid': '97ddcfd6-f27c-4757-9110-0586ed789871'}, 'oper': 'CREATE', 'request-id': 'req-3b596e04-8dd7-4af9-846e-56cf174b721f', 'type': 'tag_type', 'uuid': '97ddcfd6-f27c-4757-9110-0586ed789871'} 09/11/2025 04:16:23.505 7f6e23451448 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 09/11/2025 04:16:23.505 7f6e1e9fc6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.506 7f6e1e9fc6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ModuleCpuStateTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. build_info = {"build-info" : [{"build-version" : "v0+nightly.r24.1.centos", "build-time" : "2025-09-11 00:11:28.695100", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-10925-1.novalocal", "build-id" : "1", "build-number" : "centos"}]} config_node_ip = [ 10.0.0.254, 10.20.0.17, 172.17.0.1, ] >> 09/11/2025 04:16:23.506 7f6e1e9fc6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.508 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['site'], 'obj_dict': {'display_name': 'site', 'fq_name': ['site'], 'id_perms': {'created': '2025-09-11T04:16:22.908864', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.908864', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 9870919207673426473, 'uuid_mslong': 12700333279531319896}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0004', 'uuid': 'b040a5d4-1789-4258-88fc-8cb893f47229'}, 'oper': 'CREATE', 'request-id': 'req-1b4ca902-f099-4254-93d8-1b1e9b1dabdc', 'type': 'tag_type', 'uuid': 'b040a5d4-1789-4258-88fc-8cb893f47229'} 09/11/2025 04:16:23.511 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['neutron_fwaas'], 'obj_dict': {'display_name': 'neutron_fwaas', 'fq_name': ['neutron_fwaas'], 'id_perms': {'created': '2025-09-11T04:16:22.932227', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.932227', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 13547327247236983865, 'uuid_mslong': 9252318365970614982}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0005', 'uuid': '8066d688-7080-4ac6-bc01-c65ac387ec39'}, 'oper': 'CREATE', 'request-id': 'req-86493e65-0f4b-4be7-82d0-b891adb52cf2', 'type': 'tag_type', 'uuid': '8066d688-7080-4ac6-bc01-c65ac387ec39'} 09/11/2025 04:16:23.513 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['neutron_tag'], 'obj_dict': {'display_name': 'neutron_tag', 'fq_name': ['neutron_tag'], 'id_perms': {'created': '2025-09-11T04:16:22.971818', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:22.971818', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 9961341426273569796, 'uuid_mslong': 1399863826645602133}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0006', 'uuid': '136d50bb-c921-4f55-8a3d-cb3fef6b4c04'}, 'oper': 'CREATE', 'request-id': 'req-89322878-3c06-4479-9246-7f4c17aacf20', 'type': 'tag_type', 'uuid': '136d50bb-c921-4f55-8a3d-cb3fef6b4c04'} 09/11/2025 04:16:23.652 7f6e199e2828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.653 7f6e199e2828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Generic Connection:Keystone[] connection down >>, ] >> 09/11/2025 04:16:23.653 7f6e199e2828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.659 7f6e19812cc0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Starting consumer greenlet 09/11/2025 04:16:23.659 7f6e19812cc0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 09/11/2025 04:16:23.660 7f6e19812780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Starting publisher greenlet 09/11/2025 04:16:23.660 7f6e19812780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Publisher connection 09/11/2025 04:16:23.662 7f6e23451448 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Added consumer: amqp_request.cn-jenkins-deploy-platform-ansible-os-4080-1..dummy 09/11/2025 04:16:23.662 7f6e23451448 [contrail-api] [DEBUG]: Add uve in the [none:ConfigApiWorkerTrace] map 09/11/2025 04:16:23.663 7f6e1b987588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.663 7f6e1b987588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ConfigApiWorkerTrace: data = << name = worker-0 worker_id = 0 introspect_port = 8084 admin_port = 8095 introspect_url = http://10.0.0.254:8084 >> 09/11/2025 04:16:23.663 7f6e1b987588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.685 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-3cf042fa-36b1-403d-8e82-e95c9c0247b1', 'type': 'network_ipam', 'uuid': '2cc405b2-832e-42c7-9f5a-0fbca3cf48d0'} 09/11/2025 04:16:23.686 7f6e19812780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Publisher connection established 09/11/2025 04:16:23.686 7f6e19812cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 09/11/2025 04:16:23.723 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-api-access-list'], 'obj_dict': {'api_access_list_entries': {'rbac_rule': [{'rule_field': '', 'rule_object': 'fqname-to-id', 'rule_perms': [{'role_crud': 'CRUD', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': 'id-to-fqname', 'rule_perms': [{'role_crud': 'CRUD', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': 'useragent-kv', 'rule_perms': [{'role_crud': 'CRUD', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': 'documentation', 'rule_perms': [{'role_crud': 'R', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': '/', 'rule_perms': [{'role_crud': 'R', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': 'watch', 'rule_perms': [{'role_crud': 'R', 'role_name': '*'}]}, {'rule_field': 'logical_router_gateway_external', 'rule_object': 'logical-router', 'rule_perms': [{'role_crud': 'R', 'role_name': '*'}]}]}, 'fq_name': ['default-global-system-config', 'default-api-access-list'], 'id_perms': {'created': '2025-09-11T04:16:23.098686', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:23.098686', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11142944384121381115, 'uuid_mslong': 8560508307290147341}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '76cd08f3-30cf-4a0d-9aa3-b0e1277d20fb'}, 'oper': 'CREATE', 'request-id': 'req-579a303a-b9b9-4e25-ac89-3af7a622618b', 'type': 'api_access_list', 'uuid': '76cd08f3-30cf-4a0d-9aa3-b0e1277d20fb'} 09/11/2025 04:16:23.730 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'fq_name': ['default-domain', 'default-project', 'default-application-policy-set'], 'id_perms': {'created': '2025-09-11T04:16:23.213074', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:23.213074', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11564433820086935077, 'uuid_mslong': 2181515096521920009}}, 'parent_type': 'project', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1e464c6c-1057-4e09-a07d-1f49d2cb9e25'}, 'oper': 'CREATE', 'request-id': 'req-90132cae-578f-44ad-b2dd-1d0ad777e807', 'type': 'application_policy_set', 'uuid': '1e464c6c-1057-4e09-a07d-1f49d2cb9e25'} 09/11/2025 04:16:23.731 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 09/11/2025 04:16:23.735 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-27cbd493-8c63-4cde-b751-338768f1d51d', 'type': 'project', 'uuid': '6b83acaf-67eb-4c3b-aba7-8727560a43c6'} 09/11/2025 04:16:23.736 7f6e18b46a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.736 7f6e18b46a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:default-application-policy-set elements = { all_applications : truefq_name : ["default-domain", "default-project", "default-application-policy-set"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2181515096521920009, "uuid_lslong": 11564433820086935077}, "enable": true, "created": "2025-09-11T04:16:23.213074", "last_modified": "2025-09-11T04:16:23.213074", "description": null, "user_visible": true, "creator": null}parent_type : "project"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "1e464c6c-1057-4e09-a07d-1f49d2cb9e25" } deleted = False >> 09/11/2025 04:16:23.736 7f6e18b46a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.750 7f6e18b452e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.750 7f6e18b452e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7747225653370113083, "uuid_lslong": 12369003504613344198}, "enable": true, "created": "2025-09-11T04:16:21.451462", "last_modified": "2025-09-11T04:16:23.397393", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "7134262f-1ffb-453e-aad9-fbdd9a7a2b72"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}quota : {"defaults": -1}uuid : "6b83acaf-67eb-4c3b-aba7-8727560a43c6" } deleted = False >> 09/11/2025 04:16:23.750 7f6e18b452e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:23.764 7f6e19812cc0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-4080-1..dummy'] 09/11/2025 04:16:23.790 7f6e19812cc0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 09/11/2025 04:16:23.799 7f6e19812cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 09/11/2025 04:16:23.845 7f6e19812cc0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-4080-1..dummy'] 09/11/2025 04:16:25.267 7f6e193814e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_appliance_set identifier_name = default-global-system-config:opencontrail url = http://10.0.0.254:8082/service-appliance-sets operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.254 body = {"service-appliance-set": {"uuid": null, "fq_name": ["default-global-system-config", "opencontrail"], "parent_type": "global-system-config", "service_appliance_driver": "svc_monitor.services.loadbalancer.drivers.ha_proxy.driver.OpencontrailLoadbalancerDriver", "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 5, "share": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "display_name": "opencontrail"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:25.304 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'opencontrail'], 'obj_dict': {'display_name': 'opencontrail', 'fq_name': ['default-global-system-config', 'opencontrail'], 'id_perms': {'created': '2025-09-11T04:16:25.295202', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:25.295202', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13798265984318335999, 'uuid_mslong': 17114950696511292080}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 5, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service_appliance_driver': 'svc_monitor.services.loadbalancer.drivers.ha_proxy.driver.OpencontrailLoadbalancerDriver', 'uuid': 'ed8484fa-c5e1-42b0-bf7d-49ce6fa66bff'}, 'oper': 'CREATE', 'request-id': 'req-73d053a7-aebd-46cc-8b57-0ad5102b45da', 'type': 'service_appliance_set', 'uuid': 'ed8484fa-c5e1-42b0-bf7d-49ce6fa66bff'} 09/11/2025 04:16:25.523 7f6e193814e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_appliance_set identifier_name = default-global-system-config:native url = http://10.0.0.254:8082/service-appliance-sets operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.254 body = {"service-appliance-set": {"uuid": null, "fq_name": ["default-global-system-config", "native"], "parent_type": "global-system-config", "service_appliance_driver": "svc_monitor.services.loadbalancer.drivers.native.driver.OpencontrailLoadbalancerDriver", "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 5, "share": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "display_name": "native"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:25.568 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'native'], 'obj_dict': {'display_name': 'native', 'fq_name': ['default-global-system-config', 'native'], 'id_perms': {'created': '2025-09-11T04:16:25.558101', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:25.558101', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10206331030925425416, 'uuid_mslong': 12640172738672870229}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 5, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service_appliance_driver': 'svc_monitor.services.loadbalancer.drivers.native.driver.OpencontrailLoadbalancerDriver', 'uuid': 'af6aea22-a42c-4355-8da4-2bff465b3b08'}, 'oper': 'CREATE', 'request-id': 'req-a0769747-f371-4c59-acaf-d138efe93c20', 'type': 'service_appliance_set', 'uuid': 'af6aea22-a42c-4355-8da4-2bff465b3b08'} 09/11/2025 04:16:25.645 7f6e19364978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:25.646 7f6e19364978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:25.647 7f6e19364978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:25.647 7f6e19364978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:25.647 7f6e19364978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Generic Connection:Keystone[] connection down >>, ] >> 09/11/2025 04:16:25.647 7f6e19364978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:25.647 7f6e19364978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:25.647 7f6e19364978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:25.647 7f6e19364978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:25.647 7f6e19364978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Generic Connection:Keystone[] connection down >>, ] >> 09/11/2025 04:16:25.647 7f6e19364978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:25.648 7f6e19364978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:25.648 7f6e19364978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:16:25.648 7f6e19364978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:25.806 7f6e18a9b438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:25.807 7f6e18a9b438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:25.807 7f6e18a9b438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:25.899 7f6e18b29390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:image_upgrade_template url = http://10.0.0.254:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.254 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "image_upgrade_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/image_upgrade.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Image upgrade input\", \"type\": \"object\", \"properties\": {\"image_uuid\": {\"type\": \"string\"}}, \"required\": [\"image_uuid\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Image Upgrade", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:25.900 7f6e193814e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:analyzer-template url = http://10.0.0.254:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.254 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "analyzer-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": null, "service_type": "analyzer", "image_name": "analyzer", "service_scaling": false, "interface_type": [{"service_interface_type": "left", "shared_ip": false, "static_route_enable": false}], "flavor": "m1.medium", "ordered_interfaces": true, "service_virtualization_type": "virtual-machine", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "1c7bc00d913741dc91182b098025db9c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "analyzer-template"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:25.940 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'analyzer-template'], 'obj_dict': {'display_name': 'analyzer-template', 'fq_name': ['default-domain', 'analyzer-template'], 'id_perms': {'created': '2025-09-11T04:16:25.926200', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:25.926200', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13555163032588532043, 'uuid_mslong': 13048760335005207025}}, 'parent_type': 'domain', 'parent_uuid': '7134262f-1ffb-453e-aad9-fbdd9a7a2b72', 'perms2': {'global_access': 0, 'owner': '1c7bc00d913741dc91182b098025db9c', 'owner_access': 7, 'share': [{'tenant': 'domain:7134262f-1ffb-453e-aad9-fbdd9a7a2b72', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': 'm1.medium', 'image_name': 'analyzer', 'instance_data': None, 'interface_type': [{'service_interface_type': 'left', 'shared_ip': False, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': None, 'service_scaling': False, 'service_type': 'analyzer', 'service_virtualization_type': 'virtual-machine', 'version': 1, 'vrouter_instance_type': None}, 'uuid': 'b5168263-af31-49f1-bc1d-9cf5b5f2394b'}, 'oper': 'CREATE', 'request-id': 'req-371c172c-4090-4509-9cd0-7de878e9ea2f', 'type': 'service_template', 'uuid': 'b5168263-af31-49f1-bc1d-9cf5b5f2394b'} 09/11/2025 04:16:25.950 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'image_upgrade_template'], 'obj_dict': {'display_name': 'Image Upgrade', 'fq_name': ['default-global-system-config', 'image_upgrade_template'], 'id_perms': {'created': '2025-09-11T04:16:25.925407', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:25.925407', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12901803558724113866, 'uuid_mslong': 7028184823981557283}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Image upgrade input", ' '"type": "object", "properties": ' '{"image_uuid": {"type": ' '"string"}}, "required": ' '["image_uuid"]}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/image_upgrade.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '618920dc-4936-4623-b30c-69fadf9f15ca'}, 'oper': 'CREATE', 'request-id': 'req-b56e10da-5af3-423f-8a63-73b1c4dd68b8', 'type': 'job_template', 'uuid': '618920dc-4936-4623-b30c-69fadf9f15ca'} 09/11/2025 04:16:25.954 7f6e193814e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:nat-template url = http://10.0.0.254:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.254 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "nat-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "in-network-nat", "service_type": "firewall", "image_name": "analyzer", "service_scaling": false, "interface_type": [{"service_interface_type": "management", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "right", "shared_ip": false, "static_route_enable": false}], "flavor": "m1.medium", "ordered_interfaces": true, "service_virtualization_type": "virtual-machine", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "1c7bc00d913741dc91182b098025db9c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "nat-template"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:25.999 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'nat-template'], 'obj_dict': {'display_name': 'nat-template', 'fq_name': ['default-domain', 'nat-template'], 'id_perms': {'created': '2025-09-11T04:16:25.987928', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:25.987928', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13125336813958754553, 'uuid_mslong': 17830174255821573318}}, 'parent_type': 'domain', 'parent_uuid': '7134262f-1ffb-453e-aad9-fbdd9a7a2b72', 'perms2': {'global_access': 0, 'owner': '1c7bc00d913741dc91182b098025db9c', 'owner_access': 7, 'share': [{'tenant': 'domain:7134262f-1ffb-453e-aad9-fbdd9a7a2b72', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': 'm1.medium', 'image_name': 'analyzer', 'instance_data': None, 'interface_type': [{'service_interface_type': 'management', 'shared_ip': False, 'static_route_enable': False}, {'service_interface_type': 'left', 'shared_ip': False, 'static_route_enable': False}, {'service_interface_type': 'right', 'shared_ip': False, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': 'in-network-nat', 'service_scaling': False, 'service_type': 'firewall', 'service_virtualization_type': 'virtual-machine', 'version': 1, 'vrouter_instance_type': None}, 'uuid': 'f7718104-718f-4cc6-b626-904a915e70f9'}, 'oper': 'CREATE', 'request-id': 'req-87c7147f-3468-478d-a280-9698514f73da', 'type': 'service_template', 'uuid': 'f7718104-718f-4cc6-b626-904a915e70f9'} 09/11/2025 04:16:26.053 7f6e18b29390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:container_cleanup_template url = http://10.0.0.254:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.254 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "container_cleanup_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/container_cleanup.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Container cleanup input\", \"type\": \"object\", \"required\": [\"fabric_fq_name\", \"container_name\"], \"properties\": {\"container_name\": {\"type\": \"string\"}, \"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Container cleanup output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Container Cleanup", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:26.055 7f6e193814e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:netns-snat-template url = http://10.0.0.254:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.254 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "netns-snat-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "in-network-nat", "service_type": "source-nat", "image_name": null, "service_scaling": true, "interface_type": [{"service_interface_type": "right", "shared_ip": true, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": true, "static_route_enable": false}], "flavor": null, "ordered_interfaces": true, "service_virtualization_type": "network-namespace", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "1c7bc00d913741dc91182b098025db9c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "netns-snat-template"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:26.086 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'netns-snat-template'], 'obj_dict': {'display_name': 'netns-snat-template', 'fq_name': ['default-domain', 'netns-snat-template'], 'id_perms': {'created': '2025-09-11T04:16:26.078140', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:26.078140', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12405438907846170164, 'uuid_mslong': 2879814073858739701}}, 'parent_type': 'domain', 'parent_uuid': '7134262f-1ffb-453e-aad9-fbdd9a7a2b72', 'perms2': {'global_access': 0, 'owner': '1c7bc00d913741dc91182b098025db9c', 'owner_access': 7, 'share': [{'tenant': 'domain:7134262f-1ffb-453e-aad9-fbdd9a7a2b72', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': None, 'image_name': None, 'instance_data': None, 'interface_type': [{'service_interface_type': 'right', 'shared_ip': True, 'static_route_enable': False}, {'service_interface_type': 'left', 'shared_ip': True, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': 'in-network-nat', 'service_scaling': True, 'service_type': 'source-nat', 'service_virtualization_type': 'network-namespace', 'version': 1, 'vrouter_instance_type': None}, 'uuid': '27f727a4-6b85-4df5-ac28-f8f5b8fb1634'}, 'oper': 'CREATE', 'request-id': 'req-832585a4-a65e-4ded-9885-32b908503820', 'type': 'service_template', 'uuid': '27f727a4-6b85-4df5-ac28-f8f5b8fb1634'} 09/11/2025 04:16:26.140 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'container_cleanup_template'], 'obj_dict': {'display_name': 'Container Cleanup', 'fq_name': ['default-global-system-config', 'container_cleanup_template'], 'id_perms': {'created': '2025-09-11T04:16:26.077345', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:26.077345', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13239291728806157140, 'uuid_mslong': 3224656676538368430}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Container cleanup ' 'input", "type": "object", ' '"required": ["fabric_fq_name", ' '"container_name"], "properties": ' '{"container_name": {"type": ' '"string"}, "fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Container cleanup ' 'output", "type": "object", ' '"properties": {"status": {"type": ' '"string", "enum": ["Success", ' '"Failure", "Timeout"], ' '"description": "Result status of ' 'the job"}, "message": {"type": ' '"string", "description": "Should ' 'capture a summarized error ' 'message in case of Failures."}, ' '"results": {"type": "object", ' '"description": "JSON object ' 'holding the job specific output ' 'details"}}, "required": ' '["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/container_cleanup.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2cc04829-8fa9-41ae-b7bb-69aebd421b54'}, 'oper': 'CREATE', 'request-id': 'req-4d0a7406-2777-487b-b582-b673811029be', 'type': 'job_template', 'uuid': '2cc04829-8fa9-41ae-b7bb-69aebd421b54'} 09/11/2025 04:16:26.154 7f6e193814e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:haproxy-loadbalancer-template url = http://10.0.0.254:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.254 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "haproxy-loadbalancer-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "in-network-nat", "service_type": "loadbalancer", "image_name": null, "service_scaling": true, "interface_type": [{"service_interface_type": "right", "shared_ip": true, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": true, "static_route_enable": false}], "flavor": null, "ordered_interfaces": true, "service_virtualization_type": "network-namespace", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "1c7bc00d913741dc91182b098025db9c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "haproxy-loadbalancer-template"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:26.198 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'haproxy-loadbalancer-template'], 'obj_dict': {'display_name': 'haproxy-loadbalancer-template', 'fq_name': ['default-domain', 'haproxy-loadbalancer-template'], 'id_perms': {'created': '2025-09-11T04:16:26.187891', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:26.187891', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13576313096579761114, 'uuid_mslong': 1645753142339259514}}, 'parent_type': 'domain', 'parent_uuid': '7134262f-1ffb-453e-aad9-fbdd9a7a2b72', 'perms2': {'global_access': 0, 'owner': '1c7bc00d913741dc91182b098025db9c', 'owner_access': 7, 'share': [{'tenant': 'domain:7134262f-1ffb-453e-aad9-fbdd9a7a2b72', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': None, 'image_name': None, 'instance_data': None, 'interface_type': [{'service_interface_type': 'right', 'shared_ip': True, 'static_route_enable': False}, {'service_interface_type': 'left', 'shared_ip': True, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': 'in-network-nat', 'service_scaling': True, 'service_type': 'loadbalancer', 'service_virtualization_type': 'network-namespace', 'version': 1, 'vrouter_instance_type': None}, 'uuid': '16d6e3c3-6d1d-4c7a-bc68-c0d4b91ec3da'}, 'oper': 'CREATE', 'request-id': 'req-e7741838-7f38-4d80-ab46-68a87e93ec03', 'type': 'service_template', 'uuid': '16d6e3c3-6d1d-4c7a-bc68-c0d4b91ec3da'} 09/11/2025 04:16:26.252 7f6e18b29390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:cli_sync_template url = http://10.0.0.254:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.254 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "cli_sync_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/cli_sync.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"CLI sync input\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"devices_cli\": {\"type\": \"array\", \"items\": {\"title\": \"Devices CLI Items\", \"type\": \"object\", \"description\": \"Dictionaries of device details\", \"additionalProperties\": false, \"required\": [\"device_uuid\", \"cli_objects\"], \"properties\": {\"device_uuid\": {\"type\": \"string\", \"title\": \"UUIDs of the device\"}, \"cli_objects\": {\"type\": \"array\", \"title\": \"cli objects for that device\", \"items\": {\"type\": \"object\", \"required\": [\"time\", \"status\"], \"properties\": {\"time\": {\"type\": \"string\", \"title\": \"Timestamp of the cli change\"}, \"status\": {\"type\": \"string\", \"title\": \"Accept or Reject the commit\"}}}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Sync cli config with Contrail", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:26.253 7f6e193814e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:docker-template url = http://10.0.0.254:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.254 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "docker-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "transparent", "service_type": "firewall", "image_name": "ubuntu", "service_scaling": false, "interface_type": [{"service_interface_type": "management", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "right", "shared_ip": false, "static_route_enable": false}], "flavor": null, "ordered_interfaces": true, "service_virtualization_type": "vrouter-instance", "availability_zone_enable": false, "vrouter_instance_type": "docker", "instance_data": "{\"command\":\"/bin/bash\"}"}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "1c7bc00d913741dc91182b098025db9c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "docker-template"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:26.306 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'docker-template'], 'obj_dict': {'display_name': 'docker-template', 'fq_name': ['default-domain', 'docker-template'], 'id_perms': {'created': '2025-09-11T04:16:26.277737', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:26.277737', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13363606273365827924, 'uuid_mslong': 10309193232138387967}}, 'parent_type': 'domain', 'parent_uuid': '7134262f-1ffb-453e-aad9-fbdd9a7a2b72', 'perms2': {'global_access': 0, 'owner': '1c7bc00d913741dc91182b098025db9c', 'owner_access': 7, 'share': [{'tenant': 'domain:7134262f-1ffb-453e-aad9-fbdd9a7a2b72', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': None, 'image_name': 'ubuntu', 'instance_data': '{"command":"/bin/bash"}', 'interface_type': [{'service_interface_type': 'management', 'shared_ip': False, 'static_route_enable': False}, {'service_interface_type': 'left', 'shared_ip': False, 'static_route_enable': False}, {'service_interface_type': 'right', 'shared_ip': False, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': 'transparent', 'service_scaling': False, 'service_type': 'firewall', 'service_virtualization_type': 'vrouter-instance', 'version': 1, 'vrouter_instance_type': 'docker'}, 'uuid': '8f119c9f-ca78-41ff-b975-111a2a26e154'}, 'oper': 'CREATE', 'request-id': 'req-f0d10e9d-350e-41e6-b78d-bf33dcdae862', 'type': 'service_template', 'uuid': '8f119c9f-ca78-41ff-b975-111a2a26e154'} 09/11/2025 04:16:26.335 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cli_sync_template'], 'obj_dict': {'display_name': 'Sync cli config with Contrail', 'fq_name': ['default-global-system-config', 'cli_sync_template'], 'id_perms': {'created': '2025-09-11T04:16:26.273647', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:26.273647', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12458121781401657051, 'uuid_mslong': 1773259779805170708}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "CLI sync input", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"type": "string", "description": ' '"Fabric UUID"}, "devices_cli": ' '{"type": "array", "items": ' '{"title": "Devices CLI Items", ' '"type": "object", "description": ' '"Dictionaries of device details", ' '"additionalProperties": false, ' '"required": ["device_uuid", ' '"cli_objects"], "properties": ' '{"device_uuid": {"type": "string", ' '"title": "UUIDs of the device"}, ' '"cli_objects": {"type": "array", ' '"title": "cli objects for that ' 'device", "items": {"type": ' '"object", "required": ["time", ' '"status"], "properties": {"time": ' '{"type": "string", "title": ' '"Timestamp of the cli change"}, ' '"status": {"type": "string", ' '"title": "Accept or Reject the ' 'commit"}}}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/cli_sync.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '189be25f-e5c6-4c14-ace4-23c115009edb'}, 'oper': 'CREATE', 'request-id': 'req-f0f1d8d4-b8fd-4582-8de4-9c00bf91aa67', 'type': 'job_template', 'uuid': '189be25f-e5c6-4c14-ace4-23c115009edb'} 09/11/2025 04:16:26.446 7f6e18b29390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:hitless_upgrade_strategy_template url = http://10.0.0.254:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.254 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "hitless_upgrade_strategy_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hitless_upgrade_strategy.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hitless_upgrade.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 90, "sequence_no": 1}]}, "job_template_input_schema": "{\"title\": \"Image upgrade strategy input\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"upgrade_mode\": {\"enum\": [\"test_run\", \"dry_run\", \"upgrade\"], \"description\": \"Mode in which to run workflow\"}, \"device_list\": {\"type\": \"array\", \"description\": \"List of device UUIDs to be upgraded\", \"items\": {\"title\": \"device uuid\", \"type\": \"string\", \"format\": \"uuid\"}}, \"image_devices\": {\"type\": \"array\", \"items\": {\"title\": \"Image Devices\", \"type\": \"object\", \"description\": \"List of images and corresponding devices to upgrade\", \"additionalProperties\": false, \"properties\": {\"image_uuid\": {\"type\": \"string\"}, \"device_list\": {\"type\": \"array\", \"description\": \"List of device UUIDs to be upgraded with this image\", \"items\": {\"title\": \"device uuid\", \"type\": \"string\", \"format\": \"uuid\"}}}, \"required\": [\"image_uuid\", \"device_list\"]}}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable local interface down check\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable peer interface down check\", \"default\": true}}}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Hitless Image Upgrade", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:26.548 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'hitless_upgrade_strategy_template'], 'obj_dict': {'display_name': 'Hitless Image Upgrade', 'fq_name': ['default-global-system-config', 'hitless_upgrade_strategy_template'], 'id_perms': {'created': '2025-09-11T04:16:26.481831', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:26.481831', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10391060954088008121, 'uuid_mslong': 4706883954370757689}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "Image upgrade strategy ' 'input", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"type": "string", "description": ' '"Fabric UUID"}, "upgrade_mode": ' '{"enum": ["test_run", "dry_run", ' '"upgrade"], "description": "Mode ' 'in which to run workflow"}, ' '"device_list": {"type": "array", ' '"description": "List of device ' 'UUIDs to be upgraded", "items": ' '{"title": "device uuid", "type": ' '"string", "format": "uuid"}}, ' '"image_devices": {"type": "array", ' '"items": {"title": "Image ' 'Devices", "type": "object", ' '"description": "List of images and ' 'corresponding devices to upgrade", ' '"additionalProperties": false, ' '"properties": {"image_uuid": ' '{"type": "string"}, "device_list": ' '{"type": "array", "description": ' '"List of device UUIDs to be ' 'upgraded with this image", ' '"items": {"title": "device uuid", ' '"type": "string", "format": ' '"uuid"}}}, "required": ' '["image_uuid", "device_list"]}}, ' '"advanced_parameters": {"title": ' '"Advanced parameters", ' '"description": "Optional ' 'parameters used to override ' 'defaults", "type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bulk_device_upgrade_count": ' '{"type": "integer", "description": ' '"Maximum number of devices to ' 'upgrade simultaneously", ' '"default": 4}, ' '"health_check_abort": {"type": ' '"boolean", "description": ' '"Enable/disable abort upon health ' 'check failures", "default": true}, ' '"Juniper": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp_flap_count": {"type": ' '"integer", "description": "Number ' 'of flaps allowed for BGP ' 'neighbors", "default": 4}, ' '"bgp_flap_count_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp_flap_count ' 'check", "default": true}, ' '"bgp_down_peer_count": {"type": ' '"integer", "description": "Number ' 'of down peers allowed", "default": ' '0}, "bgp_down_peer_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable ' 'bgp_down_peer_count check", ' '"default": true}, ' '"bgp_peer_state_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp peer state ' 'check", "default": true}}}, ' '"alarm": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"system_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable system alarm ' 'check", "default": true}, ' '"chassis_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable chassis alarm ' 'check", "default": true}}}, ' '"interface": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"interface_error_check": {"type": ' '"boolean", "description": ' '"Enable/disable interface error ' 'check", "default": true}, ' '"interface_drop_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface drop ' 'check", "default": true}, ' '"interface_carrier_transition_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface carrier ' 'transition check", "default": ' 'true}}}, "routing_engine": ' '{"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"routing_engine_cpu_idle": ' '{"type": "integer", "description": ' '"Routing engine CPU idle time", ' '"default": 60}, ' '"routing_engine_cpu_idle_check": ' '{"type": "boolean", "description": ' '"Enable/disable routing engine CLU ' 'idle time check", "default": ' 'true}}}, "fpc": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"fpc_cpu_5min_avg": {"type": ' '"integer", "description": "FPC CPU ' '5 minute average utilization", ' '"default": 50}, ' '"fpc_cpu_5min_avg_check": {"type": ' '"boolean", "description": ' '"Enable/disable FPC CPU 5 minute ' 'average utilizationcheck", ' '"default": true}, ' '"fpc_memory_heap_util": {"type": ' '"integer", "description": "FPC ' 'memory heap utilization", ' '"default": 45}, ' '"fpc_memory_heap_util_check": ' '{"type": "boolean", "description": ' '"Enable/disable FPC memory heap ' 'utilization check", "default": ' 'true}}}, ' '"active_route_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable active route count ' 'check", "default": true}, ' '"l2_total_mac_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable l2 total mac count ' 'check", "default": true}, ' '"storm_control_flag_check": ' '{"type": "boolean", "description": ' '"Enable/disable storm control flag ' 'check", "default": true}, "lacp": ' '{"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"lacp_down_local_check": {"type": ' '"boolean", "description": ' '"Enable/disable local interface ' 'down check", "default": true}, ' '"lacp_down_peer_check": {"type": ' '"boolean", "description": ' '"Enable/disable peer interface ' 'down check", "default": ' 'true}}}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hitless_upgrade_strategy.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 90, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hitless_upgrade.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '41523604-b341-4439-9034-76e22fd8e9b9'}, 'oper': 'CREATE', 'request-id': 'req-07b7247c-d61f-4563-9d95-0f98268d1137', 'type': 'job_template', 'uuid': '41523604-b341-4439-9034-76e22fd8e9b9'} 09/11/2025 04:16:26.659 7f6e18b29390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:maintenance_mode_activate_template url = http://10.0.0.254:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.254 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "maintenance_mode_activate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/maintenance_mode_activate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Activate maintenance mode\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_uuid\", \"device_uuid\"], \"properties\": {\"fabric_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Fabric UUID\", \"description\": \"UUID of the device fabric\"}, \"device_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Device UUID\", \"description\": \"UUID of the device to enter maintenance mode\"}, \"mode\": {\"enum\": [\"test_run\", \"activate\"], \"description\": \"Mode in which to run workflow\"}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"validate_critical_roles\": {\"type\": \"boolean\", \"description\": \"Enable/disable critical role validation\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on target device\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on peer device\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Activate maintenance mode output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Maintenance Mode Activation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:26.710 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'maintenance_mode_activate_template'], 'obj_dict': {'display_name': 'Maintenance Mode Activation', 'fq_name': ['default-global-system-config', 'maintenance_mode_activate_template'], 'id_perms': {'created': '2025-09-11T04:16:26.690306', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:26.690306', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11810033310735059533, 'uuid_mslong': 9813852601341132976}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"title": "Activate maintenance ' 'mode", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_uuid", ' '"device_uuid"], "properties": ' '{"fabric_uuid": {"format": "uuid", ' '"type": "string", "title": "Fabric ' 'UUID", "description": "UUID of the ' 'device fabric"}, "device_uuid": ' '{"format": "uuid", "type": ' '"string", "title": "Device UUID", ' '"description": "UUID of the device ' 'to enter maintenance mode"}, ' '"mode": {"enum": ["test_run", ' '"activate"], "description": "Mode ' 'in which to run workflow"}, ' '"advanced_parameters": {"title": ' '"Advanced parameters", ' '"description": "Optional ' 'parameters used to override ' 'defaults", "type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bulk_device_upgrade_count": ' '{"type": "integer", "description": ' '"Maximum number of devices to ' 'upgrade simultaneously", ' '"default": 4}, ' '"health_check_abort": {"type": ' '"boolean", "description": ' '"Enable/disable abort upon health ' 'check failures", "default": true}, ' '"validate_critical_roles": ' '{"type": "boolean", "description": ' '"Enable/disable critical role ' 'validation", "default": true}, ' '"Juniper": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp_flap_count": {"type": ' '"integer", "description": "Number ' 'of flaps allowed for BGP ' 'neighbors", "default": 4}, ' '"bgp_flap_count_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp_flap_count ' 'check", "default": true}, ' '"bgp_down_peer_count": {"type": ' '"integer", "description": "Number ' 'of down peers allowed", "default": ' '0}, "bgp_down_peer_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable ' 'bgp_down_peer_count check", ' '"default": true}, ' '"bgp_peer_state_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp peer state ' 'check", "default": true}}}, ' '"alarm": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"system_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable system alarm ' 'check", "default": true}, ' '"chassis_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable chassis alarm ' 'check", "default": true}}}, ' '"interface": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"interface_error_check": {"type": ' '"boolean", "description": ' '"Enable/disable interface error ' 'check", "default": true}, ' '"interface_drop_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface drop ' 'check", "default": true}, ' '"interface_carrier_transition_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface carrier ' 'transition check", "default": ' 'true}}}, "routing_engine": ' '{"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"routing_engine_cpu_idle": ' '{"type": "integer", "description": ' '"Routing engine CPU idle time", ' '"default": 60}, ' '"routing_engine_cpu_idle_check": ' '{"type": "boolean", "description": ' '"Enable/disable routing engine CLU ' 'idle time check", "default": ' 'true}}}, "fpc": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"fpc_cpu_5min_avg": {"type": ' '"integer", "description": "FPC CPU ' '5 minute average utilization", ' '"default": 50}, ' '"fpc_cpu_5min_avg_check": {"type": ' '"boolean", "description": ' '"Enable/disable FPC CPU 5 minute ' 'average utilizationcheck", ' '"default": true}, ' '"fpc_memory_heap_util": {"type": ' '"integer", "description": "FPC ' 'memory heap utilization", ' '"default": 45}, ' '"fpc_memory_heap_util_check": ' '{"type": "boolean", "description": ' '"Enable/disable FPC memory heap ' 'utilization check", "default": ' 'true}}}, "lacp": {"type": ' '"object", "additionalProperties": ' 'false, "default": {}, ' '"properties": ' '{"lacp_down_local_check": {"type": ' '"boolean", "description": "Enable ' 'lacp interface status check on ' 'target device", "default": true}, ' '"lacp_down_peer_check": {"type": ' '"boolean", "description": "Enable ' 'lacp interface status check on ' 'peer device", "default": true}}}, ' '"active_route_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable active route count ' 'check", "default": true}, ' '"l2_total_mac_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable l2 total mac count ' 'check", "default": true}, ' '"storm_control_flag_check": ' '{"type": "boolean", "description": ' '"Enable/disable storm control flag ' 'check", "default": true}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Activate maintenance ' 'mode output", "type": "object", ' '"properties": {"status": {"type": ' '"string", "enum": ["Success", ' '"Failure", "Timeout"], ' '"description": "Result status of ' 'the job"}, "message": {"type": ' '"string", "description": "Should ' 'capture a summarized error ' 'message in case of Failures."}, ' '"results": {"type": "object", ' '"description": "JSON object ' 'holding the job specific output ' 'details"}}, "required": ' '["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/maintenance_mode_activate.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8831cef1-e4fb-40b0-a3e5-aab94fe4ca4d'}, 'oper': 'CREATE', 'request-id': 'req-753a9cc4-8bba-4e40-b64b-9fa7f9bc665e', 'type': 'job_template', 'uuid': '8831cef1-e4fb-40b0-a3e5-aab94fe4ca4d'} 09/11/2025 04:16:26.822 7f6e18b29390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:maintenance_mode_deactivate_template url = http://10.0.0.254:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.254 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "maintenance_mode_deactivate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/maintenance_mode_deactivate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Deactivate maintenance mode\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_uuid\", \"device_uuid\"], \"properties\": {\"fabric_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Fabric UUID\", \"description\": \"UUID of the device fabric\"}, \"device_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Device UUID\", \"description\": \"UUID of the device to exit maintenance mode\"}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on target device\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on peer device\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Deactivate maintenance mode output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Maintenance Mode Deactivation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:26.858 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'maintenance_mode_deactivate_template'], 'obj_dict': {'display_name': 'Maintenance Mode Deactivation', 'fq_name': ['default-global-system-config', 'maintenance_mode_deactivate_template'], 'id_perms': {'created': '2025-09-11T04:16:26.849932', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:26.849932', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11448225267557474908, 'uuid_mslong': 5782732361245280899}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"title": "Deactivate maintenance ' 'mode", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_uuid", ' '"device_uuid"], "properties": ' '{"fabric_uuid": {"format": "uuid", ' '"type": "string", "title": "Fabric ' 'UUID", "description": "UUID of the ' 'device fabric"}, "device_uuid": ' '{"format": "uuid", "type": ' '"string", "title": "Device UUID", ' '"description": "UUID of the device ' 'to exit maintenance mode"}, ' '"advanced_parameters": {"title": ' '"Advanced parameters", ' '"description": "Optional ' 'parameters used to override ' 'defaults", "type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bulk_device_upgrade_count": ' '{"type": "integer", "description": ' '"Maximum number of devices to ' 'upgrade simultaneously", ' '"default": 4}, ' '"health_check_abort": {"type": ' '"boolean", "description": ' '"Enable/disable abort upon health ' 'check failures", "default": true}, ' '"Juniper": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp_flap_count": {"type": ' '"integer", "description": "Number ' 'of flaps allowed for BGP ' 'neighbors", "default": 4}, ' '"bgp_flap_count_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp_flap_count ' 'check", "default": true}, ' '"bgp_down_peer_count": {"type": ' '"integer", "description": "Number ' 'of down peers allowed", "default": ' '0}, "bgp_down_peer_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable ' 'bgp_down_peer_count check", ' '"default": true}, ' '"bgp_peer_state_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp peer state ' 'check", "default": true}}}, ' '"alarm": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"system_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable system alarm ' 'check", "default": true}, ' '"chassis_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable chassis alarm ' 'check", "default": true}}}, ' '"interface": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"interface_error_check": {"type": ' '"boolean", "description": ' '"Enable/disable interface error ' 'check", "default": true}, ' '"interface_drop_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface drop ' 'check", "default": true}, ' '"interface_carrier_transition_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface carrier ' 'transition check", "default": ' 'true}}}, "routing_engine": ' '{"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"routing_engine_cpu_idle": ' '{"type": "integer", "description": ' '"Routing engine CPU idle time", ' '"default": 60}, ' '"routing_engine_cpu_idle_check": ' '{"type": "boolean", "description": ' '"Enable/disable routing engine CLU ' 'idle time check", "default": ' 'true}}}, "fpc": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"fpc_cpu_5min_avg": {"type": ' '"integer", "description": "FPC CPU ' '5 minute average utilization", ' '"default": 50}, ' '"fpc_cpu_5min_avg_check": {"type": ' '"boolean", "description": ' '"Enable/disable FPC CPU 5 minute ' 'average utilizationcheck", ' '"default": true}, ' '"fpc_memory_heap_util": {"type": ' '"integer", "description": "FPC ' 'memory heap utilization", ' '"default": 45}, ' '"fpc_memory_heap_util_check": ' '{"type": "boolean", "description": ' '"Enable/disable FPC memory heap ' 'utilization check", "default": ' 'true}}}, "lacp": {"type": ' '"object", "additionalProperties": ' 'false, "default": {}, ' '"properties": ' '{"lacp_down_local_check": {"type": ' '"boolean", "description": "Enable ' 'lacp interface status check on ' 'target device", "default": true}, ' '"lacp_down_peer_check": {"type": ' '"boolean", "description": "Enable ' 'lacp interface status check on ' 'peer device", "default": true}}}, ' '"active_route_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable active route count ' 'check", "default": true}, ' '"l2_total_mac_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable l2 total mac count ' 'check", "default": true}, ' '"storm_control_flag_check": ' '{"type": "boolean", "description": ' '"Enable/disable storm control flag ' 'check", "default": true}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Deactivate maintenance ' 'mode output", "type": "object", ' '"properties": {"status": {"type": ' '"string", "enum": ["Success", ' '"Failure", "Timeout"], ' '"description": "Result status of ' 'the job"}, "message": {"type": ' '"string", "description": "Should ' 'capture a summarized error ' 'message in case of Failures."}, ' '"results": {"type": "object", ' '"description": "JSON object ' 'holding the job specific output ' 'details"}}, "required": ' '["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/maintenance_mode_deactivate.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '50406471-bf2e-4a83-9ee0-4439bd6a225c'}, 'oper': 'CREATE', 'request-id': 'req-a8af71a4-3b6e-4258-8405-807cd62cd363', 'type': 'job_template', 'uuid': '50406471-bf2e-4a83-9ee0-4439bd6a225c'} 09/11/2025 04:16:26.982 7f6e18b29390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_device_template url = http://10.0.0.254:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.254 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_device_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_device.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"minProperties\": 1, \"maxProperties\": 1, \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"fabric_fq_name\": {\"$id\": \"/properties/input/properties/fabric_fq_name\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/input/properties/fabric_fq_name/items\", \"type\": \"string\", \"title\": \"The Fabric_fq_name Schema\", \"description\": \"FQNAME of the fabric object created\", \"default\": \"\", \"examples\": [\"default-global-system-config\", \"fabric01\"]}}, \"manage_underlay\": {\"type\": \"boolean\", \"title\": \"Manage underlay networking\", \"description\": \"Set to true if need to configure device underlay networking\"}}}", "job_template_output_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"output\": {\"$id\": \"/properties/output\", \"type\": \"object\", \"properties\": {\"status\": {\"$id\": \"/properties/output/properties/status\", \"type\": \"string\", \"title\": \"The Status Schema\", \"description\": \"Status of the plabybook run\", \"default\": \"\", \"examples\": [\"SUCCESS\"]}, \"message\": {\"$id\": \"/properties/output/properties/message\", \"type\": \"string\", \"title\": \"The Message Schema\", \"description\": \"success/failure message about the playbook run\", \"default\": \"\", \"examples\": [\"Successfully ran playbook\"]}, \"results\": {\"$id\": \"/properties/output/properties/results\", \"type\": \"object\", \"properties\": {\"device_uuid\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid/items\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Results Schema\", \"description\": \"objects returned from the playbook to the job_manager\", \"default\": \"\", \"examples\": [\"1234\"]}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover Device", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:27.090 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_device_template'], 'obj_dict': {'display_name': 'Discover Device', 'fq_name': ['default-global-system-config', 'discover_device_template'], 'id_perms': {'created': '2025-09-11T04:16:27.031820', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:27.031820', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12759822516913138100, 'uuid_mslong': 14183590325794129007}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"minProperties": 1, ' '"maxProperties": 1, ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"$id": ' '"/properties/input/properties/fabric_uuid", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["123456789"]}, ' '"fabric_fq_name": {"$id": ' '"/properties/input/properties/fabric_fq_name", ' '"type": "array", "items": {"$id": ' '"/properties/input/properties/fabric_fq_name/items", ' '"type": "string", "title": "The ' 'Fabric_fq_name Schema", ' '"description": "FQNAME of the ' 'fabric object created", "default": ' '"", "examples": ' '["default-global-system-config", ' '"fabric01"]}}, "manage_underlay": ' '{"type": "boolean", "title": ' '"Manage underlay networking", ' '"description": "Set to true if ' 'need to configure device underlay ' 'networking"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"properties": {"output": {"$id": ' '"/properties/output", "type": ' '"object", "properties": ' '{"status": {"$id": ' '"/properties/output/properties/status", ' '"type": "string", "title": "The ' 'Status Schema", "description": ' '"Status of the plabybook run", ' '"default": "", "examples": ' '["SUCCESS"]}, "message": {"$id": ' '"/properties/output/properties/message", ' '"type": "string", "title": "The ' 'Message Schema", "description": ' '"success/failure message about ' 'the playbook run", "default": "", ' '"examples": ["Successfully ran ' 'playbook"]}, "results": {"$id": ' '"/properties/output/properties/results", ' '"type": "object", "properties": ' '{"device_uuid": {"$id": ' '"/properties/output/properties/results/properties/device_uuid", ' '"type": "array", "items": {"$id": ' '"/properties/output/properties/results/properties/device_uuid/items", ' '"format": "uuid", "type": ' '"string", "title": "The Results ' 'Schema", "description": "objects ' 'returned from the playbook to ' 'the job_manager", "default": "", ' '"examples": ["1234"]}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_device.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': ''}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c4d63c40-e0a0-446f-b113-fef985a369b4'}, 'oper': 'CREATE', 'request-id': 'req-2eb0b0d5-0cd1-4b9a-8443-f47418289a6b', 'type': 'job_template', 'uuid': 'c4d63c40-e0a0-446f-b113-fef985a369b4'} 09/11/2025 04:16:27.204 7f6e18b29390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_os_computes_template url = http://10.0.0.254:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.254 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_os_computes_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_os_computes_template.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"minProperties\": 2, \"maxProperties\": 5, \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"contrail_command_host\": {\"$id\": \"/properties/input/properties/contrail_command_host\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"10.10.10.10:9091\"]}, \"cc_username\": {\"$id\": \"/properties/input/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/input/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"fabric_fq_name\": {\"$id\": \"/properties/input/properties/fabric_fq_name\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/input/properties/fabric_fq_name/items\", \"type\": \"string\", \"title\": \"The Fabric_fq_name Schema\", \"description\": \"FQNAME of the fabric object created\", \"default\": \"\", \"examples\": [\"default-global-system-config\", \"fabric01\"]}}, \"manage_underlay\": {\"type\": \"boolean\", \"title\": \"Manage underlay networking\", \"description\": \"Set to true if need to configure device underlay networking\"}}}", "job_template_output_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"output\": {\"$id\": \"/properties/output\", \"type\": \"object\", \"properties\": {\"status\": {\"$id\": \"/properties/output/properties/status\", \"type\": \"string\", \"title\": \"The Status Schema\", \"description\": \"Status of the plabybook run\", \"default\": \"\", \"examples\": [\"SUCCESS\"]}, \"message\": {\"$id\": \"/properties/output/properties/message\", \"type\": \"string\", \"title\": \"The Message Schema\", \"description\": \"success/failure message about the playbook run\", \"default\": \"\", \"examples\": [\"Successfully ran playbook\"]}, \"results\": {\"$id\": \"/properties/output/properties/results\", \"type\": \"object\", \"properties\": {\"device_uuid\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid/items\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Results Schema\", \"description\": \"objects returned from the playbook to the job_manager\", \"default\": \"\", \"examples\": [\"1234\"]}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover OS Computes", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:27.245 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_os_computes_template'], 'obj_dict': {'display_name': 'Discover OS Computes', 'fq_name': ['default-global-system-config', 'discover_os_computes_template'], 'id_perms': {'created': '2025-09-11T04:16:27.232431', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:27.232431', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13620632304319146970, 'uuid_mslong': 14735106589303589231}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"minProperties": 2, ' '"maxProperties": 5, ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"$id": ' '"/properties/input/properties/fabric_uuid", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["123456789"]}, ' '"contrail_command_host": {"$id": ' '"/properties/input/properties/contrail_command_host", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["10.10.10.10:9091"]}, ' '"cc_username": {"$id": ' '"/properties/input/properties/cc_username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/input/properties/cc_password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, "fabric_fq_name": ' '{"$id": ' '"/properties/input/properties/fabric_fq_name", ' '"type": "array", "items": {"$id": ' '"/properties/input/properties/fabric_fq_name/items", ' '"type": "string", "title": "The ' 'Fabric_fq_name Schema", ' '"description": "FQNAME of the ' 'fabric object created", "default": ' '"", "examples": ' '["default-global-system-config", ' '"fabric01"]}}, "manage_underlay": ' '{"type": "boolean", "title": ' '"Manage underlay networking", ' '"description": "Set to true if ' 'need to configure device underlay ' 'networking"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"properties": {"output": {"$id": ' '"/properties/output", "type": ' '"object", "properties": ' '{"status": {"$id": ' '"/properties/output/properties/status", ' '"type": "string", "title": "The ' 'Status Schema", "description": ' '"Status of the plabybook run", ' '"default": "", "examples": ' '["SUCCESS"]}, "message": {"$id": ' '"/properties/output/properties/message", ' '"type": "string", "title": "The ' 'Message Schema", "description": ' '"success/failure message about ' 'the playbook run", "default": "", ' '"examples": ["Successfully ran ' 'playbook"]}, "results": {"$id": ' '"/properties/output/properties/results", ' '"type": "object", "properties": ' '{"device_uuid": {"$id": ' '"/properties/output/properties/results/properties/device_uuid", ' '"type": "array", "items": {"$id": ' '"/properties/output/properties/results/properties/device_uuid/items", ' '"format": "uuid", "type": ' '"string", "title": "The Results ' 'Schema", "description": "objects ' 'returned from the playbook to ' 'the job_manager", "default": "", ' '"examples": ["1234"]}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_os_computes_template.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': ''}]}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cc7d9d5f-7ef5-496f-bd06-34ea63272bda'}, 'oper': 'CREATE', 'request-id': 'req-33d4499a-fc53-4fd0-9549-20b1c9df6509', 'type': 'job_template', 'uuid': 'cc7d9d5f-7ef5-496f-bd06-34ea63272bda'} 09/11/2025 04:16:27.360 7f6e18b29390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_role_template url = http://10.0.0.254:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.254 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_role_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_role.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover Role", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:27.391 7f6e18afdd68 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-3. url = http://10.0.0.254:8082/config-database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.48 body = {"config-database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-3."], "parent_type": "global-system-config", "config_database_node_ip_address": "10.0.0.48", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-3."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:27.401 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_role_template'], 'obj_dict': {'display_name': 'Discover Role', 'fq_name': ['default-global-system-config', 'discover_role_template'], 'id_perms': {'created': '2025-09-11T04:16:27.386770', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:27.386770', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13621371142994865793, 'uuid_mslong': 2212622294809331092}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_role.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1eb4d041-1038-4594-bd08-d4e2abf72e81'}, 'oper': 'CREATE', 'request-id': 'req-ca2772bf-230d-4868-9cfd-19afc43dab0d', 'type': 'job_template', 'uuid': '1eb4d041-1038-4594-bd08-d4e2abf72e81'} 09/11/2025 04:16:27.431 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-3.'], 'obj_dict': {'config_database_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-3.'], 'id_perms': {'created': '2025-09-11T04:16:27.423083', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:27.423083', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10235787290382106437, 'uuid_mslong': 6789082989185092088}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5e37ab02-3106-49f8-8e0c-d24f1faeff45'}, 'oper': 'CREATE', 'request-id': 'req-7f709e32-09ac-40b6-bec0-eed7258c6952', 'type': 'config_database_node', 'uuid': '5e37ab02-3106-49f8-8e0c-d24f1faeff45'} 09/11/2025 04:16:27.431 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:16:27.431 7f6e18b02f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:27.432 7f6e18b02f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-3. elements = { config_database_node_ip_address : "10.0.0.48"display_name : "cn-jenkins-deploy-platform-ansible-os-4080-3."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-3."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6789082989185092088, "uuid_lslong": 10235787290382106437}, "enable": true, "created": "2025-09-11T04:16:27.423083", "last_modified": "2025-09-11T04:16:27.423083", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "197ee536-4af6-414f-b479-ed8e4f1ff5bb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "5e37ab02-3106-49f8-8e0c-d24f1faeff45" } deleted = False >> 09/11/2025 04:16:27.432 7f6e18b02f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:27.513 7f6e18b29390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:device_import_template url = http://10.0.0.254:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.254 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "device_import_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/device_import.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 1}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"additionalProperties\": false, \"properties\": {\"import_configured\": {\"type\": \"boolean\", \"default\": false, \"description\": \"Not importing configured interfaces by default. Set this option to true if configured interfaces need to be imported.\"}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"]}, \"expr\": {\"type\": \"string\"}}, \"title\": \"filter object\", \"description\": \"filter object having op and expr fields\", \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Device Import", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:27.590 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'device_import_template'], 'obj_dict': {'display_name': 'Device Import', 'fq_name': ['default-global-system-config', 'device_import_template'], 'id_perms': {'created': '2025-09-11T04:16:27.538263', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:27.538263', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9259474791634480304, 'uuid_mslong': 11457288006205525532}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"additionalProperties": false, ' '"properties": ' '{"import_configured": {"type": ' '"boolean", "default": false, ' '"description": "Not importing ' 'configured interfaces by default. ' 'Set this option to true if ' 'configured interfaces need to be ' 'imported."}, "interface_filters": ' '{"$id": ' '"/properties/interface_filters", ' '"type": "array", "items": {"$id": ' '"/properties/interface_filters/items", ' '"type": "object", "maxProperties": ' '2, "additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"]}, "expr": {"type": ' '"string"}}, "title": "filter ' 'object", "description": "filter ' 'object having op and expr fields", ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 50, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/device_import.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 50, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/topology_discovery.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9f0076bd-0339-4e1c-8080-4343a20eacb0'}, 'oper': 'CREATE', 'request-id': 'req-6e8f25a1-bede-46c2-a8a6-a427d15142b2', 'type': 'job_template', 'uuid': '9f0076bd-0339-4e1c-8080-4343a20eacb0'} 09/11/2025 04:16:27.708 7f6e18b29390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:fabric_config_template url = http://10.0.0.254:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.254 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "fabric_config_template"], "parent_type": "global-system-config", "job_template_type": "config", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/fabric_config.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"device_management_ip\": {\"type\": \"string\", \"description\": \"Management IP of the Device\"}, \"device_abstract_config\": {\"type\": \"object\", \"description\": \"JSON string of the device abstract config derived from VNC data model\"}, \"additional_feature_params\": {\"type\": \"object\", \"additionalProperties\": false, \"description\": \"Additional feature specific parameters that are not defined in the VNC data model. These could be vendor specific parameters.\", \"properties\": {\"basic\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ntp\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ntp_boot_servers\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"title\": \"NTP Boot server\", \"examples\": [\"6.6.6.6\"]}}, \"ntp_servers\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"title\": \"NTP server\", \"examples\": [\"8.8.8.8\"]}}, \"time_zone\": {\"type\": \"string\", \"title\": \"Time Zone\", \"examples\": [\"America/Los_Angeles\"]}}}, \"name_servers\": {\"type\": \"array\", \"additionalProperties\": false, \"items\": {\"type\": \"string\", \"Title\": \"Domain Name Server\", \"examples\": [\"10.1.1.2\", \"11.1.1.2\"]}}, \"domain_name\": {\"type\": \"string\", \"title\": \"Domain Name\", \"examples\": [\"company.net\"]}, \"snmp\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"communities\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\"}, \"readonly\": {\"type\": \"boolean\", \"default\": true}}, \"required\": [\"name\"]}}}}, \"static_routes\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"required\": [\"subnets\", \"nexthop\"], \"properties\": {\"subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"title\": \"Subnet\", \"examples\": [\"10.1.1.0/24\", \"10.1.2.0/24\"]}}, \"nexthop\": {\"type\": \"string\", \"title\": \"Next hop IP\", \"examples\": [\"10.1.1.254\"]}}}}}}, \"underlay_ip_clos\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"bgp_hold_time\": {\"type\": \"integer\", \"default\": 90}}}}}, \"is_delete\": {\"type\": \"boolean\", \"description\": \"Set to true for config delete operation\", \"default\": false}, \"manage_underlay\": {\"type\": \"boolean\", \"description\": \"Set to true to manage underlay config\", \"default\": true}, \"enterprise_style\": {\"type\": \"boolean\", \"description\": \"Set to true to if enterprise-style config\", \"default\": true}, \"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"fabric_uuid\": {\"type\": \"string\", \"format\": \"uuid\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Device Config Push", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:27.748 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_config_template'], 'obj_dict': {'display_name': 'Device Config Push', 'fq_name': ['default-global-system-config', 'fabric_config_template'], 'id_perms': {'created': '2025-09-11T04:16:27.740024', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:27.740024', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13617195583864809555, 'uuid_mslong': 1885292920949524619}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": ' '{"device_management_ip": {"type": ' '"string", "description": ' '"Management IP of the Device"}, ' '"device_abstract_config": {"type": ' '"object", "description": "JSON ' 'string of the device abstract ' 'config derived from VNC data ' 'model"}, ' '"additional_feature_params": ' '{"type": "object", ' '"additionalProperties": false, ' '"description": "Additional feature ' 'specific parameters that are not ' 'defined in the VNC data model. ' 'These could be vendor specific ' 'parameters.", "properties": ' '{"basic": {"type": "object", ' '"additionalProperties": false, ' '"properties": {"ntp": {"type": ' '"object", "additionalProperties": ' 'false, "properties": ' '{"ntp_boot_servers": {"type": ' '"array", "items": {"type": ' '"string", "title": "NTP Boot ' 'server", "examples": ' '["6.6.6.6"]}}, "ntp_servers": ' '{"type": "array", "items": ' '{"type": "string", "title": "NTP ' 'server", "examples": ' '["8.8.8.8"]}}, "time_zone": ' '{"type": "string", "title": "Time ' 'Zone", "examples": ' '["America/Los_Angeles"]}}}, ' '"name_servers": {"type": "array", ' '"additionalProperties": false, ' '"items": {"type": "string", ' '"Title": "Domain Name Server", ' '"examples": ["10.1.1.2", ' '"11.1.1.2"]}}, "domain_name": ' '{"type": "string", "title": ' '"Domain Name", "examples": ' '["company.net"]}, "snmp": {"type": ' '"object", "additionalProperties": ' 'false, "properties": ' '{"communities": {"type": "array", ' '"items": {"type": "object", ' '"additionalProperties": false, ' '"properties": {"name": {"type": ' '"string"}, "readonly": {"type": ' '"boolean", "default": true}}, ' '"required": ["name"]}}}}, ' '"static_routes": {"type": "array", ' '"items": {"type": "object", ' '"additionalProperties": false, ' '"required": ["subnets", ' '"nexthop"], "properties": ' '{"subnets": {"type": "array", ' '"items": {"type": "string", ' '"title": "Subnet", "examples": ' '["10.1.1.0/24", "10.1.2.0/24"]}}, ' '"nexthop": {"type": "string", ' '"title": "Next hop IP", ' '"examples": ["10.1.1.254"]}}}}}}, ' '"underlay_ip_clos": {"type": ' '"object", "additionalProperties": ' 'false, "properties": ' '{"bgp_hold_time": {"type": ' '"integer", "default": 90}}}}}, ' '"is_delete": {"type": "boolean", ' '"description": "Set to true for ' 'config delete operation", ' '"default": false}, ' '"manage_underlay": {"type": ' '"boolean", "description": "Set to ' 'true to manage underlay config", ' '"default": true}, ' '"enterprise_style": {"type": ' '"boolean", "description": "Set to ' 'true to if enterprise-style ' 'config", "default": true}, ' '"fabric_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "fabric_uuid": ' '{"type": "string", "format": ' '"uuid"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/fabric_config.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'config', 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1a29e7ec-42c1-488b-bcf9-ff3c8d47a853'}, 'oper': 'CREATE', 'request-id': 'req-4984b6e0-b1f6-418f-91c4-2e7e0965d03e', 'type': 'job_template', 'uuid': '1a29e7ec-42c1-488b-bcf9-ff3c8d47a853'} 09/11/2025 04:16:27.869 7f6e18b29390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:ztp_template url = http://10.0.0.254:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.254 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "ztp_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"device_count\": {\"$id\": \"/properties/input/properties/device_count\", \"type\": \"integer\", \"title\": \"The Device Count Schema\", \"description\": \"Number of devices to discover\", \"default\": 0, \"examples\": [1, 2, 3, 4, 5]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "ZTP", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:27.947 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ztp_template'], 'obj_dict': {'display_name': 'ZTP', 'fq_name': ['default-global-system-config', 'ztp_template'], 'id_perms': {'created': '2025-09-11T04:16:27.926817', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:27.926817', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13046480910979483833, 'uuid_mslong': 5048349790082911449}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"properties": {"fabric_uuid": ' '{"$id": ' '"/properties/input/properties/fabric_uuid", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["123456789"]}, ' '"device_count": {"$id": ' '"/properties/input/properties/device_count", ' '"type": "integer", "title": "The ' 'Device Count Schema", ' '"description": "Number of devices ' 'to discover", "default": 0, ' '"examples": [1, 2, 3, 4, 5]}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': ''}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '460f5763-03cf-4cd9-b50e-6943ebd8c8b9'}, 'oper': 'CREATE', 'request-id': 'req-3a142a31-3419-450c-a33c-aa4bf59d4818', 'type': 'job_template', 'uuid': '460f5763-03cf-4cd9-b50e-6943ebd8c8b9'} 09/11/2025 04:16:28.351 7f6e18a2ae10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-3. url = http://10.0.0.254:8082/config-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.48 body = {"config-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-3."], "parent_type": "global-system-config", "config_node_ip_address": "10.0.0.48", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-3."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:28.357 7f6e18a7e198 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-1. url = http://10.0.0.254:8082/config-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.254 body = {"config-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-1."], "parent_type": "global-system-config", "config_node_ip_address": "10.0.0.254", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-1."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:28.390 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-3.'], 'obj_dict': {'config_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-3.'], 'id_perms': {'created': '2025-09-11T04:16:28.383741', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:28.383741', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11027552000383002650, 'uuid_mslong': 14896607137612582320}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cebb6144-1bf2-4db0-9909-bc1e2cfa281a'}, 'oper': 'CREATE', 'request-id': 'req-66da7d6d-b96d-4dc5-9532-1e2aa7e7425e', 'type': 'config_node', 'uuid': 'cebb6144-1bf2-4db0-9909-bc1e2cfa281a'} 09/11/2025 04:16:28.390 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ContrailConfigTrace] map 09/11/2025 04:16:28.391 7f6e18a238d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:28.391 7f6e18a238d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-3. elements = { config_node_ip_address : "10.0.0.48"display_name : "cn-jenkins-deploy-platform-ansible-os-4080-3."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-3."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 14896607137612582320, "uuid_lslong": 11027552000383002650}, "enable": true, "created": "2025-09-11T04:16:28.383741", "last_modified": "2025-09-11T04:16:28.383741", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "197ee536-4af6-414f-b479-ed8e4f1ff5bb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "cebb6144-1bf2-4db0-9909-bc1e2cfa281a" } deleted = False >> 09/11/2025 04:16:28.391 7f6e18a238d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:28.411 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-1.'], 'obj_dict': {'config_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-1.'], 'id_perms': {'created': '2025-09-11T04:16:28.399535', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:28.399535', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9274401972173297705, 'uuid_mslong': 2258374274131053666}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1f575b6f-db76-4c62-80b5-4b74af925829'}, 'oper': 'CREATE', 'request-id': 'req-2ae2733a-7d9e-47d4-9264-4b6fce36dc36', 'type': 'config_node', 'uuid': '1f575b6f-db76-4c62-80b5-4b74af925829'} 09/11/2025 04:16:28.411 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ContrailConfigTrace] map 09/11/2025 04:16:28.411 7f6e18a27a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:28.412 7f6e18a27a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. elements = { config_node_ip_address : "10.0.0.254"display_name : "cn-jenkins-deploy-platform-ansible-os-4080-1."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-1."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2258374274131053666, "uuid_lslong": 9274401972173297705}, "enable": true, "created": "2025-09-11T04:16:28.399535", "last_modified": "2025-09-11T04:16:28.399535", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "197ee536-4af6-414f-b479-ed8e4f1ff5bb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "1f575b6f-db76-4c62-80b5-4b74af925829" } deleted = False >> 09/11/2025 04:16:28.412 7f6e18a27a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:29.647 7f6e18a286d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:29.690 7f6e18a286d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:29.691 7f6e18a286d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:29.692 7f6e18a286d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:29.692 7f6e18a286d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:16:29.692 7f6e18a286d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:29.692 7f6e18a286d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:29.692 7f6e18a286d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:29.692 7f6e18a286d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:29.692 7f6e18a286d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:29.692 7f6e18a286d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:29.692 7f6e18a286d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:29.693 7f6e18a286d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:16:29.693 7f6e18a286d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:30.118 7f6e18a2e240 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-2. url = http://10.0.0.254:8082/config-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.22 body = {"config-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-2."], "parent_type": "global-system-config", "config_node_ip_address": "10.0.0.22", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-2."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:30.154 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-2.'], 'obj_dict': {'config_node_ip_address': '10.0.0.22', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-2.'], 'id_perms': {'created': '2025-09-11T04:16:30.146171', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:30.146171', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10516353628131245719, 'uuid_mslong': 8600398534633079128}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '775ac0e6-7f98-4158-91f1-97e821273e97'}, 'oper': 'CREATE', 'request-id': 'req-7488fe2c-5da9-4145-9b86-a23a041a6bd8', 'type': 'config_node', 'uuid': '775ac0e6-7f98-4158-91f1-97e821273e97'} 09/11/2025 04:16:30.160 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ContrailConfigTrace] map 09/11/2025 04:16:30.163 7f6e189deb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:30.164 7f6e189deb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-2. elements = { config_node_ip_address : "10.0.0.22"display_name : "cn-jenkins-deploy-platform-ansible-os-4080-2."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-2."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 8600398534633079128, "uuid_lslong": 10516353628131245719}, "enable": true, "created": "2025-09-11T04:16:30.146171", "last_modified": "2025-09-11T04:16:30.146171", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "197ee536-4af6-414f-b479-ed8e4f1ff5bb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "775ac0e6-7f98-4158-91f1-97e821273e97" } deleted = False >> 09/11/2025 04:16:30.164 7f6e189deb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:30.538 7f6e197f9b70 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-2. url = http://10.0.0.254:8082/config-database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.22 body = {"config-database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-2."], "parent_type": "global-system-config", "config_database_node_ip_address": "10.0.0.22", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-2."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:30.590 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-2.'], 'obj_dict': {'config_database_node_ip_address': '10.0.0.22', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-2.'], 'id_perms': {'created': '2025-09-11T04:16:30.575584', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:30.575584', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10299735006504611413, 'uuid_mslong': 16989454616104749305}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ebc6aaf5-988b-48f9-8ef0-026b075cee55'}, 'oper': 'CREATE', 'request-id': 'req-56e6121a-6ca2-4bf5-84d0-63a854d14c33', 'type': 'config_database_node', 'uuid': 'ebc6aaf5-988b-48f9-8ef0-026b075cee55'} 09/11/2025 04:16:30.590 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:16:30.591 7f6e18afd828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:30.591 7f6e18afd828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-2. elements = { config_database_node_ip_address : "10.0.0.22"display_name : "cn-jenkins-deploy-platform-ansible-os-4080-2."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-2."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 16989454616104749305, "uuid_lslong": 10299735006504611413}, "enable": true, "created": "2025-09-11T04:16:30.575584", "last_modified": "2025-09-11T04:16:30.575584", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "197ee536-4af6-414f-b479-ed8e4f1ff5bb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "ebc6aaf5-988b-48f9-8ef0-026b075cee55" } deleted = False >> 09/11/2025 04:16:30.591 7f6e18afd828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:31.229 7f6e18a3f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-1. url = http://10.0.0.254:8082/config-database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.254 body = {"config-database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-1."], "parent_type": "global-system-config", "config_database_node_ip_address": "10.0.0.254", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-1."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:31.268 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-1.'], 'obj_dict': {'config_database_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-1.'], 'id_perms': {'created': '2025-09-11T04:16:31.254925', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:16:31.254925', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9524518158067836669, 'uuid_mslong': 3342391011620438154}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2e628eea-9418-408a-842d-e2cd3c6426fd'}, 'oper': 'CREATE', 'request-id': 'req-cf3912d5-6766-46c0-aa5b-b221edc1d2d9', 'type': 'config_database_node', 'uuid': '2e628eea-9418-408a-842d-e2cd3c6426fd'} 09/11/2025 04:16:31.269 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:16:31.269 7f6e1935c198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:31.270 7f6e1935c198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. elements = { config_database_node_ip_address : "10.0.0.254"display_name : "cn-jenkins-deploy-platform-ansible-os-4080-1."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-1."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3342391011620438154, "uuid_lslong": 9524518158067836669}, "enable": true, "created": "2025-09-11T04:16:31.254925", "last_modified": "2025-09-11T04:16:31.254925", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "197ee536-4af6-414f-b479-ed8e4f1ff5bb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "2e628eea-9418-408a-842d-e2cd3c6426fd" } deleted = False >> 09/11/2025 04:16:31.270 7f6e1935c198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:31.369 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-23998d83-21b5-483a-a5e5-f7aef827e679', 'type': 'application_policy_set', 'uuid': '60f9f9d6-33f1-498f-bb95-2a1a3151b512'} 09/11/2025 04:16:31.376 7f6e18b29438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:31.376 7f6e18b29438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "b6b25520-beae-4e43-885e-8e9d517df70c"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6987890995231803791, "uuid_lslong": 13516756148607366418}, "enable": true, "created": "2025-09-11T04:16:21.671952", "last_modified": "2025-09-11T04:16:31.332080", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "44d63150-6907-438f-96ea-1a3ba3a7e9cc"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "60f9f9d6-33f1-498f-bb95-2a1a3151b512" } deleted = False >> 09/11/2025 04:16:31.376 7f6e18b29438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:31.597 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-adf2a400-0cc7-428f-8d70-bbc1342a212d', 'type': 'network_ipam', 'uuid': '2cc405b2-832e-42c7-9f5a-0fbca3cf48d0'} 09/11/2025 04:16:31.640 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-a3cc8f90-09f7-4032-b89b-0896ede1292e', 'type': 'project', 'uuid': '6b83acaf-67eb-4c3b-aba7-8727560a43c6'} 09/11/2025 04:16:31.645 7f6e18aabcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:31.645 7f6e18aabcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7747225653370113083, "uuid_lslong": 12369003504613344198}, "enable": true, "created": "2025-09-11T04:16:21.451462", "last_modified": "2025-09-11T04:16:31.633878", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "7134262f-1ffb-453e-aad9-fbdd9a7a2b72"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}quota : {"defaults": -1}uuid : "6b83acaf-67eb-4c3b-aba7-8727560a43c6" } deleted = False >> 09/11/2025 04:16:31.645 7f6e18aabcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:31.783 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-e70ed867-3d9f-4a20-bdd9-047800c3ab93', 'type': 'application_policy_set', 'uuid': '60f9f9d6-33f1-498f-bb95-2a1a3151b512'} 09/11/2025 04:16:31.787 7f6e189e28d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:31.788 7f6e189e28d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "b6b25520-beae-4e43-885e-8e9d517df70c"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6987890995231803791, "uuid_lslong": 13516756148607366418}, "enable": true, "created": "2025-09-11T04:16:21.671952", "last_modified": "2025-09-11T04:16:31.771432", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "44d63150-6907-438f-96ea-1a3ba3a7e9cc"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "60f9f9d6-33f1-498f-bb95-2a1a3151b512" } deleted = False >> 09/11/2025 04:16:31.788 7f6e189e28d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:31.973 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-42bb673a-5af1-4a1b-aec7-2632ba2cde07', 'type': 'network_ipam', 'uuid': '2cc405b2-832e-42c7-9f5a-0fbca3cf48d0'} 09/11/2025 04:16:31.997 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-39156012-e23a-4f10-a626-07c59a278b8e', 'type': 'project', 'uuid': '6b83acaf-67eb-4c3b-aba7-8727560a43c6'} 09/11/2025 04:16:32.002 7f6e18b464e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:32.002 7f6e18b464e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7747225653370113083, "uuid_lslong": 12369003504613344198}, "enable": true, "created": "2025-09-11T04:16:21.451462", "last_modified": "2025-09-11T04:16:31.981356", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "7134262f-1ffb-453e-aad9-fbdd9a7a2b72"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}quota : {"defaults": -1}uuid : "6b83acaf-67eb-4c3b-aba7-8727560a43c6" } deleted = False >> 09/11/2025 04:16:32.002 7f6e18b464e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:33.691 7f6e18b29438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:33.699 7f6e18b29438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:33.699 7f6e18b29438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:33.699 7f6e18b29438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:33.700 7f6e18b29438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:16:33.700 7f6e18b29438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:33.700 7f6e18b29438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:33.700 7f6e18b29438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:33.700 7f6e18b29438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:33.700 7f6e18b29438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:33.700 7f6e18b29438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:33.700 7f6e18b29438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:33.700 7f6e18b29438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:16:33.700 7f6e18b29438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:34.570 7f6e18a7e198 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b6b25520-beae-4e43-885e-8e9d517df70c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.254:8082/global-vrouter-config/b6b25520-beae-4e43-885e-8e9d517df70c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.48 body = {"global-vrouter-config": {"uuid": "b6b25520-beae-4e43-885e-8e9d517df70c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["10.0.0.254"]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:34.591 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b6b25520-beae-4e43-885e-8e9d517df70c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.254:8082/global-vrouter-config/b6b25520-beae-4e43-885e-8e9d517df70c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.254 body = {"global-vrouter-config": {"uuid": "b6b25520-beae-4e43-885e-8e9d517df70c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["10.0.0.254"]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:34.602 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-b03e0c45-ff6b-43dc-a182-1d192ba1b9f6', 'type': 'global_vrouter_config', 'uuid': 'b6b25520-beae-4e43-885e-8e9d517df70c'} 09/11/2025 04:16:34.610 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-a115a8c5-f291-453f-a9fd-c792666d060c', 'type': 'global_vrouter_config', 'uuid': 'b6b25520-beae-4e43-885e-8e9d517df70c'} 09/11/2025 04:16:36.288 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b6b25520-beae-4e43-885e-8e9d517df70c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.254:8082/global-vrouter-config/b6b25520-beae-4e43-885e-8e9d517df70c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.22 body = {"global-vrouter-config": {"uuid": "b6b25520-beae-4e43-885e-8e9d517df70c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["10.0.0.254"]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:36.315 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-f640c775-6809-4957-b455-416c254931c1', 'type': 'global_vrouter_config', 'uuid': 'b6b25520-beae-4e43-885e-8e9d517df70c'} 09/11/2025 04:16:37.701 7f6e189f14e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:37.702 7f6e189f14e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:37.702 7f6e189f14e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:37.703 7f6e189f14e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:37.703 7f6e189f14e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:16:37.703 7f6e189f14e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:37.703 7f6e189f14e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:37.703 7f6e189f14e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:37.703 7f6e189f14e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:37.703 7f6e189f14e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:37.703 7f6e189f14e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:37.703 7f6e189f14e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:37.704 7f6e189f14e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:16:37.704 7f6e189f14e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:37.994 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig has a list of elements - it should be a dict. Controllers have inconsistency in their data.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-elements-inconsistency"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:38.038 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements', 'operand2': {'json_value': '1'}, 'operation': 'size=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-elements-inconsistency', 'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'id_perms': {'created': '2025-09-11T04:16:38.024588', 'creator': None, 'description': 'ContrailConfig has a list of ' 'elements - it should be a dict. ' 'Controllers have inconsistency in ' 'their data.', 'enable': True, 'last_modified': '2025-09-11T04:16:38.024588', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9375909152530432018, 'uuid_mslong': 11570650112545933694}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a09334f9-32a2-497e-821d-ebb2d2e90012', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-58a11cc2-c551-4d7d-929e-67e309fdf5d0', 'type': 'alarm', 'uuid': 'a09334f9-32a2-497e-821d-ebb2d2e90012'} 09/11/2025 04:16:38.057 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Compute Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-compute"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:38.082 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_ip_address', 'operand2': {'uve_attribute': 'VrouterAgent.control_ip'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-compute', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'id_perms': {'created': '2025-09-11T04:16:38.075768', 'creator': None, 'description': 'Compute Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-09-11T04:16:38.075768', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12849629455095365658, 'uuid_mslong': 9279460659080611217}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '80c7444e-03b6-4591-b253-0de8be5b001a', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-efc34d43-134c-4e0f-82c7-2a9266998d51', 'type': 'alarm', 'uuid': '80c7444e-03b6-4591-b253-0de8be5b001a'} 09/11/2025 04:16:38.136 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Control Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-control"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:38.164 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.bgp_router_parameters.address', 'operand2': {'uve_attribute': 'BgpRouterState.bgp_router_ip_list'}, 'operation': 'not ' 'in'}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-control', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'id_perms': {'created': '2025-09-11T04:16:38.157671', 'creator': None, 'description': 'Control Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-09-11T04:16:38.157671', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13572203850105146895, 'uuid_mslong': 4717301548610832269}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '417738c3-df59-478d-bc5a-277e38b4ce0f', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-5cac5a50-9744-4b07-b8b3-4d3833893fc3', 'type': 'alarm', 'uuid': '417738c3-df59-478d-bc5a-277e38b4ce0f'} 09/11/2025 04:16:38.220 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "BGP peer mismatch. Not enough BGP peers are up.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-bgp-connectivity"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:38.246 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_bgp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-bgp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'id_perms': {'created': '2025-09-11T04:16:38.239706', 'creator': None, 'description': 'BGP peer mismatch. Not enough BGP ' 'peers are up.', 'enable': True, 'last_modified': '2025-09-11T04:16:38.239706', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9658663651386035181, 'uuid_mslong': 10768107078987042227}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '95700056-2264-4db3-860a-776ac9d78bed', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-f479ea7d-894e-4b7f-adfe-3d731f1e6f00', 'type': 'alarm', 'uuid': '95700056-2264-4db3-860a-776ac9d78bed'} 09/11/2025 04:16:38.309 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-incorrect"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:38.358 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-incorrect', 'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'id_perms': {'created': '2025-09-11T04:16:38.348762', 'creator': None, 'description': 'ContrailConfig missing or ' 'incorrect. Configuration pushed to ' 'Ifmap as ContrailConfig is ' 'missing/incorrect.', 'enable': True, 'last_modified': '2025-09-11T04:16:38.348762', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12260259400501729535, 'uuid_mslong': 14800930821642996115}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cd677829-e129-4993-aa25-30f7950c98ff', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-2610d589-6e02-4544-ab7f-d9a87c1ce28e', 'type': 'alarm', 'uuid': 'cd677829-e129-4993-aa25-30f7950c98ff'} 09/11/2025 04:16:38.423 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses high threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-high"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:38.459 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '[70, ' '90]'}, 'operation': 'range', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-disk-usage-high', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'id_perms': {'created': '2025-09-11T04:16:38.452141', 'creator': None, 'description': 'Disk usage crosses high threshold ' 'limit.', 'enable': True, 'last_modified': '2025-09-11T04:16:38.452141', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10308463152618424312, 'uuid_mslong': 13993614131514722752}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c2334de9-48d2-49c0-8f0f-049ee80647f8', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-20ab4859-633f-43ce-836f-94fc6e5d923f', 'type': 'alarm', 'uuid': 'c2334de9-48d2-49c0-8f0f-049ee80647f8'} 09/11/2025 04:16:38.522 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses critical threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-critical"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:38.570 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '90'}, 'operation': '>', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-disk-usage-critical', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'id_perms': {'created': '2025-09-11T04:16:38.557466', 'creator': None, 'description': 'Disk usage crosses critical ' 'threshold limit.', 'enable': True, 'last_modified': '2025-09-11T04:16:38.557466', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9877567185324685666, 'uuid_mslong': 6106706195592135118}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '54bf60ee-1ff2-41ce-8914-2b057e553962', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-3b34bc6a-0c82-455d-b819-7787b3b27010', 'type': 'alarm', 'uuid': '54bf60ee-1ff2-41ce-8914-2b057e553962'} 09/11/2025 04:16:38.620 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Node Failure. NodeStatus UVE not present.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-node-status"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:38.664 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-node-status', 'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'id_perms': {'created': '2025-09-11T04:16:38.653926', 'creator': None, 'description': 'Node Failure. NodeStatus UVE not ' 'present.', 'enable': True, 'last_modified': '2025-09-11T04:16:38.653926', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10696405863906203653, 'uuid_mslong': 6139249840589261399}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5532ff33-efb2-4a57-9471-44761388d805', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-a04f6724-a547-4d00-849c-4cffe53179b9', 'type': 'alarm', 'uuid': '5532ff33-efb2-4a57-9471-44761388d805'} 09/11/2025 04:16:38.716 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "System Info Incomplete.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-partial-sysinfo"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:38.755 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.build_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-partial-sysinfo', 'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'id_perms': {'created': '2025-09-11T04:16:38.741392', 'creator': None, 'description': 'System Info Incomplete.', 'enable': True, 'last_modified': '2025-09-11T04:16:38.741392', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10446616369821906719, 'uuid_mslong': 53935230771938060}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '00bf9dce-7f0a-430c-90f9-d63d6403f71f', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-32d53baf-7d88-4b65-a866-22fc08d9a6fd', 'type': 'alarm', 'uuid': '00bf9dce-7f0a-430c-90f9-d63d6403f71f'} 09/11/2025 04:16:38.813 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process(es) reporting as non-functional.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-connectivity"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:38.853 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_status', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'operation': '!=', 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'id_perms': {'created': '2025-09-11T04:16:38.834810', 'creator': None, 'description': 'Process(es) reporting as ' 'non-functional.', 'enable': True, 'last_modified': '2025-09-11T04:16:38.834810', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13643699090125121779, 'uuid_mslong': 15228796985064966781}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd3578e2c-1b56-4a7d-bd58-2808f93a68f3', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-3bc64d9e-4df5-4b67-91ad-ad6e39158f36', 'type': 'alarm', 'uuid': 'd3578e2c-1b56-4a7d-bd58-2808f93a68f3'} 09/11/2025 04:16:38.905 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process Failure.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-status"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:38.933 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_info.process_state', 'operand2': {'json_value': '"PROCESS_STATE_RUNNING"'}, 'operation': '!=', 'variables': ['NodeStatus.process_info.process_name']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-status', 'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'id_perms': {'created': '2025-09-11T04:16:38.925975', 'creator': None, 'description': 'Process Failure.', 'enable': True, 'last_modified': '2025-09-11T04:16:38.925975', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9769008626938123312, 'uuid_mslong': 17379684384780275321}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f1310add-cf3b-4e79-8792-7d96785f9430', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-1d73457a-f81b-4f65-9da0-f24dd6b9f9b0', 'type': 'alarm', 'uuid': 'f1310add-cf3b-4e79-8792-7d96785f9430'} 09/11/2025 04:16:38.983 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tor agent does not exist we look for non-empty value for connected_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-connectivity"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:39.015 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.connected_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'id_perms': {'created': '2025-09-11T04:16:39.005199', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tor agent does not exist we look ' 'for non-empty value for ' 'connected_agent_list', 'enable': True, 'last_modified': '2025-09-11T04:16:39.005199', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9526402570379447079, 'uuid_mslong': 9476497755146701894}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8383487f-ea4e-4c46-8434-94aa2ad5cb27', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-4e8b9a86-7049-43e9-89b5-e8b9091dbdeb', 'type': 'alarm', 'uuid': '8383487f-ea4e-4c46-8434-94aa2ad5cb27'} 09/11/2025 04:16:39.063 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tsn agent does not exist we look for non-empty value for tsn_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-tsn-connectivity"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:39.098 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '!='}]}, {'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-tsn-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'id_perms': {'created': '2025-09-11T04:16:39.090644', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tsn agent does not exist we look ' 'for non-empty value for ' 'tsn_agent_list', 'enable': True, 'last_modified': '2025-09-11T04:16:39.090644', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10864495468544117286, 'uuid_mslong': 4768088288710640787}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '422ba709-424c-4493-96c6-7110ea69ca26', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-5f70e48c-be35-425d-a2e9-1fcdbb8d0ec0', 'type': 'alarm', 'uuid': '422ba709-424c-4493-96c6-7110ea69ca26'} 09/11/2025 04:16:39.153 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Storage Cluster warning/errors.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-storage-cluster-state"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:39.199 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'StorageCluster.info_stats.status', 'operand2': {'json_value': '0'}, 'operation': '!=', 'variables': ['StorageCluster.info_stats.health_summary']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-storage-cluster-state', 'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'id_perms': {'created': '2025-09-11T04:16:39.186691', 'creator': None, 'description': 'Storage Cluster warning/errors.', 'enable': True, 'last_modified': '2025-09-11T04:16:39.186691', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12959106328063405152, 'uuid_mslong': 671525865667972445}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0951bd37-88a0-4d5d-b3d7-fe8b8abc6c60', 'uve_keys': {'uve_key': ['storage-cluster']}}, 'oper': 'CREATE', 'request-id': 'req-a6afd93a-9802-456a-8aa0-9cb4182c6102', 'type': 'alarm', 'uuid': '0951bd37-88a0-4d5d-b3d7-fe8b8abc6c60'} 09/11/2025 04:16:39.253 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Vrouter interface(s) down.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-interface"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:39.291 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.down_interface_count', 'operand2': {'json_value': '1'}, 'operation': '>=', 'variables': ['VrouterAgent.error_intf_list', 'VrouterAgent.no_config_intf_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-interface', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'id_perms': {'created': '2025-09-11T04:16:39.281454', 'creator': None, 'description': 'Vrouter interface(s) down.', 'enable': True, 'last_modified': '2025-09-11T04:16:39.281454', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10397870190407643300, 'uuid_mslong': 13911161745278583739}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c10e5fe7-2055-43bb-904c-a7d90fdef0a4', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-93250f55-e2cb-400f-a3e4-056540fb4b46', 'type': 'alarm', 'uuid': 'c10e5fe7-2055-43bb-904c-a7d90fdef0a4'} 09/11/2025 04:16:39.342 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP peer mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-connectivity"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:39.384 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_xmpp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'id_perms': {'created': '2025-09-11T04:16:39.370483', 'creator': None, 'description': 'XMPP peer mismatch.', 'enable': True, 'last_modified': '2025-09-11T04:16:39.370483', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10760828149662060548, 'uuid_mslong': 17344371186406278350}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f0b395b3-1a44-44ce-9556-243055a19004', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-c05c38c6-9e90-4806-8124-c53db61b295e', 'type': 'alarm', 'uuid': 'f0b395b3-1a44-44ce-9556-243055a19004'} 09/11/2025 04:16:39.436 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP connection closed towards peer, alarm has close reason", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-close-reason"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:39.479 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'XmppPeerInfoData.close_reason', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'XmppPeerInfoData.state_info.state', 'operand2': {'json_value': '"Established"'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-close-reason', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'id_perms': {'created': '2025-09-11T04:16:39.470256', 'creator': None, 'description': 'XMPP connection closed towards ' 'peer, ' 'alarm has close reason', 'enable': True, 'last_modified': '2025-09-11T04:16:39.470256', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11265760388192564603, 'uuid_mslong': 7268256497274406051}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '64de08c6-8077-44a3-9c58-05626ee2757b', 'uve_keys': {'uve_key': ['xmpp-peer']}}, 'oper': 'CREATE', 'request-id': 'req-5b0c2f1a-12a1-43f7-af4b-ee2543b7323d', 'type': 'alarm', 'uuid': '64de08c6-8077-44a3-9c58-05626ee2757b'} 09/11/2025 04:16:39.533 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "A core file has been generated on the node.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-core-files"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:39.588 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-core-files', 'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'id_perms': {'created': '2025-09-11T04:16:39.573922', 'creator': None, 'description': 'A core file has been generated on ' 'the node.', 'enable': True, 'last_modified': '2025-09-11T04:16:39.573922', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12291247354303567403, 'uuid_mslong': 1068149691155499832}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0ed2d47c-1c44-4b38-aa93-4858cfb9562b', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-273ccc53-8a34-478e-8ec2-66b875e111cb', 'type': 'alarm', 'uuid': '0ed2d47c-1c44-4b38-aa93-4858cfb9562b'} 09/11/2025 04:16:39.639 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Pending compaction tasks in cassandra crossed the configured threshold.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-pending-cassandra-compaction-tasks"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:39.668 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks', 'operand2': {'json_value': '300'}, 'operation': '>='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-pending-cassandra-compaction-tasks', 'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'id_perms': {'created': '2025-09-11T04:16:39.660640', 'creator': None, 'description': 'Pending compaction tasks in ' 'cassandra crossed the configured ' 'threshold.', 'enable': True, 'last_modified': '2025-09-11T04:16:39.660640', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11204195129837918366, 'uuid_mslong': 8205564413264087404}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '71e0055b-e231-496c-9b7d-4c1bb426989e', 'uve_keys': {'uve_key': ['database-nodeconfig-database-node']}}, 'oper': 'CREATE', 'request-id': 'req-f647c460-5333-4fd8-9f65-d07bded95245', 'type': 'alarm', 'uuid': '71e0055b-e231-496c-9b7d-4c1bb426989e'} 09/11/2025 04:16:39.723 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "There is a mismatch between installed and running package version.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-package-version-mismatch"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:39.749 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.running_package_version', 'operand2': {'uve_attribute': 'NodeStatus.installed_package_version'}, 'operation': '!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-package-version-mismatch', 'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'id_perms': {'created': '2025-09-11T04:16:39.742548', 'creator': None, 'description': 'There is a mismatch between ' 'installed and running package ' 'version.', 'enable': True, 'last_modified': '2025-09-11T04:16:39.742548', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10983564222402031793, 'uuid_mslong': 3723904913721804948}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '33adf7c9-f7b8-4894-986d-757783f670b1', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-20997d7c-12b8-4533-8819-2d016e828980', 'type': 'alarm', 'uuid': '33adf7c9-f7b8-4894-986d-757783f670b1'} 09/11/2025 04:16:39.803 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded configured watermark for resource.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-limit-exceeded"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:39.830 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'id_perms': {'created': '2025-09-11T04:16:39.823746', 'creator': None, 'description': 'Agent resource usage exceeded ' 'configured watermark for resource.', 'enable': True, 'last_modified': '2025-09-11T04:16:39.823746', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10732038363437751285, 'uuid_mslong': 3586234090595568818}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '31c4dce7-9b58-4cb2-94ef-dc07e0925bf5', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-f3fc37a3-28d6-4ff1-b1fb-22a3777d9813', 'type': 'alarm', 'uuid': '31c4dce7-9b58-4cb2-94ef-dc07e0925bf5'} 09/11/2025 04:16:39.891 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded table size for resource in vrouter.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-table-limit-exceeded"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:39.933 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_table_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-table-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'id_perms': {'created': '2025-09-11T04:16:39.920746', 'creator': None, 'description': 'Agent resource usage exceeded table ' 'size for resource in vrouter.', 'enable': True, 'last_modified': '2025-09-11T04:16:39.920746', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10273913627326672796, 'uuid_mslong': 3846134834198168038}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '35603741-06a3-41e6-8e94-4602b1d9ef9c', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-2bcc5bb1-9706-4cbb-b368-8b5d7ca00a86', 'type': 'alarm', 'uuid': '35603741-06a3-41e6-8e94-4602b1d9ef9c'} 09/11/2025 04:16:39.984 7f6e1ae018d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.254:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.48 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "On l3 multihomed compute one or more physical interfaces are Inactive.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-l3mh-physical-interface-link-down"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:40.012 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.l3mh_phy_interface_down', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_l3mh_intf_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-l3mh-physical-interface-link-down', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'id_perms': {'created': '2025-09-11T04:16:40.005120', 'creator': None, 'description': 'On l3 multihomed compute one or ' 'more physical interfaces are ' 'Inactive.', 'enable': True, 'last_modified': '2025-09-11T04:16:40.005120', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12576893358341099760, 'uuid_mslong': 13867391756456838557}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c072df54-74ca-459d-ae8a-19dfc9e410f0', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-771c846c-1cbd-48ab-bec0-994a08b8b574', 'type': 'alarm', 'uuid': 'c072df54-74ca-459d-ae8a-19dfc9e410f0'} 09/11/2025 04:16:40.170 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a09334f9-32a2-497e-821d-ebb2d2e90012 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.254:8082/alarm/a09334f9-32a2-497e-821d-ebb2d2e90012 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "a09334f9-32a2-497e-821d-ebb2d2e90012", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:40.191 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-e06532b7-0da0-4038-a9ce-77a639b60335', 'type': 'alarm', 'uuid': 'a09334f9-32a2-497e-821d-ebb2d2e90012'} 09/11/2025 04:16:40.340 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 80c7444e-03b6-4591-b253-0de8be5b001a object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.254:8082/alarm/80c7444e-03b6-4591-b253-0de8be5b001a operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "80c7444e-03b6-4591-b253-0de8be5b001a", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:40.364 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-eca13644-648b-430d-a08c-683890c29d1d', 'type': 'alarm', 'uuid': '80c7444e-03b6-4591-b253-0de8be5b001a'} 09/11/2025 04:16:40.520 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 417738c3-df59-478d-bc5a-277e38b4ce0f object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.254:8082/alarm/417738c3-df59-478d-bc5a-277e38b4ce0f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "417738c3-df59-478d-bc5a-277e38b4ce0f", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:40.547 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-970daa96-fa24-42f8-9599-3eb1ff07bc47', 'type': 'alarm', 'uuid': '417738c3-df59-478d-bc5a-277e38b4ce0f'} 09/11/2025 04:16:40.697 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 95700056-2264-4db3-860a-776ac9d78bed object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.254:8082/alarm/95700056-2264-4db3-860a-776ac9d78bed operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "95700056-2264-4db3-860a-776ac9d78bed", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:40.724 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-54c8996c-bd62-4f2d-9abd-e9fd7ab1990f', 'type': 'alarm', 'uuid': '95700056-2264-4db3-860a-776ac9d78bed'} 09/11/2025 04:16:40.865 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cd677829-e129-4993-aa25-30f7950c98ff object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.254:8082/alarm/cd677829-e129-4993-aa25-30f7950c98ff operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "cd677829-e129-4993-aa25-30f7950c98ff", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:40.885 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-4d96ede4-a363-49ef-8794-a7c04d6840da', 'type': 'alarm', 'uuid': 'cd677829-e129-4993-aa25-30f7950c98ff'} 09/11/2025 04:16:41.041 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c2334de9-48d2-49c0-8f0f-049ee80647f8 object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.254:8082/alarm/c2334de9-48d2-49c0-8f0f-049ee80647f8 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "c2334de9-48d2-49c0-8f0f-049ee80647f8", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:41.070 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-135e8482-bdf0-4797-8010-e88a9939f2dd', 'type': 'alarm', 'uuid': 'c2334de9-48d2-49c0-8f0f-049ee80647f8'} 09/11/2025 04:16:41.218 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 54bf60ee-1ff2-41ce-8914-2b057e553962 object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.254:8082/alarm/54bf60ee-1ff2-41ce-8914-2b057e553962 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "54bf60ee-1ff2-41ce-8914-2b057e553962", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:41.236 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-49f4c19b-3a06-4d30-9a75-bfff9c727a2c', 'type': 'alarm', 'uuid': '54bf60ee-1ff2-41ce-8914-2b057e553962'} 09/11/2025 04:16:41.389 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5532ff33-efb2-4a57-9471-44761388d805 object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.254:8082/alarm/5532ff33-efb2-4a57-9471-44761388d805 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "5532ff33-efb2-4a57-9471-44761388d805", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:41.408 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-82685397-4516-4622-b662-0cfa66b2db5a', 'type': 'alarm', 'uuid': '5532ff33-efb2-4a57-9471-44761388d805'} 09/11/2025 04:16:41.568 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 00bf9dce-7f0a-430c-90f9-d63d6403f71f object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.254:8082/alarm/00bf9dce-7f0a-430c-90f9-d63d6403f71f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "00bf9dce-7f0a-430c-90f9-d63d6403f71f", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:41.592 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-08105351-8cd1-4b6e-a190-92cd712d0102', 'type': 'alarm', 'uuid': '00bf9dce-7f0a-430c-90f9-d63d6403f71f'} 09/11/2025 04:16:41.703 7f6e18a2ef60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:41.704 7f6e18a2ef60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:41.704 7f6e18a2ef60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:41.704 7f6e18a2ef60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:41.704 7f6e18a2ef60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:16:41.704 7f6e18a2ef60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:41.704 7f6e18a2ef60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:41.705 7f6e18a2ef60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:41.705 7f6e18a2ef60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:41.705 7f6e18a2ef60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:41.705 7f6e18a2ef60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:41.705 7f6e18a2ef60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:41.705 7f6e18a2ef60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:16:41.705 7f6e18a2ef60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:41.736 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d3578e2c-1b56-4a7d-bd58-2808f93a68f3 object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.254:8082/alarm/d3578e2c-1b56-4a7d-bd58-2808f93a68f3 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "d3578e2c-1b56-4a7d-bd58-2808f93a68f3", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:41.764 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-b2250e3a-de80-4b87-b329-22c31fc97704', 'type': 'alarm', 'uuid': 'd3578e2c-1b56-4a7d-bd58-2808f93a68f3'} 09/11/2025 04:16:41.911 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f1310add-cf3b-4e79-8792-7d96785f9430 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.254:8082/alarm/f1310add-cf3b-4e79-8792-7d96785f9430 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "f1310add-cf3b-4e79-8792-7d96785f9430", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:41.932 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-a102b5b9-5a1f-4f0c-ac4f-a1bc2ebf6f47', 'type': 'alarm', 'uuid': 'f1310add-cf3b-4e79-8792-7d96785f9430'} 09/11/2025 04:16:42.081 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8383487f-ea4e-4c46-8434-94aa2ad5cb27 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.254:8082/alarm/8383487f-ea4e-4c46-8434-94aa2ad5cb27 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "8383487f-ea4e-4c46-8434-94aa2ad5cb27", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:42.100 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-c94bc1d9-dc26-4a6e-a816-d7440aa3f402', 'type': 'alarm', 'uuid': '8383487f-ea4e-4c46-8434-94aa2ad5cb27'} 09/11/2025 04:16:42.253 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 422ba709-424c-4493-96c6-7110ea69ca26 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.254:8082/alarm/422ba709-424c-4493-96c6-7110ea69ca26 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "422ba709-424c-4493-96c6-7110ea69ca26", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:42.276 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-0f0525b7-727a-489a-b3fd-c8bf22ee67e5', 'type': 'alarm', 'uuid': '422ba709-424c-4493-96c6-7110ea69ca26'} 09/11/2025 04:16:42.417 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0951bd37-88a0-4d5d-b3d7-fe8b8abc6c60 object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.254:8082/alarm/0951bd37-88a0-4d5d-b3d7-fe8b8abc6c60 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "0951bd37-88a0-4d5d-b3d7-fe8b8abc6c60", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:42.454 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-3e44f62f-ef5f-43ee-9fc3-984d5f62e1e9', 'type': 'alarm', 'uuid': '0951bd37-88a0-4d5d-b3d7-fe8b8abc6c60'} 09/11/2025 04:16:42.604 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c10e5fe7-2055-43bb-904c-a7d90fdef0a4 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.254:8082/alarm/c10e5fe7-2055-43bb-904c-a7d90fdef0a4 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "c10e5fe7-2055-43bb-904c-a7d90fdef0a4", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:42.636 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-8654ed6d-e4fa-4a91-9576-35d2875ccd0e', 'type': 'alarm', 'uuid': 'c10e5fe7-2055-43bb-904c-a7d90fdef0a4'} 09/11/2025 04:16:42.791 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0b395b3-1a44-44ce-9556-243055a19004 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.254:8082/alarm/f0b395b3-1a44-44ce-9556-243055a19004 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "f0b395b3-1a44-44ce-9556-243055a19004", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:42.834 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-8ba24df0-7848-4884-aa77-c305cfeccd6e', 'type': 'alarm', 'uuid': 'f0b395b3-1a44-44ce-9556-243055a19004'} 09/11/2025 04:16:42.980 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 64de08c6-8077-44a3-9c58-05626ee2757b object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.254:8082/alarm/64de08c6-8077-44a3-9c58-05626ee2757b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "64de08c6-8077-44a3-9c58-05626ee2757b", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:42.998 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-a4204585-7562-47aa-b960-edcaa865c7ed', 'type': 'alarm', 'uuid': '64de08c6-8077-44a3-9c58-05626ee2757b'} 09/11/2025 04:16:43.145 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0ed2d47c-1c44-4b38-aa93-4858cfb9562b object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.254:8082/alarm/0ed2d47c-1c44-4b38-aa93-4858cfb9562b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "0ed2d47c-1c44-4b38-aa93-4858cfb9562b", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:43.166 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-94f091a7-c43c-4acd-b5df-ab816a8612d2', 'type': 'alarm', 'uuid': '0ed2d47c-1c44-4b38-aa93-4858cfb9562b'} 09/11/2025 04:16:43.313 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 71e0055b-e231-496c-9b7d-4c1bb426989e object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.254:8082/alarm/71e0055b-e231-496c-9b7d-4c1bb426989e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "71e0055b-e231-496c-9b7d-4c1bb426989e", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:43.338 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-6d498398-11df-4000-a68d-c35c20d4cf78', 'type': 'alarm', 'uuid': '71e0055b-e231-496c-9b7d-4c1bb426989e'} 09/11/2025 04:16:43.486 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 33adf7c9-f7b8-4894-986d-757783f670b1 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.254:8082/alarm/33adf7c9-f7b8-4894-986d-757783f670b1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "33adf7c9-f7b8-4894-986d-757783f670b1", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:43.508 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-fae42891-1707-4a82-8f6c-20689a3d43f8', 'type': 'alarm', 'uuid': '33adf7c9-f7b8-4894-986d-757783f670b1'} 09/11/2025 04:16:43.653 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 31c4dce7-9b58-4cb2-94ef-dc07e0925bf5 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.254:8082/alarm/31c4dce7-9b58-4cb2-94ef-dc07e0925bf5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "31c4dce7-9b58-4cb2-94ef-dc07e0925bf5", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:43.674 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-526a36a3-e8c9-49d8-90d9-60b5e2e72d97', 'type': 'alarm', 'uuid': '31c4dce7-9b58-4cb2-94ef-dc07e0925bf5'} 09/11/2025 04:16:43.816 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 35603741-06a3-41e6-8e94-4602b1d9ef9c object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.254:8082/alarm/35603741-06a3-41e6-8e94-4602b1d9ef9c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "35603741-06a3-41e6-8e94-4602b1d9ef9c", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:43.834 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-8da5805d-ce6f-4fbc-b2eb-c419ef085c4e', 'type': 'alarm', 'uuid': '35603741-06a3-41e6-8e94-4602b1d9ef9c'} 09/11/2025 04:16:44.005 7f6e18aee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c072df54-74ca-459d-ae8a-19dfc9e410f0 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.254:8082/alarm/c072df54-74ca-459d-ae8a-19dfc9e410f0 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.254 body = {"alarm": {"uuid": "c072df54-74ca-459d-ae8a-19dfc9e410f0", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:44.027 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-56f17f5d-7c0f-41f9-b2bb-9ffacc7f36ca', 'type': 'alarm', 'uuid': 'c072df54-74ca-459d-ae8a-19dfc9e410f0'} 09/11/2025 04:16:45.705 7f6e189f5780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:45.707 7f6e189f5780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:45.707 7f6e189f5780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:45.707 7f6e189f5780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:45.707 7f6e189f5780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:16:45.707 7f6e189f5780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:45.707 7f6e189f5780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:45.707 7f6e189f5780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:45.707 7f6e189f5780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:45.708 7f6e189f5780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:45.708 7f6e189f5780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:45.708 7f6e189f5780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:45.708 7f6e189f5780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:16:45.708 7f6e189f5780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:49.707 7f6e18aab2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:49.708 7f6e18aab2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:49.709 7f6e18aab2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:49.709 7f6e18aab2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:49.709 7f6e18aab2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:16:49.709 7f6e18aab2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:49.709 7f6e18aab2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:49.709 7f6e18aab2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:49.709 7f6e18aab2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:49.709 7f6e18aab2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:49.709 7f6e18aab2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:49.709 7f6e18aab2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:49.710 7f6e18aab2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:16:49.710 7f6e18aab2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:53.710 7f6e18b02978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:53.711 7f6e18b02978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:53.711 7f6e18b02978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:53.711 7f6e18b02978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:53.711 7f6e18b02978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:16:53.711 7f6e18b02978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:53.711 7f6e18b02978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:53.712 7f6e18b02978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:53.712 7f6e18b02978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:53.712 7f6e18b02978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:53.712 7f6e18b02978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:53.712 7f6e18b02978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:53.712 7f6e18b02978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:16:53.712 7f6e18b02978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:57.300 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a09334f9-32a2-497e-821d-ebb2d2e90012 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.254:8082/alarm/a09334f9-32a2-497e-821d-ebb2d2e90012 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "a09334f9-32a2-497e-821d-ebb2d2e90012", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:57.324 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-35f5348f-0702-4e71-9e2f-00c3f6fbb482', 'type': 'alarm', 'uuid': 'a09334f9-32a2-497e-821d-ebb2d2e90012'} 09/11/2025 04:16:57.469 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 80c7444e-03b6-4591-b253-0de8be5b001a object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.254:8082/alarm/80c7444e-03b6-4591-b253-0de8be5b001a operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "80c7444e-03b6-4591-b253-0de8be5b001a", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:57.489 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-6890a861-cd0c-4b4f-bcbe-08669a5eb3b9', 'type': 'alarm', 'uuid': '80c7444e-03b6-4591-b253-0de8be5b001a'} 09/11/2025 04:16:57.637 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 417738c3-df59-478d-bc5a-277e38b4ce0f object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.254:8082/alarm/417738c3-df59-478d-bc5a-277e38b4ce0f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "417738c3-df59-478d-bc5a-277e38b4ce0f", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:57.656 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-c807a46e-afe1-4ac5-b9f2-d10d6bfa5b6d', 'type': 'alarm', 'uuid': '417738c3-df59-478d-bc5a-277e38b4ce0f'} 09/11/2025 04:16:57.712 7f6e189dfa20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:16:57.713 7f6e189dfa20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:16:57.717 7f6e189dfa20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:16:57.717 7f6e189dfa20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:57.718 7f6e189dfa20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:16:57.718 7f6e189dfa20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:16:57.718 7f6e189dfa20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:16:57.718 7f6e189dfa20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:16:57.718 7f6e189dfa20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:57.719 7f6e189dfa20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:16:57.719 7f6e189dfa20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:57.719 7f6e189dfa20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:57.719 7f6e189dfa20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:16:57.719 7f6e189dfa20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:16:57.806 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 95700056-2264-4db3-860a-776ac9d78bed object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.254:8082/alarm/95700056-2264-4db3-860a-776ac9d78bed operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "95700056-2264-4db3-860a-776ac9d78bed", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:57.831 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-8ad10710-8df4-473e-af65-6310ef3e6489', 'type': 'alarm', 'uuid': '95700056-2264-4db3-860a-776ac9d78bed'} 09/11/2025 04:16:57.985 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = cd677829-e129-4993-aa25-30f7950c98ff object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.254:8082/alarm/cd677829-e129-4993-aa25-30f7950c98ff operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "cd677829-e129-4993-aa25-30f7950c98ff", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:58.001 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-f5d58b6b-8629-49cc-832d-efbc93c5af2b', 'type': 'alarm', 'uuid': 'cd677829-e129-4993-aa25-30f7950c98ff'} 09/11/2025 04:16:58.145 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c2334de9-48d2-49c0-8f0f-049ee80647f8 object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.254:8082/alarm/c2334de9-48d2-49c0-8f0f-049ee80647f8 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "c2334de9-48d2-49c0-8f0f-049ee80647f8", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:58.167 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-5d2832e8-3e53-4154-908e-506af2dcbc5c', 'type': 'alarm', 'uuid': 'c2334de9-48d2-49c0-8f0f-049ee80647f8'} 09/11/2025 04:16:58.321 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 54bf60ee-1ff2-41ce-8914-2b057e553962 object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.254:8082/alarm/54bf60ee-1ff2-41ce-8914-2b057e553962 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "54bf60ee-1ff2-41ce-8914-2b057e553962", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:58.338 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-66008662-7854-44fd-92a8-c485fd1e1c43', 'type': 'alarm', 'uuid': '54bf60ee-1ff2-41ce-8914-2b057e553962'} 09/11/2025 04:16:58.485 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5532ff33-efb2-4a57-9471-44761388d805 object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.254:8082/alarm/5532ff33-efb2-4a57-9471-44761388d805 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "5532ff33-efb2-4a57-9471-44761388d805", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:58.502 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-8c0c85d7-d6b0-4f7a-ba82-b2b833b61fb3', 'type': 'alarm', 'uuid': '5532ff33-efb2-4a57-9471-44761388d805'} 09/11/2025 04:16:58.657 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 00bf9dce-7f0a-430c-90f9-d63d6403f71f object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.254:8082/alarm/00bf9dce-7f0a-430c-90f9-d63d6403f71f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "00bf9dce-7f0a-430c-90f9-d63d6403f71f", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:58.673 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-4880c172-fe06-41fd-9262-16fac2721d0a', 'type': 'alarm', 'uuid': '00bf9dce-7f0a-430c-90f9-d63d6403f71f'} 09/11/2025 04:16:58.829 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d3578e2c-1b56-4a7d-bd58-2808f93a68f3 object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.254:8082/alarm/d3578e2c-1b56-4a7d-bd58-2808f93a68f3 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "d3578e2c-1b56-4a7d-bd58-2808f93a68f3", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:58.860 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-ed5c600b-39a8-4273-974c-77f567c8ffca', 'type': 'alarm', 'uuid': 'd3578e2c-1b56-4a7d-bd58-2808f93a68f3'} 09/11/2025 04:16:59.022 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f1310add-cf3b-4e79-8792-7d96785f9430 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.254:8082/alarm/f1310add-cf3b-4e79-8792-7d96785f9430 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "f1310add-cf3b-4e79-8792-7d96785f9430", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:59.048 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-4acf675a-d16e-4457-b3fe-5467d59c832c', 'type': 'alarm', 'uuid': 'f1310add-cf3b-4e79-8792-7d96785f9430'} 09/11/2025 04:16:59.215 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8383487f-ea4e-4c46-8434-94aa2ad5cb27 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.254:8082/alarm/8383487f-ea4e-4c46-8434-94aa2ad5cb27 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "8383487f-ea4e-4c46-8434-94aa2ad5cb27", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:59.248 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-fa989c58-f5f3-452d-bda5-3cc564925bb6', 'type': 'alarm', 'uuid': '8383487f-ea4e-4c46-8434-94aa2ad5cb27'} 09/11/2025 04:16:59.400 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 422ba709-424c-4493-96c6-7110ea69ca26 object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.254:8082/alarm/422ba709-424c-4493-96c6-7110ea69ca26 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "422ba709-424c-4493-96c6-7110ea69ca26", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:59.420 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-c77d02e0-0ad5-4e9a-8711-5428b4797045', 'type': 'alarm', 'uuid': '422ba709-424c-4493-96c6-7110ea69ca26'} 09/11/2025 04:16:59.585 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0951bd37-88a0-4d5d-b3d7-fe8b8abc6c60 object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.254:8082/alarm/0951bd37-88a0-4d5d-b3d7-fe8b8abc6c60 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "0951bd37-88a0-4d5d-b3d7-fe8b8abc6c60", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:59.622 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-31f26703-b6f6-4dff-a42c-375864931050', 'type': 'alarm', 'uuid': '0951bd37-88a0-4d5d-b3d7-fe8b8abc6c60'} 09/11/2025 04:16:59.777 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c10e5fe7-2055-43bb-904c-a7d90fdef0a4 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.254:8082/alarm/c10e5fe7-2055-43bb-904c-a7d90fdef0a4 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "c10e5fe7-2055-43bb-904c-a7d90fdef0a4", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:59.794 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-926b9c64-5cbe-44c5-8de1-e02d4099e4f0', 'type': 'alarm', 'uuid': 'c10e5fe7-2055-43bb-904c-a7d90fdef0a4'} 09/11/2025 04:16:59.941 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0b395b3-1a44-44ce-9556-243055a19004 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.254:8082/alarm/f0b395b3-1a44-44ce-9556-243055a19004 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "f0b395b3-1a44-44ce-9556-243055a19004", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:16:59.957 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-688820b9-d2b1-44c4-b11f-4d45a573f8cd', 'type': 'alarm', 'uuid': 'f0b395b3-1a44-44ce-9556-243055a19004'} 09/11/2025 04:17:00.107 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 64de08c6-8077-44a3-9c58-05626ee2757b object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.254:8082/alarm/64de08c6-8077-44a3-9c58-05626ee2757b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "64de08c6-8077-44a3-9c58-05626ee2757b", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:00.131 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-2de45689-fcbd-4d89-a058-f56b6786aac2', 'type': 'alarm', 'uuid': '64de08c6-8077-44a3-9c58-05626ee2757b'} 09/11/2025 04:17:00.280 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0ed2d47c-1c44-4b38-aa93-4858cfb9562b object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.254:8082/alarm/0ed2d47c-1c44-4b38-aa93-4858cfb9562b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "0ed2d47c-1c44-4b38-aa93-4858cfb9562b", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:00.308 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-786cd116-2624-4202-9e43-efbe3274e365', 'type': 'alarm', 'uuid': '0ed2d47c-1c44-4b38-aa93-4858cfb9562b'} 09/11/2025 04:17:00.462 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 71e0055b-e231-496c-9b7d-4c1bb426989e object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.254:8082/alarm/71e0055b-e231-496c-9b7d-4c1bb426989e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "71e0055b-e231-496c-9b7d-4c1bb426989e", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:00.487 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-1f399a62-c763-417b-9dc9-d02b2f610133', 'type': 'alarm', 'uuid': '71e0055b-e231-496c-9b7d-4c1bb426989e'} 09/11/2025 04:17:00.634 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 33adf7c9-f7b8-4894-986d-757783f670b1 object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.254:8082/alarm/33adf7c9-f7b8-4894-986d-757783f670b1 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "33adf7c9-f7b8-4894-986d-757783f670b1", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:00.649 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-2a8c326a-deca-43d2-acdb-822d069a61f3', 'type': 'alarm', 'uuid': '33adf7c9-f7b8-4894-986d-757783f670b1'} 09/11/2025 04:17:00.810 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 31c4dce7-9b58-4cb2-94ef-dc07e0925bf5 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.254:8082/alarm/31c4dce7-9b58-4cb2-94ef-dc07e0925bf5 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "31c4dce7-9b58-4cb2-94ef-dc07e0925bf5", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:00.829 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-dd3e8b83-e950-4e32-b6ec-13254c7487dd', 'type': 'alarm', 'uuid': '31c4dce7-9b58-4cb2-94ef-dc07e0925bf5'} 09/11/2025 04:17:00.986 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 35603741-06a3-41e6-8e94-4602b1d9ef9c object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.254:8082/alarm/35603741-06a3-41e6-8e94-4602b1d9ef9c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "35603741-06a3-41e6-8e94-4602b1d9ef9c", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:01.002 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-16cef622-158a-4349-9fb3-3e4c0fff7e97', 'type': 'alarm', 'uuid': '35603741-06a3-41e6-8e94-4602b1d9ef9c'} 09/11/2025 04:17:01.162 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c072df54-74ca-459d-ae8a-19dfc9e410f0 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.254:8082/alarm/c072df54-74ca-459d-ae8a-19dfc9e410f0 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.22 body = {"alarm": {"uuid": "c072df54-74ca-459d-ae8a-19dfc9e410f0", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:01.194 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-770932e0-5af4-4417-8eaa-b8d69f9d37d2', 'type': 'alarm', 'uuid': 'c072df54-74ca-459d-ae8a-19dfc9e410f0'} 09/11/2025 04:17:01.713 7f6e1890e630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:01.715 7f6e1890e630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:01.715 7f6e1890e630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:01.715 7f6e1890e630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:01.715 7f6e1890e630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:01.715 7f6e1890e630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:01.715 7f6e1890e630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:01.715 7f6e1890e630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:01.716 7f6e1890e630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:01.716 7f6e1890e630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:01.716 7f6e1890e630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:01.716 7f6e1890e630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:01.716 7f6e1890e630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:01.716 7f6e1890e630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:02.342 7f6e18a73390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b6b25520-beae-4e43-885e-8e9d517df70c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.254:8082/global-vrouter-config/b6b25520-beae-4e43-885e-8e9d517df70c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.48 body = {"global-vrouter-config": {"uuid": "b6b25520-beae-4e43-885e-8e9d517df70c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:02.355 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-e6436433-bce4-4c7e-8a05-217b9502e1da', 'type': 'global_vrouter_config', 'uuid': 'b6b25520-beae-4e43-885e-8e9d517df70c'} 09/11/2025 04:17:05.716 7f6e18918ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:05.717 7f6e18918ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:05.717 7f6e18918ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:05.717 7f6e18918ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:05.717 7f6e18918ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:05.717 7f6e18918ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:05.717 7f6e18918ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:05.717 7f6e18918ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:05.717 7f6e18918ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:05.718 7f6e18918ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:05.718 7f6e18918ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:05.718 7f6e18918ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:05.718 7f6e18918ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:05.718 7f6e18918ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:07.796 7f6e1c8ecc18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b6b25520-beae-4e43-885e-8e9d517df70c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.254:8082/global-vrouter-config/b6b25520-beae-4e43-885e-8e9d517df70c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.254 body = {"global-vrouter-config": {"uuid": "b6b25520-beae-4e43-885e-8e9d517df70c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:07.823 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-ae630774-13b7-4b03-aad8-012ae49c3a2a', 'type': 'global_vrouter_config', 'uuid': 'b6b25520-beae-4e43-885e-8e9d517df70c'} 09/11/2025 04:17:09.718 7f6e18930978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:09.719 7f6e18930978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:09.719 7f6e18930978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:09.720 7f6e18930978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:09.720 7f6e18930978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:09.720 7f6e18930978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:09.720 7f6e18930978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:09.720 7f6e18930978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:09.720 7f6e18930978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:09.720 7f6e18930978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:09.720 7f6e18930978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:09.720 7f6e18930978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:09.721 7f6e18930978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:09.721 7f6e18930978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:10.868 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'id_perms': {'created': '2025-09-11T04:17:10.861383', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:10.861383', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10544535192036714357, 'uuid_mslong': 11003617109678639790}}, 'parent_type': 'security-group', 'parent_uuid': 'dbc879fa-1587-4abd-88b1-2ad35a2ac8b6', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '98b4b376-2ace-4aae-9255-b6e3caf42775'}, 'oper': 'CREATE', 'request-id': 'req-1150dd39-e17c-4b33-8af4-8aec15a1caed', 'type': 'access_control_list', 'uuid': '98b4b376-2ace-4aae-9255-b6e3caf42775'} 09/11/2025 04:17:10.920 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'id_perms': {'created': '2025-09-11T04:17:10.913299', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:10.913299', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10666969232094724474, 'uuid_mslong': 6702487493598462486}}, 'parent_type': 'security-group', 'parent_uuid': 'dbc879fa-1587-4abd-88b1-2ad35a2ac8b6', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5d0404dd-376f-4216-9408-b0002507017a'}, 'oper': 'CREATE', 'request-id': 'req-2eb2dcf4-de21-4b14-a2db-a39a24f01b52', 'type': 'access_control_list', 'uuid': '5d0404dd-376f-4216-9408-b0002507017a'} 09/11/2025 04:17:10.991 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000000'], 'obj_dict': {'display_name': 'target:64512:8000000', 'fq_name': ['target:64512:8000000'], 'id_perms': {'created': '2025-09-11T04:17:10.984662', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:10.984662', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9718311332703100866, 'uuid_mslong': 13557389008828058987}}, 'perms2': {'global_access': 0, 'owner': '1c7bc00d913741dc91182b098025db9c', 'owner_access': 7, 'share': []}, 'uuid': 'bc258579-30fb-4d6b-86de-60aad26bdfc2'}, 'oper': 'CREATE', 'request-id': 'req-1bc71515-94ef-490f-83f5-eea0868c2347', 'type': 'route_target', 'uuid': 'bc258579-30fb-4d6b-86de-60aad26bdfc2'} 09/11/2025 04:17:11.000 7f6e18a95e10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2e1fc63d-6d97-43e5-861a-2c3093d27091 object_type = routing_instance identifier_name = default-domain:default-project:dci-network:__default__ url = http://10.0.0.254:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-schema remote_ip = 10.0.0.254 body = {"type": "routing-instance", "uuid": "2e1fc63d-6d97-43e5-861a-2c3093d27091", "ref-type": "route-target", "ref-uuid": "bc258579-30fb-4d6b-86de-60aad26bdfc2", "ref-fq-name": ["target:64512:8000000"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:11.014 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'oper': 'UPDATE', 'request-id': 'req-568b9cb3-b440-434d-8aef-cadab7afbbf4', 'type': 'routing_instance', 'uuid': '2e1fc63d-6d97-43e5-861a-2c3093d27091'} 09/11/2025 04:17:11.051 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000001'], 'obj_dict': {'display_name': 'target:64512:8000001', 'fq_name': ['target:64512:8000001'], 'id_perms': {'created': '2025-09-11T04:17:11.045253', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:11.045253', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13319250192862489228, 'uuid_mslong': 9764760161470663995}}, 'perms2': {'global_access': 0, 'owner': '1c7bc00d913741dc91182b098025db9c', 'owner_access': 7, 'share': []}, 'uuid': '878365a1-8558-4d3b-b8d7-7b7b641f2a8c'}, 'oper': 'CREATE', 'request-id': 'req-cf808f1d-d713-4cf6-b9f8-1e06e8df40c3', 'type': 'route_target', 'uuid': '878365a1-8558-4d3b-b8d7-7b7b641f2a8c'} 09/11/2025 04:17:11.078 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'oper': 'UPDATE', 'request-id': 'req-3278e168-094e-4f41-836f-4a2f80ffb743', 'type': 'routing_instance', 'uuid': 'a79654b7-d507-44f7-bbb7-2b6bf4c79ce3'} 09/11/2025 04:17:11.104 7f6e18a95e10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000002 url = http://10.0.0.254:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-schema remote_ip = 10.0.0.254 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000002"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "1c7bc00d913741dc91182b098025db9c", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000002"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:11.120 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000002'], 'obj_dict': {'display_name': 'target:64512:8000002', 'fq_name': ['target:64512:8000002'], 'id_perms': {'created': '2025-09-11T04:17:11.111209', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:11.111209', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12342043498439276032, 'uuid_mslong': 1483168597656095540}}, 'perms2': {'global_access': 0, 'owner': '1c7bc00d913741dc91182b098025db9c', 'owner_access': 7, 'share': []}, 'uuid': '149545fb-3d4e-4b34-ab47-bf2bbee47600'}, 'oper': 'CREATE', 'request-id': 'req-47db6bf6-9a2f-4488-b96e-7da5f4b4dd47', 'type': 'route_target', 'uuid': '149545fb-3d4e-4b34-ab47-bf2bbee47600'} 09/11/2025 04:17:11.161 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'oper': 'UPDATE', 'request-id': 'req-8d20350d-7580-47e8-ab88-19c83b13f8bb', 'type': 'routing_instance', 'uuid': '85522317-b3f9-447d-bea5-72a8afc7db3b'} 09/11/2025 04:17:11.226 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000003'], 'obj_dict': {'display_name': 'target:64512:8000003', 'fq_name': ['target:64512:8000003'], 'id_perms': {'created': '2025-09-11T04:17:11.214124', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:11.214124', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10879539168595788064, 'uuid_mslong': 9943932710958156803}}, 'perms2': {'global_access': 0, 'owner': '1c7bc00d913741dc91182b098025db9c', 'owner_access': 7, 'share': []}, 'uuid': '89fff21d-8b0c-4c03-96fb-e33b4819c120'}, 'oper': 'CREATE', 'request-id': 'req-72ca8908-bb31-4809-9eba-9193a8514e56', 'type': 'route_target', 'uuid': '89fff21d-8b0c-4c03-96fb-e33b4819c120'} 09/11/2025 04:17:11.233 7f6e18a95e10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 010c7f62-733c-4f41-aaaa-9712d470b6e4 object_type = routing_instance identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = http://10.0.0.254:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-schema remote_ip = 10.0.0.254 body = {"type": "routing-instance", "uuid": "010c7f62-733c-4f41-aaaa-9712d470b6e4", "ref-type": "route-target", "ref-uuid": "89fff21d-8b0c-4c03-96fb-e33b4819c120", "ref-fq-name": ["target:64512:8000003"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:11.249 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-ebe7964e-dff4-435e-96fd-f58016cbdd63', 'type': 'routing_instance', 'uuid': '010c7f62-733c-4f41-aaaa-9712d470b6e4'} 09/11/2025 04:17:11.376 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'deny'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000002'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}], 'dynamic': False}, 'display_name': 'ip-fabric', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2025-09-11T04:17:11.323519', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:11.323519', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11541561305630520375, 'uuid_mslong': 4794838566741166221}}, 'parent_type': 'virtual-network', 'parent_uuid': '81139561-8493-4c6f-b706-f85f7b7a0461', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '428ab045-b5f3-488d-a02b-dcdb8f803437'}, 'oper': 'CREATE', 'request-id': 'req-96e67f21-7a48-467e-9b31-c02b3f3598b3', 'type': 'access_control_list', 'uuid': '428ab045-b5f3-488d-a02b-dcdb8f803437'} 09/11/2025 04:17:11.388 7f6e18a95e10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 98b4b376-2ace-4aae-9255-b6e3caf42775 object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:ingress-access-control-list url = http://10.0.0.254:8082/access-control-list/98b4b376-2ace-4aae-9255-b6e3caf42775 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-schema remote_ip = 10.0.0.254 body = {"access-control-list": {"uuid": "98b4b376-2ace-4aae-9255-b6e3caf42775", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "access_control_list_hash": -782339169199063927}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:11.417 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-6a0e4766-9273-424f-b61e-5bcd665d7389', 'type': 'access_control_list', 'uuid': '98b4b376-2ace-4aae-9255-b6e3caf42775'} 09/11/2025 04:17:11.438 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-2b8be160-93d6-43a8-9ac3-118228758742', 'type': 'access_control_list', 'uuid': '5d0404dd-376f-4216-9408-b0002507017a'} 09/11/2025 04:17:13.000 7f6e19364f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b6b25520-beae-4e43-885e-8e9d517df70c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.254:8082/global-vrouter-config/b6b25520-beae-4e43-885e-8e9d517df70c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.22 body = {"global-vrouter-config": {"uuid": "b6b25520-beae-4e43-885e-8e9d517df70c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.018 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-3fab18a7-25da-48d8-921c-0fd6344da44f', 'type': 'global_vrouter_config', 'uuid': 'b6b25520-beae-4e43-885e-8e9d517df70c'} 09/11/2025 04:17:13.036 7f6e18916e10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-4080-3 url = http://10.0.0.254:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.48 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-3"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.14", "address": "10.20.0.14", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-3"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.055 7f6e189182e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-4080-1 url = http://10.0.0.254:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.254 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-1"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.17", "address": "10.20.0.17", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-1"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.072 7f6e214eb780 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b6b25520-beae-4e43-885e-8e9d517df70c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.254:8082/global-vrouter-config/b6b25520-beae-4e43-885e-8e9d517df70c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.48 body = {"global-vrouter-config": {"uuid": "b6b25520-beae-4e43-885e-8e9d517df70c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.086 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4080-3'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.14', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.14', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-3', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4080-3'], 'id_perms': {'created': '2025-09-11T04:17:13.065074', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:13.065074', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10950853773355723412, 'uuid_mslong': 15674887581649094083}}, 'parent_type': 'routing-instance', 'parent_uuid': 'ce762e2f-e373-44d9-bd23-ef7708ab3833', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd9886334-d660-45c3-97f9-3f7c9c1d2a94'}, 'oper': 'CREATE', 'request-id': 'req-afbd7e12-b185-49f5-886c-87dd86516e9c', 'type': 'bgp_router', 'uuid': 'd9886334-d660-45c3-97f9-3f7c9c1d2a94'} 09/11/2025 04:17:13.086 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 09/11/2025 04:17:13.087 7f6e189e28d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.094 7f6e189e28d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-3 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.14", "address": "10.20.0.14", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-ansible-os-4080-3"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-3"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 15674887581649094083, "uuid_lslong": 10950853773355723412}, "enable": true, "created": "2025-09-11T04:17:13.065074", "last_modified": "2025-09-11T04:17:13.065074", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "ce762e2f-e373-44d9-bd23-ef7708ab3833"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "d9886334-d660-45c3-97f9-3f7c9c1d2a94" } deleted = False >> 09/11/2025 04:17:13.094 7f6e189e28d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.098 7f6e18914cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-4080-2 url = http://10.0.0.254:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.22 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-2"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.254", "address": "10.20.0.254", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-2"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.109 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-12ea4cf1-1982-40e9-8227-2fd37ceac1c6', 'type': 'global_vrouter_config', 'uuid': 'b6b25520-beae-4e43-885e-8e9d517df70c'} 09/11/2025 04:17:13.126 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4080-1'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.17', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.17', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-1', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4080-1'], 'id_perms': {'created': '2025-09-11T04:17:13.110404', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:13.110404', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13227956060664994284, 'uuid_mslong': 12557355306522658542}}, 'parent_type': 'routing-instance', 'parent_uuid': 'ce762e2f-e373-44d9-bd23-ef7708ab3833', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ae44b01e-9ba6-46ee-b793-23f3d46999ec'}, 'oper': 'CREATE', 'request-id': 'req-cfe0e8fa-3755-4301-a4cf-7b305fcd1bc9', 'type': 'bgp_router', 'uuid': 'ae44b01e-9ba6-46ee-b793-23f3d46999ec'} 09/11/2025 04:17:13.126 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 09/11/2025 04:17:13.127 7f6e189b8d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.127 7f6e189b8d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.17", "address": "10.20.0.17", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-ansible-os-4080-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 12557355306522658542, "uuid_lslong": 13227956060664994284}, "enable": true, "created": "2025-09-11T04:17:13.110404", "last_modified": "2025-09-11T04:17:13.110404", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "ce762e2f-e373-44d9-bd23-ef7708ab3833"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "ae44b01e-9ba6-46ee-b793-23f3d46999ec" } deleted = False >> 09/11/2025 04:17:13.127 7f6e189b8d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.148 7f6e1c8ecc18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b6b25520-beae-4e43-885e-8e9d517df70c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.254:8082/global-vrouter-config/b6b25520-beae-4e43-885e-8e9d517df70c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.254 body = {"global-vrouter-config": {"uuid": "b6b25520-beae-4e43-885e-8e9d517df70c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.161 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4080-2'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.254', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.254', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-2', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4080-2'], 'id_perms': {'created': '2025-09-11T04:17:13.149684', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:13.149684', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13535373795627972135, 'uuid_mslong': 7626155110244765493}}, 'parent_type': 'routing-instance', 'parent_uuid': 'ce762e2f-e373-44d9-bd23-ef7708ab3833', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '69d58baa-ec2b-4f35-bbd7-4ec0ee893627'}, 'oper': 'CREATE', 'request-id': 'req-50f57a94-e349-42d4-a0d0-1ed1ea7310a3', 'type': 'bgp_router', 'uuid': '69d58baa-ec2b-4f35-bbd7-4ec0ee893627'} 09/11/2025 04:17:13.161 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 09/11/2025 04:17:13.163 7f6e188ecd68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.163 7f6e188ecd68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-2 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.254", "address": "10.20.0.254", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-ansible-os-4080-2"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-2"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7626155110244765493, "uuid_lslong": 13535373795627972135}, "enable": true, "created": "2025-09-11T04:17:13.149684", "last_modified": "2025-09-11T04:17:13.149684", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "ce762e2f-e373-44d9-bd23-ef7708ab3833"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "69d58baa-ec2b-4f35-bbd7-4ec0ee893627" } deleted = False >> 09/11/2025 04:17:13.163 7f6e188ecd68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.172 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-cd0eb5dc-62ab-4218-9e84-27c77d99ef96', 'type': 'global_vrouter_config', 'uuid': 'b6b25520-beae-4e43-885e-8e9d517df70c'} 09/11/2025 04:17:13.203 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4080-1'], 'oper': 'UPDATE', 'request-id': 'req-c7ff6149-09b0-4f6c-9acd-100e41a776ae', 'type': 'bgp_router', 'uuid': 'ae44b01e-9ba6-46ee-b793-23f3d46999ec'} 09/11/2025 04:17:13.231 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4080-3'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-c7ff6149-09b0-4f6c-9acd-100e41a776ae', 'type': 'bgp_router', 'uuid': 'd9886334-d660-45c3-97f9-3f7c9c1d2a94'} 09/11/2025 04:17:13.231 7f6e18a7f6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.232 7f6e18a7f6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.17", "address": "10.20.0.17", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "d9886334-d660-45c3-97f9-3f7c9c1d2a94"}]display_name : "cn-jenkins-deploy-platform-ansible-os-4080-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 12557355306522658542, "uuid_lslong": 13227956060664994284}, "enable": true, "created": "2025-09-11T04:17:13.110404", "last_modified": "2025-09-11T04:17:13.191343", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "ce762e2f-e373-44d9-bd23-ef7708ab3833"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "ae44b01e-9ba6-46ee-b793-23f3d46999ec" } deleted = False >> 09/11/2025 04:17:13.232 7f6e18a7f6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.244 7f6e18992828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.244 7f6e18992828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-3 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.14", "address": "10.20.0.14", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-1"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "ae44b01e-9ba6-46ee-b793-23f3d46999ec"}]display_name : "cn-jenkins-deploy-platform-ansible-os-4080-3"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-3"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 15674887581649094083, "uuid_lslong": 10950853773355723412}, "enable": true, "created": "2025-09-11T04:17:13.065074", "last_modified": "2025-09-11T04:17:13.189108", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "ce762e2f-e373-44d9-bd23-ef7708ab3833"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "d9886334-d660-45c3-97f9-3f7c9c1d2a94" } deleted = False >> 09/11/2025 04:17:13.244 7f6e18992828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.274 7f6e18a95e10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 69d58baa-ec2b-4f35-bbd7-4ec0ee893627 object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-4080-2 url = http://10.0.0.254:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/usr/bin/contrail-schema remote_ip = 10.0.0.254 body = {"type": "bgp-router", "uuid": "69d58baa-ec2b-4f35-bbd7-4ec0ee893627", "ref-type": "bgp-router", "ref-uuid": null, "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-3"], "operation": "ADD", "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.314 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4080-2'], 'oper': 'UPDATE', 'request-id': 'req-c769b69a-455d-415b-901c-654d46e0bb48', 'type': 'bgp_router', 'uuid': '69d58baa-ec2b-4f35-bbd7-4ec0ee893627'} 09/11/2025 04:17:13.328 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4080-3'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-c769b69a-455d-415b-901c-654d46e0bb48', 'type': 'bgp_router', 'uuid': 'd9886334-d660-45c3-97f9-3f7c9c1d2a94'} 09/11/2025 04:17:13.329 7f6e1890e4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.329 7f6e1890e4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-2 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.254", "address": "10.20.0.254", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "d9886334-d660-45c3-97f9-3f7c9c1d2a94"}]display_name : "cn-jenkins-deploy-platform-ansible-os-4080-2"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-2"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7626155110244765493, "uuid_lslong": 13535373795627972135}, "enable": true, "created": "2025-09-11T04:17:13.149684", "last_modified": "2025-09-11T04:17:13.304107", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "ce762e2f-e373-44d9-bd23-ef7708ab3833"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "69d58baa-ec2b-4f35-bbd7-4ec0ee893627" } deleted = False >> 09/11/2025 04:17:13.329 7f6e1890e4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.339 7f6e18ad4048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.340 7f6e18ad4048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-3 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.14", "address": "10.20.0.14", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-2"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "69d58baa-ec2b-4f35-bbd7-4ec0ee893627"}, {"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-1"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "ae44b01e-9ba6-46ee-b793-23f3d46999ec"}]display_name : "cn-jenkins-deploy-platform-ansible-os-4080-3"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-3"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 15674887581649094083, "uuid_lslong": 10950853773355723412}, "enable": true, "created": "2025-09-11T04:17:13.065074", "last_modified": "2025-09-11T04:17:13.301619", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "ce762e2f-e373-44d9-bd23-ef7708ab3833"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "d9886334-d660-45c3-97f9-3f7c9c1d2a94" } deleted = False >> 09/11/2025 04:17:13.340 7f6e18ad4048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.342 7f6e18916e10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 197ee536-4af6-414f-b479-ed8e4f1ff5bb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.254:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.48 body = {"uuid": "197ee536-4af6-414f-b479-ed8e4f1ff5bb", "ref-uuid": "d9886334-d660-45c3-97f9-3f7c9c1d2a94"} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.347 7f6e189182e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 197ee536-4af6-414f-b479-ed8e4f1ff5bb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.254:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.254 body = {"uuid": "197ee536-4af6-414f-b479-ed8e4f1ff5bb", "ref-uuid": "ae44b01e-9ba6-46ee-b793-23f3d46999ec"} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.392 7f6e18916e10 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 197ee536-4af6-414f-b479-ed8e4f1ff5bb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.254:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.48 body = {"type": "global-system-config", "uuid": "197ee536-4af6-414f-b479-ed8e4f1ff5bb", "ref-type": "bgp-router", "ref-uuid": "d9886334-d660-45c3-97f9-3f7c9c1d2a94", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-3"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.394 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4080-2'], 'oper': 'UPDATE', 'request-id': 'req-d7044c16-777c-4714-8fcd-9314df07aaff', 'type': 'bgp_router', 'uuid': '69d58baa-ec2b-4f35-bbd7-4ec0ee893627'} 09/11/2025 04:17:13.413 7f6e18914cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 197ee536-4af6-414f-b479-ed8e4f1ff5bb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.254:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.22 body = {"uuid": "197ee536-4af6-414f-b479-ed8e4f1ff5bb", "ref-uuid": "69d58baa-ec2b-4f35-bbd7-4ec0ee893627"} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.420 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-4080-1'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-d7044c16-777c-4714-8fcd-9314df07aaff', 'type': 'bgp_router', 'uuid': 'ae44b01e-9ba6-46ee-b793-23f3d46999ec'} 09/11/2025 04:17:13.420 7f6e18a7f780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.421 7f6e18a7f780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-2 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.254", "address": "10.20.0.254", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-1"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "ae44b01e-9ba6-46ee-b793-23f3d46999ec"}, {"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "d9886334-d660-45c3-97f9-3f7c9c1d2a94"}]display_name : "cn-jenkins-deploy-platform-ansible-os-4080-2"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-2"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7626155110244765493, "uuid_lslong": 13535373795627972135}, "enable": true, "created": "2025-09-11T04:17:13.149684", "last_modified": "2025-09-11T04:17:13.373369", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "ce762e2f-e373-44d9-bd23-ef7708ab3833"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "69d58baa-ec2b-4f35-bbd7-4ec0ee893627" } deleted = False >> 09/11/2025 04:17:13.421 7f6e18a7f780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.422 7f6e189182e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 197ee536-4af6-414f-b479-ed8e4f1ff5bb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.254:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.254 body = {"type": "global-system-config", "uuid": "197ee536-4af6-414f-b479-ed8e4f1ff5bb", "ref-type": "bgp-router", "ref-uuid": "ae44b01e-9ba6-46ee-b793-23f3d46999ec", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-1"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.424 7f6e18a63438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.424 7f6e18a63438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.17", "address": "10.20.0.17", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-2"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "69d58baa-ec2b-4f35-bbd7-4ec0ee893627"}, {"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "d9886334-d660-45c3-97f9-3f7c9c1d2a94"}]display_name : "cn-jenkins-deploy-platform-ansible-os-4080-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 12557355306522658542, "uuid_lslong": 13227956060664994284}, "enable": true, "created": "2025-09-11T04:17:13.110404", "last_modified": "2025-09-11T04:17:13.368104", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "ce762e2f-e373-44d9-bd23-ef7708ab3833"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "ae44b01e-9ba6-46ee-b793-23f3d46999ec" } deleted = False >> 09/11/2025 04:17:13.424 7f6e18a63438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.442 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-f2bca14f-2cfd-43bc-9948-f729c0e3a37f', 'type': 'global_system_config', 'uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb'} 09/11/2025 04:17:13.461 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-662265ce-3fdf-4280-8c7e-f94c11ba1c21', 'type': 'global_system_config', 'uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb'} 09/11/2025 04:17:13.475 7f6e18914cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 197ee536-4af6-414f-b479-ed8e4f1ff5bb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.254:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.22 body = {"type": "global-system-config", "uuid": "197ee536-4af6-414f-b479-ed8e4f1ff5bb", "ref-type": "bgp-router", "ref-uuid": "69d58baa-ec2b-4f35-bbd7-4ec0ee893627", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-4080-2"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:13.506 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-427484c6-8284-4f5e-86b0-5f87cd9dc220', 'type': 'global_system_config', 'uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb'} 09/11/2025 04:17:13.720 7f6e18b26d68 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:13.721 7f6e18b26d68 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:13.721 7f6e18b26d68 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:13.721 7f6e18b26d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:13.722 7f6e18b26d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:13.722 7f6e18b26d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:13.722 7f6e18b26d68 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:13.722 7f6e18b26d68 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:13.722 7f6e18b26d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.722 7f6e18b26d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:13.722 7f6e18b26d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.722 7f6e18b26d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:13.722 7f6e18b26d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:13.722 7f6e18b26d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:14.452 7f6e18892c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 197ee536-4af6-414f-b479-ed8e4f1ff5bb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.254:8082/global-system-config/197ee536-4af6-414f-b479-ed8e4f1ff5bb operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.48 body = {"global-system-config": {"uuid": "197ee536-4af6-414f-b479-ed8e4f1ff5bb", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:14.482 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-b2522a8a-d8a5-4228-8000-92edc4f78777', 'type': 'global_system_config', 'uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb'} 09/11/2025 04:17:14.508 7f6e199e2cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 197ee536-4af6-414f-b479-ed8e4f1ff5bb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.254:8082/global-system-config/197ee536-4af6-414f-b479-ed8e4f1ff5bb operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.254 body = {"global-system-config": {"uuid": "197ee536-4af6-414f-b479-ed8e4f1ff5bb", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:14.527 7f6e189842e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b6b25520-beae-4e43-885e-8e9d517df70c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.254:8082/global-vrouter-config/b6b25520-beae-4e43-885e-8e9d517df70c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.22 body = {"global-vrouter-config": {"uuid": "b6b25520-beae-4e43-885e-8e9d517df70c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:14.539 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-a01ff24e-c0f4-4c9a-ba1f-ec6c028d5c7b', 'type': 'global_system_config', 'uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb'} 09/11/2025 04:17:14.553 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-133c4bf2-8da3-4a02-afc8-2c066f8636f4', 'type': 'global_vrouter_config', 'uuid': 'b6b25520-beae-4e43-885e-8e9d517df70c'} 09/11/2025 04:17:15.337 7f6e189842e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 197ee536-4af6-414f-b479-ed8e4f1ff5bb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.254:8082/global-system-config/197ee536-4af6-414f-b479-ed8e4f1ff5bb operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.22 body = {"global-system-config": {"uuid": "197ee536-4af6-414f-b479-ed8e4f1ff5bb", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:15.359 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-588f12d9-dc0b-4e79-b75b-b1b0676d854e', 'type': 'global_system_config', 'uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb'} 09/11/2025 04:17:17.722 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:17.724 7f6e189842e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:17.724 7f6e189842e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:17.724 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:17.725 7f6e189842e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:17.725 7f6e189842e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:17.725 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:17.725 7f6e189842e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:17.725 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:17.726 7f6e189842e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:17.726 7f6e189842e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:17.726 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:17.726 7f6e189842e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:17.726 7f6e189842e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:21.725 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:21.727 7f6e189842e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:21.727 7f6e189842e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:21.727 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:21.727 7f6e189842e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:21.727 7f6e189842e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:21.727 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:21.727 7f6e189842e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:21.727 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:21.728 7f6e189842e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:21.728 7f6e189842e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:21.728 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:21.728 7f6e189842e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:21.728 7f6e189842e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:25.728 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:25.729 7f6e189842e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:25.730 7f6e189842e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:25.730 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:25.730 7f6e189842e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:25.730 7f6e189842e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:25.730 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:25.730 7f6e189842e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:25.730 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:25.730 7f6e189842e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:25.731 7f6e189842e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:25.731 7f6e189842e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:25.731 7f6e189842e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:25.731 7f6e189842e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:29.731 7f6e1890d240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:29.732 7f6e1890d240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:29.732 7f6e1890d240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:29.732 7f6e1890d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:29.733 7f6e1890d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:29.733 7f6e1890d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:29.733 7f6e1890d240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:29.733 7f6e1890d240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:29.733 7f6e1890d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:29.733 7f6e1890d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:29.733 7f6e1890d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:29.733 7f6e1890d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:29.733 7f6e1890d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:29.733 7f6e1890d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:33.733 7f6e1890d240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:33.737 7f6e1890d240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:33.737 7f6e1890d240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:33.738 7f6e1890d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:33.738 7f6e1890d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:33.738 7f6e1890d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:33.738 7f6e1890d240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:33.738 7f6e1890d240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:33.738 7f6e1890d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:33.738 7f6e1890d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:33.738 7f6e1890d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:33.738 7f6e1890d240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:33.739 7f6e1890d240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:33.739 7f6e1890d240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:37.738 7f6e1adff780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:37.739 7f6e1adff780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:37.739 7f6e1adff780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:37.739 7f6e1adff780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:37.740 7f6e1adff780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:37.740 7f6e1adff780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:37.740 7f6e1adff780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:37.740 7f6e1adff780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:37.740 7f6e1adff780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:37.740 7f6e1adff780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:37.740 7f6e1adff780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:37.740 7f6e1adff780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:37.740 7f6e1adff780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:37.741 7f6e1adff780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:41.740 7f6e18855ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:41.741 7f6e18855ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:41.741 7f6e18855ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:41.741 7f6e18855ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:41.741 7f6e18855ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:41.741 7f6e18855ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:41.742 7f6e18855ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:41.742 7f6e18855ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:41.742 7f6e18855ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:41.742 7f6e18855ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:41.742 7f6e18855ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:41.742 7f6e18855ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:41.742 7f6e18855ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:41.742 7f6e18855ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:42.377 7f6e1adff780 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Object UUID cache manager: set cache already there, before last modified: 1757564235354880 and meta row: 0 after last modified: 1757564235354880 and meta row: 0 09/11/2025 04:17:42.384 7f6e198a8cc0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Object UUID cache manager: set cache already there, before last modified: 1757564235354880 and meta row: 0 after last modified: 1757564235354880 and meta row: 0 09/11/2025 04:17:42.451 7f6e198a8cc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-2. url = http://10.0.0.254:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.22 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-2."], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.22", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-2."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:42.464 7f6e1adff780 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-3. url = http://10.0.0.254:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.48 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-3."], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.48", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-3."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:42.492 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-2.'], 'obj_dict': {'database_node_ip_address': '10.0.0.22', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-2.'], 'id_perms': {'created': '2025-09-11T04:17:42.484564', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:42.484564', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12473299482601648356, 'uuid_mslong': 6840234069582499767}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5eed64a5-29fd-4fb7-ad1a-0fcb0588f0e4'}, 'oper': 'CREATE', 'request-id': 'req-15be101a-4cb8-41fa-b100-2dd43fd1e5fb', 'type': 'database_node', 'uuid': '5eed64a5-29fd-4fb7-ad1a-0fcb0588f0e4'} 09/11/2025 04:17:42.493 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:17:42.493 7f6e189e4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:42.493 7f6e189e4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-2. elements = { database_node_ip_address : "10.0.0.22"display_name : "cn-jenkins-deploy-platform-ansible-os-4080-2."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-2."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6840234069582499767, "uuid_lslong": 12473299482601648356}, "enable": true, "created": "2025-09-11T04:17:42.484564", "last_modified": "2025-09-11T04:17:42.484564", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "197ee536-4af6-414f-b479-ed8e4f1ff5bb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "5eed64a5-29fd-4fb7-ad1a-0fcb0588f0e4" } deleted = False >> 09/11/2025 04:17:42.493 7f6e189e4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:42.495 7f6e18854780 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-1. url = http://10.0.0.254:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.254 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-1."], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.254", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-1."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:17:42.510 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-3.'], 'obj_dict': {'database_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-3.'], 'id_perms': {'created': '2025-09-11T04:17:42.490086', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:42.490086', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9542536437094928100, 'uuid_mslong': 9671215830728393113}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '86370f8e-c8b3-4199-846d-e654bd43cee4'}, 'oper': 'CREATE', 'request-id': 'req-24389133-93cd-48c9-81cc-32d609ab6a35', 'type': 'database_node', 'uuid': '86370f8e-c8b3-4199-846d-e654bd43cee4'} 09/11/2025 04:17:42.511 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:17:42.511 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:42.511 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-3. elements = { database_node_ip_address : "10.0.0.48"display_name : "cn-jenkins-deploy-platform-ansible-os-4080-3."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-3."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 9671215830728393113, "uuid_lslong": 9542536437094928100}, "enable": true, "created": "2025-09-11T04:17:42.490086", "last_modified": "2025-09-11T04:17:42.490086", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "197ee536-4af6-414f-b479-ed8e4f1ff5bb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "86370f8e-c8b3-4199-846d-e654bd43cee4" } deleted = False >> 09/11/2025 04:17:42.511 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:42.560 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-1.'], 'obj_dict': {'database_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-1.'], 'id_perms': {'created': '2025-09-11T04:17:42.533712', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:17:42.533712', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9678306055618151222, 'uuid_mslong': 7231834154468919717}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '645ca2d8-fba8-49a5-8650-401468a1c336'}, 'oper': 'CREATE', 'request-id': 'req-996024bf-9c15-41fc-9045-02c917db3c7b', 'type': 'database_node', 'uuid': '645ca2d8-fba8-49a5-8650-401468a1c336'} 09/11/2025 04:17:42.561 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:17:42.565 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:42.565 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. elements = { database_node_ip_address : "10.0.0.254"display_name : "cn-jenkins-deploy-platform-ansible-os-4080-1."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-1."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7231834154468919717, "uuid_lslong": 9678306055618151222}, "enable": true, "created": "2025-09-11T04:17:42.533712", "last_modified": "2025-09-11T04:17:42.533712", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "197ee536-4af6-414f-b479-ed8e4f1ff5bb"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "645ca2d8-fba8-49a5-8650-401468a1c336" } deleted = False >> 09/11/2025 04:17:42.565 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:45.742 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:45.743 7f6e188768d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:45.743 7f6e188768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:45.743 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:45.744 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:45.744 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:45.744 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:45.744 7f6e188768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:45.744 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:45.744 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:45.744 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:45.744 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:45.744 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:45.744 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:49.744 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:49.748 7f6e188768d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:49.748 7f6e188768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:49.748 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:49.748 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:49.748 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:49.748 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:49.749 7f6e188768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:49.749 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:49.749 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:49.749 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:49.749 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:49.749 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:49.749 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:53.749 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:53.750 7f6e188768d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:53.750 7f6e188768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:53.750 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:53.750 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:53.750 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:53.750 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:53.750 7f6e188768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:53.750 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:53.750 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:53.751 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:53.751 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:53.751 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:53.751 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:57.751 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:17:57.752 7f6e188768d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:17:57.752 7f6e188768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:17:57.752 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:57.752 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:17:57.753 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:17:57.753 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:17:57.753 7f6e188768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:17:57.753 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:57.753 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:17:57.753 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:57.753 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:17:57.753 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.22:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:17:57.753 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:18:01.753 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:18:01.755 7f6e188768d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:18:01.755 7f6e188768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:18:01.755 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:18:01.755 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:18:01.755 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:18:01.755 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:18:01.756 7f6e188768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:18:01.756 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:18:01.756 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.48:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:18:01.756 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:18:01.756 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:18:01.756 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.48:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:18:01.756 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:18:05.756 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:18:05.757 7f6e188768d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 09/11/2025 04:18:05.758 7f6e188768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:18:05.758 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:18:05.758 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:18:05.758 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:18:05.758 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 09/11/2025 04:18:05.758 7f6e188768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 09/11/2025 04:18:05.758 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:18:05.758 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.254:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 09/11/2025 04:18:05.759 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:18:05.759 7f6e188768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:18:05.759 7f6e188768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1757564165635708 collector_name = collector_ip = 10.0.0.254:8086 collector_list = [ 10.0.0.22:8086, 10.0.0.48:8086, 10.0.0.254:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 4 >> 09/11/2025 04:18:05.759 7f6e188768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 09/11/2025 04:18:09.758 7f6e188aaf60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 09/11/2025 04:18:09.760 7f6e188aaf60 [contrail-api] [INFO]: Session Event: TCP Connected 09/11/2025 04:18:09.760 7f6e188aaf60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 09/11/2025 04:18:09.760 7f6e188aaf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:18:09.760 7f6e188aaf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-4080-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.254:2181, 10.0.0.22:2181, 10.0.0.48:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.22:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.254:9041, 10.0.0.22:9041, 10.0.0.48:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.254:5673, 10.0.0.22:5673, 10.0.0.48:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.254:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 09/11/2025 04:18:09.760 7f6e188aaf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 09/11/2025 04:18:09.760 7f6e188aaf60 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 09/11/2025 04:18:09.760 7f6e188aaf60 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 09/11/2025 04:18:09.761 7f6e188aaf60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 09/11/2025 04:18:09.761 7f6e188aaf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/11/2025 04:18:09.761 7f6e188aaf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/11/2025 04:18:09.761 7f6e18859c18 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/11/2025 04:18:09.762 7f6e18859c18 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/11/2025 04:18:09.996 7f6e18aab2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-3. url = http://10.0.0.254:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.48 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-3."], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.48", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-3."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:18:10.022 7f6e188a7e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-2. url = http://10.0.0.254:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.22 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-2."], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.22", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-2."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:18:10.048 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-3.'], 'id_perms': {'created': '2025-09-11T04:18:10.032351', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:18:10.032351', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13110532886506227467, 'uuid_mslong': 10416003540305922893}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '908d1408-9725-4b4d-b5f1-f8329c47c70b'}, 'oper': 'CREATE', 'request-id': 'req-f3f1b796-0cb5-48e2-894c-b30b94e1991a', 'type': 'analytics_node', 'uuid': '908d1408-9725-4b4d-b5f1-f8329c47c70b'} 09/11/2025 04:18:10.048 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 09/11/2025 04:18:10.049 7f6e188aecc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/11/2025 04:18:10.078 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.22', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-2.'], 'id_perms': {'created': '2025-09-11T04:18:10.062496', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:18:10.062496', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11092590718447150403, 'uuid_mslong': 12330039933738634339}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ab1d19fe-0cdf-4c63-99f0-cc7cc3d66543'}, 'oper': 'CREATE', 'request-id': 'req-9767410a-2007-4774-9bf3-d38c886db553', 'type': 'analytics_node', 'uuid': 'ab1d19fe-0cdf-4c63-99f0-cc7cc3d66543'} 09/11/2025 04:18:10.080 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 09/11/2025 04:18:10.087 7f6e24bd2cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/11/2025 04:18:10.129 7f6e18a90390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-1. url = http://10.0.0.254:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.254 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-1."], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.254", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-1."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:18:10.182 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-1.'], 'id_perms': {'created': '2025-09-11T04:18:10.167292', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:18:10.167292', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10320892895518780064, 'uuid_mslong': 14353685761545292147}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c7328926-aa7d-4973-8f3b-2d67f23feaa0'}, 'oper': 'CREATE', 'request-id': 'req-55623a93-8c36-4fa5-9b3e-ae49d83d3a2e', 'type': 'analytics_node', 'uuid': 'c7328926-aa7d-4973-8f3b-2d67f23feaa0'} 09/11/2025 04:18:10.183 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 09/11/2025 04:18:10.183 7f6e18816828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 09/11/2025 04:18:19.757 7f6e18859d68 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001016 09/11/2025 04:18:19.758 7f6e18859d68 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/11/2025 04:18:19.758 7f6e18a6cf60 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 09/11/2025 04:18:19.758 7f6e18a6cf60 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 0 09/11/2025 04:18:19.758 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 09/11/2025 04:18:19.758 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 09/11/2025 04:18:19.758 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectProjectTable:ContrailConfigTrace] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ContrailConfigTrace] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ContrailConfigTrace] map 09/11/2025 04:18:19.759 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ContrailConfigTrace] map 09/11/2025 04:18:19.760 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 09/11/2025 04:18:19.760 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 09/11/2025 04:18:19.760 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 09/11/2025 04:18:19.760 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:18:19.760 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:18:19.760 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:18:19.760 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 09/11/2025 04:18:19.760 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 09/11/2025 04:18:19.760 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 09/11/2025 04:18:19.760 7f6e18a6cf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/11/2025 04:18:19.760 7f6e18a6cf60 [contrail-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 09/11/2025 04:18:19.761 7f6e18a6ca20 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/11/2025 04:18:19.765 7f6e18a6ca20 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/11/2025 04:18:19.776 7f6e189efb70 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/11/2025 04:18:19.779 7f6e189efb70 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/11/2025 04:18:24.673 7f6e1887e048 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-1. url = http://10.0.0.254:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.254 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-1."], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.254", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-1."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:18:24.747 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-1.'], 'id_perms': {'created': '2025-09-11T04:18:24.707512', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:18:24.707512', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10886084254431401214, 'uuid_mslong': 17330260339121471553}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f08173f5-7260-4041-9713-23f3d45b54fe'}, 'oper': 'CREATE', 'request-id': 'req-6820165f-126f-4f0b-acf8-6b3e60bbe16e', 'type': 'analytics_alarm_node', 'uuid': 'f08173f5-7260-4041-9713-23f3d45b54fe'} 09/11/2025 04:18:24.747 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 09/11/2025 04:18:25.144 7f6e1897c390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-2. url = http://10.0.0.254:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.22 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-2."], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.22", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-2."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:18:25.161 7f6e1897c198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-3. url = http://10.0.0.254:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.48 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-3."], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.48", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-3."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:18:25.195 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.22', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-2.'], 'id_perms': {'created': '2025-09-11T04:18:25.178613', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:18:25.178613', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10102359466033092250, 'uuid_mslong': 16787629223241666188}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e8f9a3d5-7849-4e8c-8c32-ca68e635169a'}, 'oper': 'CREATE', 'request-id': 'req-795b6ef7-8ed0-4c57-9637-7fb2f0526fe8', 'type': 'analytics_alarm_node', 'uuid': 'e8f9a3d5-7849-4e8c-8c32-ca68e635169a'} 09/11/2025 04:18:25.195 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 09/11/2025 04:18:25.238 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-3.'], 'id_perms': {'created': '2025-09-11T04:18:25.226840', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:18:25.226840', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13473968969568835711, 'uuid_mslong': 17457101299669617906}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f2441523-eed1-4cf2-bafd-2763c1c9587f'}, 'oper': 'CREATE', 'request-id': 'req-ca062d57-5af5-4949-aabd-9d24207be338', 'type': 'analytics_alarm_node', 'uuid': 'f2441523-eed1-4cf2-bafd-2763c1c9587f'} 09/11/2025 04:18:25.239 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.042 7f6e18859d68 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001715 09/11/2025 04:18:30.042 7f6e18859d68 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 09/11/2025 04:18:30.043 7f6e21a7a438 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 09/11/2025 04:18:30.043 7f6e21a7a438 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 5 09/11/2025 04:18:30.043 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 09/11/2025 04:18:30.043 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 09/11/2025 04:18:30.043 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/11/2025 04:18:30.043 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 09/11/2025 04:18:30.043 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectProjectTable:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 09/11/2025 04:18:30.044 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.045 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.045 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.045 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.045 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.045 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.045 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.045 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.045 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 09/11/2025 04:18:30.045 7f6e21a7a438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 09/11/2025 04:18:30.046 7f6e18a61d68 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/11/2025 04:18:30.049 7f6e18a61d68 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/11/2025 04:18:30.050 7f6e18a0b0f0 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 09/11/2025 04:18:30.057 7f6e18a0b0f0 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 09/11/2025 04:18:34.518 7f6e18b29c18 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-3. url = http://10.0.0.254:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.48 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-3."], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.48", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-3."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:18:34.533 7f6e18a93438 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-2. url = http://10.0.0.254:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.22 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-2."], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.22", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-2."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:18:34.557 7f6e18812cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-4080-1. url = http://10.0.0.254:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.254 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-4080-1."], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.254", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-4080-1."}} domain = default-domain project = admin user = admin >> 09/11/2025 04:18:34.587 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.48', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-3.'], 'id_perms': {'created': '2025-09-11T04:18:34.556381', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:18:34.556381', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12859871060862440166, 'uuid_mslong': 11762908882525899753}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a33e3f4e-5c3e-4be9-b277-7098680812e6'}, 'oper': 'CREATE', 'request-id': 'req-ba2badd5-6a7d-42f4-b620-b38ae358bffc', 'type': 'analytics_snmp_node', 'uuid': 'a33e3f4e-5c3e-4be9-b277-7098680812e6'} 09/11/2025 04:18:34.588 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 09/11/2025 04:18:34.613 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.22', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-2.'], 'id_perms': {'created': '2025-09-11T04:18:34.569945', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:18:34.569945', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13018931947105579613, 'uuid_mslong': 13382945662263837741}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b9b9c62c-8797-442d-b4ac-89a0ee36725d'}, 'oper': 'CREATE', 'request-id': 'req-9f11c7ff-3932-4c6b-8b03-0b97a0ed2897', 'type': 'analytics_snmp_node', 'uuid': 'b9b9c62c-8797-442d-b4ac-89a0ee36725d'} 09/11/2025 04:18:34.614 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 09/11/2025 04:18:34.655 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.254', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-4080-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-4080-1.'], 'id_perms': {'created': '2025-09-11T04:18:34.640219', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:18:34.640219', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12107081145061114528, 'uuid_mslong': 5224885903001928302}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4882860b-d060-426e-a804-fe27c63282a0'}, 'oper': 'CREATE', 'request-id': 'req-3163e87a-19e2-4596-b219-ce25ac0941fc', 'type': 'analytics_snmp_node', 'uuid': '4882860b-d060-426e-a804-fe27c63282a0'} 09/11/2025 04:18:34.655 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 09/11/2025 04:20:12.919 7f6e18a7ef60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 197ee536-4af6-414f-b479-ed8e4f1ff5bb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.254:8082/global-system-config/197ee536-4af6-414f-b479-ed8e4f1ff5bb operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.57 body = {"global-system-config": {"uuid": "197ee536-4af6-414f-b479-ed8e4f1ff5bb", "ip_fabric_subnets": {"subnet": [{"ip_prefix": "10.20.0.0", "ip_prefix_len": 24}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:20:12.943 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-6b86f379-9680-429f-81de-032adaea37b3', 'type': 'global_system_config', 'uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb'} 09/11/2025 04:20:12.965 7f6e18b45f60 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 197ee536-4af6-414f-b479-ed8e4f1ff5bb object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.254:8082/global-system-config/197ee536-4af6-414f-b479-ed8e4f1ff5bb operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.49 body = {"global-system-config": {"uuid": "197ee536-4af6-414f-b479-ed8e4f1ff5bb", "ip_fabric_subnets": {"subnet": [{"ip_prefix": "10.20.0.0", "ip_prefix_len": 24}]}}} domain = default-domain project = admin user = admin >> 09/11/2025 04:20:12.992 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-b06529dd-01cc-4a90-85db-4a44fa612e7c', 'type': 'global_system_config', 'uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb'} 09/11/2025 04:20:13.052 7f6e18930198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-4080-2 url = http://10.0.0.254:8082/virtual-routers operation = post useragent = an-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.57 body = {"virtual-router": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-4080-2"], "parent_type": "global-system-config", "virtual_router_dpdk_enabled": false, "virtual_router_ip_address": "10.20.0.193", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "an-jenkins-deploy-platform-ansible-os-4080-2"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:20:13.088 7f6e18930198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-4080-1 url = http://10.0.0.254:8082/virtual-routers operation = post useragent = an-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.49 body = {"virtual-router": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-4080-1"], "parent_type": "global-system-config", "virtual_router_dpdk_enabled": false, "virtual_router_ip_address": "10.20.0.25", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "an-jenkins-deploy-platform-ansible-os-4080-1"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:20:13.098 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4080-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4080-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4080-2'], 'id_perms': {'created': '2025-09-11T04:20:13.075833', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:20:13.075833', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12477051075703459198, 'uuid_mslong': 15851896452036903948}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dbfd3fd6-0fef-440c-ad27-63d8dbb5cd7e', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.193'}, 'oper': 'CREATE', 'request-id': 'req-295a2d83-b65a-431f-9cac-46776648aeb7', 'type': 'virtual_router', 'uuid': 'dbfd3fd6-0fef-440c-ad27-63d8dbb5cd7e'} 09/11/2025 04:20:13.098 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectVRouter:ContrailConfigTrace] map 09/11/2025 04:20:13.148 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4080-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-4080-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4080-1'], 'id_perms': {'created': '2025-09-11T04:20:13.137127', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:20:13.137127', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12488976851491600347, 'uuid_mslong': 11052219388841643631}}, 'parent_type': 'global-system-config', 'parent_uuid': '197ee536-4af6-414f-b479-ed8e4f1ff5bb', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '99615efa-1b97-4e6f-ad51-c246e93bb7db', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.25'}, 'oper': 'CREATE', 'request-id': 'req-3cd2042c-321c-4d4b-86a9-8bc268e6b080', 'type': 'virtual_router', 'uuid': '99615efa-1b97-4e6f-ad51-c246e93bb7db'} 09/11/2025 04:20:13.149 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectVRouter:ContrailConfigTrace] map 09/11/2025 04:20:13.410 7f6e198df4e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-4080-2:vhost0 url = http://10.0.0.254:8082/virtual-machine-interfaces operation = post useragent = an-jenkins-deploy-platform-ansible-os-4080-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.57 body = {"virtual-machine-interface": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-4080-2", "vhost0"], "parent_type": "virtual-router", "virtual_machine_interface_disable_policy": true, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "81139561-8493-4c6f-b706-f85f7b7a0461"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vhost0"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:20:13.457 7f6e188b2b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-4080-1:vhost0 url = http://10.0.0.254:8082/virtual-machine-interfaces operation = post useragent = an-jenkins-deploy-platform-ansible-os-4080-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.49 body = {"virtual-machine-interface": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-4080-1", "vhost0"], "parent_type": "virtual-router", "virtual_machine_interface_disable_policy": true, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "81139561-8493-4c6f-b706-f85f7b7a0461"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vhost0"}} domain = default-domain project = admin user = admin >> 09/11/2025 04:20:13.471 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4080-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4080-2', 'vhost0'], 'id_perms': {'created': '2025-09-11T04:20:13.443967', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:20:13.443967', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9250108664057376590, 'uuid_mslong': 18073068845566217385}}, 'parent_type': 'virtual-router', 'parent_uuid': 'dbfd3fd6-0fef-440c-ad27-63d8dbb5cd7e', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fad0705c-1d27-4ca9-805e-fcd21ee72f4e', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:fa:d0:70:5c:1d']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '81139561-8493-4c6f-b706-f85f7b7a0461'}]}, 'oper': 'CREATE', 'request-id': 'req-2abdf5d7-f36f-42d0-8c8d-c61a476362a5', 'type': 'virtual_machine_interface', 'uuid': 'fad0705c-1d27-4ca9-805e-fcd21ee72f4e'} 09/11/2025 04:20:13.471 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectVMITable:ContrailConfigTrace] map 09/11/2025 04:20:13.493 7f6e189df2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fad0705c-1d27-4ca9-805e-fcd21ee72f4e object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-4080-2:vhost0 url = http://127.0.0.1/ref-update operation = ref-update domain = default-domain >> 09/11/2025 04:20:13.535 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4080-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-2abdf5d7-f36f-42d0-8c8d-c61a476362a5', 'type': 'virtual_machine_interface', 'uuid': 'fad0705c-1d27-4ca9-805e-fcd21ee72f4e'} 09/11/2025 04:20:13.588 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4080-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4080-1', 'vhost0'], 'id_perms': {'created': '2025-09-11T04:20:13.528026', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-09-11T04:20:13.528026', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11741171555589873259, 'uuid_mslong': 5833699025282746537}}, 'parent_type': 'virtual-router', 'parent_uuid': '99615efa-1b97-4e6f-ad51-c246e93bb7db', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '50f5765a-f085-48a9-a2f1-055289dade6b', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:50:f5:76:5a:f0']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '81139561-8493-4c6f-b706-f85f7b7a0461'}]}, 'oper': 'CREATE', 'request-id': 'req-d44ceb72-2628-4eb8-8afe-1fcb8f39e9d4', 'type': 'virtual_machine_interface', 'uuid': '50f5765a-f085-48a9-a2f1-055289dade6b'} 09/11/2025 04:20:13.588 7f6e19781048 [contrail-api] [DEBUG]: Add uve in the [ObjectVMITable:ContrailConfigTrace] map 09/11/2025 04:20:13.618 7f6e189d76d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 50f5765a-f085-48a9-a2f1-055289dade6b object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-4080-1:vhost0 url = http://127.0.0.1/ref-update operation = ref-update domain = default-domain >> 09/11/2025 04:20:13.656 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-4080-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-d44ceb72-2628-4eb8-8afe-1fcb8f39e9d4', 'type': 'virtual_machine_interface', 'uuid': '50f5765a-f085-48a9-a2f1-055289dade6b'} 09/11/2025 04:20:14.006 7f6e19781048 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-ffb15550-a1a0-4bb9-ac99-c4f994b16a5c', 'type': 'access_control_list', 'uuid': '428ab045-b5f3-488d-a02b-dcdb8f803437'} 09/11/2025 04:20:39.093 7f6e1891df60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 09/11/2025 04:20:39.097 7f6e1891df60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/11/2025 04:21:09.478 7f6e18a2e2e8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 09/11/2025 04:21:09.481 7f6e18a2e2e8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 09/11/2025 04:22:43.790 7f6e1897c4e0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 09/11/2025 04:22:43.801 7f6e1897c4e0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map